2023-01-02T18:04:37.576 INFO:root:teuthology version: 0.0.1.dev18+g19d18db 2023-01-02T18:04:37.577 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --description rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} --name yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi/7131281 -- /home/teuthworker/archive/yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi/7131281/orig.config.yaml 2023-01-02T18:04:37.618 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-01-02T18:04:37.672 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi/7131281 branch: pacific_16.2.11_RC4 description: rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read} email: ceph-qa@ceph.io first_in_suite: false job_id: '7131281' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: centos os_version: 8.stream overrides: admin_socket: branch: pacific_16.2.11_RC4 ceph: conf: client: rbd clone copy on read: true global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - overall HEALTH_ - \(CACHE_POOL_NO_HIT_SET\) - \(POOL_APP_NOT_ENABLED\) - is full \(reached quota - \(POOL_FULL\) sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: pacific_qa sha1: 623bc557440f012d459eb3c5ded0a7dee57ecdb1 owner: scheduled_yuriw@teuthology priority: 70 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 sleep_before_teardown: 0 suite: rbd suite_branch: pacific_qa suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_623bc557440f012d459eb3c5ded0a7dee57ecdb1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 623bc557440f012d459eb3c5ded0a7dee57ecdb1 targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlm7QLOBnUG04bivDG/Yv07gb8+f1R9yllotKVGx8n5T6q9frkMikhxPDCKA49sf7pZMVmpwSiprKNbJmXI7KM= smithi057.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6KMe9xt154byMvo0EX53KLmOUUflz9VszA7hR7+ZKqJp5MHa+YvhGyedZXxqbh4sDu/xH4ksklseUPwdPAqbbyxZvT+e8gZI1mZIdcc8eDf/x7ar0SV6P2OFXV9AmXyuXcnXru1vG1bG/xNQ1/5eeFVhbJ9G9Q03su5FXx71rQyHjcjOJ4zuRWX66ZSYecKl8PaUwRQ0wN7LCWtWlUra+ibtnPAkd13bCpRCm6LZJ3VGnmZ6txgYnOOLcCZB4IojbUAJK5o4HOcM5RofZJKMbCrFtitYrkpmYPBIWus0PoYFM4yFGix9+X7bFcTGsvt0WuRMzIJKb0HVkjtovvlTO1QsjcNqXMEac5EcL5nLIzSoumGpg4SnpqZqMTtbKcURn0Wmw6wBxeOcE1IajwO69LTD+GMdJ+plnwuw8Vy65G/DfrsgivOrsItclw8vmZesSzjgxLAYkkdlpRhIUbjcsj/C69LfYDvsdWw4+XGcZpLRovtzU4nWnlOO6Wnn6chs= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - workunit: clients: client.0: - rbd/test_librbd.sh env: RBD_FEATURES: '61' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 19d18db866afdc31fd6586f558fc29b95a87ccfb timestamp: 2023-01-02_16:41:15 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.32458 2023-01-02T18:04:37.673 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_623bc557440f012d459eb3c5ded0a7dee57ecdb1/qa; will attempt to use it 2023-01-02T18:04:37.673 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_623bc557440f012d459eb3c5ded0a7dee57ecdb1/qa/tasks 2023-01-02T18:04:37.674 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-01-02T18:04:37.675 INFO:teuthology.task.internal:Checking packages... 2023-01-02T18:04:37.703 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'f2bb1478686242c0f68882a9cf8df4e0f8363116' 2023-01-02T18:04:37.703 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-01-02T18:04:37.703 INFO:teuthology.packaging:ref: None 2023-01-02T18:04:37.704 INFO:teuthology.packaging:tag: None 2023-01-02T18:04:37.704 INFO:teuthology.packaging:branch: pacific_16.2.11_RC4 2023-01-02T18:04:37.704 INFO:teuthology.packaging:sha1: f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-02T18:04:37.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific_16.2.11_RC4 2023-01-02T18:04:37.924 INFO:teuthology.task.internal:Found packages for ceph version 16.2.10-1543.gf2bb1478 2023-01-02T18:04:37.925 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-01-02T18:04:37.933 INFO:teuthology.task.internal:no buildpackages task found 2023-01-02T18:04:37.933 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-01-02T18:04:38.030 INFO:teuthology.task.internal:Saving configuration 2023-01-02T18:04:38.044 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-01-02T18:04:38.064 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-01-02T18:04:38.083 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi/7131281', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-02 17:59:56.269053', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlm7QLOBnUG04bivDG/Yv07gb8+f1R9yllotKVGx8n5T6q9frkMikhxPDCKA49sf7pZMVmpwSiprKNbJmXI7KM='} 2023-01-02T18:04:38.102 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi/7131281', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-01-02 17:59:56.270369', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPR0K3EShxUJHRYGdDfW1NroTxXTR7vTC2DI6Iw4AZOFE5q+RJkogZjxZNoMtI1RcNob6I0SQZhcmodsEr3c8eA='} 2023-01-02T18:04:38.102 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-01-02T18:04:38.114 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2023-01-02T18:04:38.114 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2023-01-02T18:04:38.114 INFO:teuthology.run_tasks:Running task console_log... 2023-01-02T18:04:38.231 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f02b0f125e0>, signals=[15]) 2023-01-02T18:04:38.232 INFO:teuthology.run_tasks:Running task internal.connect... 2023-01-02T18:04:38.244 INFO:teuthology.task.internal:Opening connections... 2023-01-02T18:04:38.244 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2023-01-02T18:04:38.246 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-02T18:04:38.317 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2023-01-02T18:04:38.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-02T18:04:38.386 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-01-02T18:04:38.394 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-01-02T18:04:38.415 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-01-02T18:04:38.416 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-01-02T18:04:38.476 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="CentOS Stream" 2023-01-02T18:04:38.476 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8" 2023-01-02T18:04:38.476 INFO:teuthology.orchestra.run.smithi007.stdout:ID="centos" 2023-01-02T18:04:38.477 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="rhel fedora" 2023-01-02T18:04:38.477 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8" 2023-01-02T18:04:38.477 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-01-02T18:04:38.477 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-02T18:04:38.477 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-01-02T18:04:38.478 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-02T18:04:38.478 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://centos.org/" 2023-01-02T18:04:38.478 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-02T18:04:38.478 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-02T18:04:38.478 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-02T18:04:38.479 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-01-02T18:04:38.494 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2023-01-02T18:04:38.515 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2023-01-02T18:04:38.516 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2023-01-02T18:04:38.575 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2023-01-02T18:04:38.575 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="8" 2023-01-02T18:04:38.575 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2023-01-02T18:04:38.575 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2023-01-02T18:04:38.575 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="8" 2023-01-02T18:04:38.576 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el8" 2023-01-02T18:04:38.576 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 8" 2023-01-02T18:04:38.576 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2023-01-02T18:04:38.576 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-01-02T18:04:38.576 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2023-01-02T18:04:38.577 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-01-02T18:04:38.577 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-01-02T18:04:38.577 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-01-02T18:04:38.578 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2023-01-02T18:04:38.591 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-01-02T18:04:38.600 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-01-02T18:04:38.620 INFO:teuthology.task.internal:Checking for old test directory... 2023-01-02T18:04:38.621 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2023-01-02T18:04:38.624 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2023-01-02T18:04:38.644 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-01-02T18:04:38.653 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-01-02T18:04:38.654 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2023-01-02T18:04:38.684 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2023-01-02T18:04:38.712 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-01-02T18:04:38.762 INFO:teuthology.run_tasks:Running task kernel... 2023-01-02T18:04:38.779 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-01-02T18:04:38.779 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-01-02T18:04:38.780 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-02T18:04:38.781 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2023-01-02T18:04:38.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-02T18:04:38.801 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2023-01-02T18:04:38.801 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-02T18:04:38.802 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2023-01-02T18:04:38.861 INFO:teuthology.orchestra.run.smithi057.stdout:4.18.0-408.el8.x86_64 2023-01-02T18:04:38.862 INFO:teuthology.task.kernel:Running kernel on smithi057: 4.18.0-408.el8.x86_64 2023-01-02T18:04:38.862 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum install -y kernel 2023-01-02T18:04:38.863 INFO:teuthology.orchestra.run.smithi007.stdout:4.18.0-408.el8.x86_64 2023-01-02T18:04:38.863 INFO:teuthology.task.kernel:Running kernel on smithi007: 4.18.0-408.el8.x86_64 2023-01-02T18:04:38.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2023-01-02T18:04:42.344 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-8 - AppStream 39 MB/s | 27 MB 00:00 2023-01-02T18:04:42.619 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS-8 - AppStream 34 MB/s | 27 MB 00:00 2023-01-02T18:04:48.211 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-8 - BaseOS 38 MB/s | 26 MB 00:00 2023-01-02T18:04:48.464 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS-8 - BaseOS 38 MB/s | 26 MB 00:00 2023-01-02T18:04:52.502 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-8 - Extras 152 kB/s | 18 kB 00:00 2023-01-02T18:04:52.821 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS-8 - Extras 113 kB/s | 18 kB 00:00 2023-01-02T18:04:52.879 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-8 - PowerTools 22 MB/s | 5.5 MB 00:00 2023-01-02T18:04:53.214 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS-8 - PowerTools 21 MB/s | 5.5 MB 00:00 2023-01-02T18:04:57.028 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 1.1 kB/s | 3.5 kB 00:03 2023-01-02T18:04:57.355 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 1.1 kB/s | 3.5 kB 00:03 2023-01-02T18:04:59.091 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 13 MB 00:01 2023-01-02T18:04:59.439 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 13 MB 00:01 2023-01-02T18:05:02.462 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 465 kB/s | 24 kB 00:00 2023-01-02T18:05:02.889 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 461 kB/s | 24 kB 00:00 2023-01-02T18:05:05.894 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-02T18:05:05.894 INFO:teuthology.orchestra.run.smithi057.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-02T18:05:06.060 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:05:06.061 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:05:06.061 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:05:06.087 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-408.el8.x86_64 is already installed. 2023-01-02T18:05:06.087 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2023-01-02T18:05:06.185 DEBUG:teuthology.orchestra.run.smithi057:> echo no | sudo yum reinstall kernel || true 2023-01-02T18:05:06.273 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:05:06.274 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:05:06.274 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:05:06.395 DEBUG:teuthology.orchestra.run.smithi007:> echo no | sudo yum reinstall kernel || true 2023-01-02T18:05:06.866 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:04 ago on Mon 02 Jan 2023 06:05:02 PM UTC. 2023-01-02T18:05:07.118 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:05 ago on Mon 02 Jan 2023 06:05:02 PM UTC. 2023-01-02T18:05:08.072 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:05:08.072 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:05:08.073 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2023-01-02T18:05:08.073 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:05:08.073 INFO:teuthology.orchestra.run.smithi057.stdout:Reinstalling: 2023-01-02T18:05:08.073 INFO:teuthology.orchestra.run.smithi057.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2023-01-02T18:05:08.074 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:05:08.074 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:05:08.074 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:05:08.074 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:05:08.075 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 8.5 M 2023-01-02T18:05:08.075 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 0 2023-01-02T18:05:08.075 INFO:teuthology.orchestra.run.smithi057.stderr:Operation aborted. 2023-01-02T18:05:08.150 INFO:teuthology.orchestra.run.smithi057.stdout:Is this ok [y/N]: 2023-01-02T18:05:08.150 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum reinstall -y kernel || true 2023-01-02T18:05:08.318 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:05:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:05:08.319 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2023-01-02T18:05:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:05:08.320 INFO:teuthology.orchestra.run.smithi007.stdout:Reinstalling: 2023-01-02T18:05:08.320 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2023-01-02T18:05:08.320 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:05:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:05:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:05:08.321 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:05:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 8.5 M 2023-01-02T18:05:08.321 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 0 2023-01-02T18:05:08.322 INFO:teuthology.orchestra.run.smithi007.stderr:Operation aborted. 2023-01-02T18:05:08.420 INFO:teuthology.orchestra.run.smithi007.stdout:Is this ok [y/N]: 2023-01-02T18:05:08.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum reinstall -y kernel || true 2023-01-02T18:05:08.818 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:06 ago on Mon 02 Jan 2023 06:05:02 PM UTC. 2023-01-02T18:05:09.090 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:07 ago on Mon 02 Jan 2023 06:05:02 PM UTC. 2023-01-02T18:05:10.019 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:05:10.020 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:05:10.020 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2023-01-02T18:05:10.021 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:05:10.021 INFO:teuthology.orchestra.run.smithi057.stdout:Reinstalling: 2023-01-02T18:05:10.021 INFO:teuthology.orchestra.run.smithi057.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2023-01-02T18:05:10.021 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:05:10.021 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:05:10.022 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:05:10.022 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:05:10.023 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 8.5 M 2023-01-02T18:05:10.023 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 0 2023-01-02T18:05:10.023 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:05:10.222 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-4.18.0-408.el8.x86_64.rpm 43 MB/s | 8.5 MB 00:00 2023-01-02T18:05:10.223 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:05:10.223 INFO:teuthology.orchestra.run.smithi057.stdout:Total 42 MB/s | 8.5 MB 00:00 2023-01-02T18:05:10.277 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:05:10.278 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:05:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2023-01-02T18:05:10.279 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:05:10.279 INFO:teuthology.orchestra.run.smithi007.stdout:Reinstalling: 2023-01-02T18:05:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: kernel x86_64 4.18.0-408.el8 CentOS-BaseOS 8.5 M 2023-01-02T18:05:10.279 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:05:10.280 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:05:10.280 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:05:10.280 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:05:10.280 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 8.5 M 2023-01-02T18:05:10.280 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 0 2023-01-02T18:05:10.281 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:05:10.319 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:05:10.498 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-4.18.0-408.el8.x86_64.rpm 39 MB/s | 8.5 MB 00:00 2023-01-02T18:05:10.499 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:05:10.499 INFO:teuthology.orchestra.run.smithi007.stdout:Total 39 MB/s | 8.5 MB 00:00 2023-01-02T18:05:10.599 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:05:10.700 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:05:10.700 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:05:10.888 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:05:10.908 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:05:10.979 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:05:10.980 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:05:11.175 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:05:11.190 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:05:11.250 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:05:11.463 INFO:teuthology.orchestra.run.smithi057.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2023-01-02T18:05:11.463 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2023-01-02T18:05:11.528 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:05:11.742 INFO:teuthology.orchestra.run.smithi007.stdout: Reinstalling : kernel-4.18.0-408.el8.x86_64 1/2 2023-01-02T18:05:11.742 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : kernel-4.18.0-408.el8.x86_64 2/2 2023-01-02T18:05:11.910 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2023-01-02T18:05:11.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2023-01-02T18:05:12.185 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: kernel-4.18.0-408.el8.x86_64 2/2 2023-01-02T18:05:12.185 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 1/2 2023-01-02T18:05:12.453 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2023-01-02T18:05:12.453 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:05:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:Reinstalled: 2023-01-02T18:05:12.454 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-4.18.0-408.el8.x86_64 2023-01-02T18:05:12.454 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:05:12.454 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:05:12.548 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q kernel --last | head -n 1 2023-01-02T18:05:12.725 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-4.18.0-408.el8.x86_64 Mon 02 Jan 2023 06:05:11 PM UTC 2023-01-02T18:05:12.727 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2023-01-02T18:05:12.727 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-02T18:05:12.727 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-01-02T18:05:12.728 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-02T18:05:12.763 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2023-01-02T18:05:12.780 DEBUG:teuthology.parallel:result is None 2023-01-02T18:05:12.798 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : kernel-4.18.0-408.el8.x86_64 2/2 2023-01-02T18:05:12.798 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:05:12.798 INFO:teuthology.orchestra.run.smithi007.stdout:Reinstalled: 2023-01-02T18:05:12.798 INFO:teuthology.orchestra.run.smithi007.stdout: kernel-4.18.0-408.el8.x86_64 2023-01-02T18:05:12.799 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:05:12.799 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:05:12.926 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel --last | head -n 1 2023-01-02T18:05:13.098 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-4.18.0-408.el8.x86_64 Mon 02 Jan 2023 06:05:11 PM UTC 2023-01-02T18:05:13.099 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-408.el8.x86_64 2023-01-02T18:05:13.099 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-01-02T18:05:13.100 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-01-02T18:05:13.100 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-01-02T18:05:13.135 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2023-01-02T18:05:13.148 DEBUG:teuthology.parallel:result is None 2023-01-02T18:05:13.148 INFO:teuthology.run_tasks:Running task internal.base... 2023-01-02T18:05:13.159 INFO:teuthology.task.internal:Creating test directory... 2023-01-02T18:05:13.160 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-02T18:05:13.191 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-01-02T18:05:13.210 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-01-02T18:05:13.224 INFO:teuthology.run_tasks:Running task internal.archive... 2023-01-02T18:05:13.258 INFO:teuthology.task.internal:Creating archive directory... 2023-01-02T18:05:13.258 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-02T18:05:13.261 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-01-02T18:05:13.295 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-01-02T18:05:13.309 INFO:teuthology.task.internal:Enabling coredump saving... 2023-01-02T18:05:13.310 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-02T18:05:13.329 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-01-02T18:05:13.362 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-02T18:05:13.366 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-02T18:05:13.372 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-02T18:05:13.377 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-01-02T18:05:13.378 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-01-02T18:05:13.387 INFO:teuthology.task.internal:Configuring sudo... 2023-01-02T18:05:13.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-02T18:05:13.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-01-02T18:05:13.446 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-01-02T18:05:13.457 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-01-02T18:05:13.457 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-02T18:05:13.484 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-01-02T18:05:13.505 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-02T18:05:13.579 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-02T18:05:13.636 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-02T18:05:13.717 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-02T18:05:13.764 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:05:13.765 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-02T18:05:13.830 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-02T18:05:13.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-01-02T18:05:13.931 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-02T18:05:14.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-01-02T18:05:14.059 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:05:14.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-01-02T18:05:14.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2023-01-02T18:05:14.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2023-01-02T18:05:14.181 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-02T18:05:14.218 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-01-02T18:05:14.696 INFO:teuthology.run_tasks:Running task internal.timer... 2023-01-02T18:05:14.705 INFO:teuthology.task.internal:Starting timer... 2023-01-02T18:05:14.706 INFO:teuthology.run_tasks:Running task pcp... 2023-01-02T18:05:14.760 INFO:teuthology.run_tasks:Running task selinux... 2023-01-02T18:05:14.794 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-01-02T18:05:14.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2023-01-02T18:05:14.852 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2023-01-02T18:05:14.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2023-01-02T18:05:14.943 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2023-01-02T18:05:14.945 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-01-02T18:05:14.946 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2023-01-02T18:05:14.970 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2023-01-02T18:05:14.970 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2023-01-02T18:05:14.992 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2023-01-02T18:05:14.993 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi057.front.sepia.ceph.com': 'permissive'} 2023-01-02T18:05:14.993 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-02T18:05:15.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-02T18:05:15.038 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\)' 2023-01-02T18:05:15.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-02T18:05:15.069 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-01-02T18:05:15.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2023-01-02T18:05:15.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2023-01-02T18:05:15.149 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-01-02T18:05:15.164 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-01-02T18:05:15.169 INFO:teuthology.repo_utils:Fetching main from origin 2023-01-02T18:05:15.289 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-01-02T18:05:15.303 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-01-02T18:05:15.305 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi057.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-01-02T18:11:39.525 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi057.front.sepia.ceph.com')] 2023-01-02T18:11:39.526 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-01-02T18:11:39.527 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-02T18:11:39.598 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-01-02T18:11:39.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2023-01-02T18:11:39.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-01-02T18:11:39.740 DEBUG:teuthology.orchestra.run.smithi057:> true 2023-01-02T18:11:39.813 INFO:teuthology.run_tasks:Running task clock... 2023-01-02T18:11:39.825 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-01-02T18:11:39.825 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-02T18:11:39.826 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-02T18:11:39.828 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-01-02T18:11:39.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-01-02T18:11:39.860 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-02T18:11:39.875 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-02T18:11:39.890 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-01-02T18:11:39.906 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-01-02T18:11:39.938 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2023-01-02T18:11:39.950 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2023-01-02T18:11:39.965 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-02T18:11:39.973 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2023-01-02T18:11:39.979 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-02T18:11:39.986 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2023-01-02T18:11:40.001 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-01-02T18:11:40.015 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-01-02T18:11:40.049 INFO:teuthology.orchestra.run.smithi007.stderr:bash: ntpq: command not found 2023-01-02T18:11:40.053 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-02T18:11:40.054 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2023-01-02T18:11:40.054 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-02T18:11:40.054 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-02T18:11:40.054 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-02T18:11:40.054 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-02T18:11:40.082 INFO:teuthology.orchestra.run.smithi057.stderr:bash: ntpq: command not found 2023-01-02T18:11:40.085 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-01-02T18:11:40.086 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2023-01-02T18:11:40.086 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-02T18:11:40.086 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-02T18:11:40.086 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-02T18:11:40.086 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-01-02T18:11:40.087 INFO:teuthology.run_tasks:Running task install... 2023-01-02T18:11:40.096 DEBUG:teuthology.task.install:project ceph 2023-01-02T18:11:40.096 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'}} 2023-01-02T18:11:40.097 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'} 2023-01-02T18:11:40.097 INFO:teuthology.task.install:Using flavor: default 2023-01-02T18:11:40.103 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-01-02T18:11:40.103 INFO:teuthology.task.install:extra packages: [] 2023-01-02T18:11:40.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2023-01-02T18:11:40.140 INFO:teuthology.orchestra.run.smithi007.stdout:CentOSStream 2023-01-02T18:11:40.141 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-02T18:11:40.142 DEBUG:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2023-01-02T18:11:40.143 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116', 'tag': None, 'wait_for_package': False} 2023-01-02T18:11:40.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2023-01-02T18:11:40.181 INFO:teuthology.orchestra.run.smithi057.stdout:CentOSStream 2023-01-02T18:11:40.182 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-02T18:11:40.182 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116', 'tag': None, 'wait_for_package': False} 2023-01-02T18:11:40.183 DEBUG:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2023-01-02T18:11:40.219 INFO:teuthology.orchestra.run.smithi007.stdout:CentOSStream 2023-01-02T18:11:40.220 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-02T18:11:40.221 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-02T18:11:40.260 INFO:teuthology.orchestra.run.smithi057.stdout:CentOSStream 2023-01-02T18:11:40.261 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-02T18:11:40.262 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-02T18:11:40.375 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/pacific_16.2.11_RC4/f2bb1478686242c0f68882a9cf8df4e0f8363116/centos/8/flavors/default/ 2023-01-02T18:11:40.376 INFO:teuthology.task.install.rpm:Package version is 16.2.10-1543.gf2bb1478 2023-01-02T18:11:40.412 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/pacific_16.2.11_RC4/f2bb1478686242c0f68882a9cf8df4e0f8363116/centos/8/flavors/default/ 2023-01-02T18:11:40.412 INFO:teuthology.task.install.rpm:Package version is 16.2.10-1543.gf2bb1478 2023-01-02T18:11:40.489 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/pacific_16.2.11_RC4/f2bb1478686242c0f68882a9cf8df4e0f8363116/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/pacific_16.2.11_RC4/f2bb1478686242c0f68882a9cf8df4e0f8363116/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/pacific_16.2.11_RC4/f2bb1478686242c0f68882a9cf8df4e0f8363116/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-02T18:11:40.489 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:11:40.490 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-02T18:11:40.518 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-02T18:11:40.519 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f2bb1478686242c0f68882a9cf8df4e0f8363116/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-02T18:11:40.523 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/pacific_16.2.11_RC4/f2bb1478686242c0f68882a9cf8df4e0f8363116/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/pacific_16.2.11_RC4/f2bb1478686242c0f68882a9cf8df4e0f8363116/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/pacific_16.2.11_RC4/f2bb1478686242c0f68882a9cf8df4e0f8363116/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-01-02T18:11:40.523 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:11:40.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-01-02T18:11:40.552 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2023-01-02T18:11:40.552 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/f2bb1478686242c0f68882a9cf8df4e0f8363116/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-01-02T18:11:40.588 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-02T18:11:40.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-01-02T18:11:40.667 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-02T18:11:40.700 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-01-02T18:11:40.735 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2023-01-02T18:11:40.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2023-01-02T18:11:40.767 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2023-01-02T18:11:40.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2023-01-02T18:11:41.002 INFO:teuthology.orchestra.run.smithi007.stdout:61 files removed 2023-01-02T18:11:41.031 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw 2023-01-02T18:11:41.034 INFO:teuthology.orchestra.run.smithi057.stdout:61 files removed 2023-01-02T18:11:41.063 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw 2023-01-02T18:11:41.703 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 278 kB/s | 76 kB 00:00 2023-01-02T18:11:41.725 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 287 kB/s | 76 kB 00:00 2023-01-02T18:11:42.011 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 56 kB/s | 15 kB 00:00 2023-01-02T18:11:42.026 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 58 kB/s | 15 kB 00:00 2023-01-02T18:11:42.310 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 5.6 kB/s | 1.4 kB 00:00 2023-01-02T18:11:42.312 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 5.3 kB/s | 1.4 kB 00:00 2023-01-02T18:11:43.070 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-8 - AppStream 36 MB/s | 27 MB 00:00 2023-01-02T18:11:43.173 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS-8 - AppStream 32 MB/s | 27 MB 00:00 2023-01-02T18:11:48.912 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-8 - BaseOS 42 MB/s | 26 MB 00:00 2023-01-02T18:11:49.165 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS-8 - BaseOS 43 MB/s | 26 MB 00:00 2023-01-02T18:11:53.261 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-8 - Extras 161 kB/s | 18 kB 00:00 2023-01-02T18:11:53.663 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-8 - PowerTools 20 MB/s | 5.5 MB 00:00 2023-01-02T18:11:53.722 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS-8 - Extras 168 kB/s | 18 kB 00:00 2023-01-02T18:11:54.133 INFO:teuthology.orchestra.run.smithi007.stdout:CentOS-8 - PowerTools 19 MB/s | 5.5 MB 00:00 2023-01-02T18:11:57.196 INFO:teuthology.orchestra.run.smithi057.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-01-02T18:11:57.649 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2023-01-02T18:11:58.529 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-02T18:11:58.957 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 11 MB/s | 13 MB 00:01 2023-01-02T18:12:01.929 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 360 kB/s | 24 kB 00:00 2023-01-02T18:12:02.416 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 383 kB/s | 24 kB 00:00 2023-01-02T18:12:05.402 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:12:05.405 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:12:05.405 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:12:05.405 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:12:05.406 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:12:05.406 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 12 M 2023-01-02T18:12:05.406 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2023-01-02T18:12:05.406 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 3.7 M 2023-01-02T18:12:05.406 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 4.2 M 2023-01-02T18:12:05.407 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-01-02T18:12:05.407 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 6.1 M 2023-01-02T18:12:05.407 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 24 M 2023-01-02T18:12:05.407 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 26 k 2023-01-02T18:12:05.407 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-02T18:12:05.408 INFO:teuthology.orchestra.run.smithi057.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-01-02T18:12:05.408 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 822 k 2023-01-02T18:12:05.408 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-02T18:12:05.408 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-02T18:12:05.408 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 494 k 2023-01-02T18:12:05.409 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-02T18:12:05.409 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 3.8 M 2023-01-02T18:12:05.409 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-02T18:12:05.409 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-02T18:12:05.409 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse 2023-01-02T18:12:05.410 INFO:teuthology.orchestra.run.smithi057.stdout: x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 45 k 2023-01-02T18:12:05.410 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 96 k 2023-01-02T18:12:05.410 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 215 k 2023-01-02T18:12:05.410 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-02T18:12:05.410 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 389 k 2023-01-02T18:12:05.411 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 368 k 2023-01-02T18:12:05.411 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 114 k 2023-01-02T18:12:05.411 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:12:05.411 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:12:05.411 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:12:05.412 INFO:teuthology.orchestra.run.smithi057.stdout:Install 21 Packages 2023-01-02T18:12:05.412 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 2 Packages 2023-01-02T18:12:05.412 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:12:05.413 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 57 M 2023-01-02T18:12:05.413 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:12:05.875 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:12:05.877 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:12:05.878 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:12:05.878 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:12:05.878 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:12:05.878 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 12 M 2023-01-02T18:12:05.878 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2023-01-02T18:12:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 3.7 M 2023-01-02T18:12:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 4.2 M 2023-01-02T18:12:05.879 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-02T18:12:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 6.1 M 2023-01-02T18:12:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 24 M 2023-01-02T18:12:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 26 k 2023-01-02T18:12:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-01-02T18:12:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2023-01-02T18:12:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 822 k 2023-01-02T18:12:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-01-02T18:12:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-BaseOS 47 k 2023-01-02T18:12:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 494 k 2023-01-02T18:12:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2023-01-02T18:12:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 3.8 M 2023-01-02T18:12:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-01-02T18:12:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2023-01-02T18:12:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse 2023-01-02T18:12:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 45 k 2023-01-02T18:12:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 96 k 2023-01-02T18:12:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 215 k 2023-01-02T18:12:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2023-01-02T18:12:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 389 k 2023-01-02T18:12:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 368 k 2023-01-02T18:12:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 114 k 2023-01-02T18:12:05.884 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:12:05.884 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:12:05.884 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:12:05.884 INFO:teuthology.orchestra.run.smithi007.stdout:Install 21 Packages 2023-01-02T18:12:05.885 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 2 Packages 2023-01-02T18:12:05.885 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:12:05.886 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 57 M 2023-01-02T18:12:05.886 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:12:07.184 INFO:teuthology.orchestra.run.smithi007.stdout:(1/23): ceph-base-16.2.10-1543.gf2bb1478.el8.x8 4.7 MB/s | 6.1 MB 00:01 2023-01-02T18:12:07.259 INFO:teuthology.orchestra.run.smithi007.stdout:(2/23): ceph-selinux-16.2.10-1543.gf2bb1478.el8 341 kB/s | 26 kB 00:00 2023-01-02T18:12:07.426 INFO:teuthology.orchestra.run.smithi007.stdout:(3/23): libcephfs2-16.2.10-1543.gf2bb1478.el8.x 4.8 MB/s | 822 kB 00:00 2023-01-02T18:12:07.526 INFO:teuthology.orchestra.run.smithi007.stdout:(4/23): libradosstriper1-16.2.10-1543.gf2bb1478 4.8 MB/s | 494 kB 00:00 2023-01-02T18:12:08.126 INFO:teuthology.orchestra.run.smithi007.stdout:(5/23): librgw2-16.2.10-1543.gf2bb1478.el8.x86_ 6.3 MB/s | 3.8 MB 00:00 2023-01-02T18:12:08.202 INFO:teuthology.orchestra.run.smithi007.stdout:(6/23): python3-ceph-argparse-16.2.10-1543.gf2b 598 kB/s | 45 kB 00:00 2023-01-02T18:12:08.277 INFO:teuthology.orchestra.run.smithi007.stdout:(7/23): python3-ceph-common-16.2.10-1543.gf2bb1 1.3 MB/s | 96 kB 00:00 2023-01-02T18:12:08.361 INFO:teuthology.orchestra.run.smithi007.stdout:(8/23): python3-cephfs-16.2.10-1543.gf2bb1478.e 2.5 MB/s | 215 kB 00:00 2023-01-02T18:12:08.453 INFO:teuthology.orchestra.run.smithi007.stdout:(9/23): python3-rados-16.2.10-1543.gf2bb1478.el 4.1 MB/s | 389 kB 00:00 2023-01-02T18:12:08.528 INFO:teuthology.orchestra.run.smithi007.stdout:(10/23): python3-rbd-16.2.10-1543.gf2bb1478.el8 4.8 MB/s | 368 kB 00:00 2023-01-02T18:12:08.595 INFO:teuthology.orchestra.run.smithi007.stdout:(11/23): python3-rgw-16.2.10-1543.gf2bb1478.el8 1.7 MB/s | 114 kB 00:00 2023-01-02T18:12:08.722 INFO:teuthology.orchestra.run.smithi057.stdout:(1/23): ceph-common-16.2.10-1543.gf2bb1478.el8. 7.3 MB/s | 24 MB 00:03 2023-01-02T18:12:08.772 INFO:teuthology.orchestra.run.smithi057.stdout:(2/23): ceph-selinux-16.2.10-1543.gf2bb1478.el8 517 kB/s | 26 kB 00:00 2023-01-02T18:12:08.870 INFO:teuthology.orchestra.run.smithi007.stdout:(12/23): ceph-common-16.2.10-1543.gf2bb1478.el8 8.0 MB/s | 24 MB 00:02 2023-01-02T18:12:08.872 INFO:teuthology.orchestra.run.smithi057.stdout:(3/23): libcephfs2-16.2.10-1543.gf2bb1478.el8.x 8.0 MB/s | 822 kB 00:00 2023-01-02T18:12:08.929 INFO:teuthology.orchestra.run.smithi007.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 1.0 MB/s | 354 kB 00:00 2023-01-02T18:12:08.947 INFO:teuthology.orchestra.run.smithi057.stdout:(4/23): libradosstriper1-16.2.10-1543.gf2bb1478 6.4 MB/s | 494 kB 00:00 2023-01-02T18:12:08.954 INFO:teuthology.orchestra.run.smithi007.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.7 MB/s | 44 kB 00:00 2023-01-02T18:12:08.979 INFO:teuthology.orchestra.run.smithi007.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-01-02T18:12:09.005 INFO:teuthology.orchestra.run.smithi007.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2023-01-02T18:12:09.172 INFO:teuthology.orchestra.run.smithi007.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 1.1 MB/s | 181 kB 00:00 2023-01-02T18:12:09.197 INFO:teuthology.orchestra.run.smithi007.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-01-02T18:12:09.214 INFO:teuthology.orchestra.run.smithi057.stdout:(5/23): librgw2-16.2.10-1543.gf2bb1478.el8.x86_ 14 MB/s | 3.8 MB 00:00 2023-01-02T18:12:09.222 INFO:teuthology.orchestra.run.smithi007.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2023-01-02T18:12:09.239 INFO:teuthology.orchestra.run.smithi007.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.7 MB/s | 75 kB 00:00 2023-01-02T18:12:09.264 INFO:teuthology.orchestra.run.smithi057.stdout:(6/23): python3-ceph-argparse-16.2.10-1543.gf2b 901 kB/s | 45 kB 00:00 2023-01-02T18:12:09.365 INFO:teuthology.orchestra.run.smithi057.stdout:(7/23): ceph-base-16.2.10-1543.gf2bb1478.el8.x8 1.5 MB/s | 6.1 MB 00:03 2023-01-02T18:12:09.390 INFO:teuthology.orchestra.run.smithi057.stdout:(8/23): python3-ceph-common-16.2.10-1543.gf2bb1 768 kB/s | 96 kB 00:00 2023-01-02T18:12:09.482 INFO:teuthology.orchestra.run.smithi057.stdout:(9/23): python3-rados-16.2.10-1543.gf2bb1478.el 4.1 MB/s | 389 kB 00:00 2023-01-02T18:12:09.557 INFO:teuthology.orchestra.run.smithi057.stdout:(10/23): python3-cephfs-16.2.10-1543.gf2bb1478. 1.1 MB/s | 215 kB 00:00 2023-01-02T18:12:09.583 INFO:teuthology.orchestra.run.smithi057.stdout:(11/23): python3-rbd-16.2.10-1543.gf2bb1478.el8 3.6 MB/s | 368 kB 00:00 2023-01-02T18:12:09.631 INFO:teuthology.orchestra.run.smithi007.stdout:(21/23): librbd1-16.2.10-1543.gf2bb1478.el8.x86 11 MB/s | 4.2 MB 00:00 2023-01-02T18:12:09.641 INFO:teuthology.orchestra.run.smithi057.stdout:(12/23): python3-rgw-16.2.10-1543.gf2bb1478.el8 1.3 MB/s | 114 kB 00:00 2023-01-02T18:12:09.690 INFO:teuthology.orchestra.run.smithi007.stdout:(22/23): librados2-16.2.10-1543.gf2bb1478.el8.x 8.0 MB/s | 3.7 MB 00:00 2023-01-02T18:12:09.700 INFO:teuthology.orchestra.run.smithi057.stdout:(13/23): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-01-02T18:12:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 1.8 MB/s | 44 kB 00:00 2023-01-02T18:12:09.750 INFO:teuthology.orchestra.run.smithi057.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-01-02T18:12:09.775 INFO:teuthology.orchestra.run.smithi057.stdout:(16/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2023-01-02T18:12:09.943 INFO:teuthology.orchestra.run.smithi057.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 1.1 MB/s | 181 kB 00:00 2023-01-02T18:12:09.968 INFO:teuthology.orchestra.run.smithi057.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.4 MB/s | 306 kB 00:00 2023-01-02T18:12:09.993 INFO:teuthology.orchestra.run.smithi057.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 1.1 MB/s | 59 kB 00:00 2023-01-02T18:12:10.018 INFO:teuthology.orchestra.run.smithi057.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-01-02T18:12:10.344 INFO:teuthology.orchestra.run.smithi057.stdout:(21/23): librbd1-16.2.10-1543.gf2bb1478.el8.x86 13 MB/s | 4.2 MB 00:00 2023-01-02T18:12:10.611 INFO:teuthology.orchestra.run.smithi057.stdout:(22/23): ceph-radosgw-16.2.10-1543.gf2bb1478.el 2.2 MB/s | 12 MB 00:05 2023-01-02T18:12:10.994 INFO:teuthology.orchestra.run.smithi057.stdout:(23/23): librados2-16.2.10-1543.gf2bb1478.el8.x 3.7 MB/s | 3.7 MB 00:01 2023-01-02T18:12:10.998 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:12:10.999 INFO:teuthology.orchestra.run.smithi057.stdout:Total 10 MB/s | 57 MB 00:05 2023-01-02T18:12:11.040 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:12:11.090 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:12:11.091 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:12:11.653 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:12:11.657 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:12:11.973 INFO:teuthology.orchestra.run.smithi007.stdout:(23/23): ceph-radosgw-16.2.10-1543.gf2bb1478.el 1.9 MB/s | 12 MB 00:06 2023-01-02T18:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:12:11.977 INFO:teuthology.orchestra.run.smithi007.stdout:Total 9.4 MB/s | 57 MB 00:06 2023-01-02T18:12:12.020 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:12:12.071 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:12:12.071 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:12:12.643 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:12:12.646 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:12:12.789 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:12:13.008 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-01-02T18:12:13.161 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-02T18:12:13.550 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-02T18:12:13.726 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:12:13.736 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 3/25 2023-01-02T18:12:13.820 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 3/25 2023-01-02T18:12:13.974 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2023-01-02T18:12:14.055 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:16.2.10-1543.gf2bb1478.el8.x86_64 4/25 2023-01-02T18:12:14.131 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-02T18:12:14.211 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/25 2023-01-02T18:12:14.521 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2023-01-02T18:12:14.673 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/25 2023-01-02T18:12:14.706 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 3/25 2023-01-02T18:12:14.825 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 3/25 2023-01-02T18:12:14.877 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 6/25 2023-01-02T18:12:14.941 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 6/25 2023-01-02T18:12:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:16.2.10-1543.gf2bb1478.el8.x86_64 4/25 2023-01-02T18:12:15.144 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2023-01-02T18:12:15.264 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/25 2023-01-02T18:12:15.278 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/25 2023-01-02T18:12:15.677 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/25 2023-01-02T18:12:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/25 2023-01-02T18:12:15.847 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 6/25 2023-01-02T18:12:15.860 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:16.2.10-1543.gf2bb1478.el8.x86_64 9/25 2023-01-02T18:12:15.912 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 6/25 2023-01-02T18:12:15.940 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:16.2.10-1543.gf2bb1478.el8.x86_64 9/25 2023-01-02T18:12:16.106 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2023-01-02T18:12:16.116 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2023-01-02T18:12:16.247 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 8/25 2023-01-02T18:12:16.293 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:16.2.10-1543.gf2bb1478.el8 11/25 2023-01-02T18:12:16.482 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:16.2.10-1543.gf2bb1478.el8.x86_64 12/25 2023-01-02T18:12:16.642 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 8/25 2023-01-02T18:12:16.797 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 13/25 2023-01-02T18:12:16.805 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:16.2.10-1543.gf2bb1478.el8.x86_64 9/25 2023-01-02T18:12:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:16.2.10-1543.gf2bb1478.el8.x86_64 9/25 2023-01-02T18:12:17.022 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 14/25 2023-01-02T18:12:17.095 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2023-01-02T18:12:17.194 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:16.2.10-1543.gf2bb1478.el8.x86_ 15/25 2023-01-02T18:12:17.253 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:16.2.10-1543.gf2bb1478.el8.x86_ 15/25 2023-01-02T18:12:17.270 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:16.2.10-1543.gf2bb1478.el8 11/25 2023-01-02T18:12:17.484 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:16.2.10-1543.gf2bb1478.el8.x86_64 12/25 2023-01-02T18:12:17.509 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-01-02T18:12:17.692 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 13/25 2023-01-02T18:12:17.728 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-01-02T18:12:17.928 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-02T18:12:17.934 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 14/25 2023-01-02T18:12:18.080 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:16.2.10-1543.gf2bb1478.el8.x86_ 15/25 2023-01-02T18:12:18.111 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:16.2.10-1543.gf2bb1478.el8.x 19/25 2023-01-02T18:12:18.156 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:16.2.10-1543.gf2bb1478.el8.x86_ 15/25 2023-01-02T18:12:18.404 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2023-01-02T18:12:18.598 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2023-01-02T18:12:18.815 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2023-01-02T18:12:18.989 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:16.2.10-1543.gf2bb1478.el8.x 19/25 2023-01-02T18:12:21.761 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 20/25 2023-01-02T18:12:22.127 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 20/25 2023-01-02T18:12:22.692 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 20/25 2023-01-02T18:12:22.847 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 20/25 2023-01-02T18:12:22.896 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 20/25 2023-01-02T18:12:23.157 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 21/25 2023-01-02T18:12:23.247 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 21/25 2023-01-02T18:12:23.426 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:16.2.10-1543.gf2bb1478.el8.x86_64 22/25 2023-01-02T18:12:23.612 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 20/25 2023-01-02T18:12:23.933 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 21/25 2023-01-02T18:12:24.032 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 21/25 2023-01-02T18:12:24.204 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:16.2.10-1543.gf2bb1478.el8.x86_64 22/25 2023-01-02T18:12:43.099 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:16.2.10-1543.gf2bb1478.el8.x86_64 22/25 2023-01-02T18:12:43.099 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2023-01-02T18:12:43.100 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2023-01-02T18:12:43.100 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2023-01-02T18:12:43.100 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /run 2023-01-02T18:12:43.100 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2023-01-02T18:12:43.100 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2023-01-02T18:12:43.101 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2023-01-02T18:12:43.101 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2023-01-02T18:12:43.101 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /dev 2023-01-02T18:12:43.101 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:12:43.543 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:16.2.10-1543.gf2bb1478.el8.x86_64 22/25 2023-01-02T18:12:43.543 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2023-01-02T18:12:43.543 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2023-01-02T18:12:43.544 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-01-02T18:12:43.544 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /run 2023-01-02T18:12:43.544 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2023-01-02T18:12:43.544 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2023-01-02T18:12:43.544 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2023-01-02T18:12:43.545 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2023-01-02T18:12:43.545 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-01-02T18:12:43.545 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:12:44.337 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 23/25 2023-01-02T18:12:44.416 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 23/25 2023-01-02T18:12:44.416 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-02T18:12:44.634 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-02T18:12:44.634 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-02T18:12:44.813 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 23/25 2023-01-02T18:12:44.892 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 23/25 2023-01-02T18:12:44.892 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-02T18:12:45.079 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2023-01-02T18:12:45.079 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-02T18:12:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-02T18:12:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/25 2023-01-02T18:12:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/25 2023-01-02T18:12:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 3/25 2023-01-02T18:12:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:16.2.10-1543.gf2bb1478.el8.x86_64 4/25 2023-01-02T18:12:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/25 2023-01-02T18:12:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:16.2.10-1543.gf2bb1478.el8.x86_ 6/25 2023-01-02T18:12:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:16.2.10-1543.gf2bb1478.el8.x86_64 7/25 2023-01-02T18:12:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:16.2.10-1543.gf2bb1478.el8 8/25 2023-01-02T18:12:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:16.2.10-1543.gf2bb1478.el8.x 9/25 2023-01-02T18:12:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:16.2.10-1543.gf2bb1478.el8.x86_64 10/25 2023-01-02T18:12:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:16.2.10-1543.gf2bb1478.el8.x86_64 11/25 2023-01-02T18:12:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 12/25 2023-01-02T18:12:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 13/25 2023-01-02T18:12:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-02T18:12:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-02T18:12:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-02T18:12:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-02T18:12:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-02T18:12:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2023-01-02T18:12:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2023-01-02T18:12:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2023-01-02T18:12:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 22/25 2023-01-02T18:12:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-02T18:12:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 24/25 2023-01-02T18:12:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2023-01-02T18:12:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/25 2023-01-02T18:12:45.802 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/25 2023-01-02T18:12:45.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 3/25 2023-01-02T18:12:45.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:16.2.10-1543.gf2bb1478.el8.x86_64 4/25 2023-01-02T18:12:45.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/25 2023-01-02T18:12:45.803 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:16.2.10-1543.gf2bb1478.el8.x86_ 6/25 2023-01-02T18:12:45.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:16.2.10-1543.gf2bb1478.el8.x86_64 7/25 2023-01-02T18:12:45.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:16.2.10-1543.gf2bb1478.el8 8/25 2023-01-02T18:12:45.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:16.2.10-1543.gf2bb1478.el8.x 9/25 2023-01-02T18:12:45.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:16.2.10-1543.gf2bb1478.el8.x86_64 10/25 2023-01-02T18:12:45.804 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:16.2.10-1543.gf2bb1478.el8.x86_64 11/25 2023-01-02T18:12:45.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 12/25 2023-01-02T18:12:45.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 13/25 2023-01-02T18:12:45.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 14/25 2023-01-02T18:12:45.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2023-01-02T18:12:45.805 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2023-01-02T18:12:45.806 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2023-01-02T18:12:45.806 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2023-01-02T18:12:45.806 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2023-01-02T18:12:45.806 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2023-01-02T18:12:45.806 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2023-01-02T18:12:45.807 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 22/25 2023-01-02T18:12:45.807 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2023-01-02T18:12:45.807 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 24/25 2023-01-02T18:12:46.222 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-02T18:12:46.223 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:12:46.223 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2023-01-02T18:12:46.223 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.223 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.223 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:12:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-02T18:12:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: leveldb-1.22-1.el8.x86_64 2023-01-02T18:12:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-02T18:12:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-02T18:12:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-02T18:12:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-02T18:12:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-02T18:12:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-02T18:12:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.228 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.228 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:12:46.228 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:12:46.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-test 2023-01-02T18:12:46.647 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2023-01-02T18:12:46.648 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:12:46.648 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2023-01-02T18:12:46.648 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.648 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.649 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:12:46.649 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.649 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.649 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.649 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.650 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-01-02T18:12:46.650 INFO:teuthology.orchestra.run.smithi007.stdout: leveldb-1.22-1.el8.x86_64 2023-01-02T18:12:46.650 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.650 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.2-3.el8.x86_64 2023-01-02T18:12:46.650 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-01-02T18:12:46.651 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.651 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-01-02T18:12:46.651 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.651 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.3.1-3.el8.x86_64 2023-01-02T18:12:46.651 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-01-02T18:12:46.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-01-02T18:12:46.652 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.653 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.653 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:12:46.653 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:12:46.654 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:12:46.929 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-test 2023-01-02T18:12:47.237 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:00:46 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:12:47.619 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:45 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:12:48.436 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:12:48.437 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:12:48.437 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:12:48.438 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:12:48.438 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:12:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 52 M 2023-01-02T18:12:48.438 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-01-02T18:12:48.438 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-02T18:12:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 174 k 2023-01-02T18:12:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-02T18:12:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-02T18:12:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-02T18:12:48.439 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:12:48.439 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:12:48.440 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:12:48.440 INFO:teuthology.orchestra.run.smithi057.stdout:Install 6 Packages 2023-01-02T18:12:48.440 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:12:48.441 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 53 M 2023-01-02T18:12:48.441 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 195 M 2023-01-02T18:12:48.441 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:12:48.514 INFO:teuthology.orchestra.run.smithi057.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.7 MB/s | 202 kB 00:00 2023-01-02T18:12:48.548 INFO:teuthology.orchestra.run.smithi057.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.4 MB/s | 187 kB 00:00 2023-01-02T18:12:48.573 INFO:teuthology.orchestra.run.smithi057.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 13 MB/s | 323 kB 00:00 2023-01-02T18:12:48.599 INFO:teuthology.orchestra.run.smithi057.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 71 kB 00:00 2023-01-02T18:12:48.827 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:12:48.828 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:12:48.828 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:12:48.828 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:12:48.829 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:12:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 52 M 2023-01-02T18:12:48.829 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-02T18:12:48.829 INFO:teuthology.orchestra.run.smithi007.stdout: jq x86_64 1.6-6.el8 CentOS-AppStream 202 k 2023-01-02T18:12:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 174 k 2023-01-02T18:12:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2023-01-02T18:12:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2023-01-02T18:12:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el8 CentOS-AppStream 71 k 2023-01-02T18:12:48.830 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:12:48.830 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:12:48.831 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:12:48.831 INFO:teuthology.orchestra.run.smithi007.stdout:Install 6 Packages 2023-01-02T18:12:48.831 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:12:48.832 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 53 M 2023-01-02T18:12:48.832 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 195 M 2023-01-02T18:12:48.832 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:12:48.900 INFO:teuthology.orchestra.run.smithi007.stdout:(1/6): jq-1.6-6.el8.x86_64.rpm 2.9 MB/s | 202 kB 00:00 2023-01-02T18:12:48.926 INFO:teuthology.orchestra.run.smithi007.stdout:(2/6): oniguruma-6.8.2-2.el8.x86_64.rpm 7.3 MB/s | 187 kB 00:00 2023-01-02T18:12:48.967 INFO:teuthology.orchestra.run.smithi007.stdout:(3/6): socat-1.7.4.1-1.el8.x86_64.rpm 9.6 MB/s | 323 kB 00:00 2023-01-02T18:12:48.974 INFO:teuthology.orchestra.run.smithi057.stdout:(5/6): libcephsqlite-16.2.10-1543.gf2bb1478.el8 325 kB/s | 174 kB 00:00 2023-01-02T18:12:48.993 INFO:teuthology.orchestra.run.smithi007.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 71 kB 00:00 2023-01-02T18:12:49.368 INFO:teuthology.orchestra.run.smithi007.stdout:(5/6): libcephsqlite-16.2.10-1543.gf2bb1478.el8 323 kB/s | 174 kB 00:00 2023-01-02T18:12:55.517 INFO:teuthology.orchestra.run.smithi007.stdout:(6/6): ceph-test-16.2.10-1543.gf2bb1478.el8.x86 7.8 MB/s | 52 MB 00:06 2023-01-02T18:12:55.520 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:12:55.521 INFO:teuthology.orchestra.run.smithi007.stdout:Total 7.9 MB/s | 53 MB 00:06 2023-01-02T18:12:55.540 INFO:teuthology.orchestra.run.smithi057.stdout:(6/6): ceph-test-16.2.10-1543.gf2bb1478.el8.x86 7.3 MB/s | 52 MB 00:07 2023-01-02T18:12:55.543 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:12:55.543 INFO:teuthology.orchestra.run.smithi057.stdout:Total 7.4 MB/s | 53 MB 00:07 2023-01-02T18:12:55.565 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:12:55.586 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:12:55.587 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:12:55.587 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:12:55.608 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:12:55.609 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:12:55.907 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:12:55.911 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:12:55.932 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:12:55.936 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:12:56.426 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:12:56.448 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:12:56.652 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-02T18:12:56.655 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2023-01-02T18:12:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-02T18:12:56.862 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2023-01-02T18:12:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-02T18:12:57.024 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-02T18:12:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-02T18:12:57.106 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2023-01-02T18:12:57.262 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-02T18:12:57.315 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jq-1.6-6.el8.x86_64 4/6 2023-01-02T18:12:57.413 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/6 2023-01-02T18:12:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/6 2023-01-02T18:13:02.292 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/6 2023-01-02T18:13:02.386 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/6 2023-01-02T18:13:02.534 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:16.2.10-1543.gf2bb1478.el8.x86_64 6/6 2023-01-02T18:13:02.670 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:16.2.10-1543.gf2bb1478.el8.x86_64 6/6 2023-01-02T18:13:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-test-2:16.2.10-1543.gf2bb1478.el8.x86_64 6/6 2023-01-02T18:13:02.802 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/6 2023-01-02T18:13:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/6 2023-01-02T18:13:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-02T18:13:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-02T18:13:02.803 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-02T18:13:02.950 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-test-2:16.2.10-1543.gf2bb1478.el8.x86_64 6/6 2023-01-02T18:13:02.950 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/6 2023-01-02T18:13:02.951 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/6 2023-01-02T18:13:02.951 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jq-1.6-6.el8.x86_64 3/6 2023-01-02T18:13:02.951 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/6 2023-01-02T18:13:02.951 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2023-01-02T18:13:03.292 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-02T18:13:03.292 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:03.293 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:13:03.293 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:03.293 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-6.el8.x86_64 2023-01-02T18:13:03.293 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:03.294 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-02T18:13:03.294 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-02T18:13:03.294 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-02T18:13:03.294 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:03.295 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:13:03.470 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2023-01-02T18:13:03.471 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:03.471 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:13:03.471 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:03.471 INFO:teuthology.orchestra.run.smithi007.stdout: jq-1.6-6.el8.x86_64 2023-01-02T18:13:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-01-02T18:13:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-1.el8.x86_64 2023-01-02T18:13:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-01-02T18:13:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:03.472 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:13:03.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph 2023-01-02T18:13:03.693 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph 2023-01-02T18:13:04.209 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:03 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:13:04.371 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:02 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:13:05.405 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:13:05.408 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================== 2023-01-02T18:13:05.409 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:13:05.409 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================== 2023-01-02T18:13:05.410 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:13:05.410 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 6.4 k 2023-01-02T18:13:05.410 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-01-02T18:13:05.411 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 2.4 M 2023-01-02T18:13:05.411 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 1.6 M 2023-01-02T18:13:05.411 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 243 k 2023-01-02T18:13:05.412 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 5.0 M 2023-01-02T18:13:05.412 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 18 M 2023-01-02T18:13:05.412 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-02T18:13:05.413 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-02T18:13:05.413 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-02T18:13:05.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-02T18:13:05.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-02T18:13:05.414 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-02T18:13:05.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-02T18:13:05.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-02T18:13:05.415 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-02T18:13:05.416 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-02T18:13:05.416 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-02T18:13:05.417 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-02T18:13:05.417 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-02T18:13:05.417 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-02T18:13:05.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-02T18:13:05.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-02T18:13:05.418 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-02T18:13:05.419 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-02T18:13:05.419 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-02T18:13:05.420 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-02T18:13:05.420 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-02T18:13:05.420 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-02T18:13:05.421 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-02T18:13:05.421 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-02T18:13:05.421 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-02T18:13:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-02T18:13:05.422 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:05.423 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:13:05.423 INFO:teuthology.orchestra.run.smithi057.stdout:======================================================================================== 2023-01-02T18:13:05.423 INFO:teuthology.orchestra.run.smithi057.stdout:Install 32 Packages 2023-01-02T18:13:05.423 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:05.424 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 31 M 2023-01-02T18:13:05.424 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 101 M 2023-01-02T18:13:05.424 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:13:05.540 INFO:teuthology.orchestra.run.smithi057.stdout:(1/32): ceph-16.2.10-1543.gf2bb1478.el8.x86_64. 52 kB/s | 6.4 kB 00:00 2023-01-02T18:13:05.570 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:13:05.574 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================== 2023-01-02T18:13:05.574 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:13:05.574 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================== 2023-01-02T18:13:05.574 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:13:05.575 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 6.4 k 2023-01-02T18:13:05.575 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-02T18:13:05.575 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 2.4 M 2023-01-02T18:13:05.575 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 1.6 M 2023-01-02T18:13:05.576 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 243 k 2023-01-02T18:13:05.576 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 5.0 M 2023-01-02T18:13:05.576 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 18 M 2023-01-02T18:13:05.576 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-01-02T18:13:05.577 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-01-02T18:13:05.577 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-BaseOS 237 k 2023-01-02T18:13:05.577 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-01-02T18:13:05.577 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-01-02T18:13:05.578 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-BaseOS 559 k 2023-01-02T18:13:05.578 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-01-02T18:13:05.578 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-01-02T18:13:05.578 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-01-02T18:13:05.579 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2023-01-02T18:13:05.579 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2023-01-02T18:13:05.579 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-01-02T18:13:05.579 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-01-02T18:13:05.580 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-01-02T18:13:05.580 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2023-01-02T18:13:05.580 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-BaseOS 109 k 2023-01-02T18:13:05.580 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2023-01-02T18:13:05.581 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-01-02T18:13:05.581 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-01-02T18:13:05.581 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-01-02T18:13:05.582 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-01-02T18:13:05.582 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-01-02T18:13:05.582 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-01-02T18:13:05.583 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-01-02T18:13:05.583 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2023-01-02T18:13:05.583 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-01-02T18:13:05.583 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:05.584 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:13:05.584 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================== 2023-01-02T18:13:05.584 INFO:teuthology.orchestra.run.smithi007.stdout:Install 32 Packages 2023-01-02T18:13:05.584 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:05.585 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 31 M 2023-01-02T18:13:05.586 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 101 M 2023-01-02T18:13:05.586 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:13:05.778 INFO:teuthology.orchestra.run.smithi007.stdout:(1/32): ceph-16.2.10-1543.gf2bb1478.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2023-01-02T18:13:05.790 INFO:teuthology.orchestra.run.smithi057.stdout:(2/32): ceph-mds-16.2.10-1543.gf2bb1478.el8.x86 6.5 MB/s | 2.4 MB 00:00 2023-01-02T18:13:05.832 INFO:teuthology.orchestra.run.smithi057.stdout:(3/32): ceph-mgr-16.2.10-1543.gf2bb1478.el8.x86 3.8 MB/s | 1.6 MB 00:00 2023-01-02T18:13:05.933 INFO:teuthology.orchestra.run.smithi057.stdout:(4/32): ceph-mgr-modules-core-16.2.10-1543.gf2b 2.4 MB/s | 243 kB 00:00 2023-01-02T18:13:05.991 INFO:teuthology.orchestra.run.smithi057.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-01-02T18:13:06.016 INFO:teuthology.orchestra.run.smithi057.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2023-01-02T18:13:06.042 INFO:teuthology.orchestra.run.smithi057.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.1 MB/s | 103 kB 00:00 2023-01-02T18:13:06.067 INFO:teuthology.orchestra.run.smithi057.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-01-02T18:13:06.101 INFO:teuthology.orchestra.run.smithi057.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2023-01-02T18:13:06.126 INFO:teuthology.orchestra.run.smithi057.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.3 MB/s | 237 kB 00:00 2023-01-02T18:13:06.160 INFO:teuthology.orchestra.run.smithi057.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 16 MB/s | 559 kB 00:00 2023-01-02T18:13:06.185 INFO:teuthology.orchestra.run.smithi057.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 4.3 MB/s | 109 kB 00:00 2023-01-02T18:13:06.318 INFO:teuthology.orchestra.run.smithi057.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 328 kB/s | 44 kB 00:00 2023-01-02T18:13:06.427 INFO:teuthology.orchestra.run.smithi057.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.7 MB/s | 185 kB 00:00 2023-01-02T18:13:06.453 INFO:teuthology.orchestra.run.smithi007.stdout:(2/32): ceph-mgr-16.2.10-1543.gf2bb1478.el8.x86 1.8 MB/s | 1.6 MB 00:00 2023-01-02T18:13:06.477 INFO:teuthology.orchestra.run.smithi057.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 3.4 MB/s | 173 kB 00:00 2023-01-02T18:13:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:(16/32): ceph-mon-16.2.10-1543.gf2bb1478.el8.x8 4.9 MB/s | 5.0 MB 00:01 2023-01-02T18:13:06.578 INFO:teuthology.orchestra.run.smithi057.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 3.7 MB/s | 384 kB 00:00 2023-01-02T18:13:06.595 INFO:teuthology.orchestra.run.smithi007.stdout:(3/32): ceph-mds-16.2.10-1543.gf2bb1478.el8.x86 2.4 MB/s | 2.4 MB 00:01 2023-01-02T18:13:06.620 INFO:teuthology.orchestra.run.smithi057.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 420 kB/s | 18 kB 00:00 2023-01-02T18:13:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:(19/32): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-01-02T18:13:06.670 INFO:teuthology.orchestra.run.smithi057.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 975 kB/s | 49 kB 00:00 2023-01-02T18:13:06.712 INFO:teuthology.orchestra.run.smithi057.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 779 kB/s | 59 kB 00:00 2023-01-02T18:13:06.720 INFO:teuthology.orchestra.run.smithi007.stdout:(4/32): ceph-mgr-modules-core-16.2.10-1543.gf2b 1.9 MB/s | 243 kB 00:00 2023-01-02T18:13:06.746 INFO:teuthology.orchestra.run.smithi057.stdout:(22/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.7 MB/s | 283 kB 00:00 2023-01-02T18:13:06.779 INFO:teuthology.orchestra.run.smithi007.stdout:(5/32): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-01-02T18:13:06.780 INFO:teuthology.orchestra.run.smithi057.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 232 kB/s | 16 kB 00:00 2023-01-02T18:13:06.804 INFO:teuthology.orchestra.run.smithi007.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.5 MB/s | 39 kB 00:00 2023-01-02T18:13:06.805 INFO:teuthology.orchestra.run.smithi057.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 318 kB/s | 19 kB 00:00 2023-01-02T18:13:06.830 INFO:teuthology.orchestra.run.smithi007.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 4.0 MB/s | 103 kB 00:00 2023-01-02T18:13:06.830 INFO:teuthology.orchestra.run.smithi057.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 477 kB/s | 24 kB 00:00 2023-01-02T18:13:06.855 INFO:teuthology.orchestra.run.smithi007.stdout:(8/32): python3-pytz-2017.2-9.el8.noarch.rpm 2.1 MB/s | 54 kB 00:00 2023-01-02T18:13:06.889 INFO:teuthology.orchestra.run.smithi007.stdout:(9/32): python3-werkzeug-0.12.2-4.el8.noarch.rp 13 MB/s | 457 kB 00:00 2023-01-02T18:13:06.914 INFO:teuthology.orchestra.run.smithi007.stdout:(10/32): python3-cffi-1.11.5-5.el8.x86_64.rpm 9.3 MB/s | 237 kB 00:00 2023-01-02T18:13:06.948 INFO:teuthology.orchestra.run.smithi007.stdout:(11/32): python3-cryptography-3.2.1-5.el8.x86_6 16 MB/s | 559 kB 00:00 2023-01-02T18:13:06.972 INFO:teuthology.orchestra.run.smithi057.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 175 kB/s | 29 kB 00:00 2023-01-02T18:13:06.989 INFO:teuthology.orchestra.run.smithi007.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 2.6 MB/s | 109 kB 00:00 2023-01-02T18:13:06.997 INFO:teuthology.orchestra.run.smithi057.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 165 kB/s | 27 kB 00:00 2023-01-02T18:13:07.123 INFO:teuthology.orchestra.run.smithi007.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 327 kB/s | 44 kB 00:00 2023-01-02T18:13:07.181 INFO:teuthology.orchestra.run.smithi057.stdout:(28/32): ceph-osd-16.2.10-1543.gf2bb1478.el8.x8 13 MB/s | 18 MB 00:01 2023-01-02T18:13:07.206 INFO:teuthology.orchestra.run.smithi057.stdout:(29/32): python3-waitress-1.2.1-2.el8.1.noarch. 1.0 MB/s | 241 kB 00:00 2023-01-02T18:13:07.231 INFO:teuthology.orchestra.run.smithi057.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.0 MB/s | 251 kB 00:00 2023-01-02T18:13:07.232 INFO:teuthology.orchestra.run.smithi007.stdout:(14/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.7 MB/s | 185 kB 00:00 2023-01-02T18:13:07.274 INFO:teuthology.orchestra.run.smithi057.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 342 kB/s | 23 kB 00:00 2023-01-02T18:13:07.282 INFO:teuthology.orchestra.run.smithi007.stdout:(15/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 3.4 MB/s | 173 kB 00:00 2023-01-02T18:13:07.340 INFO:teuthology.orchestra.run.smithi057.stdout:(32/32): python3-webtest-2.0.33-1.el8.noarch.rp 538 kB/s | 85 kB 00:00 2023-01-02T18:13:07.343 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:07.343 INFO:teuthology.orchestra.run.smithi057.stdout:Total 16 MB/s | 31 MB 00:01 2023-01-02T18:13:07.366 INFO:teuthology.orchestra.run.smithi007.stdout:(16/32): python3-cherrypy-18.4.0-1.el8.noarch.r 4.5 MB/s | 384 kB 00:00 2023-01-02T18:13:07.427 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:13:07.441 INFO:teuthology.orchestra.run.smithi007.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-01-02T18:13:07.469 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:13:07.469 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:13:07.491 INFO:teuthology.orchestra.run.smithi007.stdout:(18/32): python3-jaraco-functools-2.0-4.el8.noa 353 kB/s | 18 kB 00:00 2023-01-02T18:13:07.542 INFO:teuthology.orchestra.run.smithi007.stdout:(19/32): python3-logutils-0.3.5-11.el8.noarch.r 971 kB/s | 49 kB 00:00 2023-01-02T18:13:07.592 INFO:teuthology.orchestra.run.smithi007.stdout:(20/32): python3-more-itertools-7.2.0-3.el8.noa 1.1 MB/s | 59 kB 00:00 2023-01-02T18:13:07.676 INFO:teuthology.orchestra.run.smithi007.stdout:(21/32): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-01-02T18:13:07.726 INFO:teuthology.orchestra.run.smithi007.stdout:(22/32): python3-portend-2.6-1.el8.noarch.rpm 312 kB/s | 16 kB 00:00 2023-01-02T18:13:07.776 INFO:teuthology.orchestra.run.smithi007.stdout:(23/32): python3-simplegeneric-0.8.1-17.el8.noa 374 kB/s | 19 kB 00:00 2023-01-02T18:13:07.842 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:13:07.846 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:13:07.847 INFO:teuthology.orchestra.run.smithi007.stdout:(24/32): python3-singledispatch-3.4.0.3-18.el8. 337 kB/s | 24 kB 00:00 2023-01-02T18:13:07.902 INFO:teuthology.orchestra.run.smithi007.stdout:(25/32): python3-tempora-1.14.1-5.el8.noarch.rp 541 kB/s | 29 kB 00:00 2023-01-02T18:13:07.952 INFO:teuthology.orchestra.run.smithi007.stdout:(26/32): python3-trustme-0.6.0-4.el8.noarch.rpm 551 kB/s | 27 kB 00:00 2023-01-02T18:13:08.003 INFO:teuthology.orchestra.run.smithi007.stdout:(27/32): python3-waitress-1.2.1-2.el8.1.noarch. 4.7 MB/s | 241 kB 00:00 2023-01-02T18:13:08.061 INFO:teuthology.orchestra.run.smithi007.stdout:(28/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 4.2 MB/s | 251 kB 00:00 2023-01-02T18:13:08.111 INFO:teuthology.orchestra.run.smithi007.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2023-01-02T18:13:08.153 INFO:teuthology.orchestra.run.smithi007.stdout:(30/32): python3-zc-lockfile-2.0-2.el8.noarch.r 551 kB/s | 23 kB 00:00 2023-01-02T18:13:08.395 INFO:teuthology.orchestra.run.smithi007.stdout:(31/32): ceph-mon-16.2.10-1543.gf2bb1478.el8.x8 1.9 MB/s | 5.0 MB 00:02 2023-01-02T18:13:09.011 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:13:09.262 INFO:teuthology.orchestra.run.smithi007.stdout:(32/32): ceph-osd-16.2.10-1543.gf2bb1478.el8.x8 6.5 MB/s | 18 MB 00:02 2023-01-02T18:13:09.265 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:09.265 INFO:teuthology.orchestra.run.smithi007.stdout:Total 8.4 MB/s | 31 MB 00:03 2023-01-02T18:13:09.345 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:13:09.386 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:13:09.386 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:13:09.387 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-02T18:13:09.661 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-02T18:13:09.786 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:13:09.790 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:13:09.921 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-02T18:13:10.160 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-02T18:13:10.407 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-02T18:13:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-02T18:13:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-02T18:13:10.951 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-02T18:13:11.009 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:13:11.179 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-02T18:13:11.240 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2023-01-02T18:13:11.441 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-02T18:13:11.522 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2023-01-02T18:13:11.679 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-02T18:13:11.764 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2023-01-02T18:13:11.911 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-02T18:13:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 4/32 2023-01-02T18:13:12.242 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2023-01-02T18:13:12.340 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-02T18:13:12.466 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2023-01-02T18:13:12.649 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-02T18:13:12.674 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2023-01-02T18:13:12.869 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-02T18:13:12.870 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2023-01-02T18:13:13.081 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2023-01-02T18:13:13.134 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-02T18:13:13.334 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2023-01-02T18:13:13.396 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-02T18:13:13.572 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2023-01-02T18:13:13.731 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-02T18:13:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2023-01-02T18:13:13.968 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-02T18:13:14.180 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-02T18:13:14.218 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 13/32 2023-01-02T18:13:14.408 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-02T18:13:14.534 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 14/32 2023-01-02T18:13:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-02T18:13:14.746 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2023-01-02T18:13:14.949 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-02T18:13:15.035 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2023-01-02T18:13:15.222 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-02T18:13:15.331 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-02T18:13:15.598 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-02T18:13:15.664 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2023-01-02T18:13:15.903 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2023-01-02T18:13:15.961 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-02T18:13:16.116 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 20/32 2023-01-02T18:13:16.344 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2023-01-02T18:13:16.358 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:16.2.10-1543.gf2bb1478.el8 27/32 2023-01-02T18:13:16.582 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 28/32 2023-01-02T18:13:16.607 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2023-01-02T18:13:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2023-01-02T18:13:17.122 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2023-01-02T18:13:17.524 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 25/32 2023-01-02T18:13:17.888 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2023-01-02T18:13:18.229 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 28/32 2023-01-02T18:13:18.719 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:16.2.10-1543.gf2bb1478.el8 27/32 2023-01-02T18:13:18.827 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:16.2.10-1543.gf2bb1478.el8.x86_64 29/32 2023-01-02T18:13:18.933 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 28/32 2023-01-02T18:13:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:16.2.10-1543.gf2bb1478.el8.x86_64 29/32 2023-01-02T18:13:19.510 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:16.2.10-1543.gf2bb1478.el8.x86_64 30/32 2023-01-02T18:13:19.737 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:16.2.10-1543.gf2bb1478.el8.x86_64 30/32 2023-01-02T18:13:19.902 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:16.2.10-1543.gf2bb1478.el8.x86_64 31/32 2023-01-02T18:13:19.921 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:16.2.10-1543.gf2bb1478.el8.x86_64 31/32 2023-01-02T18:13:20.040 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:16.2.10-1543.gf2bb1478.el8.x86_64 32/32 2023-01-02T18:13:20.467 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-2:16.2.10-1543.gf2bb1478.el8.x86_64 32/32 2023-01-02T18:13:20.467 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/32 2023-01-02T18:13:20.467 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/32 2023-01-02T18:13:20.468 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 3/32 2023-01-02T18:13:20.468 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:16.2.10-1543.gf2bb1478.el8.x86_64 4/32 2023-01-02T18:13:20.468 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/32 2023-01-02T18:13:20.468 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:16.2.10-1543.gf2bb1478.el8 6/32 2023-01-02T18:13:20.468 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-02T18:13:20.468 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-02T18:13:20.469 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-02T18:13:20.469 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-02T18:13:20.469 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-02T18:13:20.469 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-02T18:13:20.469 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-02T18:13:20.470 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-02T18:13:20.470 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-02T18:13:20.470 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-02T18:13:20.470 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-02T18:13:20.470 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-02T18:13:20.471 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-02T18:13:20.471 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-02T18:13:20.471 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-02T18:13:20.471 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-02T18:13:20.471 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-02T18:13:20.472 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-02T18:13:20.472 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-02T18:13:20.472 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-02T18:13:20.472 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-02T18:13:20.473 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-02T18:13:20.473 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-02T18:13:20.473 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-02T18:13:20.473 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-02T18:13:20.531 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 28/32 2023-01-02T18:13:20.729 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:16.2.10-1543.gf2bb1478.el8.x86_64 29/32 2023-01-02T18:13:21.194 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:16.2.10-1543.gf2bb1478.el8.x86_64 29/32 2023-01-02T18:13:21.387 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:16.2.10-1543.gf2bb1478.el8.x86_64 30/32 2023-01-02T18:13:21.576 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-02T18:13:21.576 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:21.576 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:13:21.576 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:21.577 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:21.577 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:21.577 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:21.577 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:21.577 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-02T18:13:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-02T18:13:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-02T18:13:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-02T18:13:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-02T18:13:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-02T18:13:21.579 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-02T18:13:21.579 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-02T18:13:21.579 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-02T18:13:21.579 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-02T18:13:21.579 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-02T18:13:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-02T18:13:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-02T18:13:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-2.6-1.el8.noarch 2023-01-02T18:13:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-02T18:13:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-02T18:13:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-02T18:13:21.581 INFO:teuthology.orchestra.run.smithi057.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-02T18:13:21.581 INFO:teuthology.orchestra.run.smithi057.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-02T18:13:21.581 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-02T18:13:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-02T18:13:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-02T18:13:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-02T18:13:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-02T18:13:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-02T18:13:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-02T18:13:21.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:21.583 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:13:21.614 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:16.2.10-1543.gf2bb1478.el8.x86_64 30/32 2023-01-02T18:13:21.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-base 2023-01-02T18:13:21.770 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:16.2.10-1543.gf2bb1478.el8.x86_64 31/32 2023-01-02T18:13:21.788 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:16.2.10-1543.gf2bb1478.el8.x86_64 31/32 2023-01-02T18:13:21.884 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:16.2.10-1543.gf2bb1478.el8.x86_64 32/32 2023-01-02T18:13:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-2:16.2.10-1543.gf2bb1478.el8.x86_64 32/32 2023-01-02T18:13:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/32 2023-01-02T18:13:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/32 2023-01-02T18:13:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 3/32 2023-01-02T18:13:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:16.2.10-1543.gf2bb1478.el8.x86_64 4/32 2023-01-02T18:13:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:16.2.10-1543.gf2bb1478.el8.x86_64 5/32 2023-01-02T18:13:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:16.2.10-1543.gf2bb1478.el8 6/32 2023-01-02T18:13:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 7/32 2023-01-02T18:13:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2023-01-02T18:13:22.304 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2023-01-02T18:13:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 10/32 2023-01-02T18:13:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2023-01-02T18:13:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 12/32 2023-01-02T18:13:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 13/32 2023-01-02T18:13:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2023-01-02T18:13:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2023-01-02T18:13:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2023-01-02T18:13:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2023-01-02T18:13:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2023-01-02T18:13:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2023-01-02T18:13:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2023-01-02T18:13:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2023-01-02T18:13:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2023-01-02T18:13:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2023-01-02T18:13:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2023-01-02T18:13:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2023-01-02T18:13:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2023-01-02T18:13:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2023-01-02T18:13:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2023-01-02T18:13:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 29/32 2023-01-02T18:13:22.310 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2023-01-02T18:13:22.310 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2023-01-02T18:13:22.366 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:21 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:13:23.391 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2023-01-02T18:13:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:23.392 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:13:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-01-02T18:13:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-01-02T18:13:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-01-02T18:13:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-01-02T18:13:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-01-02T18:13:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-01-02T18:13:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-6.2-6.el8.noarch 2023-01-02T18:13:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-01-02T18:13:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-01-02T18:13:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.0.6-13.el8.noarch 2023-01-02T18:13:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-01-02T18:13:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-01-02T18:13:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-01-02T18:13:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-2.6-1.el8.noarch 2023-01-02T18:13:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-01-02T18:13:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.14-14.el8.noarch 2023-01-02T18:13:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2017.2-9.el8.noarch 2023-01-02T18:13:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-01-02T18:13:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-01-02T18:13:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-01-02T18:13:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-01-02T18:13:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-01-02T18:13:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-01-02T18:13:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-01-02T18:13:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-01-02T18:13:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-01-02T18:13:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:23.398 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:13:23.450 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:13:23.520 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-base 2023-01-02T18:13:23.558 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:13:23.559 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:13:23.560 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:13:23.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install cephadm 2023-01-02T18:13:24.208 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:22 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:13:24.314 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:23 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:13:25.288 INFO:teuthology.orchestra.run.smithi007.stdout:Package ceph-base-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:13:25.395 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:13:25.396 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:13:25.397 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:13:25.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install cephadm 2023-01-02T18:13:25.499 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:13:25.500 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:25.500 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:13:25.500 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:25.501 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:13:25.501 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 82 k 2023-01-02T18:13:25.501 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:25.502 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:13:25.502 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:25.502 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2023-01-02T18:13:25.503 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:25.503 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 82 k 2023-01-02T18:13:25.503 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 341 k 2023-01-02T18:13:25.504 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:13:25.678 INFO:teuthology.orchestra.run.smithi057.stdout:cephadm-16.2.10-1543.gf2bb1478.el8.noarch.rpm 468 kB/s | 82 kB 00:00 2023-01-02T18:13:25.679 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:25.679 INFO:teuthology.orchestra.run.smithi057.stdout:Total 463 kB/s | 82 kB 00:00 2023-01-02T18:13:25.679 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:13:25.686 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:13:25.686 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:13:25.688 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:13:25.692 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:13:25.747 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:13:26.153 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:24 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:13:27.346 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:13:27.348 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:13:27.348 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:27.349 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:13:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 82 k 2023-01-02T18:13:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:27.349 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:13:27.349 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:27.350 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-02T18:13:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:27.350 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 82 k 2023-01-02T18:13:27.350 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 341 k 2023-01-02T18:13:27.350 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:13:27.387 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/1 2023-01-02T18:13:27.521 INFO:teuthology.orchestra.run.smithi007.stdout:cephadm-16.2.10-1543.gf2bb1478.el8.noarch.rpm 478 kB/s | 82 kB 00:00 2023-01-02T18:13:27.522 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:27.522 INFO:teuthology.orchestra.run.smithi007.stdout:Total 474 kB/s | 82 kB 00:00 2023-01-02T18:13:27.522 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:13:27.529 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:13:27.530 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:13:27.531 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:13:27.535 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:13:27.580 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/1 2023-01-02T18:13:27.593 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:13:27.793 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/1 2023-01-02T18:13:28.253 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/1 2023-01-02T18:13:28.253 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:28.253 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:13:28.253 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:28.254 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:28.254 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:13:28.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-immutable-object-cache 2023-01-02T18:13:29.265 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:28 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:13:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/1 2023-01-02T18:13:30.248 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/1 2023-01-02T18:13:30.456 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:13:30.457 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:30.457 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2023-01-02T18:13:30.457 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:30.458 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:13:30.458 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 161 k 2023-01-02T18:13:30.458 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:30.458 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:13:30.458 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:30.459 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2023-01-02T18:13:30.459 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:30.459 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 161 k 2023-01-02T18:13:30.459 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 470 k 2023-01-02T18:13:30.459 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:13:30.462 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/1 2023-01-02T18:13:30.666 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-immutable-object-cache-16.2.10-1543.gf2bb1 777 kB/s | 161 kB 00:00 2023-01-02T18:13:30.667 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:30.667 INFO:teuthology.orchestra.run.smithi057.stdout:Total 771 kB/s | 161 kB 00:00 2023-01-02T18:13:30.668 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:13:30.679 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:13:30.679 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:13:30.732 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:13:30.736 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:13:30.854 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:13:30.923 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/1 2023-01-02T18:13:30.923 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:30.923 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:13:30.923 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:30.924 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:30.924 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:13:31.016 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:16.2.10-1543.gf2bb1478 1/1 2023-01-02T18:13:31.125 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-immutable-object-cache 2023-01-02T18:13:31.418 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.10-1543.gf2bb1478 1/1 2023-01-02T18:13:31.815 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:29 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:13:31.877 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:16.2.10-1543.gf2bb1478 1/1 2023-01-02T18:13:31.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:31.878 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:13:31.878 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:31.878 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:31.878 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:13:32.074 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr 2023-01-02T18:13:32.759 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:31 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:13:33.006 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:13:33.007 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-02T18:13:33.007 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:33.008 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:13:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 161 k 2023-01-02T18:13:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:33.008 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:13:33.008 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:33.008 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-02T18:13:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:33.009 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 161 k 2023-01-02T18:13:33.009 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 470 k 2023-01-02T18:13:33.009 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:13:33.278 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-immutable-object-cache-16.2.10-1543.gf2bb1 596 kB/s | 161 kB 00:00 2023-01-02T18:13:33.279 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:33.279 INFO:teuthology.orchestra.run.smithi007.stdout:Total 594 kB/s | 161 kB 00:00 2023-01-02T18:13:33.279 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:13:33.291 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:13:33.291 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:13:33.344 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:13:33.348 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:13:33.481 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:13:33.643 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:16.2.10-1543.gf2bb1478 1/1 2023-01-02T18:13:33.847 INFO:teuthology.orchestra.run.smithi057.stdout:Package ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:13:33.956 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:13:33.957 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:13:33.958 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:13:34.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-dashboard 2023-01-02T18:13:34.062 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.10-1543.gf2bb1478 1/1 2023-01-02T18:13:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:16.2.10-1543.gf2bb1478 1/1 2023-01-02T18:13:34.599 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:34.599 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:13:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:13:34.600 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:34.600 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:13:34.726 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:33 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:13:34.815 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr 2023-01-02T18:13:35.502 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:33 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:13:35.931 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:13:35.932 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:35.932 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:13:35.932 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:35.933 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:13:35.933 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 3.1 M 2023-01-02T18:13:35.933 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-01-02T18:13:35.933 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards 2023-01-02T18:13:35.933 INFO:teuthology.orchestra.run.smithi057.stdout: noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 24 k 2023-01-02T18:13:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 15 k 2023-01-02T18:13:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-02T18:13:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-02T18:13:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-02T18:13:35.934 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:35.935 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:13:35.935 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:13:35.935 INFO:teuthology.orchestra.run.smithi057.stdout:Install 6 Packages 2023-01-02T18:13:35.935 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:35.936 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 3.4 M 2023-01-02T18:13:35.936 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 22 M 2023-01-02T18:13:35.936 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:13:36.086 INFO:teuthology.orchestra.run.smithi057.stdout:(1/6): ceph-grafana-dashboards-16.2.10-1543.gf2 160 kB/s | 24 kB 00:00 2023-01-02T18:13:36.111 INFO:teuthology.orchestra.run.smithi057.stdout:(2/6): ceph-prometheus-alerts-16.2.10-1543.gf2b 84 kB/s | 15 kB 00:00 2023-01-02T18:13:36.161 INFO:teuthology.orchestra.run.smithi057.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 567 kB/s | 43 kB 00:00 2023-01-02T18:13:36.236 INFO:teuthology.orchestra.run.smithi057.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 268 kB/s | 34 kB 00:00 2023-01-02T18:13:36.345 INFO:teuthology.orchestra.run.smithi057.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.0 MB/s | 196 kB 00:00 2023-01-02T18:13:36.512 INFO:teuthology.orchestra.run.smithi057.stdout:(6/6): ceph-mgr-dashboard-16.2.10-1543.gf2bb147 5.4 MB/s | 3.1 MB 00:00 2023-01-02T18:13:36.514 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:36.514 INFO:teuthology.orchestra.run.smithi057.stdout:Total 5.9 MB/s | 3.4 MB 00:00 2023-01-02T18:13:36.524 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:13:36.535 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:13:36.535 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:13:36.587 INFO:teuthology.orchestra.run.smithi007.stdout:Package ceph-mgr-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:13:36.695 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:13:36.696 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:13:36.697 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:13:36.706 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:13:36.709 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:13:36.786 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr-dashboard 2023-01-02T18:13:36.999 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:13:37.256 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-02T18:13:37.467 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-02T18:13:37.468 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:35 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:13:37.676 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-02T18:13:37.838 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:16.2.10-1543.gf2bb1478.el8. 4/6 2023-01-02T18:13:38.667 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:13:38.668 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:38.668 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:13:38.668 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:38.668 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:13:38.669 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 3.1 M 2023-01-02T18:13:38.669 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-02T18:13:38.669 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards 2023-01-02T18:13:38.669 INFO:teuthology.orchestra.run.smithi007.stdout: noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 24 k 2023-01-02T18:13:38.670 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 15 k 2023-01-02T18:13:38.670 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-BaseOS 43 k 2023-01-02T18:13:38.670 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-01-02T18:13:38.670 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-01-02T18:13:38.670 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:38.671 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:13:38.671 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:13:38.671 INFO:teuthology.orchestra.run.smithi007.stdout:Install 6 Packages 2023-01-02T18:13:38.671 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:38.672 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 3.4 M 2023-01-02T18:13:38.672 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 22 M 2023-01-02T18:13:38.672 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:13:38.853 INFO:teuthology.orchestra.run.smithi007.stdout:(1/6): ceph-grafana-dashboards-16.2.10-1543.gf2 133 kB/s | 24 kB 00:00 2023-01-02T18:13:38.881 INFO:teuthology.orchestra.run.smithi007.stdout:(2/6): ceph-prometheus-alerts-16.2.10-1543.gf2b 70 kB/s | 15 kB 00:00 2023-01-02T18:13:38.932 INFO:teuthology.orchestra.run.smithi007.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 542 kB/s | 43 kB 00:00 2023-01-02T18:13:38.938 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:16.2.10-1543.gf2bb1478.el8 5/6 2023-01-02T18:13:38.990 INFO:teuthology.orchestra.run.smithi007.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 310 kB/s | 34 kB 00:00 2023-01-02T18:13:39.091 INFO:teuthology.orchestra.run.smithi007.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 1.2 MB/s | 196 kB 00:00 2023-01-02T18:13:39.195 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:16.2.10-1543.gf2bb1478.el8.noar 6/6 2023-01-02T18:13:39.257 INFO:teuthology.orchestra.run.smithi007.stdout:(6/6): ceph-mgr-dashboard-16.2.10-1543.gf2bb147 5.3 MB/s | 3.1 MB 00:00 2023-01-02T18:13:39.260 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:39.260 INFO:teuthology.orchestra.run.smithi007.stdout:Total 5.8 MB/s | 3.4 MB 00:00 2023-01-02T18:13:39.271 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:13:39.281 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:13:39.282 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:13:39.447 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:13:39.451 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:13:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.10-1543.gf2bb1478.el8.noar 6/6 2023-01-02T18:13:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:16.2.10-1543.gf2bb1478.el8 1/6 2023-01-02T18:13:39.500 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:16.2.10-1543.gf2bb1478.el8.noar 2/6 2023-01-02T18:13:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:16.2.10-1543.gf2bb1478.el8. 3/6 2023-01-02T18:13:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-02T18:13:39.501 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-02T18:13:39.739 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:13:39.958 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2023-01-02T18:13:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-02T18:13:39.961 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:39.962 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:13:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:39.962 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-02T18:13:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-02T18:13:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-02T18:13:39.963 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:39.963 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:13:40.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-02T18:13:40.186 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2023-01-02T18:13:40.369 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2023-01-02T18:13:40.481 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:16.2.10-1543.gf2bb1478.el8. 4/6 2023-01-02T18:13:40.764 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:39 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:13:41.597 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:16.2.10-1543.gf2bb1478.el8 5/6 2023-01-02T18:13:41.870 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:16.2.10-1543.gf2bb1478.el8.noar 6/6 2023-01-02T18:13:41.957 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:13:41.958 INFO:teuthology.orchestra.run.smithi057.stdout:===================================================================================================== 2023-01-02T18:13:41.958 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:13:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:===================================================================================================== 2023-01-02T18:13:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:13:41.959 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 8.6 M 2023-01-02T18:13:41.959 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-01-02T18:13:41.959 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 8.5.0-17.el8 CentOS-BaseOS 645 k 2023-01-02T18:13:41.960 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 8.5.0-17.el8 CentOS-BaseOS 172 k 2023-01-02T18:13:41.960 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-02T18:13:41.960 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-02T18:13:41.960 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-02T18:13:41.961 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-02T18:13:41.961 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-02T18:13:41.961 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:13:41.961 INFO:teuthology.orchestra.run.smithi057.stdout:===================================================================================================== 2023-01-02T18:13:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:Install 8 Packages 2023-01-02T18:13:41.962 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:41.962 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 37 M 2023-01-02T18:13:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 210 M 2023-01-02T18:13:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:13:42.132 INFO:teuthology.orchestra.run.smithi057.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 28 MB/s | 4.7 MB 00:00 2023-01-02T18:13:42.149 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.10-1543.gf2bb1478.el8.noar 6/6 2023-01-02T18:13:42.149 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:16.2.10-1543.gf2bb1478.el8 1/6 2023-01-02T18:13:42.149 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:16.2.10-1543.gf2bb1478.el8.noar 2/6 2023-01-02T18:13:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:16.2.10-1543.gf2bb1478.el8. 3/6 2023-01-02T18:13:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2023-01-02T18:13:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2023-01-02T18:13:42.241 INFO:teuthology.orchestra.run.smithi057.stdout:(2/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 35 MB/s | 3.7 MB 00:00 2023-01-02T18:13:42.274 INFO:teuthology.orchestra.run.smithi057.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-02T18:13:42.357 INFO:teuthology.orchestra.run.smithi057.stdout:(4/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.9 MB 00:00 2023-01-02T18:13:42.408 INFO:teuthology.orchestra.run.smithi057.stdout:(5/8): libgfortran-8.5.0-17.el8.x86_64.rpm 13 MB/s | 645 kB 00:00 2023-01-02T18:13:42.442 INFO:teuthology.orchestra.run.smithi057.stdout:(6/8): libquadmath-8.5.0-17.el8.x86_64.rpm 5.1 MB/s | 172 kB 00:00 2023-01-02T18:13:42.640 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2023-01-02T18:13:42.641 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:42.641 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:13:42.641 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:42.641 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:42.641 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-01-02T18:13:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-01-02T18:13:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.4.1-12.el8.noarch 2023-01-02T18:13:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:42.642 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:13:42.667 INFO:teuthology.orchestra.run.smithi057.stdout:(7/8): python3-scipy-1.0.0-21.module_el8.5.0+77 35 MB/s | 14 MB 00:00 2023-01-02T18:13:42.782 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr-diskprediction-local 2023-01-02T18:13:43.100 INFO:teuthology.orchestra.run.smithi057.stdout:(8/8): ceph-mgr-diskprediction-local-16.2.10-15 7.5 MB/s | 8.6 MB 00:01 2023-01-02T18:13:43.103 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:43.103 INFO:teuthology.orchestra.run.smithi057.stdout:Total 32 MB/s | 37 MB 00:01 2023-01-02T18:13:43.339 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:13:43.359 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:13:43.359 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:13:43.471 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:41 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:13:43.696 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:13:43.700 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:13:44.300 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:13:44.455 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-8.5.0-17.el8.x86_64 1/8 2023-01-02T18:13:44.590 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libquadmath-8.5.0-17.el8.x86_64 1/8 2023-01-02T18:13:44.678 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:13:44.679 INFO:teuthology.orchestra.run.smithi007.stdout:===================================================================================================== 2023-01-02T18:13:44.680 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:13:44.680 INFO:teuthology.orchestra.run.smithi007.stdout:===================================================================================================== 2023-01-02T18:13:44.680 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:13:44.680 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 8.6 M 2023-01-02T18:13:44.680 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-02T18:13:44.681 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 8.5.0-17.el8 CentOS-BaseOS 645 k 2023-01-02T18:13:44.681 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 8.5.0-17.el8 CentOS-BaseOS 172 k 2023-01-02T18:13:44.681 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.15-4.el8 CentOS-AppStream 4.7 M 2023-01-02T18:13:44.681 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads x86_64 0.3.15-4.el8 CentOS-AppStream 4.9 M 2023-01-02T18:13:44.681 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2023-01-02T18:13:44.682 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2023-01-02T18:13:44.682 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2023-01-02T18:13:44.682 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:44.682 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:13:44.683 INFO:teuthology.orchestra.run.smithi007.stdout:===================================================================================================== 2023-01-02T18:13:44.683 INFO:teuthology.orchestra.run.smithi007.stdout:Install 8 Packages 2023-01-02T18:13:44.683 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:44.684 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 37 M 2023-01-02T18:13:44.684 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 210 M 2023-01-02T18:13:44.684 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:13:44.772 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-8.5.0-17.el8.x86_64 2/8 2023-01-02T18:13:44.868 INFO:teuthology.orchestra.run.smithi007.stdout:(1/8): openblas-0.3.15-4.el8.x86_64.rpm 25 MB/s | 4.7 MB 00:00 2023-01-02T18:13:44.969 INFO:teuthology.orchestra.run.smithi007.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 17 MB/s | 4.9 MB 00:00 2023-01-02T18:13:45.003 INFO:teuthology.orchestra.run.smithi007.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 6.6 MB/s | 225 kB 00:00 2023-01-02T18:13:45.086 INFO:teuthology.orchestra.run.smithi007.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 17 MB/s | 3.7 MB 00:00 2023-01-02T18:13:45.128 INFO:teuthology.orchestra.run.smithi007.stdout:(5/8): libgfortran-8.5.0-17.el8.x86_64.rpm 15 MB/s | 645 kB 00:00 2023-01-02T18:13:45.153 INFO:teuthology.orchestra.run.smithi007.stdout:(6/8): libquadmath-8.5.0-17.el8.x86_64.rpm 6.8 MB/s | 172 kB 00:00 2023-01-02T18:13:45.401 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libgfortran-8.5.0-17.el8.x86_64 2/8 2023-01-02T18:13:45.429 INFO:teuthology.orchestra.run.smithi007.stdout:(7/8): python3-scipy-1.0.0-21.module_el8.5.0+77 32 MB/s | 14 MB 00:00 2023-01-02T18:13:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-02T18:13:45.654 INFO:teuthology.orchestra.run.smithi007.stdout:(8/8): ceph-mgr-diskprediction-local-16.2.10-15 8.8 MB/s | 8.6 MB 00:00 2023-01-02T18:13:45.656 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:45.657 INFO:teuthology.orchestra.run.smithi007.stdout:Total 38 MB/s | 37 MB 00:00 2023-01-02T18:13:45.894 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:13:45.912 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:13:45.913 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:13:46.287 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:13:46.290 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:13:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-02T18:13:46.547 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-02T18:13:47.282 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:13:47.282 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-02T18:13:47.557 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-8.5.0-17.el8.x86_64 1/8 2023-01-02T18:13:47.614 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-02T18:13:47.708 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libquadmath-8.5.0-17.el8.x86_64 1/8 2023-01-02T18:13:47.848 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-8.5.0-17.el8.x86_64 2/8 2023-01-02T18:13:47.871 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-02T18:13:48.464 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libgfortran-8.5.0-17.el8.x86_64 2/8 2023-01-02T18:13:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2023-01-02T18:13:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2023-01-02T18:13:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-02T18:13:49.749 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-02T18:13:50.187 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2023-01-02T18:13:50.532 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2023-01-02T18:13:50.773 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-02T18:13:51.140 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-02T18:13:51.719 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.10-1543.gf2bb14 8/8 2023-01-02T18:13:52.647 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2023-01-02T18:13:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.10-1543.gf2bb14 8/8 2023-01-02T18:13:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.10-1543.gf2bb14 1/8 2023-01-02T18:13:52.669 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-02T18:13:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-02T18:13:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-02T18:13:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-02T18:13:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-02T18:13:52.670 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-8.5.0-17.el8.x86_64 7/8 2023-01-02T18:13:53.166 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-8.5.0-17.el8.x86_64 8/8 2023-01-02T18:13:53.166 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:53.166 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:13:53.167 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:53.167 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-8.5.0-17.el8.x86_64 2023-01-02T18:13:53.167 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-8.5.0-17.el8.x86_64 2023-01-02T18:13:53.167 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-02T18:13:53.168 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-02T18:13:53.168 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-02T18:13:53.168 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-02T18:13:53.169 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-02T18:13:53.169 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:53.169 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:13:53.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-rook 2023-01-02T18:13:53.966 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:01:52 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:13:54.066 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 7/8 2023-01-02T18:13:54.256 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.10-1543.gf2bb14 8/8 2023-01-02T18:13:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.10-1543.gf2bb14 8/8 2023-01-02T18:13:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.10-1543.gf2bb14 1/8 2023-01-02T18:13:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2023-01-02T18:13:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2023-01-02T18:13:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2023-01-02T18:13:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2023-01-02T18:13:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x 6/8 2023-01-02T18:13:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-8.5.0-17.el8.x86_64 7/8 2023-01-02T18:13:55.098 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-8.5.0-17.el8.x86_64 8/8 2023-01-02T18:13:55.098 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:55.098 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:13:55.099 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:13:55.099 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-8.5.0-17.el8.x86_64 2023-01-02T18:13:55.099 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-8.5.0-17.el8.x86_64 2023-01-02T18:13:55.100 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.15-4.el8.x86_64 2023-01-02T18:13:55.100 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-01-02T18:13:55.100 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-01-02T18:13:55.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-01-02T18:13:55.101 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-01-02T18:13:55.101 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:55.101 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:13:55.155 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:13:55.160 INFO:teuthology.orchestra.run.smithi057.stdout:========================================================================================= 2023-01-02T18:13:55.160 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:13:55.160 INFO:teuthology.orchestra.run.smithi057.stdout:========================================================================================= 2023-01-02T18:13:55.161 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:13:55.161 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 27 k 2023-01-02T18:13:55.161 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-01-02T18:13:55.162 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-02T18:13:55.162 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-02T18:13:55.162 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-02T18:13:55.163 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-02T18:13:55.163 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-02T18:13:55.163 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-02T18:13:55.163 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-02T18:13:55.163 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-02T18:13:55.164 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-02T18:13:55.164 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-02T18:13:55.164 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-02T18:13:55.164 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-02T18:13:55.165 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:55.165 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:13:55.165 INFO:teuthology.orchestra.run.smithi057.stdout:========================================================================================= 2023-01-02T18:13:55.165 INFO:teuthology.orchestra.run.smithi057.stdout:Install 13 Packages 2023-01-02T18:13:55.165 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:13:55.166 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 1.9 M 2023-01-02T18:13:55.166 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 24 M 2023-01-02T18:13:55.166 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:13:55.220 INFO:teuthology.orchestra.run.smithi057.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 442 kB/s | 27 kB 00:00 2023-01-02T18:13:55.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr-rook 2023-01-02T18:13:55.246 INFO:teuthology.orchestra.run.smithi057.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 234 kB/s | 20 kB 00:00 2023-01-02T18:13:55.271 INFO:teuthology.orchestra.run.smithi057.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-01-02T18:13:55.297 INFO:teuthology.orchestra.run.smithi057.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.3 MB/s | 110 kB 00:00 2023-01-02T18:13:55.321 INFO:teuthology.orchestra.run.smithi057.stdout:(5/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 3.0 MB/s | 155 kB 00:00 2023-01-02T18:13:55.347 INFO:teuthology.orchestra.run.smithi057.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 858 kB/s | 43 kB 00:00 2023-01-02T18:13:55.398 INFO:teuthology.orchestra.run.smithi057.stdout:(7/13): ceph-mgr-rook-16.2.10-1543.gf2bb1478.el 115 kB/s | 27 kB 00:00 2023-01-02T18:13:55.481 INFO:teuthology.orchestra.run.smithi057.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 122 kB/s | 16 kB 00:00 2023-01-02T18:13:55.506 INFO:teuthology.orchestra.run.smithi057.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 179 kB/s | 33 kB 00:00 2023-01-02T18:13:55.548 INFO:teuthology.orchestra.run.smithi057.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 540 kB/s | 81 kB 00:00 2023-01-02T18:13:55.624 INFO:teuthology.orchestra.run.smithi057.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 525 kB/s | 61 kB 00:00 2023-01-02T18:13:55.649 INFO:teuthology.orchestra.run.smithi057.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 610 kB/s | 61 kB 00:00 2023-01-02T18:13:55.916 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:53 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:13:56.124 INFO:teuthology.orchestra.run.smithi057.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.8 MB/s | 1.2 MB 00:00 2023-01-02T18:13:56.126 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:56.126 INFO:teuthology.orchestra.run.smithi057.stdout:Total 2.0 MB/s | 1.9 MB 00:00 2023-01-02T18:13:56.180 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:13:56.197 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:13:56.197 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:13:56.295 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:13:56.299 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:13:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:13:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-02T18:13:57.111 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:13:57.112 INFO:teuthology.orchestra.run.smithi007.stdout:========================================================================================= 2023-01-02T18:13:57.113 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:13:57.113 INFO:teuthology.orchestra.run.smithi007.stdout:========================================================================================= 2023-01-02T18:13:57.113 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:13:57.113 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 27 k 2023-01-02T18:13:57.114 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-02T18:13:57.114 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-01-02T18:13:57.114 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-01-02T18:13:57.114 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-01-02T18:13:57.115 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2023-01-02T18:13:57.115 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2023-01-02T18:13:57.115 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-01-02T18:13:57.116 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-BaseOS 155 k 2023-01-02T18:13:57.116 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2023-01-02T18:13:57.116 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2023-01-02T18:13:57.117 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-BaseOS 43 k 2023-01-02T18:13:57.117 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-01-02T18:13:57.117 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-01-02T18:13:57.118 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:57.118 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:13:57.118 INFO:teuthology.orchestra.run.smithi007.stdout:========================================================================================= 2023-01-02T18:13:57.118 INFO:teuthology.orchestra.run.smithi007.stdout:Install 13 Packages 2023-01-02T18:13:57.119 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:13:57.120 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 1.9 M 2023-01-02T18:13:57.120 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 24 M 2023-01-02T18:13:57.120 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:13:57.179 INFO:teuthology.orchestra.run.smithi007.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 430 kB/s | 27 kB 00:00 2023-01-02T18:13:57.228 INFO:teuthology.orchestra.run.smithi007.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 180 kB/s | 20 kB 00:00 2023-01-02T18:13:57.254 INFO:teuthology.orchestra.run.smithi007.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.7 MB/s | 126 kB 00:00 2023-01-02T18:13:57.279 INFO:teuthology.orchestra.run.smithi007.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 2.1 MB/s | 110 kB 00:00 2023-01-02T18:13:57.304 INFO:teuthology.orchestra.run.smithi007.stdout:(5/13): ceph-mgr-rook-16.2.10-1543.gf2bb1478.el 146 kB/s | 27 kB 00:00 2023-01-02T18:13:57.315 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-02T18:13:57.330 INFO:teuthology.orchestra.run.smithi007.stdout:(6/13): python3-requests-oauthlib-1.0.0-1.el8.n 846 kB/s | 43 kB 00:00 2023-01-02T18:13:57.372 INFO:teuthology.orchestra.run.smithi007.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 1.3 MB/s | 155 kB 00:00 2023-01-02T18:13:57.447 INFO:teuthology.orchestra.run.smithi007.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 139 kB/s | 16 kB 00:00 2023-01-02T18:13:57.472 INFO:teuthology.orchestra.run.smithi007.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 197 kB/s | 33 kB 00:00 2023-01-02T18:13:57.506 INFO:teuthology.orchestra.run.smithi007.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 608 kB/s | 81 kB 00:00 2023-01-02T18:13:57.556 INFO:teuthology.orchestra.run.smithi007.stdout:(11/13): python3-rsa-4.8-1.el8.noarch.rpm 736 kB/s | 61 kB 00:00 2023-01-02T18:13:57.581 INFO:teuthology.orchestra.run.smithi007.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 813 kB/s | 61 kB 00:00 2023-01-02T18:13:57.707 INFO:teuthology.orchestra.run.smithi007.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 4.5 MB/s | 1.2 MB 00:00 2023-01-02T18:13:57.708 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:13:57.709 INFO:teuthology.orchestra.run.smithi007.stdout:Total 3.2 MB/s | 1.9 MB 00:00 2023-01-02T18:13:57.761 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:13:57.777 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:13:57.778 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:13:57.876 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:13:57.880 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:13:57.918 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-02T18:13:58.195 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-02T18:13:58.412 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-02T18:13:58.413 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:13:58.654 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-02T18:13:58.727 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2023-01-02T18:13:58.933 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2023-01-02T18:13:59.000 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-02T18:13:59.184 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.8-1.el8.noarch 3/13 2023-01-02T18:13:59.202 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-02T18:13:59.454 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2023-01-02T18:13:59.662 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2023-01-02T18:13:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2023-01-02T18:14:00.208 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2023-01-02T18:14:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-02T18:14:00.446 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2023-01-02T18:14:00.585 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-02T18:14:00.786 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-02T18:14:00.944 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-02T18:14:01.087 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:16.2.10-1543.gf2bb1478.el8.noarch 13/13 2023-01-02T18:14:01.395 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.10-1543.gf2bb1478.el8.noarch 13/13 2023-01-02T18:14:01.395 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:16.2.10-1543.gf2bb1478.el8.noarch 1/13 2023-01-02T18:14:01.396 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-02T18:14:01.396 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-02T18:14:01.396 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-02T18:14:01.396 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-02T18:14:01.396 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-02T18:14:01.397 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-02T18:14:01.397 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-02T18:14:01.397 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-02T18:14:01.397 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-02T18:14:01.397 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-02T18:14:01.398 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-02T18:14:01.562 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2023-01-02T18:14:01.812 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2023-01-02T18:14:01.937 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-02T18:14:01.937 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:01.937 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:14:01.938 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:14:01.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-02T18:14:01.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-02T18:14:01.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-02T18:14:01.938 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-02T18:14:01.939 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-02T18:14:01.939 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-02T18:14:01.939 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-02T18:14:01.939 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-02T18:14:01.939 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-02T18:14:01.940 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-02T18:14:01.940 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-02T18:14:01.940 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-02T18:14:01.940 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:01.940 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:02.037 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2023-01-02T18:14:02.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-mgr-cephadm 2023-01-02T18:14:02.204 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2023-01-02T18:14:02.346 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:16.2.10-1543.gf2bb1478.el8.noarch 13/13 2023-01-02T18:14:02.670 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.10-1543.gf2bb1478.el8.noarch 13/13 2023-01-02T18:14:02.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:16.2.10-1543.gf2bb1478.el8.noarch 1/13 2023-01-02T18:14:02.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2023-01-02T18:14:02.670 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2023-01-02T18:14:02.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2023-01-02T18:14:02.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2023-01-02T18:14:02.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2023-01-02T18:14:02.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2023-01-02T18:14:02.671 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2023-01-02T18:14:02.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2023-01-02T18:14:02.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2023-01-02T18:14:02.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2023-01-02T18:14:02.672 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 12/13 2023-01-02T18:14:02.758 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:01 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:03.340 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2023-01-02T18:14:03.340 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:03.340 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:14:03.340 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:14:03.341 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-01-02T18:14:03.341 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-01-02T18:14:03.341 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-01-02T18:14:03.341 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-01-02T18:14:03.342 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-01-02T18:14:03.342 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-01-02T18:14:03.342 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-01-02T18:14:03.342 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-01-02T18:14:03.343 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-01-02T18:14:03.343 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-01-02T18:14:03.343 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.8-1.el8.noarch 2023-01-02T18:14:03.343 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-01-02T18:14:03.343 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:03.344 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:03.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-mgr-cephadm 2023-01-02T18:14:03.948 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:03.949 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:03.949 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:14:03.950 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:03.950 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:14:03.950 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 114 k 2023-01-02T18:14:03.950 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-01-02T18:14:03.950 INFO:teuthology.orchestra.run.smithi057.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-01-02T18:14:03.951 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-02T18:14:03.951 INFO:teuthology.orchestra.run.smithi057.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-01-02T18:14:03.951 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-02T18:14:03.951 INFO:teuthology.orchestra.run.smithi057.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-01-02T18:14:03.951 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:03.952 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:14:03.952 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:03.952 INFO:teuthology.orchestra.run.smithi057.stdout:Install 6 Packages 2023-01-02T18:14:03.952 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:03.953 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 5.8 M 2023-01-02T18:14:03.953 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 24 M 2023-01-02T18:14:03.953 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:14:04.024 INFO:teuthology.orchestra.run.smithi057.stdout:(1/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 7.3 MB/s | 538 kB 00:00 2023-01-02T18:14:04.124 INFO:teuthology.orchestra.run.smithi057.stdout:(2/6): python3-babel-2.5.1-7.el8.noarch.rpm 28 MB/s | 4.8 MB 00:00 2023-01-02T18:14:04.150 INFO:teuthology.orchestra.run.smithi057.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 170 kB/s | 21 kB 00:00 2023-01-02T18:14:04.153 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:02 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:04.175 INFO:teuthology.orchestra.run.smithi057.stdout:(4/6): ceph-mgr-cephadm-16.2.10-1543.gf2bb1478. 511 kB/s | 114 kB 00:00 2023-01-02T18:14:04.225 INFO:teuthology.orchestra.run.smithi057.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 651 kB/s | 49 kB 00:00 2023-01-02T18:14:04.367 INFO:teuthology.orchestra.run.smithi057.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.4 MB/s | 355 kB 00:00 2023-01-02T18:14:04.369 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:04.369 INFO:teuthology.orchestra.run.smithi057.stdout:Total 14 MB/s | 5.8 MB 00:00 2023-01-02T18:14:04.421 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:14:04.431 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:14:04.431 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:14:04.557 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:14:04.560 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:14:04.852 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:14:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-01-02T18:14:05.344 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:05.345 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:14:05.345 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:05.346 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:14:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:16.2.10-1543.gf2bb1478.el8 ceph-noarch 114 k 2023-01-02T18:14:05.346 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-02T18:14:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2023-01-02T18:14:05.346 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2023-01-02T18:14:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2023-01-02T18:14:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2023-01-02T18:14:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2023-01-02T18:14:05.347 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:05.347 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:14:05.347 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:05.348 INFO:teuthology.orchestra.run.smithi007.stdout:Install 6 Packages 2023-01-02T18:14:05.348 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:05.348 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 5.8 M 2023-01-02T18:14:05.349 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 24 M 2023-01-02T18:14:05.349 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:14:05.373 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-01-02T18:14:05.430 INFO:teuthology.orchestra.run.smithi007.stdout:(1/6): python3-jinja2-2.10.1-3.el8.noarch.rpm 6.4 MB/s | 538 kB 00:00 2023-01-02T18:14:05.555 INFO:teuthology.orchestra.run.smithi007.stdout:(2/6): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-01-02T18:14:05.572 INFO:teuthology.orchestra.run.smithi007.stdout:(3/6): ceph-mgr-cephadm-16.2.10-1543.gf2bb1478. 508 kB/s | 114 kB 00:00 2023-01-02T18:14:05.606 INFO:teuthology.orchestra.run.smithi007.stdout:(4/6): python3-apipkg-1.5-6.el8.noarch.rpm 121 kB/s | 21 kB 00:00 2023-01-02T18:14:05.739 INFO:teuthology.orchestra.run.smithi007.stdout:(5/6): python3-remoto-1.2.1-1.el8.noarch.rpm 292 kB/s | 49 kB 00:00 2023-01-02T18:14:05.789 INFO:teuthology.orchestra.run.smithi007.stdout:(6/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.5 MB/s | 355 kB 00:00 2023-01-02T18:14:05.791 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:05.791 INFO:teuthology.orchestra.run.smithi007.stdout:Total 13 MB/s | 5.8 MB 00:00 2023-01-02T18:14:05.844 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:14:05.854 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:14:05.854 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:14:06.002 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:14:06.006 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:14:06.290 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:14:06.352 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-01-02T18:14:06.566 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2023-01-02T18:14:06.771 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-01-02T18:14:06.858 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2023-01-02T18:14:07.028 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-01-02T18:14:07.235 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 6/6 2023-01-02T18:14:07.503 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 6/6 2023-01-02T18:14:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/6 2023-01-02T18:14:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-01-02T18:14:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-01-02T18:14:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-01-02T18:14:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-01-02T18:14:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2023-01-02T18:14:07.989 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-01-02T18:14:07.990 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:07.990 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:14:07.990 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:14:07.990 INFO:teuthology.orchestra.run.smithi057.stdout: python3-apipkg-1.5-6.el8.noarch 2023-01-02T18:14:07.991 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-02T18:14:07.991 INFO:teuthology.orchestra.run.smithi057.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-01-02T18:14:07.991 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-02T18:14:07.991 INFO:teuthology.orchestra.run.smithi057.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-01-02T18:14:07.991 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:07.992 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:08.108 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-fuse 2023-01-02T18:14:08.389 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2023-01-02T18:14:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 5/6 2023-01-02T18:14:08.793 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:07 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:08.953 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 6/6 2023-01-02T18:14:09.268 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 6/6 2023-01-02T18:14:09.268 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 1/6 2023-01-02T18:14:09.268 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2023-01-02T18:14:09.269 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/6 2023-01-02T18:14:09.269 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2023-01-02T18:14:09.269 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2023-01-02T18:14:09.765 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2023-01-02T18:14:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:09.766 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:14:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:16.2.10-1543.gf2bb1478.el8.noarch 2023-01-02T18:14:09.766 INFO:teuthology.orchestra.run.smithi007.stdout: python3-apipkg-1.5-6.el8.noarch 2023-01-02T18:14:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.5.1-7.el8.noarch 2023-01-02T18:14:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-execnet-1.7.1-1.el8.noarch 2023-01-02T18:14:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-01-02T18:14:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: python3-remoto-1.2.1-1.el8.noarch 2023-01-02T18:14:09.767 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:09.768 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:09.892 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-fuse 2023-01-02T18:14:10.004 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:10.004 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:10.005 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2023-01-02T18:14:10.005 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:10.005 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:14:10.005 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 908 k 2023-01-02T18:14:10.006 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2023-01-02T18:14:10.006 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-02T18:14:10.006 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:10.006 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:14:10.006 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:10.006 INFO:teuthology.orchestra.run.smithi057.stdout:Install 2 Packages 2023-01-02T18:14:10.007 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:10.007 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 991 k 2023-01-02T18:14:10.007 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 2.8 M 2023-01-02T18:14:10.008 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:14:10.076 INFO:teuthology.orchestra.run.smithi057.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-01-02T18:14:10.285 INFO:teuthology.orchestra.run.smithi057.stdout:(2/2): ceph-fuse-16.2.10-1543.gf2bb1478.el8.x86 3.2 MB/s | 908 kB 00:00 2023-01-02T18:14:10.286 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:10.286 INFO:teuthology.orchestra.run.smithi057.stdout:Total 3.4 MB/s | 991 kB 00:00 2023-01-02T18:14:10.296 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:14:10.318 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:14:10.318 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:14:10.410 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:14:10.414 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:14:10.578 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:08 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:10.594 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:14:10.855 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-02T18:14:11.042 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/2 2023-01-02T18:14:11.433 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/2 2023-01-02T18:14:11.433 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/2 2023-01-02T18:14:11.776 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:11.777 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-01-02T18:14:11.778 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:11.778 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:14:11.778 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 908 k 2023-01-02T18:14:11.779 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-01-02T18:14:11.779 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.7-16.el8 CentOS-BaseOS 83 k 2023-01-02T18:14:11.779 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:11.779 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:14:11.780 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:11.780 INFO:teuthology.orchestra.run.smithi007.stdout:Install 2 Packages 2023-01-02T18:14:11.780 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:11.781 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 991 k 2023-01-02T18:14:11.781 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 2.8 M 2023-01-02T18:14:11.781 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:14:11.831 INFO:teuthology.orchestra.run.smithi007.stdout:(1/2): fuse-2.9.7-16.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-01-02T18:14:11.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-02T18:14:11.913 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:11.913 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:14:11.913 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-02T18:14:11.913 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:11.914 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:12.073 INFO:teuthology.orchestra.run.smithi007.stdout:(2/2): ceph-fuse-16.2.10-1543.gf2bb1478.el8.x86 3.0 MB/s | 908 kB 00:00 2023-01-02T18:14:12.074 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:12.074 INFO:teuthology.orchestra.run.smithi007.stdout:Total 3.3 MB/s | 991 kB 00:00 2023-01-02T18:14:12.084 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:14:12.106 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:14:12.106 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:14:12.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados-devel 2023-01-02T18:14:12.198 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:14:12.202 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:14:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:14:12.673 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.7-16.el8.x86_64 1/2 2023-01-02T18:14:12.851 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/2 2023-01-02T18:14:12.883 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:11 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:13.251 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 2/2 2023-01-02T18:14:13.251 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/2 2023-01-02T18:14:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.7-16.el8.x86_64 2/2 2023-01-02T18:14:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:13.917 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:14:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 fuse-2.9.7-16.el8.x86_64 2023-01-02T18:14:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:13.918 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:14.122 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:14.123 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:14.124 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2023-01-02T18:14:14.124 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:14.124 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:14:14.124 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 131 k 2023-01-02T18:14:14.125 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:14.125 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:14:14.125 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:14.125 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2023-01-02T18:14:14.125 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:14.126 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 131 k 2023-01-02T18:14:14.126 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 432 k 2023-01-02T18:14:14.126 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:14:14.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install librados-devel 2023-01-02T18:14:14.318 INFO:teuthology.orchestra.run.smithi057.stdout:librados-devel-16.2.10-1543.gf2bb1478.el8.x86_6 682 kB/s | 131 kB 00:00 2023-01-02T18:14:14.319 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:14.319 INFO:teuthology.orchestra.run.smithi057.stdout:Total 671 kB/s | 131 kB 00:00 2023-01-02T18:14:14.320 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:14:14.325 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:14:14.326 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:14:14.382 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:14:14.385 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:14:14.504 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:14:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:14.845 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:12 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:14.967 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:15.420 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:15.420 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:15.420 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:14:15.420 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:15.420 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:15.421 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:15.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs2 2023-01-02T18:14:16.035 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:16.036 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:16.036 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-02T18:14:16.036 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:16.037 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:14:16.037 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 131 k 2023-01-02T18:14:16.037 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:16.037 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:14:16.037 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:16.038 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-02T18:14:16.038 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:16.038 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 131 k 2023-01-02T18:14:16.038 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 432 k 2023-01-02T18:14:16.038 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:14:16.237 INFO:teuthology.orchestra.run.smithi007.stdout:librados-devel-16.2.10-1543.gf2bb1478.el8.x86_6 656 kB/s | 131 kB 00:00 2023-01-02T18:14:16.238 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:16.238 INFO:teuthology.orchestra.run.smithi007.stdout:Total 652 kB/s | 131 kB 00:00 2023-01-02T18:14:16.238 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:14:16.243 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:14:16.244 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:14:16.299 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:14:16.302 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:14:16.315 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:15 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:16.416 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:14:16.608 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:17.334 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:17.335 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:14:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:17.336 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:17.396 INFO:teuthology.orchestra.run.smithi057.stdout:Package libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:17.505 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:17.507 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:14:17.507 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:17.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install libcephfs2 2023-01-02T18:14:17.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install libcephfs-devel 2023-01-02T18:14:18.236 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:16 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:18.287 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:17 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:19.332 INFO:teuthology.orchestra.run.smithi007.stdout:Package libcephfs2-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:19.441 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:19.442 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:14:19.443 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:19.481 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:19.482 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:19.482 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2023-01-02T18:14:19.482 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:19.482 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:14:19.482 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 25 k 2023-01-02T18:14:19.483 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:19.483 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:14:19.483 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:19.483 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2023-01-02T18:14:19.483 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:19.484 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 25 k 2023-01-02T18:14:19.484 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 107 k 2023-01-02T18:14:19.484 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:14:19.824 INFO:teuthology.orchestra.run.smithi057.stdout:libcephfs-devel-16.2.10-1543.gf2bb1478.el8.x86_ 75 kB/s | 25 kB 00:00 2023-01-02T18:14:19.825 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:19.825 INFO:teuthology.orchestra.run.smithi057.stdout:Total 74 kB/s | 25 kB 00:00 2023-01-02T18:14:19.825 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:14:19.828 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:14:19.829 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:14:19.831 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:14:19.835 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:14:19.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install libcephfs-devel 2023-01-02T18:14:19.907 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:14:20.098 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:20.353 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:20.533 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:18 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:20.824 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:14:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:20.825 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:20.825 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:20.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librados2 2023-01-02T18:14:21.639 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:20 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:21.723 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:21.724 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:21.724 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-02T18:14:21.724 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:21.724 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:14:21.724 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 25 k 2023-01-02T18:14:21.725 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:21.725 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:14:21.725 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:21.725 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-02T18:14:21.725 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:21.726 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 25 k 2023-01-02T18:14:21.726 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 107 k 2023-01-02T18:14:21.726 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:14:21.895 INFO:teuthology.orchestra.run.smithi007.stdout:libcephfs-devel-16.2.10-1543.gf2bb1478.el8.x86_ 149 kB/s | 25 kB 00:00 2023-01-02T18:14:21.896 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:21.896 INFO:teuthology.orchestra.run.smithi007.stdout:Total 148 kB/s | 25 kB 00:00 2023-01-02T18:14:21.896 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:14:21.899 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:14:21.900 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:14:21.902 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:14:21.906 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:14:21.961 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:14:22.157 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:22.418 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:22.743 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:22.854 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:22.856 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:14:22.856 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:22.859 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:22.860 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:22.860 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:14:22.860 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:22.860 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:22.861 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:22.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install librbd1 2023-01-02T18:14:22.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install librados2 2023-01-02T18:14:23.633 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:22 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:23.676 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:21 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:24.738 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:24.757 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:24.852 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:24.854 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:14:24.854 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:24.867 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:24.868 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:14:24.869 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:24.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install librbd1 2023-01-02T18:14:25.245 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rados 2023-01-02T18:14:25.661 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:23 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:25.930 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:24 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:26.746 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:26.853 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:26.854 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:14:26.855 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:26.953 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install python3-rados 2023-01-02T18:14:27.018 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rados-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:27.128 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:27.129 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:14:27.129 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:27.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rgw 2023-01-02T18:14:27.634 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:25 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:27.910 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:26 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:28.720 INFO:teuthology.orchestra.run.smithi007.stdout:Package python3-rados-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:28.828 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:28.830 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:14:28.830 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:28.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install python3-rgw 2023-01-02T18:14:28.993 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:29.103 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:29.104 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:14:29.105 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:29.202 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-cephfs 2023-01-02T18:14:29.630 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:27 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:29.889 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:28 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:30.717 INFO:teuthology.orchestra.run.smithi007.stdout:Package python3-rgw-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:30.827 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:30.829 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:14:30.829 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:30.932 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install python3-cephfs 2023-01-02T18:14:30.968 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-cephfs-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:31.078 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:31.080 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:14:31.080 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:31.174 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install python3-rbd 2023-01-02T18:14:31.620 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:29 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:31.861 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:30 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:32.704 INFO:teuthology.orchestra.run.smithi007.stdout:Package python3-cephfs-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:32.814 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:32.816 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:14:32.816 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:32.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install python3-rbd 2023-01-02T18:14:32.948 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-rbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:33.058 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:33.059 INFO:teuthology.orchestra.run.smithi057.stdout:Nothing to do. 2023-01-02T18:14:33.059 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:33.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-fuse 2023-01-02T18:14:33.611 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:31 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:33.839 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:32 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:34.691 INFO:teuthology.orchestra.run.smithi007.stdout:Package python3-rbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 is already installed. 2023-01-02T18:14:34.801 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:34.802 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-01-02T18:14:34.803 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:34.913 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install rbd-fuse 2023-01-02T18:14:35.034 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:35.035 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:35.035 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2023-01-02T18:14:35.036 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:35.036 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:14:35.036 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 88 k 2023-01-02T18:14:35.036 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:35.036 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:14:35.037 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:35.037 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2023-01-02T18:14:35.037 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:35.038 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 88 k 2023-01-02T18:14:35.038 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 240 k 2023-01-02T18:14:35.038 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:14:35.355 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-fuse-16.2.10-1543.gf2bb1478.el8.x86_64.rpm 277 kB/s | 88 kB 00:00 2023-01-02T18:14:35.356 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:35.356 INFO:teuthology.orchestra.run.smithi057.stdout:Total 276 kB/s | 88 kB 00:00 2023-01-02T18:14:35.357 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:14:35.367 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:14:35.367 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:14:35.423 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:14:35.427 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:14:35.538 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:14:35.598 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:33 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:35.712 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:35.997 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:36.480 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:36.480 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:36.480 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:14:36.481 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:36.481 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:36.481 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:36.788 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:36.789 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:36.789 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-02T18:14:36.790 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:36.790 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:14:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 88 k 2023-01-02T18:14:36.791 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:36.791 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:14:36.792 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:36.792 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-02T18:14:36.792 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:36.793 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 88 k 2023-01-02T18:14:36.793 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 240 k 2023-01-02T18:14:36.794 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:14:36.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-mirror 2023-01-02T18:14:37.150 INFO:teuthology.orchestra.run.smithi007.stdout:rbd-fuse-16.2.10-1543.gf2bb1478.el8.x86_64.rpm 245 kB/s | 88 kB 00:00 2023-01-02T18:14:37.151 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:37.151 INFO:teuthology.orchestra.run.smithi007.stdout:Total 245 kB/s | 88 kB 00:00 2023-01-02T18:14:37.151 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:14:37.161 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:14:37.162 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:14:37.221 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:14:37.225 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:14:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:14:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:37.548 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:36 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:37.802 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:38.286 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:38.286 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:38.287 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:14:38.287 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:38.287 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:38.287 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:38.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install rbd-mirror 2023-01-02T18:14:38.734 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:38.734 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:38.735 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repo Size 2023-01-02T18:14:38.735 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:38.735 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:14:38.735 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 3.7 M 2023-01-02T18:14:38.735 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:38.736 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:14:38.736 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:38.736 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2023-01-02T18:14:38.736 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:38.737 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 3.7 M 2023-01-02T18:14:38.737 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 15 M 2023-01-02T18:14:38.737 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:14:39.214 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:37 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:39.752 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-mirror-16.2.10-1543.gf2bb1478.el8.x86_64.rp 3.6 MB/s | 3.7 MB 00:01 2023-01-02T18:14:39.753 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:39.753 INFO:teuthology.orchestra.run.smithi057.stdout:Total 3.6 MB/s | 3.7 MB 00:01 2023-01-02T18:14:39.754 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:14:39.767 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:14:39.767 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:14:39.839 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:14:39.842 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:14:40.307 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:14:40.411 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repo Size 2023-01-02T18:14:40.412 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 3.7 M 2023-01-02T18:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:14:40.413 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-02T18:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:40.414 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 3.7 M 2023-01-02T18:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 15 M 2023-01-02T18:14:40.415 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:14:40.505 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:40.933 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:41.208 INFO:teuthology.orchestra.run.smithi007.stdout:rbd-mirror-16.2.10-1543.gf2bb1478.el8.x86_64.rp 4.6 MB/s | 3.7 MB 00:00 2023-01-02T18:14:41.209 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:41.209 INFO:teuthology.orchestra.run.smithi007.stdout:Total 4.6 MB/s | 3.7 MB 00:00 2023-01-02T18:14:41.210 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:14:41.222 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:14:41.223 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:14:41.294 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:14:41.297 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:14:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:41.407 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:41.408 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:14:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:41.408 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:41.408 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:41.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install rbd-nbd 2023-01-02T18:14:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:14:42.206 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:42.295 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:02:41 ago on Mon 02 Jan 2023 06:12:01 PM UTC. 2023-01-02T18:14:42.640 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:43.111 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:43.112 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:43.112 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:14:43.112 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:43.112 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:43.113 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:43.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install rbd-nbd 2023-01-02T18:14:43.486 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2023-01-02T18:14:43.487 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:43.487 INFO:teuthology.orchestra.run.smithi057.stdout: Package Architecture Version Repository Size 2023-01-02T18:14:43.487 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:43.488 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2023-01-02T18:14:43.488 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 173 k 2023-01-02T18:14:43.488 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:43.488 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2023-01-02T18:14:43.488 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2023-01-02T18:14:43.489 INFO:teuthology.orchestra.run.smithi057.stdout:Install 1 Package 2023-01-02T18:14:43.489 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:43.489 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 173 k 2023-01-02T18:14:43.489 INFO:teuthology.orchestra.run.smithi057.stdout:Installed size: 519 k 2023-01-02T18:14:43.489 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2023-01-02T18:14:43.748 INFO:teuthology.orchestra.run.smithi057.stdout:rbd-nbd-16.2.10-1543.gf2bb1478.el8.x86_64.rpm 667 kB/s | 173 kB 00:00 2023-01-02T18:14:43.749 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:43.749 INFO:teuthology.orchestra.run.smithi057.stdout:Total 664 kB/s | 173 kB 00:00 2023-01-02T18:14:43.749 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2023-01-02T18:14:43.761 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2023-01-02T18:14:43.761 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2023-01-02T18:14:43.816 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2023-01-02T18:14:43.820 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2023-01-02T18:14:43.945 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2023-01-02T18:14:44.048 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:02:42 ago on Mon 02 Jan 2023 06:12:02 PM UTC. 2023-01-02T18:14:44.135 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:44.417 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-nbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:44.926 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:44.926 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2023-01-02T18:14:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:44.927 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:44.927 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2023-01-02T18:14:45.137 DEBUG:teuthology.parallel:result is None 2023-01-02T18:14:45.259 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-01-02T18:14:45.260 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:45.260 INFO:teuthology.orchestra.run.smithi007.stdout: Package Architecture Version Repository Size 2023-01-02T18:14:45.260 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:45.260 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-01-02T18:14:45.261 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:16.2.10-1543.gf2bb1478.el8 ceph 173 k 2023-01-02T18:14:45.261 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:45.261 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-01-02T18:14:45.261 INFO:teuthology.orchestra.run.smithi007.stdout:================================================================================ 2023-01-02T18:14:45.261 INFO:teuthology.orchestra.run.smithi007.stdout:Install 1 Package 2023-01-02T18:14:45.262 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:45.262 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 173 k 2023-01-02T18:14:45.262 INFO:teuthology.orchestra.run.smithi007.stdout:Installed size: 519 k 2023-01-02T18:14:45.262 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-01-02T18:14:45.487 INFO:teuthology.orchestra.run.smithi007.stdout:rbd-nbd-16.2.10-1543.gf2bb1478.el8.x86_64.rpm 765 kB/s | 173 kB 00:00 2023-01-02T18:14:45.488 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-01-02T18:14:45.489 INFO:teuthology.orchestra.run.smithi007.stdout:Total 760 kB/s | 173 kB 00:00 2023-01-02T18:14:45.489 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-01-02T18:14:45.500 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-01-02T18:14:45.500 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-01-02T18:14:45.556 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-01-02T18:14:45.559 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-01-02T18:14:45.696 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-01-02T18:14:46.020 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:46.291 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-nbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:46.744 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 1/1 2023-01-02T18:14:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:46.745 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-01-02T18:14:46.745 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:16.2.10-1543.gf2bb1478.el8.x86_64 2023-01-02T18:14:46.746 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:46.746 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-01-02T18:14:46.980 DEBUG:teuthology.parallel:result is None 2023-01-02T18:14:46.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo lsb_release -is 2023-01-02T18:14:47.020 INFO:teuthology.orchestra.run.smithi007.stdout:CentOSStream 2023-01-02T18:14:47.022 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-02T18:14:47.023 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-02T18:14:47.205 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-02T18:14:47.228 INFO:teuthology.orchestra.run.smithi007.stdout:16.2.10-1543.gf2bb1478.el8 2023-01-02T18:14:47.229 INFO:teuthology.packaging:The installed version of ceph is 16.2.10-1543.gf2bb1478.el8 2023-01-02T18:14:47.229 INFO:teuthology.task.install:The correct ceph version 16.2.10-1543.gf2bb1478 is installed. 2023-01-02T18:14:47.229 DEBUG:teuthology.orchestra.run.smithi057:> sudo lsb_release -is 2023-01-02T18:14:47.275 INFO:teuthology.orchestra.run.smithi057.stdout:CentOSStream 2023-01-02T18:14:47.277 DEBUG:teuthology.misc:System to be installed: CentOSStream 2023-01-02T18:14:47.277 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f2bb1478686242c0f68882a9cf8df4e0f8363116 2023-01-02T18:14:47.427 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-01-02T18:14:47.452 INFO:teuthology.orchestra.run.smithi057.stdout:16.2.10-1543.gf2bb1478.el8 2023-01-02T18:14:47.453 INFO:teuthology.packaging:The installed version of ceph is 16.2.10-1543.gf2bb1478.el8 2023-01-02T18:14:47.453 INFO:teuthology.task.install:The correct ceph version 16.2.10-1543.gf2bb1478 is installed. 2023-01-02T18:14:47.454 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-01-02T18:14:47.454 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:47.454 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-02T18:14:47.483 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:14:47.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-01-02T18:14:47.523 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-01-02T18:14:47.523 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:47.524 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2023-01-02T18:14:47.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-02T18:14:47.619 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:14:47.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2023-01-02T18:14:47.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-01-02T18:14:47.722 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-01-02T18:14:47.723 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:47.723 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-02T18:14:47.751 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-02T18:14:47.819 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:14:47.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2023-01-02T18:14:47.852 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-01-02T18:14:47.924 INFO:teuthology.run_tasks:Running task ceph... 2023-01-02T18:14:47.991 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-01-02T18:14:47.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2023-01-02T18:14:47.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2023-01-02T18:14:48.024 INFO:tasks.ceph:Disabling ceph logrotate... 2023-01-02T18:14:48.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-02T18:14:48.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2023-01-02T18:14:48.093 INFO:tasks.ceph:Creating extra log directories... 2023-01-02T18:14:48.094 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-02T18:14:48.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-01-02T18:14:48.173 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-01-02T18:14:48.174 INFO:tasks.ceph:config {'conf': {'client': {'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-01-02T18:14:48.174 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi/7131281', 'branch': 'pacific_16.2.11_RC4', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/rbd_api_tests_copy_on_read}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '7131281', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-01-02_16:41:15-rbd-pacific_16.2.11_RC4-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'pacific_16.2.11_RC4'}, 'ceph': {'conf': {'client': {'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'pacific_qa', 'sha1': '623bc557440f012d459eb3c5ded0a7dee57ecdb1'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 70, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116', 'sleep_before_teardown': 0, 'suite': 'rbd', 'suite_branch': 'pacific_qa', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_623bc557440f012d459eb3c5ded0a7dee57ecdb1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '623bc557440f012d459eb3c5ded0a7dee57ecdb1', 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAlm7QLOBnUG04bivDG/Yv07gb8+f1R9yllotKVGx8n5T6q9frkMikhxPDCKA49sf7pZMVmpwSiprKNbJmXI7KM=', 'smithi057.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6KMe9xt154byMvo0EX53KLmOUUflz9VszA7hR7+ZKqJp5MHa+YvhGyedZXxqbh4sDu/xH4ksklseUPwdPAqbbyxZvT+e8gZI1mZIdcc8eDf/x7ar0SV6P2OFXV9AmXyuXcnXru1vG1bG/xNQ1/5eeFVhbJ9G9Q03su5FXx71rQyHjcjOJ4zuRWX66ZSYecKl8PaUwRQ0wN7LCWtWlUra+ibtnPAkd13bCpRCm6LZJ3VGnmZ6txgYnOOLcCZB4IojbUAJK5o4HOcM5RofZJKMbCrFtitYrkpmYPBIWus0PoYFM4yFGix9+X7bFcTGsvt0WuRMzIJKb0HVkjtovvlTO1QsjcNqXMEac5EcL5nLIzSoumGpg4SnpqZqMTtbKcURn0Wmw6wBxeOcE1IajwO69LTD+GMdJ+plnwuw8Vy65G/DfrsgivOrsItclw8vmZesSzjgxLAYkkdlpRhIUbjcsj/C69LfYDvsdWw4+XGcZpLRovtzU4nWnlOO6Wnn6chs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rbd/test_librbd.sh']}, 'env': {'RBD_FEATURES': '61'}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '19d18db866afdc31fd6586f558fc29b95a87ccfb', 'timestamp': '2023-01-02_16:41:15', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.32458'} 2023-01-02T18:14:48.175 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-02T18:14:48.197 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-01-02T18:14:48.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2023-01-02T18:14:48.255 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2023-01-02T18:14:48.290 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:48.290 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/scratch_devs of=/dev/stdout 2023-01-02T18:14:48.338 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-02T18:14:48.338 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_1 2023-01-02T18:14:48.395 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-02T18:14:48.396 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-02T18:14:48.396 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 377924 Links: 1 2023-01-02T18:14:48.396 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-02T18:14:48.396 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-01-02T18:14:48.396 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-01-02 18:14:42.399117648 +0000 2023-01-02T18:14:48.397 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-01-02 18:11:11.469090532 +0000 2023-01-02T18:14:48.397 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-01-02 18:11:11.469090532 +0000 2023-01-02T18:14:48.397 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-01-02T18:14:48.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-02T18:14:48.462 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-01-02T18:14:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-01-02T18:14:48.463 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 0.000101439 s, 5.0 MB/s 2023-01-02T18:14:48.464 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-02T18:14:48.523 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_2 2023-01-02T18:14:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-02T18:14:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-02T18:14:48.581 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 379979 Links: 1 2023-01-02T18:14:48.582 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-02T18:14:48.582 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-01-02T18:14:48.582 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-01-02 18:14:42.399117648 +0000 2023-01-02T18:14:48.582 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-01-02 18:11:12.003081711 +0000 2023-01-02T18:14:48.582 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-01-02 18:11:12.003081711 +0000 2023-01-02T18:14:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-01-02T18:14:48.583 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-02T18:14:48.647 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-01-02T18:14:48.647 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-01-02T18:14:48.648 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 8.5888e-05 s, 6.0 MB/s 2023-01-02T18:14:48.648 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-02T18:14:48.708 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_3 2023-01-02T18:14:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-02T18:14:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-02T18:14:48.766 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 375706 Links: 1 2023-01-02T18:14:48.767 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-02T18:14:48.767 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-01-02T18:14:48.767 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-01-02 18:14:42.399117648 +0000 2023-01-02T18:14:48.767 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-01-02 18:11:12.506073403 +0000 2023-01-02T18:14:48.767 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-01-02 18:11:12.506073403 +0000 2023-01-02T18:14:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-01-02T18:14:48.768 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-02T18:14:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-01-02T18:14:48.832 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-01-02T18:14:48.833 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 8.2939e-05 s, 6.2 MB/s 2023-01-02T18:14:48.834 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-02T18:14:48.893 DEBUG:teuthology.orchestra.run.smithi007:> stat /dev/vg_nvme/lv_4 2023-01-02T18:14:48.952 INFO:teuthology.orchestra.run.smithi007.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-02T18:14:48.953 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-02T18:14:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 6h/6d Inode: 381277 Links: 1 2023-01-02T18:14:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-02T18:14:48.953 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:device_t:s0 2023-01-02T18:14:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 2023-01-02 18:14:42.399117648 +0000 2023-01-02T18:14:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-01-02 18:11:13.004065178 +0000 2023-01-02T18:14:48.954 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-01-02 18:11:13.004065178 +0000 2023-01-02T18:14:48.954 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-01-02T18:14:48.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-02T18:14:49.019 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records in 2023-01-02T18:14:49.020 INFO:teuthology.orchestra.run.smithi007.stderr:1+0 records out 2023-01-02T18:14:49.020 INFO:teuthology.orchestra.run.smithi007.stderr:512 bytes copied, 9.8454e-05 s, 5.2 MB/s 2023-01-02T18:14:49.021 DEBUG:teuthology.orchestra.run.smithi007:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-02T18:14:49.080 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-02T18:14:49.081 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:14:49.081 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2023-01-02T18:14:49.104 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-01-02T18:14:49.105 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2023-01-02T18:14:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-01-02T18:14:49.167 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-02T18:14:49.167 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 371606 Links: 1 2023-01-02T18:14:49.167 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-02T18:14:49.167 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-01-02T18:14:49.168 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-01-02 18:14:40.694675642 +0000 2023-01-02T18:14:49.168 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-01-02 18:11:11.479030056 +0000 2023-01-02T18:14:49.168 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-01-02 18:11:11.479030056 +0000 2023-01-02T18:14:49.168 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-01-02T18:14:49.169 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-01-02T18:14:49.238 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-01-02T18:14:49.239 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-01-02T18:14:49.239 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000308088 s, 1.7 MB/s 2023-01-02T18:14:49.240 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-01-02T18:14:49.302 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2023-01-02T18:14:49.363 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-01-02T18:14:49.363 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-02T18:14:49.363 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 375412 Links: 1 2023-01-02T18:14:49.363 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-02T18:14:49.363 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-01-02T18:14:49.364 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-01-02 18:14:40.694675642 +0000 2023-01-02T18:14:49.364 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-01-02 18:11:11.986022125 +0000 2023-01-02T18:14:49.364 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-01-02 18:11:11.986022125 +0000 2023-01-02T18:14:49.364 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-01-02T18:14:49.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-01-02T18:14:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-01-02T18:14:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-01-02T18:14:49.432 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000280985 s, 1.8 MB/s 2023-01-02T18:14:49.433 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-01-02T18:14:49.497 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2023-01-02T18:14:49.557 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-01-02T18:14:49.557 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-02T18:14:49.557 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 373371 Links: 1 2023-01-02T18:14:49.557 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-02T18:14:49.558 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-01-02T18:14:49.558 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-01-02 18:14:40.694675642 +0000 2023-01-02T18:14:49.558 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-01-02 18:11:12.481014383 +0000 2023-01-02T18:14:49.558 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-01-02 18:11:12.481014383 +0000 2023-01-02T18:14:49.558 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-01-02T18:14:49.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-01-02T18:14:49.626 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-01-02T18:14:49.626 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-01-02T18:14:49.626 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000282376 s, 1.8 MB/s 2023-01-02T18:14:49.627 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-01-02T18:14:49.688 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2023-01-02T18:14:49.746 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-01-02T18:14:49.746 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-01-02T18:14:49.746 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 6h/6d Inode: 376167 Links: 1 2023-01-02T18:14:49.747 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-01-02T18:14:49.747 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2023-01-02T18:14:49.747 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2023-01-02 18:14:40.694675642 +0000 2023-01-02T18:14:49.747 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2023-01-02 18:11:12.986006484 +0000 2023-01-02T18:14:49.747 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2023-01-02 18:11:12.986006484 +0000 2023-01-02T18:14:49.748 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: - 2023-01-02T18:14:49.748 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-01-02T18:14:49.815 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2023-01-02T18:14:49.816 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2023-01-02T18:14:49.816 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000296057 s, 1.7 MB/s 2023-01-02T18:14:49.818 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-01-02T18:14:49.878 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-02T18:14:49.878 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-02T18:14:49.879 INFO:tasks.ceph:Generating config... 2023-01-02T18:14:49.880 INFO:tasks.ceph:[client] rbd clone copy on read = True 2023-01-02T18:14:49.880 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-01-02T18:14:49.881 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-01-02T18:14:49.881 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-01-02T18:14:49.881 INFO:tasks.ceph:[mgr] debug ms = 1 2023-01-02T18:14:49.882 INFO:tasks.ceph:[mon] debug mon = 20 2023-01-02T18:14:49.882 INFO:tasks.ceph:[mon] debug ms = 1 2023-01-02T18:14:49.882 INFO:tasks.ceph:[mon] debug paxos = 20 2023-01-02T18:14:49.883 INFO:tasks.ceph:[osd] bdev async discard = True 2023-01-02T18:14:49.883 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-01-02T18:14:49.884 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-01-02T18:14:49.884 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-01-02T18:14:49.885 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-01-02T18:14:49.885 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-01-02T18:14:49.886 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-01-02T18:14:49.886 INFO:tasks.ceph:[osd] debug ms = 1 2023-01-02T18:14:49.886 INFO:tasks.ceph:[osd] debug osd = 20 2023-01-02T18:14:49.887 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-01-02T18:14:49.887 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-01-02T18:14:49.888 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-01-02T18:14:49.888 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-01-02T18:14:49.889 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-01-02T18:14:49.889 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-01-02T18:14:49.890 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-01-02T18:14:49.890 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-01-02T18:14:49.890 INFO:tasks.ceph:Setting up mon.a... 2023-01-02T18:14:49.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-01-02T18:14:49.973 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2023-01-02T18:14:49.975 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-01-02T18:14:50.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-02T18:14:50.089 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.c', '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]'), ('mon.b', '172.21.15.57')] 2023-01-02T18:14:50.090 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.57', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd clone copy on read': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2023-01-02T18:14:50.091 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:50.091 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-01-02T18:14:50.148 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --addv c '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]' --add b 172.21.15.57 --print /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:14:50.233 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:14:50.234 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid 4e320929-c4bb-4ea9-9e1c-d8479b7e40b1 2023-01-02T18:14:50.234 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2023-01-02T18:14:50.234 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 4e320929-c4bb-4ea9-9e1c-d8479b7e40b1 2023-01-02T18:14:50.234 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2023-01-02T18:14:50.234947+0000 2023-01-02T18:14:50.235 INFO:teuthology.orchestra.run.smithi007.stdout:created 2023-01-02T18:14:50.234947+0000 2023-01-02T18:14:50.235 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 0 (unknown) 2023-01-02T18:14:50.235 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2023-01-02T18:14:50.235 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2023-01-02T18:14:50.235 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.b 2023-01-02T18:14:50.235 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.c 2023-01-02T18:14:50.236 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-01-02T18:14:50.237 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-01-02T18:14:50.255 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4e320929-c4bb-4ea9-9e1c-d8479b7e40b1... 2023-01-02T18:14:50.256 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-02T18:14:50.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-01-02T18:14:50.341 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2023-01-02T18:14:50.342 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2023-01-02T18:14:50.342 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-02T18:14:50.342 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2023-01-02T18:14:50.342 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.342 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2023-01-02T18:14:50.343 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.343 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2023-01-02T18:14:50.343 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.344 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2023-01-02T18:14:50.344 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2023-01-02T18:14:50.344 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.344 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2023-01-02T18:14:50.345 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2023-01-02T18:14:50.345 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.345 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-02T18:14:50.346 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2023-01-02T18:14:50.346 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.347 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2023-01-02T18:14:50.347 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-02T18:14:50.347 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.348 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2023-01-02T18:14:50.348 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.348 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2023-01-02T18:14:50.349 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2023-01-02T18:14:50.349 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2023-01-02T18:14:50.349 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2023-01-02T18:14:50.350 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2023-01-02T18:14:50.350 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2023-01-02T18:14:50.350 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2023-01-02T18:14:50.351 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-02T18:14:50.351 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-02T18:14:50.351 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2023-01-02T18:14:50.352 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.352 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-01-02T18:14:50.352 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.353 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2023-01-02T18:14:50.353 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.353 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2023-01-02T18:14:50.353 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.353 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2023-01-02T18:14:50.354 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2023-01-02T18:14:50.354 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2023-01-02T18:14:50.354 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.57" 2023-01-02T18:14:50.354 INFO:teuthology.orchestra.run.smithi007.stdout: mon client directed command retry = 5 2023-01-02T18:14:50.354 INFO:teuthology.orchestra.run.smithi007.stdout: ms inject socket failures = 5000 2023-01-02T18:14:50.355 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 4e320929-c4bb-4ea9-9e1c-d8479b7e40b1 2023-01-02T18:14:50.355 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.355 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2023-01-02T18:14:50.355 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2023-01-02T18:14:50.356 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.356 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2023-01-02T18:14:50.356 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2023-01-02T18:14:50.356 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.356 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2023-01-02T18:14:50.357 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2023-01-02T18:14:50.357 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.357 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2023-01-02T18:14:50.357 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2023-01-02T18:14:50.358 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2023-01-02T18:14:50.358 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.358 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2023-01-02T18:14:50.358 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2023-01-02T18:14:50.358 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.359 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2023-01-02T18:14:50.359 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.359 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2023-01-02T18:14:50.359 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.360 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2023-01-02T18:14:50.360 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.360 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2023-01-02T18:14:50.360 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2023-01-02T18:14:50.361 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.361 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2023-01-02T18:14:50.361 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2023-01-02T18:14:50.361 INFO:teuthology.orchestra.run.smithi007.stdout: bdev async discard = True 2023-01-02T18:14:50.361 INFO:teuthology.orchestra.run.smithi007.stdout: bdev enable discard = True 2023-01-02T18:14:50.362 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore allocator = stupid 2023-01-02T18:14:50.362 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2023-01-02T18:14:50.362 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2023-01-02T18:14:50.362 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 1/20 2023-01-02T18:14:50.362 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 1/20 2023-01-02T18:14:50.363 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-01-02T18:14:50.363 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2023-01-02T18:14:50.363 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 4/10 2023-01-02T18:14:50.363 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2023-01-02T18:14:50.363 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2023-01-02T18:14:50.363 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2023-01-02T18:14:50.364 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2023-01-02T18:14:50.364 INFO:teuthology.orchestra.run.smithi007.stdout: osd max markdown count = 1000 2023-01-02T18:14:50.364 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2023-01-02T18:14:50.364 INFO:teuthology.orchestra.run.smithi007.stdout: osd shutdown pgref assert = True 2023-01-02T18:14:50.364 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.365 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2023-01-02T18:14:50.365 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-01-02T18:14:50.365 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2023-01-02T18:14:50.365 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-01-02T18:14:50.365 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-01-02T18:14:50.366 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-01-02T18:14:50.366 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-01-02T18:14:50.366 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2023-01-02T18:14:50.366 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.366 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2023-01-02T18:14:50.367 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-01-02T18:14:50.367 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-01-02T18:14:50.367 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2023-01-02T18:14:50.367 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-01-02T18:14:50.367 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2023-01-02T18:14:50.367 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2023-01-02T18:14:50.368 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-01-02T18:14:50.368 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2023-01-02T18:14:50.368 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2023-01-02T18:14:50.368 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-01-02T18:14:50.368 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.369 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-02T18:14:50.369 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2023-01-02T18:14:50.369 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2023-01-02T18:14:50.369 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.370 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2023-01-02T18:14:50.370 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-02T18:14:50.370 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-02T18:14:50.370 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:14:50.370 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2023-01-02T18:14:50.371 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2023-01-02T18:14:50.371 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2023-01-02T18:14:50.371 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2023-01-02T18:14:50.371 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-02T18:14:50.371 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-02T18:14:50.372 INFO:teuthology.orchestra.run.smithi007.stdout: rbd clone copy on read = True 2023-01-02T18:14:50.372 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2023-01-02T18:14:50.372 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2023-01-02T18:14:50.372 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2023-01-02T18:14:50.374 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2023-01-02T18:14:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2023-01-02T18:14:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-01-02T18:14:50.374 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2023-01-02T18:14:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2023-01-02T18:14:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2023-01-02T18:14:50.375 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2023-01-02T18:14:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2023-01-02T18:14:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2023-01-02T18:14:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2023-01-02T18:14:50.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2023-01-02T18:14:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2023-01-02T18:14:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2023-01-02T18:14:50.377 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2023-01-02T18:14:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2023-01-02T18:14:50.378 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2023-01-02T18:14:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2023-01-02T18:14:50.379 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2023-01-02T18:14:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2023-01-02T18:14:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2023-01-02T18:14:50.380 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2023-01-02T18:14:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2023-01-02T18:14:50.381 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-01-02T18:14:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2023-01-02T18:14:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2023-01-02T18:14:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.382 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-01-02T18:14:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2023-01-02T18:14:50.383 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2023-01-02T18:14:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.384 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2023-01-02T18:14:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2023-01-02T18:14:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2023-01-02T18:14:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.57" 2023-01-02T18:14:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: mon client directed command retry = 5 2023-01-02T18:14:50.385 INFO:teuthology.orchestra.run.smithi057.stdout: ms inject socket failures = 5000 2023-01-02T18:14:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 4e320929-c4bb-4ea9-9e1c-d8479b7e40b1 2023-01-02T18:14:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.386 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2023-01-02T18:14:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2023-01-02T18:14:50.386 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2023-01-02T18:14:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2023-01-02T18:14:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2023-01-02T18:14:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2023-01-02T18:14:50.387 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2023-01-02T18:14:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2023-01-02T18:14:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2023-01-02T18:14:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2023-01-02T18:14:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2023-01-02T18:14:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2023-01-02T18:14:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.389 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2023-01-02T18:14:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2023-01-02T18:14:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2023-01-02T18:14:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2023-01-02T18:14:50.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2023-01-02T18:14:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2023-01-02T18:14:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: bdev async discard = True 2023-01-02T18:14:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: bdev enable discard = True 2023-01-02T18:14:50.391 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore allocator = stupid 2023-01-02T18:14:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2023-01-02T18:14:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2023-01-02T18:14:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 1/20 2023-01-02T18:14:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 1/20 2023-01-02T18:14:50.392 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-01-02T18:14:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2023-01-02T18:14:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 4/10 2023-01-02T18:14:50.393 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2023-01-02T18:14:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2023-01-02T18:14:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2023-01-02T18:14:50.394 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2023-01-02T18:14:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: osd max markdown count = 1000 2023-01-02T18:14:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2023-01-02T18:14:50.395 INFO:teuthology.orchestra.run.smithi057.stdout: osd shutdown pgref assert = True 2023-01-02T18:14:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.396 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2023-01-02T18:14:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-01-02T18:14:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2023-01-02T18:14:50.396 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-01-02T18:14:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-01-02T18:14:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-01-02T18:14:50.397 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-01-02T18:14:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2023-01-02T18:14:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.398 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2023-01-02T18:14:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2023-01-02T18:14:50.398 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2023-01-02T18:14:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2023-01-02T18:14:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2023-01-02T18:14:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2023-01-02T18:14:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2023-01-02T18:14:50.399 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2023-01-02T18:14:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2023-01-02T18:14:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2023-01-02T18:14:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2023-01-02T18:14:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.400 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-01-02T18:14:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2023-01-02T18:14:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2023-01-02T18:14:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2023-01-02T18:14:50.401 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-01-02T18:14:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-01-02T18:14:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: 2023-01-02T18:14:50.402 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2023-01-02T18:14:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2023-01-02T18:14:50.402 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2023-01-02T18:14:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2023-01-02T18:14:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-01-02T18:14:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-01-02T18:14:50.403 INFO:teuthology.orchestra.run.smithi057.stdout: rbd clone copy on read = True 2023-01-02T18:14:50.403 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2023-01-02T18:14:50.403 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2023-01-02T18:14:50.404 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2023-01-02T18:14:50.404 INFO:tasks.ceph:Creating admin key on mon.a... 2023-01-02T18:14:50.404 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-01-02T18:14:50.468 INFO:tasks.ceph:Copying monmap to all nodes... 2023-01-02T18:14:50.469 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:50.469 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-01-02T18:14:50.487 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:50.487 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-01-02T18:14:50.545 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2023-01-02T18:14:50.545 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:50.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-02T18:14:50.546 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-02T18:14:50.622 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:14:50.623 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:14:50.680 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2023-01-02T18:14:50.680 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:14:50.680 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2023-01-02T18:14:50.681 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-01-02T18:14:50.722 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:14:50.722 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:14:50.782 INFO:tasks.ceph:Setting up mon nodes... 2023-01-02T18:14:50.783 INFO:tasks.ceph:Setting up mgr nodes... 2023-01-02T18:14:50.784 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-01-02T18:14:50.835 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-01-02T18:14:50.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-01-02T18:14:50.922 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-01-02T18:14:50.925 INFO:tasks.ceph:Setting up mds nodes... 2023-01-02T18:14:50.925 INFO:tasks.ceph_client:Setting up client nodes... 2023-01-02T18:14:50.925 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-01-02T18:14:50.966 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-01-02T18:14:50.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-01-02T18:14:51.021 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-01-02T18:14:51.034 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-01-02T18:14:51.034 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi007.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-01-02T18:14:51.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-01-02T18:14:51.063 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-02T18:14:51.063 INFO:tasks.ceph:role: osd.0 2023-01-02T18:14:51.063 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com 2023-01-02T18:14:51.064 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-02T18:14:51.131 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-02T18:14:51.131 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-02T18:14:51.131 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-02T18:14:51.131 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-02T18:14:51.131 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-02T18:14:51.132 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-01-02T18:14:51.132 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-02T18:14:51.132 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-02T18:14:51.132 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-02T18:14:51.132 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-02T18:14:51.153 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-01-02T18:14:51.155 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-01-02T18:14:51.155 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-01-02T18:14:51.237 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-01-02T18:14:51.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-01-02T18:14:51.378 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-02T18:14:51.378 INFO:tasks.ceph:role: osd.1 2023-01-02T18:14:51.379 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com 2023-01-02T18:14:51.379 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-02T18:14:51.445 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-02T18:14:51.445 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-02T18:14:51.445 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-02T18:14:51.446 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-02T18:14:51.446 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-02T18:14:51.446 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-01-02T18:14:51.446 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-02T18:14:51.446 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-02T18:14:51.447 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-02T18:14:51.447 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-02T18:14:51.467 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-01-02T18:14:51.469 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-01-02T18:14:51.469 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-01-02T18:14:51.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-01-02T18:14:51.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-01-02T18:14:51.704 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-02T18:14:51.705 INFO:tasks.ceph:role: osd.2 2023-01-02T18:14:51.705 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com 2023-01-02T18:14:51.705 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-02T18:14:51.773 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-02T18:14:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-02T18:14:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-02T18:14:51.774 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-02T18:14:51.774 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-02T18:14:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-01-02T18:14:51.775 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-02T18:14:51.775 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-02T18:14:51.775 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-02T18:14:51.775 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-02T18:14:51.797 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-01-02T18:14:51.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-01-02T18:14:51.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-01-02T18:14:51.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-01-02T18:14:51.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-01-02T18:14:52.021 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-01-02T18:14:52.022 INFO:tasks.ceph:role: osd.3 2023-01-02T18:14:52.022 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com 2023-01-02T18:14:52.023 DEBUG:teuthology.orchestra.run.smithi007:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-02T18:14:52.089 INFO:teuthology.orchestra.run.smithi007.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-02T18:14:52.090 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-02T18:14:52.090 INFO:teuthology.orchestra.run.smithi007.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-02T18:14:52.090 INFO:teuthology.orchestra.run.smithi007.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-02T18:14:52.091 INFO:teuthology.orchestra.run.smithi007.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-02T18:14:52.091 INFO:teuthology.orchestra.run.smithi007.stdout: = sunit=0 swidth=0 blks 2023-01-02T18:14:52.091 INFO:teuthology.orchestra.run.smithi007.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-02T18:14:52.091 INFO:teuthology.orchestra.run.smithi007.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-02T18:14:52.091 INFO:teuthology.orchestra.run.smithi007.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-02T18:14:52.092 INFO:teuthology.orchestra.run.smithi007.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-02T18:14:52.112 INFO:teuthology.orchestra.run.smithi007.stdout:Discarding blocks...Done. 2023-01-02T18:14:52.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi007.front.sepia.ceph.com -o noatime 2023-01-02T18:14:52.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-01-02T18:14:52.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-01-02T18:14:52.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:14:52.366 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:52.366+0000 7fc74d802200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-01-02T18:14:52.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:52.366+0000 7fc74d802200 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-01-02T18:14:52.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:52.366+0000 7fc74d802200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-02T18:14:52.367 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:52.366+0000 7fc74d802200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-02T18:14:52.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:52.366+0000 7fc74d802200 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-01-02T18:14:52.368 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:52.366+0000 7fc74d802200 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-01-02T18:14:55.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-01-02T18:14:55.253 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:14:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:55.342+0000 7f1ed7046200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-01-02T18:14:55.343 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:55.343+0000 7f1ed7046200 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-01-02T18:14:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:55.343+0000 7f1ed7046200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-02T18:14:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:55.343+0000 7f1ed7046200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-02T18:14:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:55.343+0000 7f1ed7046200 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-01-02T18:14:55.344 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:55.343+0000 7f1ed7046200 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-01-02T18:14:58.179 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-01-02T18:14:58.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:14:58.304 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:58.304+0000 7f30dd766200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-01-02T18:14:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:58.304+0000 7f30dd766200 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-01-02T18:14:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:58.304+0000 7f30dd766200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-02T18:14:58.305 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:58.304+0000 7f30dd766200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-02T18:14:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:58.304+0000 7f30dd766200 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-01-02T18:14:58.306 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:14:58.304+0000 7f30dd766200 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-01-02T18:15:01.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-01-02T18:15:01.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:15:01.265 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:15:01.265+0000 7f3e95588200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-01-02T18:15:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:15:01.265+0000 7f3e95588200 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-01-02T18:15:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:15:01.265+0000 7f3e95588200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-02T18:15:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:15:01.265+0000 7f3e95588200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-02T18:15:01.266 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:15:01.265+0000 7f3e95588200 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-01-02T18:15:01.267 INFO:teuthology.orchestra.run.smithi007.stderr:2023-01-02T18:15:01.265+0000 7f3e95588200 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-01-02T18:15:04.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-01-02T18:15:04.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-01-02T18:15:04.163 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-02T18:15:04.163 INFO:tasks.ceph:role: osd.4 2023-01-02T18:15:04.163 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2023-01-02T18:15:04.164 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-01-02T18:15:04.263 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-01-02T18:15:04.263 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-02T18:15:04.264 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-02T18:15:04.264 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-02T18:15:04.264 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-02T18:15:04.264 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-01-02T18:15:04.265 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-02T18:15:04.265 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-02T18:15:04.265 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-02T18:15:04.265 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-02T18:15:05.551 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-01-02T18:15:05.553 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-01-02T18:15:05.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-01-02T18:15:05.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-01-02T18:15:05.637 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-01-02T18:15:05.707 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-02T18:15:05.707 INFO:tasks.ceph:role: osd.5 2023-01-02T18:15:05.707 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2023-01-02T18:15:05.708 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-01-02T18:15:05.806 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-01-02T18:15:05.806 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-02T18:15:05.806 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-02T18:15:05.806 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-02T18:15:05.807 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-02T18:15:05.807 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-01-02T18:15:05.807 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-02T18:15:05.807 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-02T18:15:05.807 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-02T18:15:05.808 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-02T18:15:07.095 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-01-02T18:15:07.097 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-01-02T18:15:07.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-01-02T18:15:07.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-01-02T18:15:07.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-01-02T18:15:07.252 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-02T18:15:07.253 INFO:tasks.ceph:role: osd.6 2023-01-02T18:15:07.253 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2023-01-02T18:15:07.253 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-01-02T18:15:07.350 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-01-02T18:15:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-02T18:15:07.350 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-02T18:15:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-02T18:15:07.351 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-02T18:15:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-01-02T18:15:07.351 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-02T18:15:07.351 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-02T18:15:07.352 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-02T18:15:07.352 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-02T18:15:08.641 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-01-02T18:15:08.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-01-02T18:15:08.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-01-02T18:15:08.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-01-02T18:15:08.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-01-02T18:15:08.793 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-01-02T18:15:08.794 INFO:tasks.ceph:role: osd.7 2023-01-02T18:15:08.794 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2023-01-02T18:15:08.795 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-01-02T18:15:08.889 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-01-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2023-01-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-01-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-01-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-01-02T18:15:08.890 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2023-01-02T18:15:08.891 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-01-02T18:15:08.891 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-01-02T18:15:08.891 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-01-02T18:15:08.891 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-01-02T18:15:10.180 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2023-01-02T18:15:10.182 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2023-01-02T18:15:10.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-01-02T18:15:10.232 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-01-02T18:15:10.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:15:10.365 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:10.365+0000 7f6a7c014200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-01-02T18:15:10.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:10.366+0000 7f6a7c014200 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-01-02T18:15:10.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:10.366+0000 7f6a7c014200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-02T18:15:10.366 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:10.366+0000 7f6a7c014200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-02T18:15:10.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:10.366+0000 7f6a7c014200 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-01-02T18:15:10.367 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:10.366+0000 7f6a7c014200 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-01-02T18:15:13.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-01-02T18:15:13.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:15:13.334 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:13.334+0000 7f5d2c307200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-01-02T18:15:13.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:13.335+0000 7f5d2c307200 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-01-02T18:15:13.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:13.335+0000 7f5d2c307200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-02T18:15:13.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:13.335+0000 7f5d2c307200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-02T18:15:13.335 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:13.335+0000 7f5d2c307200 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-01-02T18:15:13.336 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:13.335+0000 7f5d2c307200 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-01-02T18:15:16.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-01-02T18:15:16.215 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:15:16.306 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:16.306+0000 7f33a4ab9200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-01-02T18:15:16.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:16.307+0000 7f33a4ab9200 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-01-02T18:15:16.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:16.307+0000 7f33a4ab9200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-02T18:15:16.307 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:16.307+0000 7f33a4ab9200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-02T18:15:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:16.307+0000 7f33a4ab9200 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-01-02T18:15:16.308 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:16.308+0000 7f33a4ab9200 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-01-02T18:15:19.158 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-01-02T18:15:19.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:15:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:19.276+0000 7fe9e725e200 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-01-02T18:15:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:19.276+0000 7fe9e725e200 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-01-02T18:15:19.276 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:19.276+0000 7fe9e725e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-02T18:15:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:19.276+0000 7fe9e725e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-02T18:15:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:19.276+0000 7fe9e725e200 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-01-02T18:15:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2023-01-02T18:15:19.277+0000 7fe9e725e200 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-01-02T18:15:22.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-01-02T18:15:22.160 INFO:tasks.ceph:Reading keys from all nodes... 2023-01-02T18:15:22.161 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:22.161 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-01-02T18:15:22.194 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:22.195 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-01-02T18:15:22.267 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:22.267 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-01-02T18:15:22.338 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:22.339 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-01-02T18:15:22.407 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:22.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-01-02T18:15:22.476 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:22.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-01-02T18:15:22.512 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:22.520 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-01-02T18:15:22.587 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:22.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-01-02T18:15:22.658 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:22.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-01-02T18:15:22.730 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:22.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-01-02T18:15:22.803 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:22.804 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-01-02T18:15:22.826 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:22.826 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-01-02T18:15:22.866 INFO:tasks.ceph:Adding keys to all mons... 2023-01-02T18:15:22.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-02T18:15:22.872 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2023-01-02T18:15:22.917 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2023-01-02T18:15:22.917 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAaH7NjgijZMRAAwpZJUasYjelTEuxFHFfgMA== 2023-01-02T18:15:22.917 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2023-01-02T18:15:22.917 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAcH7Nj593oFRAA7FQnD6dgi9RKqA98R5fOLQ== 2023-01-02T18:15:22.918 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2023-01-02T18:15:22.918 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAfH7NjZoiGFBAAvXEvb5726DOQvSzbi0hCbQ== 2023-01-02T18:15:22.918 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2023-01-02T18:15:22.918 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAiH7NjgTI4EhAAb2Qb+nBEsJ6dN/3+AjH7Cg== 2023-01-02T18:15:22.918 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.3] 2023-01-02T18:15:22.919 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAlH7NjuOPjDxAAfv5r3CYtbiBkbHbr9jA5hA== 2023-01-02T18:15:22.919 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2023-01-02T18:15:22.919 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAaH7NjR1wUNxAAiQ7u4P7vkykJmrNWgHbwkQ== 2023-01-02T18:15:22.919 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.4] 2023-01-02T18:15:22.919 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAuH7Nj/vnZFRAAn/Xh1LBnY80nyiLBkgpMdw== 2023-01-02T18:15:22.920 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.5] 2023-01-02T18:15:22.920 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAxH7Nj0K4AFBAAw+a4oA+GgQyv6hTmq76wwA== 2023-01-02T18:15:22.920 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.6] 2023-01-02T18:15:22.920 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQA0H7Njl3RYEhAAx/bVvjxhLzhZPa+KsQfxtg== 2023-01-02T18:15:22.920 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.7] 2023-01-02T18:15:22.921 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQA3H7NjPZSCEBAAf3knsAimia9DKVx2xrc/9A== 2023-01-02T18:15:22.921 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2023-01-02T18:15:22.921 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAaH7NjK1GzORAAVEZ3OCm19UB9dyxaHKkRgw== 2023-01-02T18:15:22.921 INFO:teuthology.orchestra.run.smithi007.stdout:[client.1] 2023-01-02T18:15:22.921 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQAbH7Nj9UxdARAAOupVJBwaYeG2qI22nre3/Q== 2023-01-02T18:15:22.941 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2023-01-02T18:15:22.941 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAaH7NjgijZMRAAwpZJUasYjelTEuxFHFfgMA== 2023-01-02T18:15:22.942 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2023-01-02T18:15:22.942 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAcH7Nj593oFRAA7FQnD6dgi9RKqA98R5fOLQ== 2023-01-02T18:15:22.942 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2023-01-02T18:15:22.942 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAfH7NjZoiGFBAAvXEvb5726DOQvSzbi0hCbQ== 2023-01-02T18:15:22.942 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2023-01-02T18:15:22.943 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAiH7NjgTI4EhAAb2Qb+nBEsJ6dN/3+AjH7Cg== 2023-01-02T18:15:22.943 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2023-01-02T18:15:22.943 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAlH7NjuOPjDxAAfv5r3CYtbiBkbHbr9jA5hA== 2023-01-02T18:15:22.943 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2023-01-02T18:15:22.943 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAaH7NjR1wUNxAAiQ7u4P7vkykJmrNWgHbwkQ== 2023-01-02T18:15:22.944 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2023-01-02T18:15:22.944 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAuH7Nj/vnZFRAAn/Xh1LBnY80nyiLBkgpMdw== 2023-01-02T18:15:22.944 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2023-01-02T18:15:22.944 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAxH7Nj0K4AFBAAw+a4oA+GgQyv6hTmq76wwA== 2023-01-02T18:15:22.944 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2023-01-02T18:15:22.945 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQA0H7Njl3RYEhAAx/bVvjxhLzhZPa+KsQfxtg== 2023-01-02T18:15:22.945 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2023-01-02T18:15:22.945 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQA3H7NjPZSCEBAAf3knsAimia9DKVx2xrc/9A== 2023-01-02T18:15:22.945 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2023-01-02T18:15:22.945 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAaH7NjK1GzORAAVEZ3OCm19UB9dyxaHKkRgw== 2023-01-02T18:15:22.946 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2023-01-02T18:15:22.946 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQAbH7Nj9UxdARAAOupVJBwaYeG2qI22nre3/Q== 2023-01-02T18:15:22.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-02T18:15:22.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-02T18:15:23.041 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.148 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.257 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-02T18:15:23.260 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-01-02T18:15:23.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.311 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.361 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.412 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.467 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-01-02T18:15:23.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-02T18:15:23.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-02T18:15:23.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-02T18:15:23.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-01-02T18:15:23.626 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-01-02T18:15:23.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-01-02T18:15:23.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-02T18:15:23.748 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-01-02T18:15:23.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-01-02T18:15:23.843 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-02T18:15:23.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-01-02T18:15:23.966 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-01-02T18:15:23.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-01-02T18:15:24.103 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-01-02T18:15:24.131 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:15:24.134 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-01-02T18:15:24.189 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-01-02T18:15:24.189 INFO:tasks.ceph.mon.a:Restarting daemon 2023-01-02T18:15:24.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-01-02T18:15:24.192 INFO:tasks.ceph.mon.a:Started 2023-01-02T18:15:24.193 INFO:tasks.ceph.mon.c:Restarting daemon 2023-01-02T18:15:24.193 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-01-02T18:15:24.195 INFO:tasks.ceph.mon.c:Started 2023-01-02T18:15:24.196 INFO:tasks.ceph.mon.b:Restarting daemon 2023-01-02T18:15:24.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-01-02T18:15:24.231 INFO:tasks.ceph.mon.b:Started 2023-01-02T18:15:24.231 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-01-02T18:15:24.232 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-01-02T18:15:24.232 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-01-02T18:15:24.235 INFO:tasks.ceph.mgr.y:Started 2023-01-02T18:15:24.235 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-01-02T18:15:24.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-01-02T18:15:24.237 INFO:tasks.ceph.mgr.x:Started 2023-01-02T18:15:24.238 INFO:tasks.ceph:Setting crush tunables to default 2023-01-02T18:15:24.238 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2023-01-02T18:15:29.642 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2023-01-02T18:15:29.653 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-01-02T18:15:29.653 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:29.653 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-01-02T18:15:29.681 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:29.682 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-01-02T18:15:29.700 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:29.700+0000 7f6db0d0c680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-02T18:15:29.749 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:29.750 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-01-02T18:15:29.773 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:29.772+0000 7f6db0d0c680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-02T18:15:29.817 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:15:29.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-01-02T18:15:29.884 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:29.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-01-02T18:15:29.912 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:29.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-01-02T18:15:29.980 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:29.980 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-01-02T18:15:30.048 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2023-01-02T18:15:30.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-01-02T18:15:30.115 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 69e18813-bd8e-4b22-9c40-d702ff3a5efd 0 2023-01-02T18:15:30.258 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:30.258+0000 7f6db0d0c680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-02T18:15:30.372 INFO:teuthology.orchestra.run.smithi057.stdout:0 2023-01-02T18:15:30.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new aa04dec6-4607-4f2a-85a3-a6278832fef3 1 2023-01-02T18:15:30.456 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:30.456+0000 7f90b1d8a680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-01-02T18:15:30.528 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:30.529+0000 7f90b1d8a680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-01-02T18:15:30.595 INFO:teuthology.orchestra.run.smithi057.stdout:1 2023-01-02T18:15:30.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new c98a28fb-d910-4601-a229-d4318259ab9b 2 2023-01-02T18:15:30.866 INFO:teuthology.orchestra.run.smithi057.stdout:2 2023-01-02T18:15:30.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 3c5d48f4-5384-4563-8acb-11d866b85ef4 3 2023-01-02T18:15:31.046 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:31.047+0000 7f90b1d8a680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-01-02T18:15:31.087 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:31.086+0000 7f6db0d0c680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-02T18:15:31.135 INFO:teuthology.orchestra.run.smithi057.stdout:3 2023-01-02T18:15:31.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 2476d495-4979-4679-a7e9-12652c270092 4 2023-01-02T18:15:31.159 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:31.159+0000 7f6db0d0c680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-02T18:15:31.359 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:31.358+0000 7f6db0d0c680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-02T18:15:31.363 INFO:teuthology.orchestra.run.smithi057.stdout:4 2023-01-02T18:15:31.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 38d57e5e-b6c1-445f-b181-23fb518698f9 5 2023-01-02T18:15:31.629 INFO:teuthology.orchestra.run.smithi057.stdout:5 2023-01-02T18:15:31.641 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new 6c78f25a-2a65-47fe-b101-e47c00a5b2f6 6 2023-01-02T18:15:31.827 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:31.828+0000 7f90b1d8a680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-01-02T18:15:31.829 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:31.829+0000 7f6db0d0c680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-02T18:15:31.857 INFO:teuthology.orchestra.run.smithi057.stdout:6 2023-01-02T18:15:31.870 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd new b094706d-7145-4865-ae95-e5cd7e40d23b 7 2023-01-02T18:15:31.897 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:31.898+0000 7f90b1d8a680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-01-02T18:15:31.939 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:31.939+0000 7f6db0d0c680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-02T18:15:32.093 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:32.093+0000 7f90b1d8a680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-01-02T18:15:32.100 INFO:teuthology.orchestra.run.smithi057.stdout:7 2023-01-02T18:15:32.112 INFO:tasks.ceph.osd.0:Restarting daemon 2023-01-02T18:15:32.113 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-01-02T18:15:32.115 INFO:tasks.ceph.osd.0:Started 2023-01-02T18:15:32.115 INFO:tasks.ceph.osd.1:Restarting daemon 2023-01-02T18:15:32.115 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-01-02T18:15:32.117 INFO:tasks.ceph.osd.1:Started 2023-01-02T18:15:32.118 INFO:tasks.ceph.osd.2:Restarting daemon 2023-01-02T18:15:32.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-01-02T18:15:32.119 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:32.117+0000 7f6db0d0c680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-02T18:15:32.120 INFO:tasks.ceph.osd.2:Started 2023-01-02T18:15:32.121 INFO:tasks.ceph.osd.3:Restarting daemon 2023-01-02T18:15:32.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-01-02T18:15:32.125 INFO:tasks.ceph.osd.3:Started 2023-01-02T18:15:32.125 INFO:tasks.ceph.osd.4:Restarting daemon 2023-01-02T18:15:32.125 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-01-02T18:15:32.127 INFO:tasks.ceph.osd.4:Started 2023-01-02T18:15:32.128 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-02T18:15:32.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-02T18:15:32.130 INFO:tasks.ceph.osd.5:Started 2023-01-02T18:15:32.130 INFO:tasks.ceph.osd.6:Restarting daemon 2023-01-02T18:15:32.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-01-02T18:15:32.133 INFO:tasks.ceph.osd.6:Started 2023-01-02T18:15:32.133 INFO:tasks.ceph.osd.7:Restarting daemon 2023-01-02T18:15:32.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-01-02T18:15:32.135 INFO:tasks.ceph.osd.7:Started 2023-01-02T18:15:32.136 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-02T18:15:32.216 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:32.212+0000 7f6db0d0c680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-02T18:15:32.289 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:32.289+0000 7f6db0d0c680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-02T18:15:32.365 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:32.365 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":10,"fsid":"4e320929-c4bb-4ea9-9e1c-d8479b7e40b1","created":"2023-01-02T18:15:29.542145+0000","modified":"2023-01-02T18:15:32.099480+0000","last_up_change":"0.000000","last_in_change":"2023-01-02T18:15:32.099480+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"69e18813-bd8e-4b22-9c40-d702ff3a5efd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aa04dec6-4607-4f2a-85a3-a6278832fef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c98a28fb-d910-4601-a229-d4318259ab9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3c5d48f4-5384-4563-8acb-11d866b85ef4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2476d495-4979-4679-a7e9-12652c270092","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38d57e5e-b6c1-445f-b181-23fb518698f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c78f25a-2a65-47fe-b101-e47c00a5b2f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b094706d-7145-4865-ae95-e5cd7e40d23b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-02T18:15:32.378 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-01-02T18:15:32.379 INFO:tasks.ceph:Waiting for OSDs to come up 2023-01-02T18:15:32.566 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:32.565+0000 7f6db0d0c680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-02T18:15:32.597 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:32.598+0000 7f90b1d8a680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-01-02T18:15:32.704 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:32.705+0000 7f90b1d8a680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-01-02T18:15:32.733 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:32.732+0000 7fce6456f200 -1 Falling back to public interface 2023-01-02T18:15:32.734 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:32.735+0000 7f28d1f39200 -1 Falling back to public interface 2023-01-02T18:15:32.735 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:32.736+0000 7f54ddfa8200 -1 Falling back to public interface 2023-01-02T18:15:32.736 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:32.735+0000 7fed62a6d200 -1 Falling back to public interface 2023-01-02T18:15:32.739 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:32.740+0000 7f20939d1200 -1 Falling back to public interface 2023-01-02T18:15:32.744 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:32.745+0000 7f5a77116200 -1 Falling back to public interface 2023-01-02T18:15:32.749 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:32.748+0000 7f081882b200 -1 Falling back to public interface 2023-01-02T18:15:32.753 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:32.752+0000 7f1058d22200 -1 Falling back to public interface 2023-01-02T18:15:32.769 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:32.768+0000 7f6db0d0c680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-02T18:15:32.866 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:32.867+0000 7f90b1d8a680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-01-02T18:15:32.946 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:32.947+0000 7f90b1d8a680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-01-02T18:15:33.019 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:33.020+0000 7f90b1d8a680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-01-02T18:15:33.184 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-02T18:15:33.302 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:33.303+0000 7f90b1d8a680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-01-02T18:15:33.371 INFO:teuthology.misc.health.smithi007.stdout: 2023-01-02T18:15:33.371 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":10,"fsid":"4e320929-c4bb-4ea9-9e1c-d8479b7e40b1","created":"2023-01-02T18:15:29.542145+0000","modified":"2023-01-02T18:15:32.099480+0000","last_up_change":"0.000000","last_in_change":"2023-01-02T18:15:32.099480+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"69e18813-bd8e-4b22-9c40-d702ff3a5efd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aa04dec6-4607-4f2a-85a3-a6278832fef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c98a28fb-d910-4601-a229-d4318259ab9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3c5d48f4-5384-4563-8acb-11d866b85ef4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2476d495-4979-4679-a7e9-12652c270092","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"38d57e5e-b6c1-445f-b181-23fb518698f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"6c78f25a-2a65-47fe-b101-e47c00a5b2f6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b094706d-7145-4865-ae95-e5cd7e40d23b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-02T18:15:33.382 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-01-02T18:15:33.467 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:33.466+0000 7f6db0d0c680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-02T18:15:33.505 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:33.506+0000 7f90b1d8a680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-01-02T18:15:33.539 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:33.538+0000 7f6db0d0c680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-02T18:15:33.621 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:33.621+0000 7f6db0d0c680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-02T18:15:33.776 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:33.775+0000 7f6db0d0c680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-02T18:15:33.853 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:33.850+0000 7f6db0d0c680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-02T18:15:33.972 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:33.972+0000 7f6db0d0c680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-02T18:15:34.086 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:34.085+0000 7f6db0d0c680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-02T18:15:34.201 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:34.202+0000 7f90b1d8a680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-01-02T18:15:34.273 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:34.274+0000 7f90b1d8a680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-01-02T18:15:34.354 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:34.355+0000 7f90b1d8a680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-01-02T18:15:34.421 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:34.420+0000 7f6db0d0c680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-02T18:15:34.495 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:34.494+0000 7f6db0d0c680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-02T18:15:34.508 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:34.508+0000 7f90b1d8a680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-01-02T18:15:34.585 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:34.586+0000 7f90b1d8a680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-01-02T18:15:34.706 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:34.707+0000 7f90b1d8a680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-01-02T18:15:34.818 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:34.819+0000 7f90b1d8a680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-01-02T18:15:35.150 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:35.150+0000 7f90b1d8a680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-01-02T18:15:35.228 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-01-02T18:15:35.228+0000 7f90b1d8a680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-01-02T18:15:35.525 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:35.524+0000 7f6d66212700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-01-02T18:15:35.525 INFO:tasks.ceph.mgr.x.smithi057.stderr:2023-01-02T18:15:35.524+0000 7f6d66212700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-01-02T18:15:36.221 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:36.221+0000 7f081882b200 -1 osd.5 0 log_to_monitors {default=true} 2023-01-02T18:15:36.245 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:36.246+0000 7f54ddfa8200 -1 osd.0 0 log_to_monitors {default=true} 2023-01-02T18:15:36.255 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:36.256+0000 7f28d1f39200 -1 osd.3 0 log_to_monitors {default=true} 2023-01-02T18:15:36.256 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:36.257+0000 7f5a77116200 -1 osd.1 0 log_to_monitors {default=true} 2023-01-02T18:15:36.266 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:36.266+0000 7fce6456f200 -1 osd.4 0 log_to_monitors {default=true} 2023-01-02T18:15:36.268 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:36.269+0000 7f20939d1200 -1 osd.2 0 log_to_monitors {default=true} 2023-01-02T18:15:36.271 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:36.270+0000 7fed62a6d200 -1 osd.6 0 log_to_monitors {default=true} 2023-01-02T18:15:36.274 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:36.274+0000 7f1058d22200 -1 osd.7 0 log_to_monitors {default=true} 2023-01-02T18:15:37.524 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:37.524+0000 7f54d494f700 -1 osd.0 0 waiting for initial osdmap 2023-01-02T18:15:37.524 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:37.525+0000 7f5a6dabd700 -1 osd.1 0 waiting for initial osdmap 2023-01-02T18:15:37.525 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:37.524+0000 7fed59414700 -1 osd.6 0 waiting for initial osdmap 2023-01-02T18:15:37.526 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:37.526+0000 7f28c88e0700 -1 osd.3 0 waiting for initial osdmap 2023-01-02T18:15:37.526 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:37.525+0000 7f080f1d2700 -1 osd.5 0 waiting for initial osdmap 2023-01-02T18:15:37.526 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:37.524+0000 7f104f6c9700 -1 osd.7 0 waiting for initial osdmap 2023-01-02T18:15:37.527 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:37.526+0000 7fce5af16700 -1 osd.4 0 waiting for initial osdmap 2023-01-02T18:15:37.527 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:37.527+0000 7f208a378700 -1 osd.2 0 waiting for initial osdmap 2023-01-02T18:15:37.530 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:37.531+0000 7f54d10cb700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:15:37.531 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:37.532+0000 7f28c505c700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:15:37.534 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:37.535+0000 7f5a6a239700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:15:37.535 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:37.535+0000 7fed55b90700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:15:37.536 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:37.535+0000 7f080b94e700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:15:37.536 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:37.536+0000 7f104be45700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:15:37.537 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:37.538+0000 7f2086af4700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:15:37.541 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:37.540+0000 7fce57692700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:15:40.189 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-01-02T18:15:40.503 INFO:teuthology.misc.health.smithi007.stdout: 2023-01-02T18:15:40.504 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":14,"fsid":"4e320929-c4bb-4ea9-9e1c-d8479b7e40b1","created":"2023-01-02T18:15:29.542145+0000","modified":"2023-01-02T18:15:39.553250+0000","last_up_change":"2023-01-02T18:15:38.537792+0000","last_in_change":"2023-01-02T18:15:32.099480+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-02T18:15:38.598445+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{}}],"osds":[{"osd":0,"uuid":"69e18813-bd8e-4b22-9c40-d702ff3a5efd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":107063},{"type":"v1","addr":"172.21.15.7:6809","nonce":107063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":107063},{"type":"v1","addr":"172.21.15.7:6811","nonce":107063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":107063},{"type":"v1","addr":"172.21.15.7:6815","nonce":107063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":107063},{"type":"v1","addr":"172.21.15.7:6813","nonce":107063}]},"public_addr":"172.21.15.7:6809/107063","cluster_addr":"172.21.15.7:6811/107063","heartbeat_back_addr":"172.21.15.7:6815/107063","heartbeat_front_addr":"172.21.15.7:6813/107063","state":["exists","up"]},{"osd":1,"uuid":"aa04dec6-4607-4f2a-85a3-a6278832fef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":107066},{"type":"v1","addr":"172.21.15.7:6825","nonce":107066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":107066},{"type":"v1","addr":"172.21.15.7:6827","nonce":107066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":107066},{"type":"v1","addr":"172.21.15.7:6831","nonce":107066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":107066},{"type":"v1","addr":"172.21.15.7:6829","nonce":107066}]},"public_addr":"172.21.15.7:6825/107066","cluster_addr":"172.21.15.7:6827/107066","heartbeat_back_addr":"172.21.15.7:6831/107066","heartbeat_front_addr":"172.21.15.7:6829/107066","state":["exists","up"]},{"osd":2,"uuid":"c98a28fb-d910-4601-a229-d4318259ab9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":107065},{"type":"v1","addr":"172.21.15.7:6817","nonce":107065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":107065},{"type":"v1","addr":"172.21.15.7:6819","nonce":107065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":107065},{"type":"v1","addr":"172.21.15.7:6823","nonce":107065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":107065},{"type":"v1","addr":"172.21.15.7:6821","nonce":107065}]},"public_addr":"172.21.15.7:6817/107065","cluster_addr":"172.21.15.7:6819/107065","heartbeat_back_addr":"172.21.15.7:6823/107065","heartbeat_front_addr":"172.21.15.7:6821/107065","state":["exists","up"]},{"osd":3,"uuid":"3c5d48f4-5384-4563-8acb-11d866b85ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":107064},{"type":"v1","addr":"172.21.15.7:6801","nonce":107064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":107064},{"type":"v1","addr":"172.21.15.7:6803","nonce":107064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":107064},{"type":"v1","addr":"172.21.15.7:6807","nonce":107064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":107064},{"type":"v1","addr":"172.21.15.7:6805","nonce":107064}]},"public_addr":"172.21.15.7:6801/107064","cluster_addr":"172.21.15.7:6803/107064","heartbeat_back_addr":"172.21.15.7:6807/107064","heartbeat_front_addr":"172.21.15.7:6805/107064","state":["exists","up"]},{"osd":4,"uuid":"2476d495-4979-4679-a7e9-12652c270092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":106900},{"type":"v1","addr":"172.21.15.57:6801","nonce":106900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":106900},{"type":"v1","addr":"172.21.15.57:6803","nonce":106900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":106900},{"type":"v1","addr":"172.21.15.57:6807","nonce":106900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":106900},{"type":"v1","addr":"172.21.15.57:6805","nonce":106900}]},"public_addr":"172.21.15.57:6801/106900","cluster_addr":"172.21.15.57:6803/106900","heartbeat_back_addr":"172.21.15.57:6807/106900","heartbeat_front_addr":"172.21.15.57:6805/106900","state":["exists","up"]},{"osd":5,"uuid":"38d57e5e-b6c1-445f-b181-23fb518698f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":106930},{"type":"v1","addr":"172.21.15.57:6817","nonce":106930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":106930},{"type":"v1","addr":"172.21.15.57:6819","nonce":106930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":106930},{"type":"v1","addr":"172.21.15.57:6823","nonce":106930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":106930},{"type":"v1","addr":"172.21.15.57:6821","nonce":106930}]},"public_addr":"172.21.15.57:6817/106930","cluster_addr":"172.21.15.57:6819/106930","heartbeat_back_addr":"172.21.15.57:6823/106930","heartbeat_front_addr":"172.21.15.57:6821/106930","state":["exists","up"]},{"osd":6,"uuid":"6c78f25a-2a65-47fe-b101-e47c00a5b2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":106901},{"type":"v1","addr":"172.21.15.57:6809","nonce":106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":106901},{"type":"v1","addr":"172.21.15.57:6811","nonce":106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":106901},{"type":"v1","addr":"172.21.15.57:6815","nonce":106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":106901},{"type":"v1","addr":"172.21.15.57:6813","nonce":106901}]},"public_addr":"172.21.15.57:6809/106901","cluster_addr":"172.21.15.57:6811/106901","heartbeat_back_addr":"172.21.15.57:6815/106901","heartbeat_front_addr":"172.21.15.57:6813/106901","state":["exists","up"]},{"osd":7,"uuid":"b094706d-7145-4865-ae95-e5cd7e40d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":106931},{"type":"v1","addr":"172.21.15.57:6825","nonce":106931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":106931},{"type":"v1","addr":"172.21.15.57:6827","nonce":106931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":106931},{"type":"v1","addr":"172.21.15.57:6831","nonce":106931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":106931},{"type":"v1","addr":"172.21.15.57:6829","nonce":106931}]},"public_addr":"172.21.15.57:6825/106931","cluster_addr":"172.21.15.57:6827/106931","heartbeat_back_addr":"172.21.15.57:6831/106931","heartbeat_front_addr":"172.21.15.57:6829/106931","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.290083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.303022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.292245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.210530+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.282212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.237376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.239974+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.276340+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-02T18:15:40.516 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-01-02T18:15:40.516 INFO:tasks.ceph:Creating RBD pool 2023-01-02T18:15:40.517 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool create rbd 8 2023-01-02T18:15:41.572 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'rbd' created 2023-01-02T18:15:41.587 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-01-02T18:15:42.582 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rbd' on pool 'rbd' 2023-01-02T18:15:42.592 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-01-02T18:15:42.592 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-01-02T18:15:42.593 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-01-02T18:15:42.593 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-01-02T18:15:42.593 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-01-02T18:15:42.948 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:42.960 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":106237},{"type":"v1","addr":"172.21.15.57:6833","nonce":106237}]},"active_addr":"172.21.15.57:6833/106237","active_change":"2023-01-02T18:15:34.509414+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":4122,"name":"y","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":1700798785}]},{"addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":2040412619}]}]}} 2023-01-02T18:15:42.964 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-01-02T18:15:42.964 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-01-02T18:15:42.964 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-02T18:15:43.266 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:43.266 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":17,"fsid":"4e320929-c4bb-4ea9-9e1c-d8479b7e40b1","created":"2023-01-02T18:15:29.542145+0000","modified":"2023-01-02T18:15:42.566517+0000","last_up_change":"2023-01-02T18:15:38.537792+0000","last_in_change":"2023-01-02T18:15:32.099480+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-02T18:15:38.598445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-02T18:15:40.853543+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"69e18813-bd8e-4b22-9c40-d702ff3a5efd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":107063},{"type":"v1","addr":"172.21.15.7:6809","nonce":107063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":107063},{"type":"v1","addr":"172.21.15.7:6811","nonce":107063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":107063},{"type":"v1","addr":"172.21.15.7:6815","nonce":107063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":107063},{"type":"v1","addr":"172.21.15.7:6813","nonce":107063}]},"public_addr":"172.21.15.7:6809/107063","cluster_addr":"172.21.15.7:6811/107063","heartbeat_back_addr":"172.21.15.7:6815/107063","heartbeat_front_addr":"172.21.15.7:6813/107063","state":["exists","up"]},{"osd":1,"uuid":"aa04dec6-4607-4f2a-85a3-a6278832fef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":107066},{"type":"v1","addr":"172.21.15.7:6825","nonce":107066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":107066},{"type":"v1","addr":"172.21.15.7:6827","nonce":107066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":107066},{"type":"v1","addr":"172.21.15.7:6831","nonce":107066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":107066},{"type":"v1","addr":"172.21.15.7:6829","nonce":107066}]},"public_addr":"172.21.15.7:6825/107066","cluster_addr":"172.21.15.7:6827/107066","heartbeat_back_addr":"172.21.15.7:6831/107066","heartbeat_front_addr":"172.21.15.7:6829/107066","state":["exists","up"]},{"osd":2,"uuid":"c98a28fb-d910-4601-a229-d4318259ab9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":107065},{"type":"v1","addr":"172.21.15.7:6817","nonce":107065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":107065},{"type":"v1","addr":"172.21.15.7:6819","nonce":107065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":107065},{"type":"v1","addr":"172.21.15.7:6823","nonce":107065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":107065},{"type":"v1","addr":"172.21.15.7:6821","nonce":107065}]},"public_addr":"172.21.15.7:6817/107065","cluster_addr":"172.21.15.7:6819/107065","heartbeat_back_addr":"172.21.15.7:6823/107065","heartbeat_front_addr":"172.21.15.7:6821/107065","state":["exists","up"]},{"osd":3,"uuid":"3c5d48f4-5384-4563-8acb-11d866b85ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":107064},{"type":"v1","addr":"172.21.15.7:6801","nonce":107064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":107064},{"type":"v1","addr":"172.21.15.7:6803","nonce":107064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":107064},{"type":"v1","addr":"172.21.15.7:6807","nonce":107064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":107064},{"type":"v1","addr":"172.21.15.7:6805","nonce":107064}]},"public_addr":"172.21.15.7:6801/107064","cluster_addr":"172.21.15.7:6803/107064","heartbeat_back_addr":"172.21.15.7:6807/107064","heartbeat_front_addr":"172.21.15.7:6805/107064","state":["exists","up"]},{"osd":4,"uuid":"2476d495-4979-4679-a7e9-12652c270092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":106900},{"type":"v1","addr":"172.21.15.57:6801","nonce":106900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":106900},{"type":"v1","addr":"172.21.15.57:6803","nonce":106900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":106900},{"type":"v1","addr":"172.21.15.57:6807","nonce":106900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":106900},{"type":"v1","addr":"172.21.15.57:6805","nonce":106900}]},"public_addr":"172.21.15.57:6801/106900","cluster_addr":"172.21.15.57:6803/106900","heartbeat_back_addr":"172.21.15.57:6807/106900","heartbeat_front_addr":"172.21.15.57:6805/106900","state":["exists","up"]},{"osd":5,"uuid":"38d57e5e-b6c1-445f-b181-23fb518698f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":106930},{"type":"v1","addr":"172.21.15.57:6817","nonce":106930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":106930},{"type":"v1","addr":"172.21.15.57:6819","nonce":106930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":106930},{"type":"v1","addr":"172.21.15.57:6823","nonce":106930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":106930},{"type":"v1","addr":"172.21.15.57:6821","nonce":106930}]},"public_addr":"172.21.15.57:6817/106930","cluster_addr":"172.21.15.57:6819/106930","heartbeat_back_addr":"172.21.15.57:6823/106930","heartbeat_front_addr":"172.21.15.57:6821/106930","state":["exists","up"]},{"osd":6,"uuid":"6c78f25a-2a65-47fe-b101-e47c00a5b2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":106901},{"type":"v1","addr":"172.21.15.57:6809","nonce":106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":106901},{"type":"v1","addr":"172.21.15.57:6811","nonce":106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":106901},{"type":"v1","addr":"172.21.15.57:6815","nonce":106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":106901},{"type":"v1","addr":"172.21.15.57:6813","nonce":106901}]},"public_addr":"172.21.15.57:6809/106901","cluster_addr":"172.21.15.57:6811/106901","heartbeat_back_addr":"172.21.15.57:6815/106901","heartbeat_front_addr":"172.21.15.57:6813/106901","state":["exists","up"]},{"osd":7,"uuid":"b094706d-7145-4865-ae95-e5cd7e40d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":106931},{"type":"v1","addr":"172.21.15.57:6825","nonce":106931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":106931},{"type":"v1","addr":"172.21.15.57:6827","nonce":106931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":106931},{"type":"v1","addr":"172.21.15.57:6831","nonce":106931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":106931},{"type":"v1","addr":"172.21.15.57:6829","nonce":106931}]},"public_addr":"172.21.15.57:6825/106931","cluster_addr":"172.21.15.57:6827/106931","heartbeat_back_addr":"172.21.15.57:6831/106931","heartbeat_front_addr":"172.21.15.57:6829/106931","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.290083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.303022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.292245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.210530+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.282212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.237376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.239974+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.276340+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-02T18:15:43.279 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-01-02T18:15:43.280 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-01-02T18:15:43.584 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:43.585 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"fsid":"4e320929-c4bb-4ea9-9e1c-d8479b7e40b1","created":"2023-01-02T18:15:29.542145+0000","modified":"2023-01-02T18:15:43.573709+0000","last_up_change":"2023-01-02T18:15:38.537792+0000","last_in_change":"2023-01-02T18:15:32.099480+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-01-02T18:15:38.598445+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-01-02T18:15:40.853543+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"69e18813-bd8e-4b22-9c40-d702ff3a5efd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6808","nonce":107063},{"type":"v1","addr":"172.21.15.7:6809","nonce":107063}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6810","nonce":107063},{"type":"v1","addr":"172.21.15.7:6811","nonce":107063}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6814","nonce":107063},{"type":"v1","addr":"172.21.15.7:6815","nonce":107063}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6812","nonce":107063},{"type":"v1","addr":"172.21.15.7:6813","nonce":107063}]},"public_addr":"172.21.15.7:6809/107063","cluster_addr":"172.21.15.7:6811/107063","heartbeat_back_addr":"172.21.15.7:6815/107063","heartbeat_front_addr":"172.21.15.7:6813/107063","state":["exists","up"]},{"osd":1,"uuid":"aa04dec6-4607-4f2a-85a3-a6278832fef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6824","nonce":107066},{"type":"v1","addr":"172.21.15.7:6825","nonce":107066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6826","nonce":107066},{"type":"v1","addr":"172.21.15.7:6827","nonce":107066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6830","nonce":107066},{"type":"v1","addr":"172.21.15.7:6831","nonce":107066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6828","nonce":107066},{"type":"v1","addr":"172.21.15.7:6829","nonce":107066}]},"public_addr":"172.21.15.7:6825/107066","cluster_addr":"172.21.15.7:6827/107066","heartbeat_back_addr":"172.21.15.7:6831/107066","heartbeat_front_addr":"172.21.15.7:6829/107066","state":["exists","up"]},{"osd":2,"uuid":"c98a28fb-d910-4601-a229-d4318259ab9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6816","nonce":107065},{"type":"v1","addr":"172.21.15.7:6817","nonce":107065}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6818","nonce":107065},{"type":"v1","addr":"172.21.15.7:6819","nonce":107065}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6822","nonce":107065},{"type":"v1","addr":"172.21.15.7:6823","nonce":107065}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6820","nonce":107065},{"type":"v1","addr":"172.21.15.7:6821","nonce":107065}]},"public_addr":"172.21.15.7:6817/107065","cluster_addr":"172.21.15.7:6819/107065","heartbeat_back_addr":"172.21.15.7:6823/107065","heartbeat_front_addr":"172.21.15.7:6821/107065","state":["exists","up"]},{"osd":3,"uuid":"3c5d48f4-5384-4563-8acb-11d866b85ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":107064},{"type":"v1","addr":"172.21.15.7:6801","nonce":107064}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":107064},{"type":"v1","addr":"172.21.15.7:6803","nonce":107064}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6806","nonce":107064},{"type":"v1","addr":"172.21.15.7:6807","nonce":107064}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6804","nonce":107064},{"type":"v1","addr":"172.21.15.7:6805","nonce":107064}]},"public_addr":"172.21.15.7:6801/107064","cluster_addr":"172.21.15.7:6803/107064","heartbeat_back_addr":"172.21.15.7:6807/107064","heartbeat_front_addr":"172.21.15.7:6805/107064","state":["exists","up"]},{"osd":4,"uuid":"2476d495-4979-4679-a7e9-12652c270092","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":106900},{"type":"v1","addr":"172.21.15.57:6801","nonce":106900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":106900},{"type":"v1","addr":"172.21.15.57:6803","nonce":106900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":106900},{"type":"v1","addr":"172.21.15.57:6807","nonce":106900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":106900},{"type":"v1","addr":"172.21.15.57:6805","nonce":106900}]},"public_addr":"172.21.15.57:6801/106900","cluster_addr":"172.21.15.57:6803/106900","heartbeat_back_addr":"172.21.15.57:6807/106900","heartbeat_front_addr":"172.21.15.57:6805/106900","state":["exists","up"]},{"osd":5,"uuid":"38d57e5e-b6c1-445f-b181-23fb518698f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":106930},{"type":"v1","addr":"172.21.15.57:6817","nonce":106930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":106930},{"type":"v1","addr":"172.21.15.57:6819","nonce":106930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":106930},{"type":"v1","addr":"172.21.15.57:6823","nonce":106930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":106930},{"type":"v1","addr":"172.21.15.57:6821","nonce":106930}]},"public_addr":"172.21.15.57:6817/106930","cluster_addr":"172.21.15.57:6819/106930","heartbeat_back_addr":"172.21.15.57:6823/106930","heartbeat_front_addr":"172.21.15.57:6821/106930","state":["exists","up"]},{"osd":6,"uuid":"6c78f25a-2a65-47fe-b101-e47c00a5b2f6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":106901},{"type":"v1","addr":"172.21.15.57:6809","nonce":106901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":106901},{"type":"v1","addr":"172.21.15.57:6811","nonce":106901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":106901},{"type":"v1","addr":"172.21.15.57:6815","nonce":106901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":106901},{"type":"v1","addr":"172.21.15.57:6813","nonce":106901}]},"public_addr":"172.21.15.57:6809/106901","cluster_addr":"172.21.15.57:6811/106901","heartbeat_back_addr":"172.21.15.57:6815/106901","heartbeat_front_addr":"172.21.15.57:6813/106901","state":["exists","up"]},{"osd":7,"uuid":"b094706d-7145-4865-ae95-e5cd7e40d23b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":106931},{"type":"v1","addr":"172.21.15.57:6825","nonce":106931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":106931},{"type":"v1","addr":"172.21.15.57:6827","nonce":106931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":106931},{"type":"v1","addr":"172.21.15.57:6831","nonce":106931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":106931},{"type":"v1","addr":"172.21.15.57:6829","nonce":106931}]},"public_addr":"172.21.15.57:6825/106931","cluster_addr":"172.21.15.57:6827/106931","heartbeat_back_addr":"172.21.15.57:6831/106931","heartbeat_front_addr":"172.21.15.57:6829/106931","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.290083+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.303022+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.292245+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.210530+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.282212+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.237376+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.239974+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-01-02T18:15:37.276340+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-01-02T18:15:43.598 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-01-02T18:15:43.752 INFO:teuthology.orchestra.run.smithi007.stdout:55834574850 2023-01-02T18:15:43.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-01-02T18:15:43.906 INFO:teuthology.orchestra.run.smithi007.stdout:55834574851 2023-01-02T18:15:43.907 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-01-02T18:15:44.060 INFO:teuthology.orchestra.run.smithi007.stdout:55834574851 2023-01-02T18:15:44.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-01-02T18:15:44.214 INFO:teuthology.orchestra.run.smithi007.stdout:55834574851 2023-01-02T18:15:44.214 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-01-02T18:15:44.368 INFO:teuthology.orchestra.run.smithi007.stdout:55834574851 2023-01-02T18:15:44.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-01-02T18:15:44.523 INFO:teuthology.orchestra.run.smithi007.stdout:55834574850 2023-01-02T18:15:44.523 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-01-02T18:15:44.676 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-01-02T18:15:44.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-01-02T18:15:44.831 INFO:teuthology.orchestra.run.smithi007.stdout:55834574851 2023-01-02T18:15:44.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-02T18:15:45.136 INFO:teuthology.orchestra.run.smithi007.stdout:55834574849 2023-01-02T18:15:45.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574849 for osd.0 2023-01-02T18:15:46.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-01-02T18:15:46.464 INFO:teuthology.orchestra.run.smithi007.stdout:55834574850 2023-01-02T18:15:46.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574850 for osd.0 2023-01-02T18:15:46.478 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-01-02T18:15:46.780 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-01-02T18:15:46.793 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.1 2023-01-02T18:15:46.793 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-01-02T18:15:47.096 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-01-02T18:15:47.110 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.2 2023-01-02T18:15:47.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-01-02T18:15:47.411 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-01-02T18:15:47.425 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.3 2023-01-02T18:15:47.425 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-01-02T18:15:47.725 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-01-02T18:15:47.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574852 for osd.4 2023-01-02T18:15:47.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-01-02T18:15:48.041 INFO:teuthology.orchestra.run.smithi007.stdout:55834574851 2023-01-02T18:15:48.054 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574850 got 55834574851 for osd.5 2023-01-02T18:15:48.054 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-01-02T18:15:48.357 INFO:teuthology.orchestra.run.smithi007.stdout:55834574852 2023-01-02T18:15:48.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2023-01-02T18:15:48.370 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-01-02T18:15:48.676 INFO:teuthology.orchestra.run.smithi007.stdout:55834574851 2023-01-02T18:15:48.690 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.7 2023-01-02T18:15:48.690 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-02T18:15:48.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:15:48.986 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:48.988 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:15:48.999 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-02T18:15:48.516907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":39744,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":38272,"kb_avail":754934976,"statfs":{"total":773094113280,"available":773053415424,"internally_reserved":0,"allocated":1441792,"data_stored":468432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39190528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.591748+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:15:42.591748+0000","last_peered":"2023-01-02T18:15:42.591748+0000","last_clean":"2023-01-02T18:15:42.591748+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:15:42.591748+0000","last_undegraded":"2023-01-02T18:15:42.591748+0000","last_fullsized":"2023-01-02T18:15:42.591748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.588012+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:15:42.588012+0000","last_peered":"2023-01-02T18:15:42.588012+0000","last_clean":"2023-01-02T18:15:42.588012+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:15:42.588012+0000","last_undegraded":"2023-01-02T18:15:42.588012+0000","last_fullsized":"2023-01-02T18:15:42.588012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.591722+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:15:42.591722+0000","last_peered":"2023-01-02T18:15:42.591722+0000","last_clean":"2023-01-02T18:15:42.591722+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:15:42.591722+0000","last_undegraded":"2023-01-02T18:15:42.591722+0000","last_fullsized":"2023-01-02T18:15:42.591722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.586801+0000","last_change":"2023-01-02T18:15:42.581338+0000","last_active":"2023-01-02T18:15:42.586801+0000","last_peered":"2023-01-02T18:15:42.586801+0000","last_clean":"2023-01-02T18:15:42.586801+0000","last_became_active":"2023-01-02T18:15:42.581049+0000","last_became_peered":"2023-01-02T18:15:42.581049+0000","last_unstale":"2023-01-02T18:15:42.586801+0000","last_undegraded":"2023-01-02T18:15:42.586801+0000","last_fullsized":"2023-01-02T18:15:42.586801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.577078+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:15:42.577078+0000","last_peered":"2023-01-02T18:15:42.577078+0000","last_clean":"2023-01-02T18:15:42.577078+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:15:42.577078+0000","last_undegraded":"2023-01-02T18:15:42.577078+0000","last_fullsized":"2023-01-02T18:15:42.577078+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.582087+0000","last_change":"2023-01-02T18:15:42.578753+0000","last_active":"2023-01-02T18:15:42.582087+0000","last_peered":"2023-01-02T18:15:42.582087+0000","last_clean":"2023-01-02T18:15:42.582087+0000","last_became_active":"2023-01-02T18:15:42.578479+0000","last_became_peered":"2023-01-02T18:15:42.578479+0000","last_unstale":"2023-01-02T18:15:42.582087+0000","last_undegraded":"2023-01-02T18:15:42.582087+0000","last_fullsized":"2023-01-02T18:15:42.582087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.575749+0000","last_change":"2023-01-02T18:15:42.574921+0000","last_active":"2023-01-02T18:15:42.575749+0000","last_peered":"2023-01-02T18:15:42.575749+0000","last_clean":"2023-01-02T18:15:42.575749+0000","last_became_active":"2023-01-02T18:15:42.574593+0000","last_became_peered":"2023-01-02T18:15:42.574593+0000","last_unstale":"2023-01-02T18:15:42.575749+0000","last_undegraded":"2023-01-02T18:15:42.575749+0000","last_fullsized":"2023-01-02T18:15:42.575749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.586638+0000","last_change":"2023-01-02T18:15:42.581483+0000","last_active":"2023-01-02T18:15:42.586638+0000","last_peered":"2023-01-02T18:15:42.586638+0000","last_clean":"2023-01-02T18:15:42.586638+0000","last_became_active":"2023-01-02T18:15:42.581182+0000","last_became_peered":"2023-01-02T18:15:42.581182+0000","last_unstale":"2023-01-02T18:15:42.586638+0000","last_undegraded":"2023-01-02T18:15:42.586638+0000","last_fullsized":"2023-01-02T18:15:42.586638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.575890+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:15:42.575890+0000","last_peered":"2023-01-02T18:15:42.575890+0000","last_clean":"2023-01-02T18:15:42.575890+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:15:42.575890+0000","last_undegraded":"2023-01-02T18:15:42.575890+0000","last_fullsized":"2023-01-02T18:15:42.575890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4920,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366920,"statfs":{"total":96636764160,"available":96631726080,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":4920,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366920,"statfs":{"total":96636764160,"available":96631726080,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:15:49.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:15:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:49.302 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:15:49.313 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-02T18:15:48.516907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":39744,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":38272,"kb_avail":754934976,"statfs":{"total":773094113280,"available":773053415424,"internally_reserved":0,"allocated":1441792,"data_stored":468432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39190528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.591748+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:15:42.591748+0000","last_peered":"2023-01-02T18:15:42.591748+0000","last_clean":"2023-01-02T18:15:42.591748+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:15:42.591748+0000","last_undegraded":"2023-01-02T18:15:42.591748+0000","last_fullsized":"2023-01-02T18:15:42.591748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.588012+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:15:42.588012+0000","last_peered":"2023-01-02T18:15:42.588012+0000","last_clean":"2023-01-02T18:15:42.588012+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:15:42.588012+0000","last_undegraded":"2023-01-02T18:15:42.588012+0000","last_fullsized":"2023-01-02T18:15:42.588012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.591722+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:15:42.591722+0000","last_peered":"2023-01-02T18:15:42.591722+0000","last_clean":"2023-01-02T18:15:42.591722+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:15:42.591722+0000","last_undegraded":"2023-01-02T18:15:42.591722+0000","last_fullsized":"2023-01-02T18:15:42.591722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.586801+0000","last_change":"2023-01-02T18:15:42.581338+0000","last_active":"2023-01-02T18:15:42.586801+0000","last_peered":"2023-01-02T18:15:42.586801+0000","last_clean":"2023-01-02T18:15:42.586801+0000","last_became_active":"2023-01-02T18:15:42.581049+0000","last_became_peered":"2023-01-02T18:15:42.581049+0000","last_unstale":"2023-01-02T18:15:42.586801+0000","last_undegraded":"2023-01-02T18:15:42.586801+0000","last_fullsized":"2023-01-02T18:15:42.586801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.577078+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:15:42.577078+0000","last_peered":"2023-01-02T18:15:42.577078+0000","last_clean":"2023-01-02T18:15:42.577078+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:15:42.577078+0000","last_undegraded":"2023-01-02T18:15:42.577078+0000","last_fullsized":"2023-01-02T18:15:42.577078+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.582087+0000","last_change":"2023-01-02T18:15:42.578753+0000","last_active":"2023-01-02T18:15:42.582087+0000","last_peered":"2023-01-02T18:15:42.582087+0000","last_clean":"2023-01-02T18:15:42.582087+0000","last_became_active":"2023-01-02T18:15:42.578479+0000","last_became_peered":"2023-01-02T18:15:42.578479+0000","last_unstale":"2023-01-02T18:15:42.582087+0000","last_undegraded":"2023-01-02T18:15:42.582087+0000","last_fullsized":"2023-01-02T18:15:42.582087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.575749+0000","last_change":"2023-01-02T18:15:42.574921+0000","last_active":"2023-01-02T18:15:42.575749+0000","last_peered":"2023-01-02T18:15:42.575749+0000","last_clean":"2023-01-02T18:15:42.575749+0000","last_became_active":"2023-01-02T18:15:42.574593+0000","last_became_peered":"2023-01-02T18:15:42.574593+0000","last_unstale":"2023-01-02T18:15:42.575749+0000","last_undegraded":"2023-01-02T18:15:42.575749+0000","last_fullsized":"2023-01-02T18:15:42.575749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.586638+0000","last_change":"2023-01-02T18:15:42.581483+0000","last_active":"2023-01-02T18:15:42.586638+0000","last_peered":"2023-01-02T18:15:42.586638+0000","last_clean":"2023-01-02T18:15:42.586638+0000","last_became_active":"2023-01-02T18:15:42.581182+0000","last_became_peered":"2023-01-02T18:15:42.581182+0000","last_unstale":"2023-01-02T18:15:42.586638+0000","last_undegraded":"2023-01-02T18:15:42.586638+0000","last_fullsized":"2023-01-02T18:15:42.586638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.575890+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:15:42.575890+0000","last_peered":"2023-01-02T18:15:42.575890+0000","last_clean":"2023-01-02T18:15:42.575890+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:15:42.575890+0000","last_undegraded":"2023-01-02T18:15:42.575890+0000","last_fullsized":"2023-01-02T18:15:42.575890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4920,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366920,"statfs":{"total":96636764160,"available":96631726080,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":4920,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366920,"statfs":{"total":96636764160,"available":96631726080,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:15:49.314 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-02T18:15:49.315 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-01-02T18:15:49.315 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-01-02T18:15:49.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-01-02T18:15:49.653 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:49.667 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-01-02T18:15:49.667 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-01-02T18:15:49.668 INFO:teuthology.run_tasks:Running task thrashosds... 2023-01-02T18:15:49.678 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-01-02T18:15:49.678 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'pacific_16.2.11_RC4'}, 'ceph': {'conf': {'client': {'rbd clone copy on read': True}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(CACHE_POOL_NO_HIT_SET\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'is full \\(reached quota', '\\(POOL_FULL\\)'], 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f2bb1478686242c0f68882a9cf8df4e0f8363116'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'pacific_qa', 'sha1': '623bc557440f012d459eb3c5ded0a7dee57ecdb1'}} 2023-01-02T18:15:49.679 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-01-02T18:15:49.679 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-01-02T18:15:49.998 INFO:tasks.thrashosds:Beginning thrashosds... 2023-01-02T18:15:49.998 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-01-02T18:15:49.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:15:50.295 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:50.297 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:15:50.308 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2023-01-02T18:15:48.516907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":39744,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":38272,"kb_avail":754934976,"statfs":{"total":773094113280,"available":773053415424,"internally_reserved":0,"allocated":1441792,"data_stored":468432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39190528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.591748+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:15:42.591748+0000","last_peered":"2023-01-02T18:15:42.591748+0000","last_clean":"2023-01-02T18:15:42.591748+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:15:42.591748+0000","last_undegraded":"2023-01-02T18:15:42.591748+0000","last_fullsized":"2023-01-02T18:15:42.591748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.588012+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:15:42.588012+0000","last_peered":"2023-01-02T18:15:42.588012+0000","last_clean":"2023-01-02T18:15:42.588012+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:15:42.588012+0000","last_undegraded":"2023-01-02T18:15:42.588012+0000","last_fullsized":"2023-01-02T18:15:42.588012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.591722+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:15:42.591722+0000","last_peered":"2023-01-02T18:15:42.591722+0000","last_clean":"2023-01-02T18:15:42.591722+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:15:42.591722+0000","last_undegraded":"2023-01-02T18:15:42.591722+0000","last_fullsized":"2023-01-02T18:15:42.591722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.586801+0000","last_change":"2023-01-02T18:15:42.581338+0000","last_active":"2023-01-02T18:15:42.586801+0000","last_peered":"2023-01-02T18:15:42.586801+0000","last_clean":"2023-01-02T18:15:42.586801+0000","last_became_active":"2023-01-02T18:15:42.581049+0000","last_became_peered":"2023-01-02T18:15:42.581049+0000","last_unstale":"2023-01-02T18:15:42.586801+0000","last_undegraded":"2023-01-02T18:15:42.586801+0000","last_fullsized":"2023-01-02T18:15:42.586801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.577078+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:15:42.577078+0000","last_peered":"2023-01-02T18:15:42.577078+0000","last_clean":"2023-01-02T18:15:42.577078+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:15:42.577078+0000","last_undegraded":"2023-01-02T18:15:42.577078+0000","last_fullsized":"2023-01-02T18:15:42.577078+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.582087+0000","last_change":"2023-01-02T18:15:42.578753+0000","last_active":"2023-01-02T18:15:42.582087+0000","last_peered":"2023-01-02T18:15:42.582087+0000","last_clean":"2023-01-02T18:15:42.582087+0000","last_became_active":"2023-01-02T18:15:42.578479+0000","last_became_peered":"2023-01-02T18:15:42.578479+0000","last_unstale":"2023-01-02T18:15:42.582087+0000","last_undegraded":"2023-01-02T18:15:42.582087+0000","last_fullsized":"2023-01-02T18:15:42.582087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.575749+0000","last_change":"2023-01-02T18:15:42.574921+0000","last_active":"2023-01-02T18:15:42.575749+0000","last_peered":"2023-01-02T18:15:42.575749+0000","last_clean":"2023-01-02T18:15:42.575749+0000","last_became_active":"2023-01-02T18:15:42.574593+0000","last_became_peered":"2023-01-02T18:15:42.574593+0000","last_unstale":"2023-01-02T18:15:42.575749+0000","last_undegraded":"2023-01-02T18:15:42.575749+0000","last_fullsized":"2023-01-02T18:15:42.575749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.586638+0000","last_change":"2023-01-02T18:15:42.581483+0000","last_active":"2023-01-02T18:15:42.586638+0000","last_peered":"2023-01-02T18:15:42.586638+0000","last_clean":"2023-01-02T18:15:42.586638+0000","last_became_active":"2023-01-02T18:15:42.581182+0000","last_became_peered":"2023-01-02T18:15:42.581182+0000","last_unstale":"2023-01-02T18:15:42.586638+0000","last_undegraded":"2023-01-02T18:15:42.586638+0000","last_fullsized":"2023-01-02T18:15:42.586638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.575890+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:15:42.575890+0000","last_peered":"2023-01-02T18:15:42.575890+0000","last_clean":"2023-01-02T18:15:42.575890+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:15:42.575890+0000","last_undegraded":"2023-01-02T18:15:42.575890+0000","last_fullsized":"2023-01-02T18:15:42.575890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.24099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.372}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4920,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366920,"statfs":{"total":96636764160,"available":96631726080,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":4920,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366920,"statfs":{"total":96636764160,"available":96631726080,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:15:50.309 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:15:50.611 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:15:50.613 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:15:50.624 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2023-01-02T18:15:50.517334+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":39744,"kb_used_data":1408,"kb_used_omap":0,"kb_used_meta":38272,"kb_avail":754934976,"statfs":{"total":773094113280,"available":773053415424,"internally_reserved":0,"allocated":1441792,"data_stored":468432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39190528},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.591748+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:15:42.591748+0000","last_peered":"2023-01-02T18:15:42.591748+0000","last_clean":"2023-01-02T18:15:42.591748+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:15:42.591748+0000","last_undegraded":"2023-01-02T18:15:42.591748+0000","last_fullsized":"2023-01-02T18:15:42.591748+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.588012+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:15:42.588012+0000","last_peered":"2023-01-02T18:15:42.588012+0000","last_clean":"2023-01-02T18:15:42.588012+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:15:42.588012+0000","last_undegraded":"2023-01-02T18:15:42.588012+0000","last_fullsized":"2023-01-02T18:15:42.588012+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.591722+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:15:42.591722+0000","last_peered":"2023-01-02T18:15:42.591722+0000","last_clean":"2023-01-02T18:15:42.591722+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:15:42.591722+0000","last_undegraded":"2023-01-02T18:15:42.591722+0000","last_fullsized":"2023-01-02T18:15:42.591722+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.586801+0000","last_change":"2023-01-02T18:15:42.581338+0000","last_active":"2023-01-02T18:15:42.586801+0000","last_peered":"2023-01-02T18:15:42.586801+0000","last_clean":"2023-01-02T18:15:42.586801+0000","last_became_active":"2023-01-02T18:15:42.581049+0000","last_became_peered":"2023-01-02T18:15:42.581049+0000","last_unstale":"2023-01-02T18:15:42.586801+0000","last_undegraded":"2023-01-02T18:15:42.586801+0000","last_fullsized":"2023-01-02T18:15:42.586801+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.577078+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:15:42.577078+0000","last_peered":"2023-01-02T18:15:42.577078+0000","last_clean":"2023-01-02T18:15:42.577078+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:15:42.577078+0000","last_undegraded":"2023-01-02T18:15:42.577078+0000","last_fullsized":"2023-01-02T18:15:42.577078+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.582087+0000","last_change":"2023-01-02T18:15:42.578753+0000","last_active":"2023-01-02T18:15:42.582087+0000","last_peered":"2023-01-02T18:15:42.582087+0000","last_clean":"2023-01-02T18:15:42.582087+0000","last_became_active":"2023-01-02T18:15:42.578479+0000","last_became_peered":"2023-01-02T18:15:42.578479+0000","last_unstale":"2023-01-02T18:15:42.582087+0000","last_undegraded":"2023-01-02T18:15:42.582087+0000","last_fullsized":"2023-01-02T18:15:42.582087+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.575749+0000","last_change":"2023-01-02T18:15:42.574921+0000","last_active":"2023-01-02T18:15:42.575749+0000","last_peered":"2023-01-02T18:15:42.575749+0000","last_clean":"2023-01-02T18:15:42.575749+0000","last_became_active":"2023-01-02T18:15:42.574593+0000","last_became_peered":"2023-01-02T18:15:42.574593+0000","last_unstale":"2023-01-02T18:15:42.575749+0000","last_undegraded":"2023-01-02T18:15:42.575749+0000","last_fullsized":"2023-01-02T18:15:42.575749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.586638+0000","last_change":"2023-01-02T18:15:42.581483+0000","last_active":"2023-01-02T18:15:42.586638+0000","last_peered":"2023-01-02T18:15:42.586638+0000","last_clean":"2023-01-02T18:15:42.586638+0000","last_became_active":"2023-01-02T18:15:42.581182+0000","last_became_peered":"2023-01-02T18:15:42.581182+0000","last_unstale":"2023-01-02T18:15:42.586638+0000","last_undegraded":"2023-01-02T18:15:42.586638+0000","last_fullsized":"2023-01-02T18:15:42.586638+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-01-02T18:15:42.575890+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:15:42.575890+0000","last_peered":"2023-01-02T18:15:42.575890+0000","last_clean":"2023-01-02T18:15:42.575890+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:15:42.575890+0000","last_undegraded":"2023-01-02T18:15:42.575890+0000","last_fullsized":"2023-01-02T18:15:42.575890+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4920,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366920,"statfs":{"total":96636764160,"available":96631726080,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":4920,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":94366920,"statfs":{"total":96636764160,"available":96631726080,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4984,"kb_used_data":176,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366856,"statfs":{"total":96636764160,"available":96631660544,"internally_reserved":0,"allocated":180224,"data_stored":58554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:15:50.626 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-01-02T18:15:50.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-01-02T18:15:50.926 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 18 2023-01-02T18:15:50.926 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 4e320929-c4bb-4ea9-9e1c-d8479b7e40b1 2023-01-02T18:15:50.927 INFO:teuthology.orchestra.run.smithi007.stdout:created 2023-01-02T18:15:29.542145+0000 2023-01-02T18:15:50.927 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2023-01-02T18:15:43.573709+0000 2023-01-02T18:15:50.927 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-01-02T18:15:50.927 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 4 2023-01-02T18:15:50.928 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2023-01-02T18:15:50.928 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2023-01-02T18:15:50.928 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2023-01-02T18:15:50.928 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2023-01-02T18:15:50.928 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client jewel 2023-01-02T18:15:50.929 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release pacific 2023-01-02T18:15:50.929 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2023-01-02T18:15:50.929 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 'device_health_metrics' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr_devicehealth 2023-01-02T18:15:50.929 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 application rbd 2023-01-02T18:15:50.929 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 8 2023-01-02T18:15:50.930 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6808/107063,v1:172.21.15.7:6809/107063] [v2:172.21.15.7:6810/107063,v1:172.21.15.7:6811/107063] exists,up 69e18813-bd8e-4b22-9c40-d702ff3a5efd 2023-01-02T18:15:50.930 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6824/107066,v1:172.21.15.7:6825/107066] [v2:172.21.15.7:6826/107066,v1:172.21.15.7:6827/107066] exists,up aa04dec6-4607-4f2a-85a3-a6278832fef3 2023-01-02T18:15:50.930 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6816/107065,v1:172.21.15.7:6817/107065] [v2:172.21.15.7:6818/107065,v1:172.21.15.7:6819/107065] exists,up c98a28fb-d910-4601-a229-d4318259ab9b 2023-01-02T18:15:50.930 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6800/107064,v1:172.21.15.7:6801/107064] [v2:172.21.15.7:6802/107064,v1:172.21.15.7:6803/107064] exists,up 3c5d48f4-5384-4563-8acb-11d866b85ef4 2023-01-02T18:15:50.931 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6800/106900,v1:172.21.15.57:6801/106900] [v2:172.21.15.57:6802/106900,v1:172.21.15.57:6803/106900] exists,up 2476d495-4979-4679-a7e9-12652c270092 2023-01-02T18:15:50.931 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6816/106930,v1:172.21.15.57:6817/106930] [v2:172.21.15.57:6818/106930,v1:172.21.15.57:6819/106930] exists,up 38d57e5e-b6c1-445f-b181-23fb518698f9 2023-01-02T18:15:50.931 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6808/106901,v1:172.21.15.57:6809/106901] [v2:172.21.15.57:6810/106901,v1:172.21.15.57:6811/106901] exists,up 6c78f25a-2a65-47fe-b101-e47c00a5b2f6 2023-01-02T18:15:50.931 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6824/106931,v1:172.21.15.57:6825/106931] [v2:172.21.15.57:6826/106931,v1:172.21.15.57:6827/106931] exists,up b094706d-7145-4865-ae95-e5cd7e40d23b 2023-01-02T18:15:50.939 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6808/107063,v1:172.21.15.7:6809/107063] [v2:172.21.15.7:6810/107063,v1:172.21.15.7:6811/107063] exists,up 69e18813-bd8e-4b22-9c40-d702ff3a5efd', 'osd.1 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6824/107066,v1:172.21.15.7:6825/107066] [v2:172.21.15.7:6826/107066,v1:172.21.15.7:6827/107066] exists,up aa04dec6-4607-4f2a-85a3-a6278832fef3', 'osd.2 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6816/107065,v1:172.21.15.7:6817/107065] [v2:172.21.15.7:6818/107065,v1:172.21.15.7:6819/107065] exists,up c98a28fb-d910-4601-a229-d4318259ab9b', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.7:6800/107064,v1:172.21.15.7:6801/107064] [v2:172.21.15.7:6802/107064,v1:172.21.15.7:6803/107064] exists,up 3c5d48f4-5384-4563-8acb-11d866b85ef4', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6800/106900,v1:172.21.15.57:6801/106900] [v2:172.21.15.57:6802/106900,v1:172.21.15.57:6803/106900] exists,up 2476d495-4979-4679-a7e9-12652c270092', 'osd.5 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6816/106930,v1:172.21.15.57:6817/106930] [v2:172.21.15.57:6818/106930,v1:172.21.15.57:6819/106930] exists,up 38d57e5e-b6c1-445f-b181-23fb518698f9', 'osd.6 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6808/106901,v1:172.21.15.57:6809/106901] [v2:172.21.15.57:6810/106901,v1:172.21.15.57:6811/106901] exists,up 6c78f25a-2a65-47fe-b101-e47c00a5b2f6', 'osd.7 up in weight 1 up_from 13 up_thru 16 down_at 0 last_clean_interval [0,0) [v2:172.21.15.57:6824/106931,v1:172.21.15.57:6825/106931] [v2:172.21.15.57:6826/106931,v1:172.21.15.57:6827/106931] exists,up b094706d-7145-4865-ae95-e5cd7e40d23b'] 2023-01-02T18:15:50.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-01-02T18:15:51.061 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:51.062 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mon.a", 2023-01-02T18:15:51.062 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster": "ceph", 2023-01-02T18:15:51.062 INFO:teuthology.orchestra.run.smithi007.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-01-02T18:15:51.062 INFO:teuthology.orchestra.run.smithi007.stdout: "admin_socket_mode": "", 2023-01-02T18:15:51.062 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-01-02T18:15:51.063 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_client_required": "cephx, none", 2023-01-02T18:15:51.063 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_cluster_required": "cephx", 2023-01-02T18:15:51.063 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_debug": "true", 2023-01-02T18:15:51.063 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-01-02T18:15:51.063 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-01-02T18:15:51.064 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_service_required": "cephx", 2023-01-02T18:15:51.064 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_service_ticket_ttl": "240.000000", 2023-01-02T18:15:51.064 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_supported": "cephx", 2023-01-02T18:15:51.064 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio": "true", 2023-01-02T18:15:51.064 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_max_queue_depth": "1024", 2023-01-02T18:15:51.065 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_poll_ms": "250", 2023-01-02T18:15:51.065 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_reap_max": "16", 2023-01-02T18:15:51.065 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_async_discard": "false", 2023-01-02T18:15:51.065 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_block_size": "4096", 2023-01-02T18:15:51.065 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio": "false", 2023-01-02T18:15:51.065 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-01-02T18:15:51.066 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-01-02T18:15:51.066 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_inflight_ios": "false", 2023-01-02T18:15:51.066 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_enable_discard": "false", 2023-01-02T18:15:51.066 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_flock_retry": "3", 2023-01-02T18:15:51.066 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_flock_retry_interval": "0.100000", 2023-01-02T18:15:51.067 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_inject_crash": "0", 2023-01-02T18:15:51.067 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_inject_crash_flush_delay": "2", 2023-01-02T18:15:51.067 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring": "false", 2023-01-02T18:15:51.067 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring_hipri": "false", 2023-01-02T18:15:51.067 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring_sqthread_poll": "false", 2023-01-02T18:15:51.068 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-01-02T18:15:51.068 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_type": "", 2023-01-02T18:15:51.068 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_alloc_size": "1048576", 2023-01-02T18:15:51.068 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_allocator": "hybrid", 2023-01-02T18:15:51.068 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_buffered_io": "true", 2023-01-02T18:15:51.069 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_for_zeros": "false", 2023-01-02T18:15:51.069 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_compact_log_sync": "false", 2023-01-02T18:15:51.069 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-01-02T18:15:51.069 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_compact_min_size": "16777216", 2023-01-02T18:15:51.069 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_replay_check_allocations": "true", 2023-01-02T18:15:51.070 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_max_log_runway": "4194304", 2023-01-02T18:15:51.070 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_max_prefetch": "1048576", 2023-01-02T18:15:51.070 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_min_flush_size": "524288", 2023-01-02T18:15:51.070 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_min_log_runway": "1048576", 2023-01-02T18:15:51.070 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_replay_recovery": "false", 2023-01-02T18:15:51.071 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-01-02T18:15:51.071 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_shared_alloc_size": "65536", 2023-01-02T18:15:51.071 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_sync_write": "false", 2023-01-02T18:15:51.071 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-01-02T18:15:51.071 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-01-02T18:15:51.071 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-01-02T18:15:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_allocator": "hybrid", 2023-01-02T18:15:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-01-02T18:15:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-01-02T18:15:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-01-02T18:15:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-01-02T18:15:51.072 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-01-02T18:15:51.073 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-01-02T18:15:51.073 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blobid_prealloc": "10240", 2023-01-02T18:15:51.073 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_create": "true", 2023-01-02T18:15:51.073 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_create": "false", 2023-01-02T18:15:51.073 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_path": "", 2023-01-02T18:15:51.074 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_size": "0", 2023-01-02T18:15:51.074 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_path": "", 2023-01-02T18:15:51.074 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_preallocate_file": "false", 2023-01-02T18:15:51.074 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_size": "107374182400", 2023-01-02T18:15:51.074 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_create": "false", 2023-01-02T18:15:51.075 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_path": "", 2023-01-02T18:15:51.075 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_size": "100663296", 2023-01-02T18:15:51.075 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs": "true", 2023-01-02T18:15:51.075 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-01-02T18:15:51.075 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_env_mirror": "false", 2023-01-02T18:15:51.075 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_autotune": "true", 2023-01-02T18:15:51.076 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-01-02T18:15:51.076 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-01-02T18:15:51.076 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-01-02T18:15:51.076 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-01-02T18:15:51.076 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size": "0", 2023-01-02T18:15:51.077 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-01-02T18:15:51.077 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-01-02T18:15:51.077 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-01-02T18:15:51.077 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-01-02T18:15:51.077 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_type": "2q", 2023-01-02T18:15:51.078 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_clone_cow": "true", 2023-01-02T18:15:51.078 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_algorithm": "snappy", 2023-01-02T18:15:51.078 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size": "0", 2023-01-02T18:15:51.078 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-01-02T18:15:51.078 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-01-02T18:15:51.079 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size": "0", 2023-01-02T18:15:51.079 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-01-02T18:15:51.079 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size_ssd": "8192", 2023-01-02T18:15:51.079 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_mode": "none", 2023-01-02T18:15:51.079 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-01-02T18:15:51.079 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_csum_type": "crc32c", 2023-01-02T18:15:51.080 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_enforce_settings": "default", 2023-01-02T18:15:51.080 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_freelist": "false", 2023-01-02T18:15:51.080 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_fsck_abort": "false", 2023-01-02T18:15:51.080 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_bug21040": "false", 2023-01-02T18:15:51.080 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-01-02T18:15:51.081 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_read_err": "false", 2023-01-02T18:15:51.081 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_legacy_omap": "false", 2023-01-02T18:15:51.081 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-01-02T18:15:51.081 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-01-02T18:15:51.081 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-01-02T18:15:51.082 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-01-02T18:15:51.082 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_prefill": "0.000000", 2023-01-02T18:15:51.082 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-01-02T18:15:51.082 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-01-02T18:15:51.082 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-01-02T18:15:51.082 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_small_allocations": "0", 2023-01-02T18:15:51.083 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-01-02T18:15:51.083 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_default_buffered_read": "true", 2023-01-02T18:15:51.083 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_default_buffered_write": "false", 2023-01-02T18:15:51.083 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops": "0", 2023-01-02T18:15:51.083 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-01-02T18:15:51.084 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-01-02T18:15:51.084 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-01-02T18:15:51.084 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-01-02T18:15:51.084 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-01-02T18:15:51.084 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-01-02T18:15:51.084 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-01-02T18:15:51.085 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-01-02T18:15:51.085 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-01-02T18:15:51.085 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-01-02T18:15:51.085 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-01-02T18:15:51.085 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mkfs": "true", 2023-01-02T18:15:51.086 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-01-02T18:15:51.086 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mount": "false", 2023-01-02T18:15:51.086 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-01-02T18:15:51.086 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_umount": "false", 2023-01-02T18:15:51.086 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-01-02T18:15:51.087 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-01-02T18:15:51.087 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-01-02T18:15:51.087 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-01-02T18:15:51.087 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-01-02T18:15:51.087 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-01-02T18:15:51.087 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-01-02T18:15:51.088 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-01-02T18:15:51.088 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_ignore_data_csum": "false", 2023-01-02T18:15:51.088 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-01-02T18:15:51.088 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_kvbackend": "rocksdb", 2023-01-02T18:15:51.088 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-01-02T18:15:51.088 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-01-02T18:15:51.089 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_op_age": "5.000000", 2023-01-02T18:15:51.089 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_alloc_size": "0", 2023-01-02T18:15:51.089 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size": "0", 2023-01-02T18:15:51.089 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-01-02T18:15:51.089 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-01-02T18:15:51.090 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_defer_interval": "3.000000", 2023-01-02T18:15:51.090 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_deferred_txc": "32", 2023-01-02T18:15:51.090 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size": "0", 2023-01-02T18:15:51.090 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-01-02T18:15:51.090 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-01-02T18:15:51.090 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_nid_prealloc": "1024", 2023-01-02T18:15:51.091 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size": "0", 2023-01-02T18:15:51.091 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-01-02T18:15:51.091 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-01-02T18:15:51.091 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_retry_disk_reads": "3", 2023-01-02T18:15:51.091 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_cf": "true", 2023-01-02T18:15:51.091 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L P", 2023-01-02T18:15:51.092 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_options": "compression=kNoCompression,max_write_buffer_number=4,min_write_buffer_number_to_merge=1,recycle_log_file_num=4,write_buffer_size=268435456,writable_file_max_buffer_size=0,compaction_readahead_size=2097152,max_background_compactions=2,max_total_wal_size=1073741824", 2023-01-02T18:15:51.092 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_options_annex": "", 2023-01-02T18:15:51.092 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_coremask": "0x1", 2023-01-02T18:15:51.092 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_io_sleep": "5", 2023-01-02T18:15:51.092 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_max_io_completion": "0", 2023-01-02T18:15:51.092 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_mem": "512", 2023-01-02T18:15:51.093 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_sync_submit_transaction": "false", 2023-01-02T18:15:51.093 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_bytes": "67108864", 2023-01-02T18:15:51.093 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io": "0", 2023-01-02T18:15:51.093 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-01-02T18:15:51.093 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-01-02T18:15:51.094 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-01-02T18:15:51.094 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-01-02T18:15:51.094 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_tracing": "false", 2023-01-02T18:15:51.094 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-01-02T18:15:51.094 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_reserved": "0", 2023-01-02T18:15:51.095 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-01-02T18:15:51.095 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-01-02T18:15:51.095 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-01-02T18:15:51.095 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-01-02T18:15:51.095 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-01-02T18:15:51.096 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-01-02T18:15:51.096 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-01-02T18:15:51.096 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_action_update_interval": "2", 2023-01-02T18:15:51.096 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-01-02T18:15:51.096 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-01-02T18:15:51.096 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-01-02T18:15:51.097 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-01-02T18:15:51.097 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_mount_timeout": "10", 2023-01-02T18:15:51.097 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-01-02T18:15:51.097 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-01-02T18:15:51.097 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-01-02T18:15:51.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-01-02T18:15:51.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-01-02T18:15:51.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-01-02T18:15:51.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_cluster_require_signatures": "false", 2023-01-02T18:15:51.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_cluster_require_version": "2", 2023-01-02T18:15:51.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_require_signatures": "false", 2023-01-02T18:15:51.099 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_require_version": "2", 2023-01-02T18:15:51.099 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_service_require_signatures": "false", 2023-01-02T18:15:51.099 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_service_require_version": "2", 2023-01-02T18:15:51.099 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_sign_messages": "true", 2023-01-02T18:15:51.099 INFO:teuthology.orchestra.run.smithi007.stdout: "chdir": "", 2023-01-02T18:15:51.099 INFO:teuthology.orchestra.run.smithi007.stdout: "client_acl_type": "", 2023-01-02T18:15:51.100 INFO:teuthology.orchestra.run.smithi007.stdout: "client_asio_thread_count": "2", 2023-01-02T18:15:51.100 INFO:teuthology.orchestra.run.smithi007.stdout: "client_cache_mid": "0.750000", 2023-01-02T18:15:51.100 INFO:teuthology.orchestra.run.smithi007.stdout: "client_cache_size": "16384", 2023-01-02T18:15:51.100 INFO:teuthology.orchestra.run.smithi007.stdout: "client_caps_release_delay": "5", 2023-01-02T18:15:51.100 INFO:teuthology.orchestra.run.smithi007.stdout: "client_check_pool_perm": "true", 2023-01-02T18:15:51.101 INFO:teuthology.orchestra.run.smithi007.stdout: "client_collect_and_send_global_metrics": "false", 2023-01-02T18:15:51.101 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_force_sync_read": "false", 2023-01-02T18:15:51.101 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_getattr_caps": "false", 2023-01-02T18:15:51.101 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_inject_tick_delay": "0", 2023-01-02T18:15:51.101 INFO:teuthology.orchestra.run.smithi007.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-01-02T18:15:51.102 INFO:teuthology.orchestra.run.smithi007.stdout: "client_die_on_failed_remount": "false", 2023-01-02T18:15:51.102 INFO:teuthology.orchestra.run.smithi007.stdout: "client_dirsize_rbytes": "true", 2023-01-02T18:15:51.102 INFO:teuthology.orchestra.run.smithi007.stdout: "client_force_lazyio": "false", 2023-01-02T18:15:51.102 INFO:teuthology.orchestra.run.smithi007.stdout: "client_fs": "", 2023-01-02T18:15:51.102 INFO:teuthology.orchestra.run.smithi007.stdout: "client_inject_fixed_oldest_tid": "false", 2023-01-02T18:15:51.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_inject_release_failure": "false", 2023-01-02T18:15:51.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_max_inline_size": "4096", 2023-01-02T18:15:51.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mds_namespace": "", 2023-01-02T18:15:51.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_metadata": "", 2023-01-02T18:15:51.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_gid": "-1", 2023-01-02T18:15:51.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_timeout": "300", 2023-01-02T18:15:51.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_uid": "-1", 2023-01-02T18:15:51.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mountpoint": "/", 2023-01-02T18:15:51.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_notify_timeout": "10", 2023-01-02T18:15:51.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc": "true", 2023-01-02T18:15:51.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_dirty": "104857600", 2023-01-02T18:15:51.105 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_dirty_age": "5.000000", 2023-01-02T18:15:51.105 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_objects": "1000", 2023-01-02T18:15:51.105 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_size": "209715200", 2023-01-02T18:15:51.105 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_target_dirty": "8388608", 2023-01-02T18:15:51.105 INFO:teuthology.orchestra.run.smithi007.stdout: "client_permissions": "true", 2023-01-02T18:15:51.106 INFO:teuthology.orchestra.run.smithi007.stdout: "client_quota": "true", 2023-01-02T18:15:51.106 INFO:teuthology.orchestra.run.smithi007.stdout: "client_quota_df": "true", 2023-01-02T18:15:51.106 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_max_bytes": "0", 2023-01-02T18:15:51.106 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_max_periods": "4", 2023-01-02T18:15:51.106 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_min": "131072", 2023-01-02T18:15:51.106 INFO:teuthology.orchestra.run.smithi007.stdout: "client_reconnect_stale": "false", 2023-01-02T18:15:51.107 INFO:teuthology.orchestra.run.smithi007.stdout: "client_shutdown_timeout": "30", 2023-01-02T18:15:51.107 INFO:teuthology.orchestra.run.smithi007.stdout: "client_snapdir": ".snap", 2023-01-02T18:15:51.107 INFO:teuthology.orchestra.run.smithi007.stdout: "client_tick_interval": "1", 2023-01-02T18:15:51.107 INFO:teuthology.orchestra.run.smithi007.stdout: "client_trace": "", 2023-01-02T18:15:51.107 INFO:teuthology.orchestra.run.smithi007.stdout: "client_try_dentry_invalidate": "false", 2023-01-02T18:15:51.108 INFO:teuthology.orchestra.run.smithi007.stdout: "client_use_faked_inos": "false", 2023-01-02T18:15:51.108 INFO:teuthology.orchestra.run.smithi007.stdout: "client_use_random_mds": "false", 2023-01-02T18:15:51.108 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog": "false", 2023-01-02T18:15:51.108 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-01-02T18:15:51.108 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog_port": "12201", 2023-01-02T18:15:51.108 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_monitors": "default=true", 2023-01-02T18:15:51.109 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog": "false", 2023-01-02T18:15:51.109 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-01-02T18:15:51.109 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog_level": "info", 2023-01-02T18:15:51.109 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "-", 2023-01-02T18:15:51.109 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_network": "", 2023-01-02T18:15:51.110 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_network_interface": "", 2023-01-02T18:15:51.110 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_isal": "false", 2023-01-02T18:15:51.110 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_level": "5", 2023-01-02T18:15:51.110 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_winsize": "-15", 2023-01-02T18:15:51.110 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zstd_level": "1", 2023-01-02T18:15:51.110 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image": "docker.io/ceph/daemon-base:latest-pacific-devel", 2023-01-02T18:15:51.111 INFO:teuthology.orchestra.run.smithi007.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-01-02T18:15:51.111 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_obc_lru_size": "10", 2023-01-02T18:15:51.111 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-01-02T18:15:51.111 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location": "", 2023-01-02T18:15:51.111 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location_hook": "", 2023-01-02T18:15:51.112 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location_hook_timeout": "10", 2023-01-02T18:15:51.112 INFO:teuthology.orchestra.run.smithi007.stdout: "daemonize": "false", 2023-01-02T18:15:51.112 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_allow_any_pool_priority": "false", 2023-01-02T18:15:51.112 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asok": "1/5", 2023-01-02T18:15:51.112 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asok_assert_abort": "false", 2023-01-02T18:15:51.112 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asserts_on_shutdown": "true", 2023-01-02T18:15:51.113 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_auth": "20/20", 2023-01-02T18:15:51.113 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bdev": "1/3", 2023-01-02T18:15:51.113 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bluefs": "1/5", 2023-01-02T18:15:51.113 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bluestore": "1/5", 2023-01-02T18:15:51.113 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_buffer": "0/1", 2023-01-02T18:15:51.114 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cephfs_mirror": "0/5", 2023-01-02T18:15:51.114 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cephsqlite": "0/5", 2023-01-02T18:15:51.114 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_civetweb": "1/10", 2023-01-02T18:15:51.114 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_client": "0/5", 2023-01-02T18:15:51.114 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_compressor": "1/5", 2023-01-02T18:15:51.114 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_context": "0/1", 2023-01-02T18:15:51.115 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crush": "1/1", 2023-01-02T18:15:51.115 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crypto": "1/5", 2023-01-02T18:15:51.115 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_deliberately_leak_memory": "false", 2023-01-02T18:15:51.115 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_disable_randomized_ping": "false", 2023-01-02T18:15:51.115 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_dpdk": "1/5", 2023-01-02T18:15:51.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_eventtrace": "1/5", 2023-01-02T18:15:51.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_filer": "0/1", 2023-01-02T18:15:51.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_filestore": "1/3", 2023-01-02T18:15:51.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_finisher": "1/1", 2023-01-02T18:15:51.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_fuse": "1/5", 2023-01-02T18:15:51.116 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_heartbeat_testing_span": "0", 2023-01-02T18:15:51.117 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_heartbeatmap": "1/5", 2023-01-02T18:15:51.117 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_immutable_obj_cache": "0/5", 2023-01-02T18:15:51.117 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_javaclient": "1/5", 2023-01-02T18:15:51.117 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_journal": "1/3", 2023-01-02T18:15:51.117 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_journaler": "0/5", 2023-01-02T18:15:51.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_kstore": "1/5", 2023-01-02T18:15:51.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_leveldb": "4/5", 2023-01-02T18:15:51.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_lockdep": "0/1", 2023-01-02T18:15:51.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds": "1/5", 2023-01-02T18:15:51.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_balancer": "1/5", 2023-01-02T18:15:51.118 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_locker": "1/5", 2023-01-02T18:15:51.119 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_log": "1/5", 2023-01-02T18:15:51.119 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_log_expire": "1/5", 2023-01-02T18:15:51.119 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_migrator": "1/5", 2023-01-02T18:15:51.119 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_memdb": "4/5", 2023-01-02T18:15:51.119 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mgr": "2/5", 2023-01-02T18:15:51.119 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mgrc": "1/5", 2023-01-02T18:15:51.120 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mon": "20/20", 2023-01-02T18:15:51.120 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_monc": "0/10", 2023-01-02T18:15:51.120 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_ms": "1/1", 2023-01-02T18:15:51.120 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_none": "0/5", 2023-01-02T18:15:51.120 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objclass": "0/5", 2023-01-02T18:15:51.121 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objectcacher": "0/5", 2023-01-02T18:15:51.121 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objecter": "0/1", 2023-01-02T18:15:51.121 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_optracker": "0/5", 2023-01-02T18:15:51.121 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_osd": "1/5", 2023-01-02T18:15:51.121 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_paxos": "20/20", 2023-01-02T18:15:51.121 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_perfcounter": "1/5", 2023-01-02T18:15:51.122 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_prioritycache": "1/5", 2023-01-02T18:15:51.122 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rados": "0/5", 2023-01-02T18:15:51.122 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd": "0/5", 2023-01-02T18:15:51.122 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_mirror": "0/5", 2023-01-02T18:15:51.122 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_pwl": "0/5", 2023-01-02T18:15:51.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_replay": "0/5", 2023-01-02T18:15:51.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_refs": "0/0", 2023-01-02T18:15:51.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_reserver": "1/1", 2023-01-02T18:15:51.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw": "1/5", 2023-01-02T18:15:51.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_sync": "1/5", 2023-01-02T18:15:51.123 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rocksdb": "4/5", 2023-01-02T18:15:51.124 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_striper": "0/1", 2023-01-02T18:15:51.124 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_test": "0/5", 2023-01-02T18:15:51.124 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_throttle": "1/1", 2023-01-02T18:15:51.124 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_timer": "0/1", 2023-01-02T18:15:51.124 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_tp": "0/5", 2023-01-02T18:15:51.124 INFO:teuthology.orchestra.run.smithi007.stdout: "device_failure_prediction_mode": "none", 2023-01-02T18:15:51.125 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-01-02T18:15:51.125 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-01-02T18:15:51.125 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_graylog": "false", 2023-01-02T18:15:51.125 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_stderr": "true", 2023-01-02T18:15:51.125 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_syslog": "false", 2023-01-02T18:15:51.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event_tracing": "false", 2023-01-02T18:15:51.126 INFO:teuthology.orchestra.run.smithi007.stdout: "fake_statfs_for_testing": "0", 2023-01-02T18:15:51.126 INFO:teuthology.orchestra.run.smithi007.stdout: "fatal_signal_handlers": "true", 2023-01-02T18:15:51.126 INFO:teuthology.orchestra.run.smithi007.stdout: "filer_max_purge_ops": "10", 2023-01-02T18:15:51.126 INFO:teuthology.orchestra.run.smithi007.stdout: "filer_max_truncate_ops": "128", 2023-01-02T18:15:51.126 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_apply_finisher_threads": "1", 2023-01-02T18:15:51.127 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_blackhole": "false", 2023-01-02T18:15:51.127 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_btrfs_clone_range": "true", 2023-01-02T18:15:51.127 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_btrfs_snap": "true", 2023-01-02T18:15:51.127 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_caller_concurrency": "10", 2023-01-02T18:15:51.127 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_collect_device_partition_information": "true", 2023-01-02T18:15:51.128 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_commit_timeout": "600.000000", 2023-01-02T18:15:51.128 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_inject_read_err": "false", 2023-01-02T18:15:51.128 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_omap_check": "false", 2023-01-02T18:15:51.128 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_random_read_err": "0.000000", 2023-01-02T18:15:51.128 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_verify_split": "false", 2023-01-02T18:15:51.128 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_dump_file": "", 2023-01-02T18:15:51.129 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-01-02T18:15:51.129 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-01-02T18:15:51.129 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fadvise": "true", 2023-01-02T18:15:51.129 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fail_eio": "true", 2023-01-02T18:15:51.130 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fd_cache_shards": "16", 2023-01-02T18:15:51.130 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fd_cache_size": "128", 2023-01-02T18:15:51.130 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fiemap": "false", 2023-01-02T18:15:51.130 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fiemap_threshold": "4096", 2023-01-02T18:15:51.130 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-01-02T18:15:51.130 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_index_retry_probability": "0.000000", 2023-01-02T18:15:51.131 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_inject_stall": "0", 2023-01-02T18:15:51.131 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_parallel": "false", 2023-01-02T18:15:51.131 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_trailing": "false", 2023-01-02T18:15:51.131 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_writeahead": "false", 2023-01-02T18:15:51.131 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_kill_at": "0", 2023-01-02T18:15:51.132 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-01-02T18:15:51.132 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size": "0", 2023-01-02T18:15:51.132 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-01-02T18:15:51.132 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-01-02T18:15:51.132 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-01-02T18:15:51.132 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs": "0", 2023-01-02T18:15:51.133 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-01-02T18:15:51.133 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_other": "2", 2023-01-02T18:15:51.133 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-01-02T18:15:51.133 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_sync_interval": "5.000000", 2023-01-02T18:15:51.133 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size": "0", 2023-01-02T18:15:51.133 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-01-02T18:15:51.134 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-01-02T18:15:51.134 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-01-02T18:15:51.134 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_merge_threshold": "-10", 2023-01-02T18:15:51.134 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_min_sync_interval": "0.010000", 2023-01-02T18:15:51.134 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_odsync_write": "false", 2023-01-02T18:15:51.135 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_backend": "rocksdb", 2023-01-02T18:15:51.135 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_backend_path": "", 2023-01-02T18:15:51.135 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_header_cache_size": "1024", 2023-01-02T18:15:51.135 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_ondisk_finisher_threads": "1", 2023-01-02T18:15:51.135 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-01-02T18:15:51.136 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_thread_timeout": "60", 2023-01-02T18:15:51.136 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_threads": "2", 2023-01-02T18:15:51.136 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_punch_hole": "false", 2023-01-02T18:15:51.136 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-01-02T18:15:51.136 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-01-02T18:15:51.136 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-01-02T18:15:51.137 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-01-02T18:15:51.137 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-01-02T18:15:51.137 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_bytes": "104857600", 2023-01-02T18:15:51.137 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-01-02T18:15:51.137 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-01-02T18:15:51.138 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-01-02T18:15:51.138 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_ops": "50", 2023-01-02T18:15:51.138 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-01-02T18:15:51.138 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_seek_data_hole": "false", 2023-01-02T18:15:51.138 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_sloppy_crc": "false", 2023-01-02T18:15:51.138 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-01-02T18:15:51.139 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_splice": "false", 2023-01-02T18:15:51.139 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_split_multiple": "2", 2023-01-02T18:15:51.139 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_split_rand_factor": "20", 2023-01-02T18:15:51.139 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_update_to": "1000", 2023-01-02T18:15:51.139 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-01-02T18:15:51.140 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-01-02T18:15:51.140 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-01-02T18:15:51.140 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-01-02T18:15:51.140 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-01-02T18:15:51.140 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-01-02T18:15:51.140 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_enable": "true", 2023-01-02T18:15:51.141 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-01-02T18:15:51.141 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-01-02T18:15:51.141 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-01-02T18:15:51.141 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-01-02T18:15:51.141 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-01-02T18:15:51.142 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-01-02T18:15:51.142 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_xfs_extsize": "false", 2023-01-02T18:15:51.142 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_zfs_snap": "false", 2023-01-02T18:15:51.142 INFO:teuthology.orchestra.run.smithi007.stdout: "fio_dir": "/tmp/fio", 2023-01-02T18:15:51.142 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "4e320929-c4bb-4ea9-9e1c-d8479b7e40b1", 2023-01-02T18:15:51.142 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_allow_other": "true", 2023-01-02T18:15:51.143 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_atomic_o_trunc": "true", 2023-01-02T18:15:51.143 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_big_writes": "true", 2023-01-02T18:15:51.143 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_debug": "false", 2023-01-02T18:15:51.143 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_default_permissions": "false", 2023-01-02T18:15:51.143 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_disable_pagecache": "false", 2023-01-02T18:15:51.144 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_max_write": "0", 2023-01-02T18:15:51.144 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_multithreaded": "true", 2023-01-02T18:15:51.144 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_require_active_mds": "true", 2023-01-02T18:15:51.144 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_set_user_groups": "true", 2023-01-02T18:15:51.144 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_move": "true", 2023-01-02T18:15:51.144 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_read": "true", 2023-01-02T18:15:51.145 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_write": "true", 2023-01-02T18:15:51.145 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_syncfs_on_mksnap": "true", 2023-01-02T18:15:51.145 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_use_invalidate_cb": "true", 2023-01-02T18:15:51.145 INFO:teuthology.orchestra.run.smithi007.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-01-02T18:15:51.145 INFO:teuthology.orchestra.run.smithi007.stdout: "gss_target_name": "ceph", 2023-01-02T18:15:51.146 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_file": "", 2023-01-02T18:15:51.146 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_inject_failure": "0", 2023-01-02T18:15:51.146 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_interval": "5", 2023-01-02T18:15:51.146 INFO:teuthology.orchestra.run.smithi007.stdout: "host": "", 2023-01-02T18:15:51.146 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-01-02T18:15:51.146 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-01-02T18:15:51.147 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_max_size": "1073741824", 2023-01-02T18:15:51.147 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-01-02T18:15:51.147 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-01-02T18:15:51.147 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-01-02T18:15:51.147 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-01-02T18:15:51.148 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-01-02T18:15:51.148 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-01-02T18:15:51.148 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-01-02T18:15:51.148 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-01-02T18:15:51.148 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-01-02T18:15:51.148 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_watermark": "0.900000", 2023-01-02T18:15:51.149 INFO:teuthology.orchestra.run.smithi007.stdout: "inject_early_sigterm": "false", 2023-01-02T18:15:51.149 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_aio": "true", 2023-01-02T18:15:51.149 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_align_min_size": "65536", 2023-01-02T18:15:51.149 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_block_align": "true", 2023-01-02T18:15:51.149 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_block_size": "4096", 2023-01-02T18:15:51.150 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_dio": "true", 2023-01-02T18:15:51.150 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_discard": "false", 2023-01-02T18:15:51.150 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_force_aio": "false", 2023-01-02T18:15:51.150 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_ignore_corruption": "false", 2023-01-02T18:15:51.150 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_max_write_bytes": "10485760", 2023-01-02T18:15:51.150 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_max_write_entries": "100", 2023-01-02T18:15:51.151 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_replay_from": "0", 2023-01-02T18:15:51.151 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_high_multiple": "0.000000", 2023-01-02T18:15:51.151 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-01-02T18:15:51.151 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-01-02T18:15:51.151 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_max_multiple": "0.000000", 2023-01-02T18:15:51.152 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_write_header_frequency": "0", 2023-01-02T18:15:51.152 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_zero_on_create": "false", 2023-01-02T18:15:51.152 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_prefetch_periods": "10", 2023-01-02T18:15:51.152 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_prezero_periods": "5", 2023-01-02T18:15:51.152 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_write_head_interval": "15", 2023-01-02T18:15:51.152 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "", 2023-01-02T18:15:51.153 INFO:teuthology.orchestra.run.smithi007.stdout: "keyfile": "", 2023-01-02T18:15:51.153 INFO:teuthology.orchestra.run.smithi007.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-01-02T18:15:51.153 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_backend": "rocksdb", 2023-01-02T18:15:51.153 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_default_stripe_size": "65536", 2023-01-02T18:15:51.153 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_fsck_on_mount": "false", 2023-01-02T18:15:51.154 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_fsck_on_mount_deep": "true", 2023-01-02T18:15:51.154 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_max_bytes": "67108864", 2023-01-02T18:15:51.154 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_max_ops": "512", 2023-01-02T18:15:51.154 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_nid_prealloc": "1024", 2023-01-02T18:15:51.154 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_onode_map_size": "1024", 2023-01-02T18:15:51.154 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-01-02T18:15:51.155 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_sync_submit_transaction": "false", 2023-01-02T18:15:51.155 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_sync_transaction": "false", 2023-01-02T18:15:51.155 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_block_size": "65536", 2023-01-02T18:15:51.155 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_bloom_size": "0", 2023-01-02T18:15:51.155 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_cache_size": "536870912", 2023-01-02T18:15:51.155 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_compact_on_mount": "false", 2023-01-02T18:15:51.156 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_compression": "false", 2023-01-02T18:15:51.156 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_log": "", 2023-01-02T18:15:51.156 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_log_to_ceph_log": "true", 2023-01-02T18:15:51.156 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_max_open_files": "0", 2023-01-02T18:15:51.156 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_paranoid": "false", 2023-01-02T18:15:51.157 INFO:teuthology.orchestra.run.smithi007.stdout: "leveldb_write_buffer_size": "33554432", 2023-01-02T18:15:51.157 INFO:teuthology.orchestra.run.smithi007.stdout: "librados_thread_count": "2", 2023-01-02T18:15:51.157 INFO:teuthology.orchestra.run.smithi007.stdout: "lockdep": "false", 2023-01-02T18:15:51.157 INFO:teuthology.orchestra.run.smithi007.stdout: "lockdep_force_backtrace": "false", 2023-01-02T18:15:51.157 INFO:teuthology.orchestra.run.smithi007.stdout: "log_coarse_timestamps": "true", 2023-01-02T18:15:51.157 INFO:teuthology.orchestra.run.smithi007.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-01-02T18:15:51.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_flush_on_exit": "false", 2023-01-02T18:15:51.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_graylog_host": "127.0.0.1", 2023-01-02T18:15:51.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_graylog_port": "12201", 2023-01-02T18:15:51.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_max_new": "1000", 2023-01-02T18:15:51.158 INFO:teuthology.orchestra.run.smithi007.stdout: "log_max_recent": "10000", 2023-01-02T18:15:51.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_stderr_prefix": "", 2023-01-02T18:15:51.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_stop_at_utilization": "0.970000", 2023-01-02T18:15:51.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": "true", 2023-01-02T18:15:51.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_graylog": "false", 2023-01-02T18:15:51.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_stderr": "false", 2023-01-02T18:15:51.159 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_syslog": "false", 2023-01-02T18:15:51.160 INFO:teuthology.orchestra.run.smithi007.stdout: "max_rotating_auth_attempts": "10", 2023-01-02T18:15:51.160 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_action_on_write_error": "1", 2023-01-02T18:15:51.160 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_alternate_name_max": "8192", 2023-01-02T18:15:51.160 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_asio_thread_count": "2", 2023-01-02T18:15:51.160 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_export_pin": "true", 2023-01-02T18:15:51.161 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_dirs": "true", 2023-01-02T18:15:51.161 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-01-02T18:15:51.161 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_interval": "5", 2023-01-02T18:15:51.161 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_size_max": "100000", 2023-01-02T18:15:51.161 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_idle_threshold": "0.000000", 2023-01-02T18:15:51.161 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_interval": "10", 2023-01-02T18:15:51.162 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_max": "-1", 2023-01-02T18:15:51.162 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_max_until": "-1", 2023-01-02T18:15:51.162 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_merge_size": "50", 2023-01-02T18:15:51.162 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_midchunk": "0.300000", 2023-01-02T18:15:51.162 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_min_rebalance": "0.100000", 2023-01-02T18:15:51.163 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_min_start": "0.200000", 2023-01-02T18:15:51.163 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_minchunk": "0.001000", 2023-01-02T18:15:51.163 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_mode": "0", 2023-01-02T18:15:51.163 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_need_max": "1.200000", 2023-01-02T18:15:51.163 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_need_min": "0.800000", 2023-01-02T18:15:51.163 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-01-02T18:15:51.164 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_sample_interval": "3.000000", 2023-01-02T18:15:51.164 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_bits": "3", 2023-01-02T18:15:51.164 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_rd": "25000.000000", 2023-01-02T18:15:51.164 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_size": "10000", 2023-01-02T18:15:51.164 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_wr": "10000.000000", 2023-01-02T18:15:51.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_target_decay": "10.000000", 2023-01-02T18:15:51.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-01-02T18:15:51.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_grace": "15.000000", 2023-01-02T18:15:51.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_interval": "4.000000", 2023-01-02T18:15:51.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_mon_down_grace": "60", 2023-01-02T18:15:51.165 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_memory_limit": "4294967296", 2023-01-02T18:15:51.166 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_mid": "0.700000", 2023-01-02T18:15:51.166 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_release_free_interval": "10", 2023-01-02T18:15:51.166 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_reservation": "0.050000", 2023-01-02T18:15:51.166 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-01-02T18:15:51.166 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_interval": "1", 2023-01-02T18:15:51.167 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_threshold": "262144", 2023-01-02T18:15:51.167 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-01-02T18:15:51.167 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-01-02T18:15:51.167 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_delegate_inos_pct": "50", 2023-01-02T18:15:51.167 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_prealloc_inos": "1000", 2023-01-02T18:15:51.167 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-01-02T18:15:51.168 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_connect_bootstrapping": "false", 2023-01-02T18:15:51.168 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_damage_table_max_entries": "10000", 2023-01-02T18:15:51.168 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-01-02T18:15:51.168 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_auth_pins": "false", 2023-01-02T18:15:51.168 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_frag": "false", 2023-01-02T18:15:51.168 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_scatterstat": "false", 2023-01-02T18:15:51.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_subtrees": "false", 2023-01-02T18:15:51.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_decay_halflife": "5.000000", 2023-01-02T18:15:51.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_default_dir_hash": "2", 2023-01-02T18:15:51.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_defer_session_stale": "true", 2023-01-02T18:15:51.169 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_deny_all_reconnect": "false", 2023-01-02T18:15:51.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_keys_per_op": "16384", 2023-01-02T18:15:51.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_max_commit_size": "10", 2023-01-02T18:15:51.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_max_entries": "0", 2023-01-02T18:15:51.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dirstat_min_interval": "1.000000", 2023-01-02T18:15:51.170 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_after_rejoin": "false", 2023-01-02T18:15:51.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_on_map": "false", 2023-01-02T18:15:51.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_threshold_file": "0", 2023-01-02T18:15:51.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-01-02T18:15:51.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_early_reply": "true", 2023-01-02T18:15:51.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_enable_op_tracker": "true", 2023-01-02T18:15:51.171 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_enforce_unique_name": "true", 2023-01-02T18:15:51.172 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_distributed": "true", 2023-01-02T18:15:51.172 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-01-02T18:15:51.172 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_random": "true", 2023-01-02T18:15:51.172 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-01-02T18:15:51.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_forward_all_requests_to_auth": "false", 2023-01-02T18:15:51.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-01-02T18:15:51.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-01-02T18:15:51.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_health_cache_threshold": "1.500000", 2023-01-02T18:15:51.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_health_summarize_threshold": "10", 2023-01-02T18:15:51.173 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_heartbeat_grace": "15.000000", 2023-01-02T18:15:51.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_heartbeat_reset_grace": "1000", 2023-01-02T18:15:51.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_health_dummy": "false", 2023-01-02T18:15:51.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_migrator_session_race": "false", 2023-01-02T18:15:51.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-01-02T18:15:51.174 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_join_fs": "", 2023-01-02T18:15:51.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_journal_format": "1", 2023-01-02T18:15:51.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_create_at": "0", 2023-01-02T18:15:51.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_export_at": "0", 2023-01-02T18:15:51.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_import_at": "0", 2023-01-02T18:15:51.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_at": "0", 2023-01-02T18:15:51.175 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_expire_at": "0", 2023-01-02T18:15:51.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_replay_at": "0", 2023-01-02T18:15:51.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_link_at": "0", 2023-01-02T18:15:51.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_mdstable_at": "0", 2023-01-02T18:15:51.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_openc_at": "0", 2023-01-02T18:15:51.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_rename_at": "0", 2023-01-02T18:15:51.176 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_events_per_segment": "1024", 2023-01-02T18:15:51.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_max_events": "-1", 2023-01-02T18:15:51.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_max_segments": "128", 2023-01-02T18:15:51.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_pause": "false", 2023-01-02T18:15:51.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_segment_size": "0", 2023-01-02T18:15:51.177 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_skip_corrupt_events": "false", 2023-01-02T18:15:51.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_warn_factor": "2.000000", 2023-01-02T18:15:51.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_caps_per_client": "1048576", 2023-01-02T18:15:51.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_completed_flushes": "100000", 2023-01-02T18:15:51.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_completed_requests": "100000", 2023-01-02T18:15:51.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_export_size": "20971520", 2023-01-02T18:15:51.178 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_file_recover": "32", 2023-01-02T18:15:51.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_files": "64", 2023-01-02T18:15:51.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_ops": "8192", 2023-01-02T18:15:51.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-01-02T18:15:51.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_retries_on_remount_failure": "5", 2023-01-02T18:15:51.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-01-02T18:15:51.179 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_snaps_per_dir": "100", 2023-01-02T18:15:51.180 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_xattr_pairs_size": "65536", 2023-01-02T18:15:51.180 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_metrics_update_interval": "2", 2023-01-02T18:15:51.180 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_min_caps_per_client": "100", 2023-01-02T18:15:51.180 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_min_caps_working_set": "10000", 2023-01-02T18:15:51.180 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-01-02T18:15:51.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_numa_node": "-1", 2023-01-02T18:15:51.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-01-02T18:15:51.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_complaint_time": "30.000000", 2023-01-02T18:15:51.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_duration": "600", 2023-01-02T18:15:51.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_size": "20", 2023-01-02T18:15:51.181 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_log_threshold": "5", 2023-01-02T18:15:51.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_ping_grace": "15", 2023-01-02T18:15:51.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_ping_interval": "5", 2023-01-02T18:15:51.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-01-02T18:15:51.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-01-02T18:15:51.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_caps": "30000", 2023-01-02T18:15:51.182 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-01-02T18:15:51.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_decay_threshold": "131072", 2023-01-02T18:15:51.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-01-02T18:15:51.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_warning_threshold": "262144", 2023-01-02T18:15:51.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_reconnect_timeout": "45.000000", 2023-01-02T18:15:51.183 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_replay_interval": "1.000000", 2023-01-02T18:15:51.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-01-02T18:15:51.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-01-02T18:15:51.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_root_ino_gid": "0", 2023-01-02T18:15:51.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_root_ino_uid": "0", 2023-01-02T18:15:51.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-01-02T18:15:51.184 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_blocklist_on_evict": "true", 2023-01-02T18:15:51.185 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_blocklist_on_timeout": "true", 2023-01-02T18:15:51.185 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-01-02T18:15:51.185 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-01-02T18:15:51.185 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cap_acquisition_decay_rate": "10.000000", 2023-01-02T18:15:51.185 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cap_acquisition_throttle": "500000", 2023-01-02T18:15:51.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-01-02T18:15:51.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-01-02T18:15:51.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_shutdown_check": "0", 2023-01-02T18:15:51.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_skip_ino": "0", 2023-01-02T18:15:51.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sleep_rank_change": "0.000000", 2023-01-02T18:15:51.186 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_max_uid": "4294967294", 2023-01-02T18:15:51.187 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_min_uid": "0", 2023-01-02T18:15:51.187 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_rstat": "false", 2023-01-02T18:15:51.187 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_standby_replay_damaged": "false", 2023-01-02T18:15:51.187 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_task_status_update_interval": "2.000000", 2023-01-02T18:15:51.187 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_thrash_exports": "0", 2023-01-02T18:15:51.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_thrash_fragments": "0", 2023-01-02T18:15:51.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_tick_interval": "5.000000", 2023-01-02T18:15:51.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_valgrind_exit": "false", 2023-01-02T18:15:51.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_verify_backtrace": "1", 2023-01-02T18:15:51.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_verify_scatter": "false", 2023-01-02T18:15:51.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_wipe_ino_prealloc": "false", 2023-01-02T18:15:51.189 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_wipe_sessions": "false", 2023-01-02T18:15:51.189 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool_debug": "false", 2023-01-02T18:15:51.189 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_debug_omit_block_device_write": "false", 2023-01-02T18:15:51.189 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_device_bytes": "1073741824", 2023-01-02T18:15:51.189 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_page_set": "false", 2023-01-02T18:15:51.189 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_page_size": "65536", 2023-01-02T18:15:51.190 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_bytes": "134217728", 2023-01-02T18:15:51.190 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_messages": "512", 2023-01-02T18:15:51.190 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-01-02T18:15:51.190 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_connect_retry_interval": "1.000000", 2023-01-02T18:15:51.190 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-01-02T18:15:51.191 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-01-02T18:15:51.191 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_disabled_modules": "", 2023-01-02T18:15:51.191 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-01-02T18:15:51.191 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_max_pg_num_change": "128", 2023-01-02T18:15:51.191 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mds_bytes": "134217728", 2023-01-02T18:15:51.191 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mds_messages": "128", 2023-01-02T18:15:51.192 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-01-02T18:15:51.192 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mon_bytes": "134217728", 2023-01-02T18:15:51.192 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mon_messages": "128", 2023-01-02T18:15:51.192 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_osd_bytes": "536870912", 2023-01-02T18:15:51.192 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_osd_messages": "8192", 2023-01-02T18:15:51.193 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_service_beacon_grace": "60.000000", 2023-01-02T18:15:51.193 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_standby_modules": "true", 2023-01-02T18:15:51.193 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_stats_period": "5", 2023-01-02T18:15:51.193 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_stats_threshold": "5", 2023-01-02T18:15:51.193 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_tick_period": "2", 2023-01-02T18:15:51.194 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-01-02T18:15:51.194 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_accept_timeout_factor": "2.000000", 2023-01-02T18:15:51.194 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_allow_pool_delete": "true", 2023-01-02T18:15:51.194 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_allow_pool_size_one": "true", 2023-01-02T18:15:51.194 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_auth_validate_all_caps": "true", 2023-01-02T18:15:51.194 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-01-02T18:15:51.195 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-01-02T18:15:51.195 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_bytes": "104857600", 2023-01-02T18:15:51.195 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_directed_command_retry": "5", 2023-01-02T18:15:51.195 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval": "3.000000", 2023-01-02T18:15:51.195 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-01-02T18:15:51.195 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-01-02T18:15:51.196 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-01-02T18:15:51.196 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_parallel": "3", 2023-01-02T18:15:51.196 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_log_interval": "1.000000", 2023-01-02T18:15:51.196 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-01-02T18:15:51.196 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_ping_interval": "10.000000", 2023-01-02T18:15:51.197 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_ping_timeout": "30.000000", 2023-01-02T18:15:51.197 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clock_drift_allowed": "1.000000", 2023-01-02T18:15:51.197 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-01-02T18:15:51.197 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-01-02T18:15:51.197 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_file_level": "debug", 2023-01-02T18:15:51.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_file": "true", 2023-01-02T18:15:51.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog": "false", 2023-01-02T18:15:51.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-01-02T18:15:51.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-01-02T18:15:51.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_stderr": "false", 2023-01-02T18:15:51.198 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-01-02T18:15:51.199 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-01-02T18:15:51.199 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-01-02T18:15:51.199 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_bootstrap": "false", 2023-01-02T18:15:51.199 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_start": "false", 2023-01-02T18:15:51.199 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_trim": "true", 2023-01-02T18:15:51.199 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_con_tracker_persist_interval": "10", 2023-01-02T18:15:51.200 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_con_tracker_score_halflife": "43200", 2023-01-02T18:15:51.200 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_config_key_max_entry_size": "65536", 2023-01-02T18:15:51.200 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cpu_threads": "4", 2023-01-02T18:15:51.200 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_crush_min_required_version": "hammer", 2023-01-02T18:15:51.200 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_daemon_bytes": "419430400", 2023-01-02T18:15:51.201 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-01-02T18:15:51.201 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_avail_crit": "5", 2023-01-02T18:15:51.201 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_avail_warn": "5", 2023-01-02T18:15:51.201 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_size_warn": "16106127360", 2023-01-02T18:15:51.201 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_block_osdmap_trim": "false", 2023-01-02T18:15:51.202 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-01-02T18:15:51.202 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_json": "false", 2023-01-02T18:15:51.202 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-01-02T18:15:51.202 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_transactions": "false", 2023-01-02T18:15:51.203 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_extra_checks": "false", 2023-01-02T18:15:51.203 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-01-02T18:15:51.203 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-01-02T18:15:51.203 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_octopus": "false", 2023-01-02T18:15:51.203 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_pacific": "false", 2023-01-02T18:15:51.204 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-01-02T18:15:51.204 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_delta_reset_interval": "10.000000", 2023-01-02T18:15:51.204 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_dns_srv_name": "ceph-mon", 2023-01-02T18:15:51.204 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_down_mkfs_grace": "60", 2023-01-02T18:15:51.204 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_election_default_strategy": "1", 2023-01-02T18:15:51.204 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_election_timeout": "5.000000", 2023-01-02T18:15:51.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-01-02T18:15:51.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ping_divisor": "2", 2023-01-02T18:15:51.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ping_timeout": "2.000000", 2023-01-02T18:15:51.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_enable_op_tracker": "true", 2023-01-02T18:15:51.205 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_fake_pool_delete": "false", 2023-01-02T18:15:51.206 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_force_quorum_join": "false", 2023-01-02T18:15:51.206 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_globalid_prealloc": "10000", 2023-01-02T18:15:51.206 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_detail_to_clog": "false", 2023-01-02T18:15:51.206 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_log_update_period": "5", 2023-01-02T18:15:51.206 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_max_detail": "50", 2023-01-02T18:15:51.206 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog": "true", 2023-01-02T18:15:51.207 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog_interval": "600", 2023-01-02T18:15:51.207 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-01-02T18:15:51.207 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_host": "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],172.21.15.57", 2023-01-02T18:15:51.207 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_host_override": "", 2023-01-02T18:15:51.207 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_initial_members": "", 2023-01-02T18:15:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-01-02T18:15:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-01-02T18:15:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-01-02T18:15:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-01-02T18:15:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_keyvaluedb": "rocksdb", 2023-01-02T18:15:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease": "5.000000", 2023-01-02T18:15:51.209 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-01-02T18:15:51.209 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-01-02T18:15:51.209 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_max_summary": "50", 2023-01-02T18:15:51.209 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_log_entries_per_event": "4096", 2023-01-02T18:15:51.209 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_log_epochs": "500", 2023-01-02T18:15:51.210 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_mdsmap_epochs": "500", 2023-01-02T18:15:51.210 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_mgrmap_epochs": "500", 2023-01-02T18:15:51.210 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_osd": "10000", 2023-01-02T18:15:51.210 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_pg_per_osd": "10000", 2023-01-02T18:15:51.210 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_pool_pg_num": "65536", 2023-01-02T18:15:51.211 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-01-02T18:15:51.211 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-01-02T18:15:51.211 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_force_trim_to": "0", 2023-01-02T18:15:51.211 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_skip_sanity": "false", 2023-01-02T18:15:51.212 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_memory_autotune": "true", 2023-01-02T18:15:51.212 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_memory_target": "2147483648", 2023-01-02T18:15:51.212 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_beacon_grace": "30", 2023-01-02T18:15:51.212 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-01-02T18:15:51.212 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_digest_period": "5", 2023-01-02T18:15:51.213 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_inactive_grace": "60", 2023-01-02T18:15:51.213 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_mkfs_grace": "240", 2023-01-02T18:15:51.213 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-01-02T18:15:51.213 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_min_osdmap_epochs": "500", 2023-01-02T18:15:51.213 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_complaint_time": "30", 2023-01-02T18:15:51.213 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_duration": "600", 2023-01-02T18:15:51.214 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_size": "20", 2023-01-02T18:15:51.214 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_slow_op_size": "20", 2023-01-02T18:15:51.214 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_slow_op_threshold": "10", 2023-01-02T18:15:51.214 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_log_threshold": "5", 2023-01-02T18:15:51.214 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-01-02T18:15:51.215 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-01-02T18:15:51.215 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-01-02T18:15:51.215 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_in": "false", 2023-01-02T18:15:51.215 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_new_in": "true", 2023-01-02T18:15:51.215 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-01-02T18:15:51.216 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-01-02T18:15:51.216 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_cache_size": "500", 2023-01-02T18:15:51.216 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_cache_size_min": "134217728", 2023-01-02T18:15:51.216 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_crush_smoke_test": "true", 2023-01-02T18:15:51.216 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_destroyed_out_interval": "600", 2023-01-02T18:15:51.216 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_down_out_interval": "600", 2023-01-02T18:15:51.217 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-01-02T18:15:51.217 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-01-02T18:15:51.217 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_force_trim_to": "0", 2023-01-02T18:15:51.217 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_full_ratio": "0.950000", 2023-01-02T18:15:51.217 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-01-02T18:15:51.217 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_halflife": "3600", 2023-01-02T18:15:51.218 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_max_interval": "300", 2023-01-02T18:15:51.218 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_weight": "0.300000", 2023-01-02T18:15:51.218 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-01-02T18:15:51.218 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_max_creating_pgs": "1024", 2023-01-02T18:15:51.218 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_max_initial_pgs": "1024", 2023-01-02T18:15:51.219 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_down_reporters": "2", 2023-01-02T18:15:51.219 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-01-02T18:15:51.219 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-01-02T18:15:51.219 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-01-02T18:15:51.219 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp": "true", 2023-01-02T18:15:51.219 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-01-02T18:15:51.220 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-01-02T18:15:51.220 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_report_timeout": "900", 2023-01-02T18:15:51.220 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-01-02T18:15:51.220 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-01-02T18:15:51.220 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_warn_num_repaired": "10", 2023-01-02T18:15:51.221 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_warn_op_age": "32.000000", 2023-01-02T18:15:51.221 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-01-02T18:15:51.221 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_interval": "10", 2023-01-02T18:15:51.221 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_min": "10000", 2023-01-02T18:15:51.221 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-01-02T18:15:51.221 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-01-02T18:15:51.222 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_stuck_threshold": "60", 2023-01-02T18:15:51.222 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-01-02T18:15:51.222 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_objects": "10000", 2023-01-02T18:15:51.222 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_per_osd": "0", 2023-01-02T18:15:51.222 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-01-02T18:15:51.223 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pool_quota_crit_threshold": "0", 2023-01-02T18:15:51.223 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pool_quota_warn_threshold": "0", 2023-01-02T18:15:51.223 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_probe_timeout": "2.000000", 2023-01-02T18:15:51.223 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_max_change": "0.050000", 2023-01-02T18:15:51.223 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_max_osds": "4", 2023-01-02T18:15:51.223 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-01-02T18:15:51.224 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-01-02T18:15:51.224 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-01-02T18:15:51.224 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-01-02T18:15:51.224 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-01-02T18:15:51.224 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_interval": "86400", 2023-01-02T18:15:51.225 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_max_keys": "100", 2023-01-02T18:15:51.225 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_timeout": "300", 2023-01-02T18:15:51.225 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_session_timeout": "300", 2023-01-02T18:15:51.225 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_smart_report_timeout": "5", 2023-01-02T18:15:51.225 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stat_smooth_intervals": "6", 2023-01-02T18:15:51.225 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-01-02T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_pool_min_size": "2", 2023-01-02T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_pool_size": "4", 2023-01-02T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-01-02T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_subscribe_interval": "86400.000000", 2023-01-02T18:15:51.226 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_debug": "false", 2023-01-02T18:15:51.227 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_max_payload_keys": "2000", 2023-01-02T18:15:51.227 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_max_payload_size": "1048576", 2023-01-02T18:15:51.227 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_provider_kill_at": "0", 2023-01-02T18:15:51.227 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_requester_kill_at": "0", 2023-01-02T18:15:51.227 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_timeout": "60.000000", 2023-01-02T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_target_pg_per_osd": "100", 2023-01-02T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_tick_interval": "5", 2023-01-02T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_timecheck_interval": "300.000000", 2023-01-02T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-01-02T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_older_version_delay": "604800", 2023-01-02T18:15:51.228 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-01-02T18:15:51.229 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-01-02T18:15:51.229 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-01-02T18:15:51.229 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-01-02T18:15:51.229 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-01-02T18:15:51.229 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-01-02T18:15:51.229 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_misplaced": "false", 2023-01-02T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-01-02T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_older_version": "true", 2023-01-02T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-01-02T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_no_app": "true", 2023-01-02T18:15:51.230 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-01-02T18:15:51.231 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-01-02T18:15:51.231 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-01-02T18:15:51.231 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-01-02T18:15:51.231 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_too_few_osds": "false", 2023-01-02T18:15:51.231 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-01-02T18:15:51.232 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-01-02T18:15:51.232 INFO:teuthology.orchestra.run.smithi007.stdout: "monmap": "", 2023-01-02T18:15:51.232 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_max_op_threads": "5", 2023-01-02T18:15:51.232 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_op_threads": "3", 2023-01-02T18:15:51.232 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_buffer_size": "131072", 2023-01-02T18:15:51.232 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_cm": "false", 2023-01-02T18:15:51.233 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_device_name": "", 2023-01-02T18:15:51.233 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_dscp": "96", 2023-01-02T18:15:51.233 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-01-02T18:15:51.233 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_gid_idx": "0", 2023-01-02T18:15:51.233 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_local_gid": "", 2023-01-02T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_polling_us": "1000", 2023-01-02T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_port_num": "1", 2023-01-02T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-01-02T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-01-02T18:15:51.234 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_roce_ver": "1", 2023-01-02T18:15:51.235 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_send_buffers": "1024", 2023-01-02T18:15:51.235 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_sl": "3", 2023-01-02T18:15:51.235 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_support_srq": "true", 2023-01-02T18:15:51.235 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_type": "ib", 2023-01-02T18:15:51.235 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_reap_threshold": "5", 2023-01-02T18:15:51.236 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_before_connect": "false", 2023-01-02T18:15:51.236 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_ipv4": "true", 2023-01-02T18:15:51.236 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_ipv6": "false", 2023-01-02T18:15:51.236 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_msgr1": "true", 2023-01-02T18:15:51.236 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_msgr2": "true", 2023-01-02T18:15:51.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_port_max": "7300", 2023-01-02T18:15:51.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_port_min": "6800", 2023-01-02T18:15:51.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_prefer_ipv4": "false", 2023-01-02T18:15:51.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_retry_count": "3", 2023-01-02T18:15:51.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_retry_delay": "5", 2023-01-02T18:15:51.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_client": "false", 2023-01-02T18:15:51.238 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mds": "false", 2023-01-02T18:15:51.238 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mgr": "false", 2023-01-02T18:15:51.238 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mon": "false", 2023-01-02T18:15:51.238 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_osd": "false", 2023-01-02T18:15:51.238 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_client_mode": "crc secure", 2023-01-02T18:15:51.239 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_cluster_mode": "crc secure", 2023-01-02T18:15:51.239 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_cluster_type": "", 2023-01-02T18:15:51.239 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_connection_idle_timeout": "900", 2023-01-02T18:15:51.239 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_connection_ready_timeout": "10", 2023-01-02T18:15:51.239 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_crc_data": "true", 2023-01-02T18:15:51.240 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_crc_header": "true", 2023-01-02T18:15:51.240 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_bad_msg": "false", 2023-01-02T18:15:51.240 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_bug": "true", 2023-01-02T18:15:51.240 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_old_message": "true", 2023-01-02T18:15:51.241 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_skipped_message": "false", 2023-01-02T18:15:51.241 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_unhandled_msg": "false", 2023-01-02T18:15:51.241 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-01-02T18:15:51.241 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_coremask": "0xF", 2023-01-02T18:15:51.242 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-01-02T18:15:51.242 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-01-02T18:15:51.242 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-01-02T18:15:51.242 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hugepages": "", 2023-01-02T18:15:51.242 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hw_flow_control": "true", 2023-01-02T18:15:51.243 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-01-02T18:15:51.243 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_lro": "true", 2023-01-02T18:15:51.243 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_memory_channel": "4", 2023-01-02T18:15:51.243 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-01-02T18:15:51.243 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_pmd": "", 2023-01-02T18:15:51.244 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_port_id": "0", 2023-01-02T18:15:51.244 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-01-02T18:15:51.244 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dump_corrupt_message_level": "1", 2023-01-02T18:15:51.244 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dump_on_send": "false", 2023-01-02T18:15:51.244 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_initial_backoff": "0.200000", 2023-01-02T18:15:51.245 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_max": "1.000000", 2023-01-02T18:15:51.245 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_probability": "0.000000", 2023-01-02T18:15:51.245 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_type": "", 2023-01-02T18:15:51.245 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_internal_delays": "0.000000", 2023-01-02T18:15:51.245 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_socket_failures": "5000", 2023-01-02T18:15:51.246 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_learn_addr_from_peer": "true", 2023-01-02T18:15:51.246 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_max_accept_failures": "4", 2023-01-02T18:15:51.246 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_max_backoff": "15.000000", 2023-01-02T18:15:51.246 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_client_mode": "secure crc", 2023-01-02T18:15:51.246 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_cluster_mode": "secure crc", 2023-01-02T18:15:51.247 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_service_mode": "secure crc", 2023-01-02T18:15:51.247 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-01-02T18:15:51.247 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_pq_min_cost": "65536", 2023-01-02T18:15:51.247 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_public_type": "", 2023-01-02T18:15:51.247 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_service_mode": "crc secure", 2023-01-02T18:15:51.247 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_listen_backlog": "512", 2023-01-02T18:15:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_nodelay": "true", 2023-01-02T18:15:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-01-02T18:15:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_rcvbuf": "0", 2023-01-02T18:15:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_type": "async+posix", 2023-01-02T18:15:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "no_config_file": "false", 2023-01-02T18:15:51.248 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_completion_locks_per_session": "32", 2023-01-02T18:15:51.249 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_debug_inject_relock_delay": "false", 2023-01-02T18:15:51.249 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inflight_op_bytes": "104857600", 2023-01-02T18:15:51.249 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inflight_ops": "1024", 2023-01-02T18:15:51.249 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inject_no_watch_ping": "false", 2023-01-02T18:15:51.249 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-01-02T18:15:51.250 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_tick_interval": "5.000000", 2023-01-02T18:15:51.250 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_timeout": "10.000000", 2023-01-02T18:15:51.250 INFO:teuthology.orchestra.run.smithi007.stdout: "objectstore_blackhole": "false", 2023-01-02T18:15:51.250 INFO:teuthology.orchestra.run.smithi007.stdout: "openssl_engine_opts": "", 2023-01-02T18:15:51.250 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_delay_time": "5.000000", 2023-01-02T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_hist_halflife": "1000", 2023-01-02T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_max_low_ops": "2", 2023-01-02T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_max_ops": "4", 2023-01-02T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-01-02T18:15:51.251 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_quantize_effort": "0.100000", 2023-01-02T18:15:51.252 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_slop": "0.020000", 2023-01-02T18:15:51.252 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-01-02T18:15:51.252 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_allow_recovery_below_min_size": "true", 2023-01-02T18:15:51.252 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_asio_thread_count": "2", 2023-01-02T18:15:51.253 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_async_recovery_min_cost": "100", 2023-01-02T18:15:51.253 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_auto_mark_unfound_lost": "false", 2023-01-02T18:15:51.253 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_retry_interval": "30.000000", 2023-01-02T18:15:51.253 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_scan_max": "512", 2023-01-02T18:15:51.253 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_scan_min": "64", 2023-01-02T18:15:51.254 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_degraded": "false", 2023-01-02T18:15:51.254 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_peering": "false", 2023-01-02T18:15:51.254 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_unfound": "true", 2023-01-02T18:15:51.254 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_beacon_report_interval": "300", 2023-01-02T18:15:51.254 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_duration": "30", 2023-01-02T18:15:51.255 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-01-02T18:15:51.255 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_max_block_size": "67108864", 2023-01-02T18:15:51.255 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_small_size_max_iops": "100", 2023-01-02T18:15:51.255 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_blkin_trace_all": "false", 2023-01-02T18:15:51.255 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-01-02T18:15:51.256 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-01-02T18:15:51.256 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_check_for_log_corruption": "false", 2023-01-02T18:15:51.256 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-01-02T18:15:51.256 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-01-02T18:15:51.256 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2023-01-02T18:15:51.257 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-01-02T18:15:51.257 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_update_on_start": "true", 2023-01-02T18:15:51.257 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_message_cap": "256", 2023-01-02T18:15:51.257 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_message_size_cap": "524288000", 2023-01-02T18:15:51.257 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_op_priority": "63", 2023-01-02T18:15:51.258 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_watch_timeout": "30", 2023-01-02T18:15:51.258 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_command_max_records": "256", 2023-01-02T18:15:51.258 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_command_thread_suicide_timeout": "900", 2023-01-02T18:15:51.258 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_command_thread_timeout": "600", 2023-01-02T18:15:51.258 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_compact_on_start": "false", 2023-01-02T18:15:51.258 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-01-02T18:15:51.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_chooseleaf_type": "0", 2023-01-02T18:15:51.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_initial_weight": "-1.000000", 2023-01-02T18:15:51.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_update_on_start": "true", 2023-01-02T18:15:51.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_update_weight_set": "true", 2023-01-02T18:15:51.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-01-02T18:15:51.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-01-02T18:15:51.260 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-01-02T18:15:51.260 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_drop_ping_duration": "0", 2023-01-02T18:15:51.260 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-01-02T18:15:51.260 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_feed_pullee": "-1", 2023-01-02T18:15:51.260 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-01-02T18:15:51.261 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-01-02T18:15:51.261 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-01-02T18:15:51.261 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_misdirected_ops": "false", 2023-01-02T18:15:51.261 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_no_acting_change": "false", 2023-01-02T18:15:51.261 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_no_purge_strays": "false", 2023-01-02T18:15:51.261 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_op_order": "false", 2023-01-02T18:15:51.262 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_pg_log_writeout": "false", 2023-01-02T18:15:51.262 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_pretend_recovery_active": "false", 2023-01-02T18:15:51.262 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-01-02T18:15:51.262 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-01-02T18:15:51.262 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_shutdown": "false", 2023-01-02T18:15:51.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-01-02T18:15:51.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-01-02T18:15:51.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_cached_snaps": "false", 2023-01-02T18:15:51.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_missing_on_start": "false", 2023-01-02T18:15:51.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_snaps": "false", 2023-01-02T18:15:51.263 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-01-02T18:15:51.264 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-01-02T18:15:51.264 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_keys": "1024", 2023-01-02T18:15:51.264 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-01-02T18:15:51.264 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-01-02T18:15:51.264 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-01-02T18:15:51.265 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_stride": "524288", 2023-01-02T18:15:51.265 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-01-02T18:15:51.265 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_default_data_pool_replay_window": "5", 2023-01-02T18:15:51.265 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_default_notify_timeout": "30", 2023-01-02T18:15:51.265 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep": "0.000000", 2023-01-02T18:15:51.266 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-01-02T18:15:51.266 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-01-02T18:15:51.266 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-01-02T18:15:51.266 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_discard_disconnected_ops": "true", 2023-01-02T18:15:51.266 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_enable_op_tracker": "true", 2023-01-02T18:15:51.266 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_erasure_code_plugins": "jerasure lrc isa", 2023-01-02T18:15:51.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-01-02T18:15:51.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-01-02T18:15:51.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_info": "true", 2023-01-02T18:15:51.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown": "true", 2023-01-02T18:15:51.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-01-02T18:15:51.268 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-01-02T18:15:51.268 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-01-02T18:15:51.268 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-01-02T18:15:51.268 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_function_tracing": "false", 2023-01-02T18:15:51.268 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_grace": "20", 2023-01-02T18:15:51.269 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_interval": "6", 2023-01-02T18:15:51.269 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-01-02T18:15:51.269 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_peers": "10", 2023-01-02T18:15:51.269 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_size": "2000", 2023-01-02T18:15:51.269 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_stale": "600", 2023-01-02T18:15:51.270 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-01-02T18:15:51.270 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_max_size": "100000", 2023-01-02T18:15:51.270 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_min_size": "1000", 2023-01-02T18:15:51.270 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-01-02T18:15:51.270 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-01-02T18:15:51.270 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-01-02T18:15:51.271 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-01-02T18:15:51.271 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-01-02T18:15:51.271 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal_flush_on_shutdown": "true", 2023-01-02T18:15:51.271 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal_size": "5120", 2023-01-02T18:15:51.271 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_kill_backfill_at": "0", 2023-01-02T18:15:51.272 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_loop_before_reset_tphandle": "64", 2023-01-02T18:15:51.272 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_cache_size": "50", 2023-01-02T18:15:51.272 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_dedup": "true", 2023-01-02T18:15:51.272 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_message_max": "40", 2023-01-02T18:15:51.272 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_message_max_bytes": "10485760", 2023-01-02T18:15:51.273 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_share_max_epochs": "40", 2023-01-02T18:15:51.273 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_attr_name_len": "100", 2023-01-02T18:15:51.273 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_attr_size": "0", 2023-01-02T18:15:51.273 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_backfills": "1", 2023-01-02T18:15:51.274 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_markdown_count": "5", 2023-01-02T18:15:51.274 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_markdown_period": "600", 2023-01-02T18:15:51.274 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_name_len": "2048", 2023-01-02T18:15:51.274 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_namespace_len": "256", 2023-01-02T18:15:51.274 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_size": "134217728", 2023-01-02T18:15:51.274 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-01-02T18:15:51.275 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_omap_entries_per_request": "1024", 2023-01-02T18:15:51.275 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_blocked_by": "16", 2023-01-02T18:15:51.275 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_log_entries": "10000", 2023-01-02T18:15:51.275 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-01-02T18:15:51.275 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pgls": "1024", 2023-01-02T18:15:51.276 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_push_cost": "8388608", 2023-01-02T18:15:51.276 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_push_objects": "10", 2023-01-02T18:15:51.276 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_scrubs": "1", 2023-01-02T18:15:51.276 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-01-02T18:15:51.276 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_trimming_pgs": "2", 2023-01-02T18:15:51.277 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_write_op_reply_len": "32", 2023-01-02T18:15:51.277 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_write_size": "90", 2023-01-02T18:15:51.277 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_cost_per_byte_usec": "0.000000", 2023-01-02T18:15:51.277 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_cost_per_byte_usec_hdd": "5.200000", 2023-01-02T18:15:51.277 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_cost_per_byte_usec_ssd": "0.011000", 2023-01-02T18:15:51.278 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_cost_per_io_usec": "0.000000", 2023-01-02T18:15:51.278 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_cost_per_io_usec_hdd": "25000.000000", 2023-01-02T18:15:51.278 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_cost_per_io_usec_ssd": "50.000000", 2023-01-02T18:15:51.278 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-01-02T18:15:51.278 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-01-02T18:15:51.279 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-01-02T18:15:51.279 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_profile": "high_client_ops", 2023-01-02T18:15:51.279 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-01-02T18:15:51.279 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_lim": "999999", 2023-01-02T18:15:51.280 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_res": "1", 2023-01-02T18:15:51.280 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-01-02T18:15:51.280 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_lim": "999999", 2023-01-02T18:15:51.280 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_res": "1", 2023-01-02T18:15:51.281 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-01-02T18:15:51.281 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_lim": "999999", 2023-01-02T18:15:51.281 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_res": "1", 2023-01-02T18:15:51.281 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-01-02T18:15:51.282 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_skip_benchmark": "false", 2023-01-02T18:15:51.282 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_base": "805306368", 2023-01-02T18:15:51.282 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_cache_min": "134217728", 2023-01-02T18:15:51.282 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-01-02T18:15:51.282 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-01-02T18:15:51.283 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target": "4294967296", 2023-01-02T18:15:51.283 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target_autotune": "false", 2023-01-02T18:15:51.283 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-01-02T18:15:51.283 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_min_pg_log_entries": "250", 2023-01-02T18:15:51.283 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_min_recovery_priority": "0", 2023-01-02T18:15:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_heartbeat_interval": "30", 2023-01-02T18:15:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-01-02T18:15:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_report_interval": "5", 2023-01-02T18:15:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_report_max_in_flight": "2", 2023-01-02T18:15:51.284 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-01-02T18:15:51.285 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_num_cache_shards": "32", 2023-01-02T18:15:51.285 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_num_op_tracker_shard": "32", 2023-01-02T18:15:51.285 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_auto_affinity": "true", 2023-01-02T18:15:51.285 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_node": "-1", 2023-01-02T18:15:51.285 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_prefer_iface": "true", 2023-01-02T18:15:51.286 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-01-02T18:15:51.286 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objecter_finishers": "1", 2023-01-02T18:15:51.286 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore": "bluestore", 2023-01-02T18:15:51.286 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore_fuse": "false", 2023-01-02T18:15:51.286 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore_tracing": "false", 2023-01-02T18:15:51.287 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_complaint_time": "30.000000", 2023-01-02T18:15:51.287 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_duration": "600", 2023-01-02T18:15:51.287 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_size": "20", 2023-01-02T18:15:51.287 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_slow_op_size": "20", 2023-01-02T18:15:51.287 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-01-02T18:15:51.287 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_log_threshold": "5", 2023-01-02T18:15:51.288 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards": "0", 2023-01-02T18:15:51.288 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards_hdd": "5", 2023-01-02T18:15:51.288 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards_ssd": "8", 2023-01-02T18:15:51.288 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard": "0", 2023-01-02T18:15:51.288 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-01-02T18:15:51.289 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-01-02T18:15:51.289 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-01-02T18:15:51.289 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_pq_min_cost": "65536", 2023-01-02T18:15:51.289 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_queue": "wpq", 2023-01-02T18:15:51.290 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_queue_cut_off": "high", 2023-01-02T18:15:51.290 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_thread_suicide_timeout": "150", 2023-01-02T18:15:51.290 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_thread_timeout": "15", 2023-01-02T18:15:51.290 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_open_classes_on_start": "true", 2023-01-02T18:15:51.291 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_os_flags": "0", 2023-01-02T18:15:51.291 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_peering_op_priority": "255", 2023-01-02T18:15:51.291 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_delete_cost": "1048576", 2023-01-02T18:15:51.291 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_delete_priority": "5", 2023-01-02T18:15:51.291 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-01-02T18:15:51.292 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-01-02T18:15:51.292 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_dups_tracked": "3000", 2023-01-02T18:15:51.292 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_trim_max": "10000", 2023-01-02T18:15:51.292 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_trim_min": "100", 2023-01-02T18:15:51.292 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-01-02T18:15:51.292 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_object_context_cache_count": "64", 2023-01-02T18:15:51.293 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_stat_report_interval_max": "500", 2023-01-02T18:15:51.293 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-01-02T18:15:51.293 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-01-02T18:15:51.293 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-01-02T18:15:51.293 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-01-02T18:15:51.294 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-01-02T18:15:51.294 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-01-02T18:15:51.294 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_crush_rule": "-1", 2023-01-02T18:15:51.294 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_ec_fast_read": "false", 2023-01-02T18:15:51.295 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd", 2023-01-02T18:15:51.295 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_bulk": "false", 2023-01-02T18:15:51.295 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-01-02T18:15:51.295 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nodelete": "false", 2023-01-02T18:15:51.295 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-01-02T18:15:51.296 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-01-02T18:15:51.296 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flags": "0", 2023-01-02T18:15:51.296 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-01-02T18:15:51.296 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_min_size": "0", 2023-01-02T18:15:51.296 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-01-02T18:15:51.296 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pg_num": "32", 2023-01-02T18:15:51.297 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pgp_num": "0", 2023-01-02T18:15:51.297 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-01-02T18:15:51.297 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_size": "2", 2023-01-02T18:15:51.297 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_type": "replicated", 2023-01-02T18:15:51.297 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-01-02T18:15:51.298 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_use_gmt_hitset": "true", 2023-01-02T18:15:51.298 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_push_per_object_cost": "1000", 2023-01-02T18:15:51.298 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_read_ec_check_for_errors": "false", 2023-01-02T18:15:51.298 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recover_clone_overlap": "true", 2023-01-02T18:15:51.298 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recover_clone_overlap_limit": "10", 2023-01-02T18:15:51.299 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_cost": "20971520", 2023-01-02T18:15:51.299 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_delay_start": "0.000000", 2023-01-02T18:15:51.299 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active": "0", 2023-01-02T18:15:51.299 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active_hdd": "3", 2023-01-02T18:15:51.299 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active_ssd": "10", 2023-01-02T18:15:51.300 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_chunk": "8388608", 2023-01-02T18:15:51.300 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-01-02T18:15:51.300 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_single_start": "1", 2023-01-02T18:15:51.300 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_op_priority": "3", 2023-01-02T18:15:51.300 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_op_warn_multiple": "16", 2023-01-02T18:15:51.301 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_priority": "5", 2023-01-02T18:15:51.301 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_retry_interval": "30.000000", 2023-01-02T18:15:51.301 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep": "0.000000", 2023-01-02T18:15:51.301 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-01-02T18:15:51.301 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-01-02T18:15:51.302 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-01-02T18:15:51.302 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_repair_during_recovery": "false", 2023-01-02T18:15:51.302 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_requested_scrub_priority": "120", 2023-01-02T18:15:51.302 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-01-02T18:15:51.302 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_rollback_to_cluster_snap": "", 2023-01-02T18:15:51.303 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_auto_repair": "false", 2023-01-02T18:15:51.303 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-01-02T18:15:51.303 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-01-02T18:15:51.303 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_begin_hour": "0", 2023-01-02T18:15:51.303 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_begin_week_day": "0", 2023-01-02T18:15:51.303 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_chunk_max": "25", 2023-01-02T18:15:51.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_chunk_min": "5", 2023-01-02T18:15:51.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_cost": "52428800", 2023-01-02T18:15:51.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_during_recovery": "false", 2023-01-02T18:15:51.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_end_hour": "0", 2023-01-02T18:15:51.304 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_end_week_day": "0", 2023-01-02T18:15:51.305 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-01-02T18:15:51.305 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-01-02T18:15:51.305 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_invalid_stats": "true", 2023-01-02T18:15:51.305 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_load_threshold": "0.500000", 2023-01-02T18:15:51.305 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_max_interval": "604800.000000", 2023-01-02T18:15:51.306 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_max_preemptions": "5", 2023-01-02T18:15:51.306 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_min_interval": "86400.000000", 2023-01-02T18:15:51.306 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_priority": "5", 2023-01-02T18:15:51.306 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_sleep": "0.000000", 2023-01-02T18:15:51.306 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shutdown_pgref_assert": "false", 2023-01-02T18:15:51.307 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_skip_data_digest": "false", 2023-01-02T18:15:51.307 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_smart_report_timeout": "5", 2023-01-02T18:15:51.307 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_cost": "1048576", 2023-01-02T18:15:51.307 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_priority": "5", 2023-01-02T18:15:51.307 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep": "0.000000", 2023-01-02T18:15:51.308 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-01-02T18:15:51.308 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-01-02T18:15:51.308 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-01-02T18:15:51.308 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-01-02T18:15:51.308 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_target_transaction_size": "30", 2023-01-02T18:15:51.309 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-01-02T18:15:51.309 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-01-02T18:15:51.309 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-01-02T18:15:51.309 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-01-02T18:15:51.309 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-01-02T18:15:51.309 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-01-02T18:15:51.310 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-01-02T18:15:51.310 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_mode": "writeback", 2023-01-02T18:15:51.310 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-01-02T18:15:51.310 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-01-02T18:15:51.311 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tracing": "false", 2023-01-02T18:15:51.311 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_use_stale_snap": "false", 2023-01-02T18:15:51.311 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-01-02T18:15:51.311 INFO:teuthology.orchestra.run.smithi007.stdout: "osdc_blkin_trace_all": "false", 2023-01-02T18:15:51.311 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_kill_at": "0", 2023-01-02T18:15:51.312 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_max_join_drift": "10", 2023-01-02T18:15:51.312 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_min": "500", 2023-01-02T18:15:51.312 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_min_wait": "0.050000", 2023-01-02T18:15:51.312 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_propose_interval": "1.000000", 2023-01-02T18:15:51.312 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_max": "500", 2023-01-02T18:15:51.313 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_max_multiplier": "20", 2023-01-02T18:15:51.313 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_min": "250", 2023-01-02T18:15:51.313 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_stash_full_interval": "25", 2023-01-02T18:15:51.313 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_trim_max": "500", 2023-01-02T18:15:51.313 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_trim_min": "250", 2023-01-02T18:15:51.314 INFO:teuthology.orchestra.run.smithi007.stdout: "perf": "true", 2023-01-02T18:15:51.314 INFO:teuthology.orchestra.run.smithi007.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2023-01-02T18:15:51.314 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin_crypto_accelerator": "crypto_isal", 2023-01-02T18:15:51.314 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin_dir": "/usr/lib64/ceph", 2023-01-02T18:15:51.314 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "-", 2023-01-02T18:15:51.315 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrv": "", 2023-01-02T18:15:51.315 INFO:teuthology.orchestra.run.smithi007.stdout: "public_bind_addr": "-", 2023-01-02T18:15:51.315 INFO:teuthology.orchestra.run.smithi007.stdout: "public_network": "", 2023-01-02T18:15:51.315 INFO:teuthology.orchestra.run.smithi007.stdout: "public_network_interface": "", 2023-01-02T18:15:51.315 INFO:teuthology.orchestra.run.smithi007.stdout: "qat_compressor_enabled": "false", 2023-01-02T18:15:51.315 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_mon_op_timeout": "0", 2023-01-02T18:15:51.316 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_osd_op_timeout": "0", 2023-01-02T18:15:51.316 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_tracing": "false", 2023-01-02T18:15:51.316 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_atime_update_interval": "60", 2023-01-02T18:15:51.316 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2023-01-02T18:15:51.316 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_balance_parent_reads": "false", 2023-01-02T18:15:51.317 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_balance_snap_reads": "false", 2023-01-02T18:15:51.317 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blkin_trace_all": "false", 2023-01-02T18:15:51.317 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blocklist_expire_seconds": "0", 2023-01-02T18:15:51.317 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blocklist_on_break_lock": "true", 2023-01-02T18:15:51.317 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache": "true", 2023-01-02T18:15:51.318 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_block_writes_upfront": "false", 2023-01-02T18:15:51.318 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty": "25165824", 2023-01-02T18:15:51.318 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty_age": "1.000000", 2023-01-02T18:15:51.318 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty_object": "0", 2023-01-02T18:15:51.318 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_policy": "writearound", 2023-01-02T18:15:51.319 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_size": "33554432", 2023-01-02T18:15:51.319 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_target_dirty": "16777216", 2023-01-02T18:15:51.319 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_writethrough_until_flush": "true", 2023-01-02T18:15:51.320 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_clone_copy_on_read": "false", 2023-01-02T18:15:51.320 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_compression_hint": "none", 2023-01-02T18:15:51.320 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_concurrent_management_ops": "10", 2023-01-02T18:15:51.320 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_config_pool_override_update_timestamp": "0", 2023-01-02T18:15:51.321 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_clone_format": "auto", 2023-01-02T18:15:51.321 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_data_pool": "", 2023-01-02T18:15:51.321 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_features": "61", 2023-01-02T18:15:51.321 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_format": "2", 2023-01-02T18:15:51.321 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_map_options": "", 2023-01-02T18:15:51.322 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_order": "22", 2023-01-02T18:15:51.322 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_pool": "rbd", 2023-01-02T18:15:51.322 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2023-01-02T18:15:51.322 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_stripe_count": "0", 2023-01-02T18:15:51.322 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_stripe_unit": "0", 2023-01-02T18:15:51.323 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_disable_zero_copy_writes": "true", 2023-01-02T18:15:51.323 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_discard_granularity_bytes": "65536", 2023-01-02T18:15:51.323 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_discard_on_zeroed_write_same": "true", 2023-01-02T18:15:51.323 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_enable_alloc_hint": "true", 2023-01-02T18:15:51.323 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2023-01-02T18:15:51.323 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_io_scheduler": "simple", 2023-01-02T18:15:51.324 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2023-01-02T18:15:51.324 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_commit_age": "5.000000", 2023-01-02T18:15:51.324 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2023-01-02T18:15:51.324 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_max_payload_bytes": "16384", 2023-01-02T18:15:51.324 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_age": "0.000000", 2023-01-02T18:15:51.324 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_bytes": "1048576", 2023-01-02T18:15:51.325 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_interval": "0", 2023-01-02T18:15:51.325 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2023-01-02T18:15:51.325 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2023-01-02T18:15:51.325 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_order": "24", 2023-01-02T18:15:51.325 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_pool": "", 2023-01-02T18:15:51.326 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_splay_width": "4", 2023-01-02T18:15:51.326 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_localize_parent_reads": "false", 2023-01-02T18:15:51.326 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_localize_snap_reads": "false", 2023-01-02T18:15:51.326 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2023-01-02T18:15:51.326 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2023-01-02T18:15:51.326 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2023-01-02T18:15:51.327 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2023-01-02T18:15:51.327 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2023-01-02T18:15:51.327 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2023-01-02T18:15:51.327 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_type": "simple", 2023-01-02T18:15:51.327 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2023-01-02T18:15:51.328 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_state_check_interval": "30", 2023-01-02T18:15:51.328 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2023-01-02T18:15:51.328 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2023-01-02T18:15:51.328 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2023-01-02T18:15:51.328 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2023-01-02T18:15:51.329 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2023-01-02T18:15:51.329 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_autotune": "true", 2023-01-02T18:15:51.329 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_base": "805306368", 2023-01-02T18:15:51.329 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2023-01-02T18:15:51.329 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_min": "134217728", 2023-01-02T18:15:51.329 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2023-01-02T18:15:51.330 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2023-01-02T18:15:51.330 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_target": "4294967296", 2023-01-02T18:15:51.330 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_perf_stats_prio": "5", 2023-01-02T18:15:51.330 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2023-01-02T18:15:51.330 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2023-01-02T18:15:51.331 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_delete_delay": "0", 2023-01-02T18:15:51.331 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2023-01-02T18:15:51.331 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_replay_delay": "0", 2023-01-02T18:15:51.331 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2023-01-02T18:15:51.331 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2023-01-02T18:15:51.332 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_to_trash_on_remove": "false", 2023-01-02T18:15:51.332 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2023-01-02T18:15:51.332 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mtime_update_interval": "60", 2023-01-02T18:15:51.332 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_non_blocking_aio": "true", 2023-01-02T18:15:51.332 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_op_thread_timeout": "60", 2023-01-02T18:15:51.332 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_op_threads": "1", 2023-01-02T18:15:51.333 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_parent_cache_enabled": "false", 2023-01-02T18:15:51.333 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_mode": "disabled", 2023-01-02T18:15:51.333 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_path": "/tmp", 2023-01-02T18:15:51.333 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_size": "1073741824", 2023-01-02T18:15:51.333 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_plugins": "", 2023-01-02T18:15:51.334 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_burst": "0", 2023-01-02T18:15:51.334 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_burst_seconds": "1", 2023-01-02T18:15:51.334 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_limit": "0", 2023-01-02T18:15:51.334 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_burst": "0", 2023-01-02T18:15:51.334 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_burst_seconds": "1", 2023-01-02T18:15:51.334 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_limit": "0", 2023-01-02T18:15:51.335 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_burst": "0", 2023-01-02T18:15:51.335 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2023-01-02T18:15:51.335 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_limit": "0", 2023-01-02T18:15:51.335 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_burst": "0", 2023-01-02T18:15:51.335 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2023-01-02T18:15:51.335 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_limit": "0", 2023-01-02T18:15:51.336 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_schedule_tick_min": "50", 2023-01-02T18:15:51.336 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_burst": "0", 2023-01-02T18:15:51.336 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2023-01-02T18:15:51.336 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_limit": "0", 2023-01-02T18:15:51.336 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_burst": "0", 2023-01-02T18:15:51.337 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2023-01-02T18:15:51.337 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_limit": "0", 2023-01-02T18:15:51.337 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_quiesce_notification_attempts": "10", 2023-01-02T18:15:51.337 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_read_from_replica_policy": "default", 2023-01-02T18:15:51.337 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2023-01-02T18:15:51.338 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_max_bytes": "524288", 2023-01-02T18:15:51.338 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_trigger_requests": "10", 2023-01-02T18:15:51.338 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_request_timed_out_seconds": "30", 2023-01-02T18:15:51.338 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_skip_partial_discard": "true", 2023-01-02T18:15:51.338 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2023-01-02T18:15:51.339 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_tracing": "false", 2023-01-02T18:15:51.339 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_validate_names": "true", 2023-01-02T18:15:51.339 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_validate_pool": "true", 2023-01-02T18:15:51.339 INFO:teuthology.orchestra.run.smithi007.stdout: "restapi_base_url": "", 2023-01-02T18:15:51.339 INFO:teuthology.orchestra.run.smithi007.stdout: "restapi_log_level": "", 2023-01-02T18:15:51.339 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_acl_grants_max_num": "100", 2023-01-02T18:15:51.340 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_admin_entry": "admin", 2023-01-02T18:15:51.340 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_barbican_url": "", 2023-01-02T18:15:51.340 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2023-01-02T18:15:51.340 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_default_quota_max_size": "-1", 2023-01-02T18:15:51.340 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_index_max_aio": "128", 2023-01-02T18:15:51.340 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_quota_cache_size": "10000", 2023-01-02T18:15:51.341 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_quota_ttl": "600", 2023-01-02T18:15:51.341 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_enabled": "true", 2023-01-02T18:15:51.341 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_expiry_interval": "900", 2023-01-02T18:15:51.341 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_lru_size": "10000", 2023-01-02T18:15:51.341 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_content_length_compat": "false", 2023-01-02T18:15:51.342 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_copy_obj_progress": "true", 2023-01-02T18:15:51.342 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2023-01-02T18:15:51.342 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cors_rules_max_num": "100", 2023-01-02T18:15:51.342 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cross_domain_policy": "", 2023-01-02T18:15:51.342 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_default_encryption_key": "", 2023-01-02T18:15:51.343 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_addr": "", 2023-01-02T18:15:51.343 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_ca_path": "", 2023-01-02T18:15:51.343 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_client_cert": "", 2023-01-02T18:15:51.343 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_client_key": "", 2023-01-02T18:15:51.343 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_kms_key_template": "", 2023-01-02T18:15:51.343 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_password": "", 2023-01-02T18:15:51.344 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2023-01-02T18:15:51.344 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_username": "", 2023-01-02T18:15:51.344 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_require_ssl": "true", 2023-01-02T18:15:51.344 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2023-01-02T18:15:51.344 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2023-01-02T18:15:51.345 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_suppress_logs": "true", 2023-01-02T18:15:51.345 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_addr": "", 2023-01-02T18:15:51.345 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_auth": "token", 2023-01-02T18:15:51.345 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_namespace": "", 2023-01-02T18:15:51.345 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_prefix": "", 2023-01-02T18:15:51.345 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_secret_engine": "transit", 2023-01-02T18:15:51.346 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_cacert": "", 2023-01-02T18:15:51.346 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2023-01-02T18:15:51.346 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2023-01-02T18:15:51.346 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_token_file": "", 2023-01-02T18:15:51.346 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_verify_ssl": "true", 2023-01-02T18:15:51.347 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_buffersize": "524288", 2023-01-02T18:15:51.347 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_low_speed_limit": "1024", 2023-01-02T18:15:51.347 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_low_speed_time": "300", 2023-01-02T18:15:51.347 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_wait_timeout_ms": "1000", 2023-01-02T18:15:51.347 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2023-01-02T18:15:51.348 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_changes_size": "1000", 2023-01-02T18:15:51.348 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_num_shards": "128", 2023-01-02T18:15:51.348 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_obj_prefix": "data_log", 2023-01-02T18:15:51.348 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_window": "30", 2023-01-02T18:15:51.348 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_notify_interval_msec": "200", 2023-01-02T18:15:51.348 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_data_log_backing": "fifo", 2023-01-02T18:15:51.349 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_realm_info_oid": "default.realm", 2023-01-02T18:15:51.349 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_region_info_oid": "default.region", 2023-01-02T18:15:51.349 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_zone_info_oid": "default.zone", 2023-01-02T18:15:51.349 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2023-01-02T18:15:51.349 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_defer_to_bucket_acls": "", 2023-01-02T18:15:51.350 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_delete_multi_obj_max_num": "1000", 2023-01-02T18:15:51.350 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_lim": "0.000000", 2023-01-02T18:15:51.350 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_res": "100.000000", 2023-01-02T18:15:51.350 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2023-01-02T18:15:51.350 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_lim": "0.000000", 2023-01-02T18:15:51.350 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_res": "200.000000", 2023-01-02T18:15:51.351 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2023-01-02T18:15:51.351 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_lim": "0.000000", 2023-01-02T18:15:51.351 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_res": "500.000000", 2023-01-02T18:15:51.351 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_wgt": "500.000000", 2023-01-02T18:15:51.351 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2023-01-02T18:15:51.351 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_res": "500.000000", 2023-01-02T18:15:51.352 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2023-01-02T18:15:51.352 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dns_name": "", 2023-01-02T18:15:51.352 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dns_s3website_name": "", 2023-01-02T18:15:51.352 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dynamic_resharding": "true", 2023-01-02T18:15:51.352 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2023-01-02T18:15:51.353 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_gc_threads": "true", 2023-01-02T18:15:51.353 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_lc_threads": "true", 2023-01-02T18:15:51.353 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_ops_log": "false", 2023-01-02T18:15:51.353 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_quota_threads": "true", 2023-01-02T18:15:51.353 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_static_website": "false", 2023-01-02T18:15:51.354 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_usage_log": "false", 2023-01-02T18:15:51.354 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enforce_swift_acls": "true", 2023-01-02T18:15:51.354 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_exit_timeout_secs": "120", 2023-01-02T18:15:51.354 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_expose_bucket": "false", 2023-01-02T18:15:51.354 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_extended_http_attrs": "", 2023-01-02T18:15:51.354 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_fcgi_socket_backlog": "1024", 2023-01-02T18:15:51.355 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2023-01-02T18:15:51.355 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_frontends": "beast port=7480", 2023-01-02T18:15:51.355 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_concurrent_io": "10", 2023-01-02T18:15:51.355 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_deferred": "50", 2023-01-02T18:15:51.355 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2023-01-02T18:15:51.356 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_objs": "32", 2023-01-02T18:15:51.356 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_queue_size": "134213632", 2023-01-02T18:15:51.356 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_trim_chunk": "16", 2023-01-02T18:15:51.356 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_obj_min_wait": "7200", 2023-01-02T18:15:51.356 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_processor_max_time": "3600", 2023-01-02T18:15:51.356 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_processor_period": "3600", 2023-01-02T18:15:51.357 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_get_obj_max_req_size": "4194304", 2023-01-02T18:15:51.357 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_get_obj_window_size": "16777216", 2023-01-02T18:15:51.357 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_healthcheck_disabling_path": "", 2023-01-02T18:15:51.357 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_host": "", 2023-01-02T18:15:51.357 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ignore_get_invalid_range": "false", 2023-01-02T18:15:51.358 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_init_timeout": "300", 2023-01-02T18:15:51.358 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2023-01-02T18:15:51.358 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_admin_roles": "", 2023-01-02T18:15:51.358 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2023-01-02T18:15:51.358 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_domain": "", 2023-01-02T18:15:51.359 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_password": "", 2023-01-02T18:15:51.359 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_password_path": "", 2023-01-02T18:15:51.359 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_project": "", 2023-01-02T18:15:51.359 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_tenant": "", 2023-01-02T18:15:51.359 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_token": "", 2023-01-02T18:15:51.359 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_token_path": "", 2023-01-02T18:15:51.360 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_user": "", 2023-01-02T18:15:51.360 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_api_version": "2", 2023-01-02T18:15:51.360 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_domain": "", 2023-01-02T18:15:51.360 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_password": "", 2023-01-02T18:15:51.360 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_project": "", 2023-01-02T18:15:51.361 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_tenant": "", 2023-01-02T18:15:51.361 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_user": "", 2023-01-02T18:15:51.361 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_implicit_tenants": "false", 2023-01-02T18:15:51.361 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_token_cache_size": "10000", 2023-01-02T18:15:51.361 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_url": "", 2023-01-02T18:15:51.361 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_verify_ssl": "true", 2023-01-02T18:15:51.362 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_debug_interval": "-1", 2023-01-02T18:15:51.362 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_lock_max_time": "90", 2023-01-02T18:15:51.362 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_objs": "32", 2023-01-02T18:15:51.362 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_rules": "1000", 2023-01-02T18:15:51.362 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_worker": "3", 2023-01-02T18:15:51.362 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_wp_worker": "3", 2023-01-02T18:15:51.363 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_thread_delay": "0", 2023-01-02T18:15:51.363 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2023-01-02T18:15:51.363 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_dnattr": "uid", 2023-01-02T18:15:51.363 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2023-01-02T18:15:51.363 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_searchfilter": "", 2023-01-02T18:15:51.363 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2023-01-02T18:15:51.364 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_uri": "ldaps://", 2023-01-02T18:15:51.364 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2023-01-02T18:15:51.364 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_list_bucket_min_readahead": "1000", 2023-01-02T18:15:51.364 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_list_buckets_max_chunk": "1000", 2023-01-02T18:15:51.364 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_http_headers": "", 2023-01-02T18:15:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_nonexistent_bucket": "false", 2023-01-02T18:15:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2023-01-02T18:15:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_object_name_utc": "false", 2023-01-02T18:15:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2023-01-02T18:15:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attr_name_len": "0", 2023-01-02T18:15:51.365 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attr_size": "0", 2023-01-02T18:15:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attrs_num_in_req": "0", 2023-01-02T18:15:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_chunk_size": "4194304", 2023-01-02T18:15:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_concurrent_requests": "1024", 2023-01-02T18:15:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_dynamic_shards": "1999", 2023-01-02T18:15:51.366 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_listing_results": "1000", 2023-01-02T18:15:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_notify_retries": "3", 2023-01-02T18:15:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_objs_per_shard": "100000", 2023-01-02T18:15:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_put_param_size": "1048576", 2023-01-02T18:15:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_put_size": "5368709120", 2023-01-02T18:15:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_slo_entries": "1000", 2023-01-02T18:15:51.367 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_md_log_max_shards": "64", 2023-01-02T18:15:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_md_notify_interval_msec": "200", 2023-01-02T18:15:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_mime_types_file": "/etc/mime.types", 2023-01-02T18:15:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_mp_lock_max_time": "600", 2023-01-02T18:15:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multipart_min_part_size": "5242880", 2023-01-02T18:15:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multipart_part_upload_limit": "10000", 2023-01-02T18:15:51.368 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_fhcache_partitions": "3", 2023-01-02T18:15:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_fhcache_size": "2017", 2023-01-02T18:15:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2023-01-02T18:15:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_lru_lanes": "5", 2023-01-02T18:15:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_max_gc": "300", 2023-01-02T18:15:51.369 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_namespace_expire_secs": "300", 2023-01-02T18:15:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_gc_threads": "false", 2023-01-02T18:15:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_lc_threads": "false", 2023-01-02T18:15:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_quota_threads": "false", 2023-01-02T18:15:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_sync_thread": "false", 2023-01-02T18:15:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_s3_fast_attrs": "false", 2023-01-02T18:15:51.370 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_write_completion_interval_s": "10", 2023-01-02T18:15:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_async_rados_threads": "32", 2023-01-02T18:15:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_control_oids": "8", 2023-01-02T18:15:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_rados_handles": "1", 2023-01-02T18:15:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_numa_node": "-1", 2023-01-02T18:15:51.371 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_obj_stripe_size": "4194304", 2023-01-02T18:15:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_obj_tombstone_cache_size": "1000", 2023-01-02T18:15:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_chunk_size": "100", 2023-01-02T18:15:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_gc_interval": "600", 2023-01-02T18:15:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_hints_num_shards": "127", 2023-01-02T18:15:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_olh_pending_timeout_sec": "3600", 2023-01-02T18:15:51.372 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_thread_suicide_timeout": "0", 2023-01-02T18:15:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_thread_timeout": "600", 2023-01-02T18:15:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_tracing": "false", 2023-01-02T18:15:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_token": "", 2023-01-02T18:15:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_url": "", 2023-01-02T18:15:51.373 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_verify_ssl": "true", 2023-01-02T18:15:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_data_backlog": "5242880", 2023-01-02T18:15:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_file_path": "", 2023-01-02T18:15:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_rados": "true", 2023-01-02T18:15:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_socket_path": "", 2023-01-02T18:15:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_override_bucket_index_max_shards": "0", 2023-01-02T18:15:51.374 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2023-01-02T18:15:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_push_interval": "2.000000", 2023-01-02T18:15:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_push_interval_max": "30.000000", 2023-01-02T18:15:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_root_pool": ".rgw.root", 2023-01-02T18:15:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_port": "", 2023-01-02T18:15:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_print_continue": "true", 2023-01-02T18:15:51.375 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_print_prohibited_content_length": "false", 2023-01-02T18:15:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_put_obj_max_window_size": "67108864", 2023-01-02T18:15:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_put_obj_min_window_size": "16777216", 2023-01-02T18:15:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2023-01-02T18:15:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_pool_recovery_priority": "5", 2023-01-02T18:15:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_tracing": "false", 2023-01-02T18:15:51.376 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm": "", 2023-01-02T18:15:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm_root_pool": ".rgw.root", 2023-01-02T18:15:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_region": "", 2023-01-02T18:15:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_region_root_pool": ".rgw.root", 2023-01-02T18:15:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_relaxed_region_enforcement": "false", 2023-01-02T18:15:51.377 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_relaxed_s3_bucket_names": "false", 2023-01-02T18:15:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2023-01-02T18:15:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_request_uri": "", 2023-01-02T18:15:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_batch_size": "64", 2023-01-02T18:15:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_bucket_lock_duration": "360", 2023-01-02T18:15:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_max_aio": "128", 2023-01-02T18:15:51.378 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_num_logs": "16", 2023-01-02T18:15:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_thread_interval": "600", 2023-01-02T18:15:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_resolve_cname": "false", 2023-01-02T18:15:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rest_getusage_op_compat": "false", 2023-01-02T18:15:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_run_sync_thread": "true", 2023-01-02T18:15:51.379 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_order": "sts, external, local", 2023-01-02T18:15:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_keystone": "false", 2023-01-02T18:15:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_ldap": "false", 2023-01-02T18:15:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_rados": "true", 2023-01-02T18:15:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_sts": "false", 2023-01-02T18:15:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_success_create_obj_status": "0", 2023-01-02T18:15:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_safe_max_objects_per_shard": "102400", 2023-01-02T18:15:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_scheduler_type": "throttler", 2023-01-02T18:15:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_script_uri": "", 2023-01-02T18:15:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_service_provider_name": "", 2023-01-02T18:15:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_shard_warning_threshold": "90.000000", 2023-01-02T18:15:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_socket_path": "", 2023-01-02T18:15:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_client_id": "", 2023-01-02T18:15:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_client_secret": "", 2023-01-02T18:15:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_entry": "sts", 2023-01-02T18:15:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_key": "sts", 2023-01-02T18:15:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_max_session_duration": "43200", 2023-01-02T18:15:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_min_session_duration": "900", 2023-01-02T18:15:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_token_introspection_url": "", 2023-01-02T18:15:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_account_in_url": "false", 2023-01-02T18:15:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_auth_entry": "auth", 2023-01-02T18:15:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_auth_url": "", 2023-01-02T18:15:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_custom_header": "", 2023-01-02T18:15:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_enforce_content_length": "false", 2023-01-02T18:15:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_need_stats": "true", 2023-01-02T18:15:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_tenant_name": "", 2023-01-02T18:15:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_token_expiration": "86400", 2023-01-02T18:15:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_url": "", 2023-01-02T18:15:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_url_prefix": "swift", 2023-01-02T18:15:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_versioning_enabled": "false", 2023-01-02T18:15:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2023-01-02T18:15:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_lease_period": "120", 2023-01-02T18:15:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2023-01-02T18:15:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_interval": "1200", 2023-01-02T18:15:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_max_buckets": "16", 2023-01-02T18:15:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2023-01-02T18:15:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2023-01-02T18:15:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_obj_etag_verify": "false", 2023-01-02T18:15:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_history_size": "4096", 2023-01-02T18:15:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_per_node_log_size": "32", 2023-01-02T18:15:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2023-01-02T18:15:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_thread_pool_size": "512", 2023-01-02T18:15:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_comment": "", 2023-01-02T18:15:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_createby": "", 2023-01-02T18:15:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_encoding": "", 2023-01-02T18:15:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_flag": "false", 2023-01-02T18:15:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_origin": "", 2023-01-02T18:15:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_sha_unit": "524288", 2023-01-02T18:15:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_tracker": "", 2023-01-02T18:15:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_trust_forwarded_https": "false", 2023-01-02T18:15:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_log_flush_threshold": "1024", 2023-01-02T18:15:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_log_tick_interval": "30", 2023-01-02T18:15:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_max_shards": "32", 2023-01-02T18:15:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_max_user_shards": "1", 2023-01-02T18:15:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_use_opa_authz": "false", 2023-01-02T18:15:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_default_quota_max_objects": "-1", 2023-01-02T18:15:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_default_quota_max_size": "-1", 2023-01-02T18:15:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_max_buckets": "1000", 2023-01-02T18:15:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2023-01-02T18:15:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_idle_users": "false", 2023-01-02T18:15:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_interval": "86400", 2023-01-02T18:15:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_wait_time": "86400", 2023-01-02T18:15:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_unique_email": "true", 2023-01-02T18:15:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_verify_ssl": "true", 2023-01-02T18:15:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_website_routing_rules_max_num": "50", 2023-01-02T18:15:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone": "", 2023-01-02T18:15:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone_root_pool": ".rgw.root", 2023-01-02T18:15:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup": "", 2023-01-02T18:15:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2023-01-02T18:15:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_block_size": "4096", 2023-01-02T18:15:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_bloom_bits_per_key": "20", 2023-01-02T18:15:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2023-01-02T18:15:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2023-01-02T18:15:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_row_ratio": "0.000000", 2023-01-02T18:15:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_shard_bits": "4", 2023-01-02T18:15:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_size": "536870912", 2023-01-02T18:15:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_type": "binned_lru", 2023-01-02T18:15:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_compaction_stats": "false", 2023-01-02T18:15:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_extended_stats": "false", 2023-01-02T18:15:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_memory_stats": "false", 2023-01-02T18:15:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_delete_range_threshold": "1048576", 2023-01-02T18:15:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_index_type": "binary_search", 2023-01-02T18:15:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_log_to_ceph_log": "true", 2023-01-02T18:15:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_metadata_block_size": "4096", 2023-01-02T18:15:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_partition_filters": "false", 2023-01-02T18:15:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_perf": "false", 2023-01-02T18:15:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2023-01-02T18:15:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "rotating_keys_bootstrap_timeout": "30", 2023-01-02T18:15:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "rotating_keys_renewal_timeout": "10", 2023-01-02T18:15:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "run_dir": "/var/run/ceph", 2023-01-02T18:15:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "setgroup": "", 2023-01-02T18:15:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: "setuser": "", 2023-01-02T18:15:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: "setuser_match_path": "", 2023-01-02T18:15:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_misplaced_ratio": "0.050000", 2023-01-02T18:15:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: "thp": "false", 2023-01-02T18:15:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: "threadpool_default_timeout": "60", 2023-01-02T18:15:51.397 INFO:teuthology.orchestra.run.smithi007.stdout: "threadpool_empty_queue_max_wait": "2", 2023-01-02T18:15:51.397 INFO:teuthology.orchestra.run.smithi007.stdout: "throttler_perf_counter": "true" 2023-01-02T18:15:51.397 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:51.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2023-01-02T18:15:51.533 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a: {} 2023-01-02T18:15:51.543 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b: {} 2023-01-02T18:15:51.552 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c: {} 2023-01-02T18:15:51.553 INFO:teuthology.orchestra.run.smithi007.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-01-02T18:15:51.554 INFO:teuthology.orchestra.run.smithi007.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-01-02T18:15:51.554 INFO:teuthology.orchestra.run.smithi007.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-01-02T18:15:51.564 DEBUG:teuthology.orchestra.run.smithi057:> type ceph-objectstore-tool 2023-01-02T18:15:51.586 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2023-01-02T18:15:51.587 DEBUG:teuthology.orchestra.run.smithi007:> type ceph-objectstore-tool 2023-01-02T18:15:51.604 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2023-01-02T18:15:51.605 INFO:teuthology.run_tasks:Running task workunit... 2023-01-02T18:15:51.618 INFO:tasks.workunit:Pulling workunits from ref 623bc557440f012d459eb3c5ded0a7dee57ecdb1 2023-01-02T18:15:51.619 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-01-02T18:15:51.619 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2023-01-02T18:15:51.620 INFO:tasks.thrashosds.thrasher:starting do_thrash 2023-01-02T18:15:51.620 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:15:51.620 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:15:51.620 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-01-02T18:15:51.621 INFO:tasks.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.657710 2023-01-02T18:15:51.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 0.6577098648136287 2023-01-02T18:15:51.621 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2023-01-02T18:15:51.622 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2023-01-02T18:15:51.622 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:15:51.623 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2023-01-02T18:15:51.623 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:15:51.623 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2023-01-02T18:15:51.624 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:15:51.628 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:51.629+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:51.669 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-01-02T18:15:51.670 INFO:teuthology.orchestra.run.smithi007.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-01-02T18:15:51.670 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-01-02T18:15:51.724 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:51.724+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:51.736 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-01-02T18:15:51.736 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-01-02T18:15:51.798 INFO:tasks.workunit:timeout=3h 2023-01-02T18:15:51.798 INFO:tasks.workunit:cleanup=True 2023-01-02T18:15:51.799 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 623bc557440f012d459eb3c5ded0a7dee57ecdb1 2023-01-02T18:15:51.802 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:51.803 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:15:51.803 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:15:51.803 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:51.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:15:51.818 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:15:51.824 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-01-02T18:15:51.824 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:51.825+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:51.839 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:15:51.860 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:15:51.879 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:15:51.898 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:15:51.916 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:15:51.925 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:51.925+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:51.934 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:15:51.952 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:51.952 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:51.953 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:15:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:15:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:15:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:15:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:15:51.955 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:15:51.956 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:15:51.956 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:15:51.956 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:15:51.964 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:15:52.026 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:52.026+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:15:52.127 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:52.127+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:52.135 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:52.135 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:52.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:15:52.227 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:52.228+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:52.311 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:52.312 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:52.321 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:15:52.328 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:52.329+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:52.429 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:52.429+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:15:52.446 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:52.446 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:52.456 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:15:52.530 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:52.530+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:15:52.582 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:52.582 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:52.592 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:15:52.612 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:15:52.614 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.0 primary-affinity to 0.65771 (8431032) 2023-01-02T18:15:52.669 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:52.669+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:15:52.724 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:52.725 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:52.731 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:52.731+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:52.734 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:15:52.832 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:52.832+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:15:52.900 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:52.900 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:52.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:15:52.954 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:52.954+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:53.033 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:53.034+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:15:53.035 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:53.035 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:53.045 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:15:53.134 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:53.134+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:15:53.212 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:53.212 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:53.222 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:15:53.234 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:53.235+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:15:53.335 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:53.335+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:53.388 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:53.388 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:53.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:15:53.442 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:53.442+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:53.525 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:53.525 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:53.535 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:15:53.581 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:53.578+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:53.638 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:53.638+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:53.679 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:53.680 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:53.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:15:53.738 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:53.738+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:53.839 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:53.840+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:53.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:15:53.957 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:53.957+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:53.968 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:15:54.038 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:54.038 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:54.041 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:54.041+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:15:54.047 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:15:54.112 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:15:54.130 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:15:54.141 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:54.141+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:15:54.147 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:15:54.164 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:15:54.184 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:15:54.203 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:15:54.215 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:54.216 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:15:54.216 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:15:54.216 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:54.220 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:15:54.226 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:15:54.239 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:15:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:15:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:15:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:15:54.240 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:15:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:15:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:15:54.241 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:15:54.242 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:15:54.244 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:54.244+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:54.344 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:54.344+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:54.352 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:54.353 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:15:54.353 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:15:54.353 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:15:54.353 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:54.363 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:15:54.446 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:54.446+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:54.488 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:54.489 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:15:54.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:15:54.489 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:15:54.489 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:54.498 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:15:54.547 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:54.547+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:15:54.625 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:15:54.626 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:15:54.626 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:54.626 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:15:54.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:15:54.677 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:54.677+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:54.749 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:54.749+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:54.802 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:54.802 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:15:54.802 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:15:54.802 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:15:54.803 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:54.812 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:15:54.850 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:54.850+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:54.938 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:54.938 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:15:54.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:15:54.938 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:15:54.938 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:54.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:15:54.951 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:54.952+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:15:55.053 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:55.052+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:15:55.075 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:55.075 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:15:55.075 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:15:55.076 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:55.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:15:55.153 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:55.153+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:55.210 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:55.210 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:15:55.211 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:15:55.211 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:15:55.211 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:55.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:15:55.253 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:55.253+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:55.346 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:15:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:15:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:15:55.347 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:55.354 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:55.354+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:55.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:15:55.454 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:55.455+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:55.487 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:55.487 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:15:55.487 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:15:55.488 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:55.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:15:55.556 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:55.556+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:15:55.620 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:15:55.625 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:55.625 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:15:55.625 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:15:55.625 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:15:55.626 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:55.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:15:55.657 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:55.658+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:15:55.758 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:55.757+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:55.801 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:55.802 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:15:55.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:15:55.802 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:15:55.802 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:55.811 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:15:55.896 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:55.896+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:55.959 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:55.959+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:55.990 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:55.991 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:15:55.991 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:15:55.991 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:56.002 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:15:56.060 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:56.061+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:56.161 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:56.161+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:56.177 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:15:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:15:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:15:56.178 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:56.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:15:56.252 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:15:56.272 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:56.272+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:56.364 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:56.364+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:56.381 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:56.382 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:15:56.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:15:56.382 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:15:56.382 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:56.396 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:15:56.424 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:15:56.446 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:15:56.465 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:56.465+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:56.465 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:15:56.485 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:15:56.504 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:15:56.523 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:15:56.542 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:15:56.558 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:56.559 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:56.561 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:15:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:15:56.562 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:15:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:15:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:15:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:15:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:15:56.563 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:15:56.564 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:15:56.566 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:56.566+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:56.571 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:15:56.667 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:56.667+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:56.749 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:56.750 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:56.760 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:15:56.801 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:56.801+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:56.869 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:56.869+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:56.930 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:56.930 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:56.940 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:15:56.981 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:56.981+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:57.071 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:57.072+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:57.113 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:57.113 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:57.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:15:57.172 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:57.172+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:15:57.251 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:57.251 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:57.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:15:57.273 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:57.274+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:15:57.374 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:57.375+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:57.432 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:57.433 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:57.443 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:15:57.488 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:57.489+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:15:57.577 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:57.578+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:57.583 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:57.583 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:57.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:15:57.628 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:15:57.629 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:15:57.629 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-01-02T18:15:57.629 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.144536 2023-01-02T18:15:57.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.14453550942685545 2023-01-02T18:15:57.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:15:57.678 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:57.678+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:57.760 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:57.761 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:57.771 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:15:57.779 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:57.779+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:57.880 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:57.880+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:57.896 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:57.896 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:57.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:15:57.989 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:57.990+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:58.012 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:15:58.012 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.2 primary-affinity to 0.144536 (894722) 2023-01-02T18:15:58.073 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:58.074 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:58.081 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:58.081+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:58.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:15:58.182 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:58.182+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:58.249 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:58.249 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:58.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:15:58.283 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:58.283+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:58.383 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:58.384 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:58.384 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:58.383+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:58.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:15:58.484 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:58.485+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:58.519 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:58.519 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:58.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:15:58.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:15:58.613 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:58.614+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:58.685 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:58.686+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:15:58.694 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:15:58.695 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:15:58.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:15:58.723 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:15:58.743 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:15:58.761 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:15:58.779 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:15:58.789 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:58.790+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:58.798 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:15:58.817 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:15:58.836 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:15:58.854 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:15:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:15:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:15:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:15:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:15:58.856 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:15:58.857 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:15:58.857 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:15:58.857 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:15:58.871 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:58.871 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:15:58.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:15:58.872 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:15:58.872 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:58.882 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:15:58.922 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:15:58.923+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:15:58.987 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:58.987+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:59.048 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:59.048 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:15:59.048 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:15:59.049 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:59.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:15:59.087 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:15:59.087+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:15:59.183 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:59.184 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:15:59.184 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:15:59.184 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:15:59.185 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:59.188 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:15:59.188+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:15:59.193 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:15:59.289 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:15:59.289+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:15:59.319 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:15:59.319 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:15:59.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:15:59.319 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:15:59.319 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:15:59.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:15:59.390 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:59.390+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:59.455 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:15:59.456 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:15:59.456 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:59.466 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:15:59.491 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:59.492+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:59.592 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:59.593+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:15:59.635 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:15:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:15:59.636 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:15:59.637 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:59.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:15:59.693 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:15:59.693+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:15:59.776 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:15:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:15:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:15:59.776 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:59.786 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:15:59.793 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:15:59.794+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:15:59.894 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:15:59.894+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:15:59.914 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:15:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:15:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:15:59.915 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:15:59.925 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:15:59.995 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:15:59.996+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:00.026 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:16:00.096 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:00.097+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:00.102 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:00.103 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:00.103 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:00.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:00.197 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:00.197+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:00.252 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:00.252 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:00.253 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:00.253 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:00.263 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:00.304 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:00.304+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:00.399 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:00.399+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:00.428 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:16:00.433 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:00.433 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:00.433 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:00.444 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:00.528 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:00.528+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:00.602 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:00.602+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:00.617 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:00.617 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:00.617 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:00.627 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:00.703 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:00.703+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:00.795 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:00.796 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:00.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:00.796 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:00.796 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:00.804 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:00.804+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:00.806 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:00.867 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:00.905 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:00.905+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:00.937 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:00.938 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:00.938 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:00.938 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:00.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:01.006 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:01.006+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:01.021 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:01.041 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:01.063 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:01.082 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:01.088 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:01.088 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:01.099 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:01.103 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:01.124 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:01.125 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:01.125+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:01.144 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:01.163 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:01.165 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:01.166 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:01.217 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:01.217+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:01.241 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:01.241 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:01.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:01.309 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:01.309+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:01.392 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:01.392 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:01.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:01.446 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:01.447+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:01.511 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:01.511+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:01.528 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:01.529 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:01.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:01.622 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:01.623+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:01.704 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:01.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:01.715 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:01.714+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:01.815 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:01.815+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:01.880 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:01.880 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:01.890 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:01.916 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:01.916+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:02.015 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:02.015 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:02.016 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:02.017+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:02.025 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:02.118 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:02.118+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:02.191 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:02.191 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:02.201 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:02.218 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:02.218+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:02.319 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:02.319+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:02.326 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:02.326 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:02.336 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:02.420 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:02.421+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:02.442 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:16:02.461 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:02.461 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:02.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:02.555 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:02.556+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:02.623 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:02.623+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:02.637 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:02.637 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:02.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:02.731 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:02.732+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:02.813 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:02.813 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:02.823 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:02.824 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:02.824+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:02.925 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:02.925+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:02.989 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:02.989 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:02.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:03.026 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:03.026+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:03.026 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:03.026 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:03.027 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-01-02T18:16:03.027 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-01-02T18:16:03.125 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:03.125 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:03.126 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:03.126+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:03.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:03.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:03.228 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:03.228+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:03.305 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:03.306 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:03.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:03.350 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:03.350 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:03.350+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:03.379 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:03.379 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:03.379 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 23, 2023-01-02T18:16:03.380 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "4e320929-c4bb-4ea9-9e1c-d8479b7e40b1", 2023-01-02T18:16:03.380 INFO:teuthology.orchestra.run.smithi007.stdout: "created": "2023-01-02T18:15:29.542145+0000", 2023-01-02T18:16:03.380 INFO:teuthology.orchestra.run.smithi007.stdout: "modified": "2023-01-02T18:16:00.422142+0000", 2023-01-02T18:16:03.380 INFO:teuthology.orchestra.run.smithi007.stdout: "last_up_change": "2023-01-02T18:15:38.537792+0000", 2023-01-02T18:16:03.381 INFO:teuthology.orchestra.run.smithi007.stdout: "last_in_change": "2023-01-02T18:15:32.099480+0000", 2023-01-02T18:16:03.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-01-02T18:16:03.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_num": 5799936, 2023-01-02T18:16:03.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_set": [ 2023-01-02T18:16:03.381 INFO:teuthology.orchestra.run.smithi007.stdout: "pglog_hardlimit", 2023-01-02T18:16:03.382 INFO:teuthology.orchestra.run.smithi007.stdout: "purged_snapdirs", 2023-01-02T18:16:03.382 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_deletes", 2023-01-02T18:16:03.382 INFO:teuthology.orchestra.run.smithi007.stdout: "sortbitwise" 2023-01-02T18:16:03.382 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:16:03.382 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_version": 4, 2023-01-02T18:16:03.383 INFO:teuthology.orchestra.run.smithi007.stdout: "full_ratio": 0.94999998807907104, 2023-01-02T18:16:03.383 INFO:teuthology.orchestra.run.smithi007.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-01-02T18:16:03.383 INFO:teuthology.orchestra.run.smithi007.stdout: "nearfull_ratio": 0.85000002384185791, 2023-01-02T18:16:03.383 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_snapshot": "", 2023-01-02T18:16:03.384 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_max": 2, 2023-01-02T18:16:03.384 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd": 8, 2023-01-02T18:16:03.384 INFO:teuthology.orchestra.run.smithi007.stdout: "require_min_compat_client": "luminous", 2023-01-02T18:16:03.384 INFO:teuthology.orchestra.run.smithi007.stdout: "min_compat_client": "jewel", 2023-01-02T18:16:03.385 INFO:teuthology.orchestra.run.smithi007.stdout: "require_osd_release": "pacific", 2023-01-02T18:16:03.385 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": [ 2023-01-02T18:16:03.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.385 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 1, 2023-01-02T18:16:03.385 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "device_health_metrics", 2023-01-02T18:16:03.386 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:38.598445+0000", 2023-01-02T18:16:03.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:16:03.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:16:03.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:16:03.386 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:16:03.387 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:16:03.387 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:16:03.387 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:16:03.387 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:16:03.387 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:16:03.388 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:16:03.388 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:16:03.388 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:16:03.388 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 1, 2023-01-02T18:16:03.388 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 1, 2023-01-02T18:16:03.389 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 1, 2023-01-02T18:16:03.389 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 1, 2023-01-02T18:16:03.389 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 1, 2023-01-02T18:16:03.389 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:16:03.389 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:16:03.389 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:16:03.390 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:16:03.390 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:16:03.390 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:16:03.390 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:16:03.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.391 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "16", 2023-01-02T18:16:03.391 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:16:03.391 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:16:03.391 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:16:03.391 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:16:03.392 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:16:03.392 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:16:03.392 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:16:03.392 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:16:03.392 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:16:03.393 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:16:03.393 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:16:03.393 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:16:03.393 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:16:03.393 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:16:03.394 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:16:03.394 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:16:03.394 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:16:03.394 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:16:03.394 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:16:03.395 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:16:03.395 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:16:03.395 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:16:03.395 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:16:03.395 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:16:03.396 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:16:03.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:16:03.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.396 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:16:03.396 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:16:03.397 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:16:03.397 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:16:03.397 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:16:03.397 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:16:03.397 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:16:03.398 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:16:03.398 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:16:03.398 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:16:03.398 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:16:03.398 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-01-02T18:16:03.399 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_max": 32, 2023-01-02T18:16:03.399 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 1 2023-01-02T18:16:03.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.399 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:16:03.399 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_devicehealth": {} 2023-01-02T18:16:03.400 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.400 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 2, 2023-01-02T18:16:03.400 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "rbd", 2023-01-02T18:16:03.401 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:40.853543+0000", 2023-01-02T18:16:03.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:16:03.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:16:03.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:16:03.402 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:16:03.402 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:16:03.402 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:16:03.402 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:16:03.403 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:16:03.403 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:16:03.403 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:16:03.403 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:16:03.403 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:16:03.404 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 8, 2023-01-02T18:16:03.404 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 8, 2023-01-02T18:16:03.404 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 8, 2023-01-02T18:16:03.404 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 8, 2023-01-02T18:16:03.405 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 8, 2023-01-02T18:16:03.405 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:16:03.405 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:16:03.405 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:16:03.405 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:16:03.406 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:16:03.406 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:16:03.406 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:16:03.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.406 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "18", 2023-01-02T18:16:03.407 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:16:03.407 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:16:03.407 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:16:03.407 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:16:03.407 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:16:03.408 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:16:03.408 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:16:03.408 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:16:03.408 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:16:03.408 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:16:03.409 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:16:03.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:16:03.409 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:16:03.409 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:16:03.409 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:16:03.410 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:16:03.410 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:16:03.410 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:16:03.410 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:16:03.410 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:16:03.411 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:16:03.411 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:16:03.411 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:16:03.411 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:16:03.411 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:16:03.412 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:16:03.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.412 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:16:03.412 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:16:03.412 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:16:03.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:16:03.413 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:16:03.413 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:16:03.413 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:16:03.414 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:16:03.414 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:16:03.414 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:16:03.414 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:16:03.414 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:16:03.415 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:16:03.415 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd": {} 2023-01-02T18:16:03.415 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.415 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.415 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:16:03.415 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:16:03.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.416 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:16:03.416 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "69e18813-bd8e-4b22-9c40-d702ff3a5efd", 2023-01-02T18:16:03.416 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:16:03.416 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:16:03.417 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:16:03.417 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.6576995849609375, 2023-01-02T18:16:03.417 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:16:03.417 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:16:03.417 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:16:03.418 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 0, 2023-01-02T18:16:03.418 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:16:03.418 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:16:03.418 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:16:03.418 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.419 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6808", 2023-01-02T18:16:03.419 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:16:03.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.420 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6809", 2023-01-02T18:16:03.420 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:16:03.420 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.421 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.421 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:16:03.421 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.422 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6810", 2023-01-02T18:16:03.422 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:16:03.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.423 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6811", 2023-01-02T18:16:03.423 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:16:03.423 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.423 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.424 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:16:03.424 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.424 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6814", 2023-01-02T18:16:03.425 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:16:03.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.425 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.425 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6815", 2023-01-02T18:16:03.426 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:16:03.426 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.426 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.426 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:16:03.427 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.427 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6812", 2023-01-02T18:16:03.427 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:16:03.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.428 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6813", 2023-01-02T18:16:03.428 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:16:03.428 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.429 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.429 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6809/107063", 2023-01-02T18:16:03.429 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6811/107063", 2023-01-02T18:16:03.430 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6815/107063", 2023-01-02T18:16:03.430 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6813/107063", 2023-01-02T18:16:03.430 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:16:03.430 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:16:03.430 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:16:03.430 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.431 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:16:03.431 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "aa04dec6-4607-4f2a-85a3-a6278832fef3", 2023-01-02T18:16:03.431 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:16:03.432 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:16:03.432 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:16:03.432 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:16:03.432 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:16:03.432 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:16:03.433 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:16:03.433 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 16, 2023-01-02T18:16:03.433 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:16:03.433 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:16:03.433 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:16:03.434 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.434 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6824", 2023-01-02T18:16:03.434 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:16:03.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.435 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6825", 2023-01-02T18:16:03.435 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:16:03.435 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.436 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.436 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:16:03.436 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.437 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.437 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6826", 2023-01-02T18:16:03.437 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:16:03.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.438 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6827", 2023-01-02T18:16:03.438 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:16:03.439 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.439 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.439 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:16:03.439 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.440 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6830", 2023-01-02T18:16:03.440 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:16:03.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.441 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6831", 2023-01-02T18:16:03.441 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:16:03.441 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.442 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.442 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:16:03.442 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.443 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6828", 2023-01-02T18:16:03.443 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:16:03.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.444 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6829", 2023-01-02T18:16:03.444 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:16:03.444 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.444 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.445 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6825/107066", 2023-01-02T18:16:03.445 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6827/107066", 2023-01-02T18:16:03.445 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6831/107066", 2023-01-02T18:16:03.445 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6829/107066", 2023-01-02T18:16:03.445 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:16:03.446 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:16:03.446 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:16:03.446 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.447 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:16:03.447 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "c98a28fb-d910-4601-a229-d4318259ab9b", 2023-01-02T18:16:03.447 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:16:03.447 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:16:03.447 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:16:03.448 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.14453125, 2023-01-02T18:16:03.448 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:16:03.448 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:16:03.448 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:16:03.448 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 16, 2023-01-02T18:16:03.449 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:16:03.449 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:16:03.449 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:16:03.449 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.450 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6816", 2023-01-02T18:16:03.450 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:16:03.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.451 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.451 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6817", 2023-01-02T18:16:03.451 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:16:03.451 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.451 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.452 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:16:03.452 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.453 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6818", 2023-01-02T18:16:03.453 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:16:03.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.454 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6819", 2023-01-02T18:16:03.454 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:16:03.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.454 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.455 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:16:03.455 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.455 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6822", 2023-01-02T18:16:03.455 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:16:03.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.456 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6823", 2023-01-02T18:16:03.457 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:16:03.457 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.457 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.457 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:16:03.458 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.458 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6820", 2023-01-02T18:16:03.458 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:16:03.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.459 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6821", 2023-01-02T18:16:03.459 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:16:03.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.460 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.460 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6817/107065", 2023-01-02T18:16:03.460 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6819/107065", 2023-01-02T18:16:03.461 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6823/107065", 2023-01-02T18:16:03.461 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6821/107065", 2023-01-02T18:16:03.461 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:16:03.461 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:16:03.461 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:16:03.462 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.462 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:16:03.462 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "3c5d48f4-5384-4563-8acb-11d866b85ef4", 2023-01-02T18:16:03.463 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:16:03.463 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:16:03.463 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:16:03.463 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:16:03.464 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:16:03.464 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:16:03.464 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:16:03.464 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 21, 2023-01-02T18:16:03.464 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:16:03.465 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:16:03.465 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:16:03.465 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.466 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2023-01-02T18:16:03.466 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:16:03.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.467 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2023-01-02T18:16:03.467 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:16:03.467 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.467 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.468 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:16:03.468 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.468 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6802", 2023-01-02T18:16:03.468 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:16:03.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.469 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6803", 2023-01-02T18:16:03.469 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:16:03.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.470 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.470 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:16:03.470 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.471 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.471 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6806", 2023-01-02T18:16:03.471 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:16:03.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6807", 2023-01-02T18:16:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:16:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.472 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.473 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:16:03.473 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.474 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6804", 2023-01-02T18:16:03.474 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:16:03.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.475 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6805", 2023-01-02T18:16:03.475 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:16:03.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.475 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.476 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6801/107064", 2023-01-02T18:16:03.476 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6803/107064", 2023-01-02T18:16:03.476 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6807/107064", 2023-01-02T18:16:03.476 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6805/107064", 2023-01-02T18:16:03.476 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:16:03.476 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:16:03.477 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:16:03.477 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.477 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:16:03.478 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "2476d495-4979-4679-a7e9-12652c270092", 2023-01-02T18:16:03.478 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:16:03.478 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:16:03.478 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:16:03.478 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:16:03.479 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:16:03.479 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:16:03.479 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:16:03.479 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 0, 2023-01-02T18:16:03.479 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:16:03.480 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:16:03.480 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:16:03.480 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.481 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6800", 2023-01-02T18:16:03.481 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:16:03.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.482 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6801", 2023-01-02T18:16:03.482 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:16:03.482 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.482 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.483 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:16:03.483 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.483 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6802", 2023-01-02T18:16:03.484 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:16:03.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.484 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6803", 2023-01-02T18:16:03.484 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:16:03.485 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.485 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.485 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:16:03.485 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.486 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6806", 2023-01-02T18:16:03.486 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:16:03.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.487 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.487 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6807", 2023-01-02T18:16:03.487 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:16:03.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.488 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.488 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:16:03.488 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.489 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6804", 2023-01-02T18:16:03.489 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:16:03.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.490 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6805", 2023-01-02T18:16:03.490 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:16:03.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.490 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.491 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6801/106900", 2023-01-02T18:16:03.491 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6803/106900", 2023-01-02T18:16:03.491 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6807/106900", 2023-01-02T18:16:03.491 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6805/106900", 2023-01-02T18:16:03.491 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:16:03.492 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:16:03.492 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:16:03.492 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.493 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:16:03.493 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "38d57e5e-b6c1-445f-b181-23fb518698f9", 2023-01-02T18:16:03.493 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:16:03.494 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:16:03.494 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:16:03.494 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:16:03.494 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:16:03.494 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:16:03.495 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:16:03.495 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 16, 2023-01-02T18:16:03.495 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:16:03.495 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:16:03.495 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:16:03.495 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.496 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6816", 2023-01-02T18:16:03.496 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:16:03.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.497 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6817", 2023-01-02T18:16:03.497 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:16:03.497 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.497 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:16:03.498 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.498 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.499 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6818", 2023-01-02T18:16:03.499 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:16:03.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.499 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.500 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6819", 2023-01-02T18:16:03.500 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:16:03.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.500 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.500 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:16:03.501 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.501 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6822", 2023-01-02T18:16:03.501 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:16:03.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.502 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6823", 2023-01-02T18:16:03.502 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:16:03.503 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.503 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.503 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:16:03.503 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.504 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.504 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6820", 2023-01-02T18:16:03.504 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:16:03.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.505 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6821", 2023-01-02T18:16:03.505 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:16:03.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.505 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.506 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6817/106930", 2023-01-02T18:16:03.506 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6819/106930", 2023-01-02T18:16:03.506 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6823/106930", 2023-01-02T18:16:03.506 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6821/106930", 2023-01-02T18:16:03.506 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:16:03.507 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:16:03.507 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:16:03.507 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.507 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:16:03.508 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "6c78f25a-2a65-47fe-b101-e47c00a5b2f6", 2023-01-02T18:16:03.508 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:16:03.508 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:16:03.508 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:16:03.508 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:16:03.509 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:16:03.509 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:16:03.509 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:16:03.509 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 16, 2023-01-02T18:16:03.509 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:16:03.510 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:16:03.510 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:16:03.510 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.511 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6808", 2023-01-02T18:16:03.511 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:16:03.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.511 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6809", 2023-01-02T18:16:03.512 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:16:03.512 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.512 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.512 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:16:03.513 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.513 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6810", 2023-01-02T18:16:03.513 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:16:03.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.514 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6811", 2023-01-02T18:16:03.514 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:16:03.514 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.515 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.515 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:16:03.515 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.516 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6814", 2023-01-02T18:16:03.516 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:16:03.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.516 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.517 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6815", 2023-01-02T18:16:03.517 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:16:03.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.518 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:16:03.518 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.518 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6812", 2023-01-02T18:16:03.518 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:16:03.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.519 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6813", 2023-01-02T18:16:03.519 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:16:03.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.520 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.520 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6809/106901", 2023-01-02T18:16:03.520 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6811/106901", 2023-01-02T18:16:03.521 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6815/106901", 2023-01-02T18:16:03.521 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6813/106901", 2023-01-02T18:16:03.521 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:16:03.521 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:16:03.521 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:16:03.521 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.522 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:16:03.522 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "b094706d-7145-4865-ae95-e5cd7e40d23b", 2023-01-02T18:16:03.522 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:16:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:16:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:16:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:16:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:16:03.523 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:16:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:16:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 16, 2023-01-02T18:16:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:16:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:16:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:16:03.524 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.525 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6824", 2023-01-02T18:16:03.525 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:16:03.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.526 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6825", 2023-01-02T18:16:03.526 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:16:03.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.526 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.527 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:16:03.527 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.527 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6826", 2023-01-02T18:16:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:16:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6827", 2023-01-02T18:16:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:16:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:16:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6830", 2023-01-02T18:16:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:16:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6831", 2023-01-02T18:16:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:16:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:16:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:16:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:16:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6828", 2023-01-02T18:16:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:16:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:16:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6829", 2023-01-02T18:16:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:16:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6825/106931", 2023-01-02T18:16:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6827/106931", 2023-01-02T18:16:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6831/106931", 2023-01-02T18:16:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6829/106931", 2023-01-02T18:16:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:16:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:16:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:16:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:16:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_xinfo": [ 2023-01-02T18:16:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:16:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:16:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:16:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:16:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:16:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:16:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.290083+0000", 2023-01-02T18:16:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:16:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:16:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:16:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:16:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:16:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:16:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:16:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.303022+0000", 2023-01-02T18:16:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:16:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:16:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:16:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:16:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:16:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:16:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:16:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.292245+0000", 2023-01-02T18:16:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:16:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:16:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:16:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:16:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:16:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:16:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:16:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.210530+0000", 2023-01-02T18:16:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:16:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:16:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:16:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:16:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:16:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:16:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:16:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.282212+0000", 2023-01-02T18:16:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:16:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:16:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:16:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:16:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:16:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:16:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:16:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.237376+0000", 2023-01-02T18:16:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:16:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:16:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:16:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:16:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:16:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:16:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:16:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.239974+0000", 2023-01-02T18:16:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:16:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:16:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:16:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:16:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:16:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:16:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:16:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.276340+0000", 2023-01-02T18:16:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:16:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:16:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap": [], 2023-01-02T18:16:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_items": [], 2023-01-02T18:16:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_temp": [], 2023-01-02T18:16:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_temp": [], 2023-01-02T18:16:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklist": {}, 2023-01-02T18:16:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: "range_blocklist": {}, 2023-01-02T18:16:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profiles": { 2023-01-02T18:16:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "default": { 2023-01-02T18:16:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-failure-domain": "osd", 2023-01-02T18:16:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "k": "2", 2023-01-02T18:16:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "m": "1", 2023-01-02T18:16:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin": "jerasure", 2023-01-02T18:16:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: "ruleset-failure-domain": "osd", 2023-01-02T18:16:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: "technique": "reed_sol_van" 2023-01-02T18:16:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps_queue": [], 2023-01-02T18:16:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "new_removed_snaps": [], 2023-01-02T18:16:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "new_purged_snaps": [], 2023-01-02T18:16:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_node_flags": {}, 2023-01-02T18:16:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "device_class_flags": {}, 2023-01-02T18:16:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode": { 2023-01-02T18:16:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_enabled": false, 2023-01-02T18:16:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_bucket_count": 0, 2023-01-02T18:16:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: "degraded_stretch_mode": 0, 2023-01-02T18:16:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: "recovering_stretch_mode": 0, 2023-01-02T18:16:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_bucket": 0 2023-01-02T18:16:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:03.558 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:03.558 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:03.560 INFO:tasks.thrashosds.thrasher:j is {'epoch': 23, 'fsid': '4e320929-c4bb-4ea9-9e1c-d8479b7e40b1', 'created': '2023-01-02T18:15:29.542145+0000', 'modified': '2023-01-02T18:16:00.422142+0000', 'last_up_change': '2023-01-02T18:15:38.537792+0000', 'last_in_change': '2023-01-02T18:15:32.099480+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-02T18:15:38.598445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-01-02T18:15:40.853543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}], 'osds': [{'osd': 0, 'uuid': '69e18813-bd8e-4b22-9c40-d702ff3a5efd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6576995849609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6808', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6809', 'nonce': 107063}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6810', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6811', 'nonce': 107063}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6814', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6815', 'nonce': 107063}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6812', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6813', 'nonce': 107063}]}, 'public_addr': '172.21.15.7:6809/107063', 'cluster_addr': '172.21.15.7:6811/107063', 'heartbeat_back_addr': '172.21.15.7:6815/107063', 'heartbeat_front_addr': '172.21.15.7:6813/107063', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa04dec6-4607-4f2a-85a3-a6278832fef3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6824', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6825', 'nonce': 107066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6826', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6827', 'nonce': 107066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6830', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6831', 'nonce': 107066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6828', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6829', 'nonce': 107066}]}, 'public_addr': '172.21.15.7:6825/107066', 'cluster_addr': '172.21.15.7:6827/107066', 'heartbeat_back_addr': '172.21.15.7:6831/107066', 'heartbeat_front_addr': '172.21.15.7:6829/107066', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'c98a28fb-d910-4601-a229-d4318259ab9b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.14453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6816', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6817', 'nonce': 107065}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6818', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6819', 'nonce': 107065}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6822', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6823', 'nonce': 107065}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6820', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6821', 'nonce': 107065}]}, 'public_addr': '172.21.15.7:6817/107065', 'cluster_addr': '172.21.15.7:6819/107065', 'heartbeat_back_addr': '172.21.15.7:6823/107065', 'heartbeat_front_addr': '172.21.15.7:6821/107065', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3c5d48f4-5384-4563-8acb-11d866b85ef4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6800', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6801', 'nonce': 107064}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6802', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6803', 'nonce': 107064}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6806', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6807', 'nonce': 107064}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6804', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6805', 'nonce': 107064}]}, 'public_addr': '172.21.15.7:6801/107064', 'cluster_addr': '172.21.15.7:6803/107064', 'heartbeat_back_addr': '172.21.15.7:6807/107064', 'heartbeat_front_addr': '172.21.15.7:6805/107064', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '2476d495-4979-4679-a7e9-12652c270092', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 106900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 106900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 106900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 106900}]}, 'public_addr': '172.21.15.57:6801/106900', 'cluster_addr': '172.21.15.57:6803/106900', 'heartbeat_back_addr': '172.21.15.57:6807/106900', 'heartbeat_front_addr': '172.21.15.57:6805/106900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '38d57e5e-b6c1-445f-b181-23fb518698f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6816', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6817', 'nonce': 106930}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6818', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 106930}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6822', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6823', 'nonce': 106930}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6820', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6821', 'nonce': 106930}]}, 'public_addr': '172.21.15.57:6817/106930', 'cluster_addr': '172.21.15.57:6819/106930', 'heartbeat_back_addr': '172.21.15.57:6823/106930', 'heartbeat_front_addr': '172.21.15.57:6821/106930', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6c78f25a-2a65-47fe-b101-e47c00a5b2f6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6808', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6809', 'nonce': 106901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6810', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6811', 'nonce': 106901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6814', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6815', 'nonce': 106901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6812', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6813', 'nonce': 106901}]}, 'public_addr': '172.21.15.57:6809/106901', 'cluster_addr': '172.21.15.57:6811/106901', 'heartbeat_back_addr': '172.21.15.57:6815/106901', 'heartbeat_front_addr': '172.21.15.57:6813/106901', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'b094706d-7145-4865-ae95-e5cd7e40d23b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 16, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6824', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6825', 'nonce': 106931}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6826', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6827', 'nonce': 106931}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6830', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6831', 'nonce': 106931}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6828', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6829', 'nonce': 106931}]}, 'public_addr': '172.21.15.57:6825/106931', 'cluster_addr': '172.21.15.57:6827/106931', 'heartbeat_back_addr': '172.21.15.57:6831/106931', 'heartbeat_front_addr': '172.21.15.57:6829/106931', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.290083+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.303022+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.292245+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.210530+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.282212+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.237376+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.239974+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.276340+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-01-02T18:16:03.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:16:03.561 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:03.561 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:03.561 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:03.562 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:03.562 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:03.562 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:03.563 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:03.563 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:03.563 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:03.564 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:03.565 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:03.565 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:03.566 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:03.567 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:03.568 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:03.559+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:03.629 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:16:03.684 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:03.684+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:03.751 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:03.752 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:03.760 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:03.761+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:03.762 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:03.862 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:03.862+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:03.935 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:03.935 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:03.935 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:03.936 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:03.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:03.952 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:03.954 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:16:03.962 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:03.963+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:03.967 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2023-01-02T18:16:03.630332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":40244,"kb_used_data":1780,"kb_used_omap":0,"kb_used_meta":38400,"kb_avail":754934476,"statfs":{"total":773094113280,"available":773052903424,"internally_reserved":0,"allocated":1822720,"data_stored":638899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39321600},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-02T18:15:56.376686+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:15:56.376686+0000","last_peered":"2023-01-02T18:15:56.376686+0000","last_clean":"2023-01-02T18:15:56.376686+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:15:56.376686+0000","last_undegraded":"2023-01-02T18:15:56.376686+0000","last_fullsized":"2023-01-02T18:15:56.376686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-01-02T18:15:58.010091+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:15:58.010091+0000","last_peered":"2023-01-02T18:15:58.010091+0000","last_clean":"2023-01-02T18:15:58.010091+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:15:58.010091+0000","last_undegraded":"2023-01-02T18:15:58.010091+0000","last_fullsized":"2023-01-02T18:15:58.010091+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-02T18:15:56.183052+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:15:56.183052+0000","last_peered":"2023-01-02T18:15:56.183052+0000","last_clean":"2023-01-02T18:15:56.183052+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:15:56.183052+0000","last_undegraded":"2023-01-02T18:15:56.183052+0000","last_fullsized":"2023-01-02T18:15:56.183052+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-02T18:15:56.183017+0000","last_change":"2023-01-02T18:15:42.581338+0000","last_active":"2023-01-02T18:15:56.183017+0000","last_peered":"2023-01-02T18:15:56.183017+0000","last_clean":"2023-01-02T18:15:56.183017+0000","last_became_active":"2023-01-02T18:15:42.581049+0000","last_became_peered":"2023-01-02T18:15:42.581049+0000","last_unstale":"2023-01-02T18:15:56.183017+0000","last_undegraded":"2023-01-02T18:15:56.183017+0000","last_fullsized":"2023-01-02T18:15:56.183017+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-01-02T18:15:56.183029+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:15:56.183029+0000","last_peered":"2023-01-02T18:15:56.183029+0000","last_clean":"2023-01-02T18:15:56.183029+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:15:56.183029+0000","last_undegraded":"2023-01-02T18:15:56.183029+0000","last_fullsized":"2023-01-02T18:15:56.183029+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-01-02T18:15:58.012510+0000","last_change":"2023-01-02T18:15:42.578753+0000","last_active":"2023-01-02T18:15:58.012510+0000","last_peered":"2023-01-02T18:15:58.012510+0000","last_clean":"2023-01-02T18:15:58.012510+0000","last_became_active":"2023-01-02T18:15:42.578479+0000","last_became_peered":"2023-01-02T18:15:42.578479+0000","last_unstale":"2023-01-02T18:15:58.012510+0000","last_undegraded":"2023-01-02T18:15:58.012510+0000","last_fullsized":"2023-01-02T18:15:58.012510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-01-02T18:15:59.012839+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:15:59.012839+0000","last_peered":"2023-01-02T18:15:59.012839+0000","last_clean":"2023-01-02T18:15:59.012839+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:15:59.012839+0000","last_undegraded":"2023-01-02T18:15:59.012839+0000","last_fullsized":"2023-01-02T18:15:59.012839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-01-02T18:15:58.012513+0000","last_change":"2023-01-02T18:15:42.581483+0000","last_active":"2023-01-02T18:15:58.012513+0000","last_peered":"2023-01-02T18:15:58.012513+0000","last_clean":"2023-01-02T18:15:58.012513+0000","last_became_active":"2023-01-02T18:15:42.581182+0000","last_became_peered":"2023-01-02T18:15:42.581182+0000","last_unstale":"2023-01-02T18:15:58.012513+0000","last_undegraded":"2023-01-02T18:15:58.012513+0000","last_fullsized":"2023-01-02T18:15:58.012513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-01-02T18:15:58.009997+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:15:58.009997+0000","last_peered":"2023-01-02T18:15:58.009997+0000","last_clean":"2023-01-02T18:15:58.009997+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:15:58.009997+0000","last_undegraded":"2023-01-02T18:15:58.009997+0000","last_fullsized":"2023-01-02T18:15:58.009997+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":229376,"data_stored":80550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":229376,"data_stored":80550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":229376,"data_stored":80550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":229376,"data_stored":80550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":229376,"data_stored":80550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95699999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5020,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366820,"statfs":{"total":96636764160,"available":96631623680,"internally_reserved":0,"allocated":217088,"data_stored":75049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5032,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":229376,"data_stored":80550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5032,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366808,"statfs":{"total":96636764160,"available":96631611392,"internally_reserved":0,"allocated":229376,"data_stored":80550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:16:03.968 INFO:tasks.thrashosds.thrasher:Setting 2.0 to [2, 3] 2023-01-02T18:16:03.969 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.0', '2', '3'] 2023-01-02T18:16:03.969 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.0 2 3 2023-01-02T18:16:04.064 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:04.064+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:04.099 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:04.099 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:04.099 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:04.099 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:04.100 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:04.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:04.165 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:04.165+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:04.247 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:04.248 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:04.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:04.248 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:04.248 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:04.258 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:04.300 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:04.299+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:04.367 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:04.367+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:04.428 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:04.429 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:04.429 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:04.429 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:04.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:04.468 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:04.468+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:04.568 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:04.568+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:04.569 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:04.569 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:04.570 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:04.570 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:04.570 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:04.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:04.669 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:04.669+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:04.757 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:04.758 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:04.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:04.758 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:04.758 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:04.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:04.770 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:04.771+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:04.872 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:04.872+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:04.935 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:04.936 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:04.936 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:04.936 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:04.946 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:04.973 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:04.973+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:05.071 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:05.072 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:05.072 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:05.072 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:05.073 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:05.074 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:05.074+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:05.082 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:05.175 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:05.175+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:05.249 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:05.250 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:05.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:05.250 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:05.250 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:05.260 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:05.298 INFO:teuthology.orchestra.run.smithi007.stderr:set 2.0 pg_upmap mapping to [2,3] 2023-01-02T18:16:05.304 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:05.305+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:05.377 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:05.377+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:05.401 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:05.401 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:05.401 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:05.402 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:05.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:05.478 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:05.478+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:05.569 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:05.577 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:05.577 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:05.578 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:05.578 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:05.579 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:05.579+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:05.587 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:05.643 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:16:05.680 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:05.680+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:05.720 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:05.738 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:05.754 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:05.756 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:05.757 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:05.764 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:05.776 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:05.804 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:05.806 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:05.807+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:05.822 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:05.841 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:05.860 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:05.861 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:05.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:05.863 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:05.882 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:05.882+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:05.931 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:05.932 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:05.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:05.985 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:05.986+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:06.068 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:06.068 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:06.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:06.119 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:06.119+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:06.185 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:06.185+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:06.243 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:06.244 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:06.254 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:06.286 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:06.286+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:06.299 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:16:06.380 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:06.380 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:06.386 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:06.387+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:06.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:06.487 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:06.487+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:06.556 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:06.566 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:06.607 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:06.608+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:06.689 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:06.689+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:06.732 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:06.732 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:06.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:06.790 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:06.790+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:06.890 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:06.890+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:06.907 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:06.907 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:06.918 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:06.992 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:06.992+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:07.044 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:07.045 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:07.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:07.093 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:07.093+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:07.194 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:07.194+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:07.220 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:07.221 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:07.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:07.295 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:07.295+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:07.366 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:07.366 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:07.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:07.396 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:07.397+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:07.497 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:07.497+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:07.556 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:07.556 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:07.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:07.598 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:07.599+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:07.699 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:07.698+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:07.735 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:07.735 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:07.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:07.832 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:07.832+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:07.874 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:07.918 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:07.918+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:07.988 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:07.988 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:08.002 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:08.002+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:08.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:08.099 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:08.102 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:08.103+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:08.132 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:08.166 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:08.199 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:08.203 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:08.203+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:08.233 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:08.244 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:08.245 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:08.245 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:08.245 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:08.245 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:08.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:08.265 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:08.298 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:08.303 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:08.303+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:08.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:16:08.332 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:08.334 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:08.335 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:08.336 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:08.404 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:08.404+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:08.467 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:08.467 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:08.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:08.467 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:08.468 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:08.482 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:08.505 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:08.506+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:08.606 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:08.607+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:08.707 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:08.708+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:08.720 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:08.720 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:08.720 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:08.721 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:08.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:08.808 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:08.809+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:08.872 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:08.872 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:08.872 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:08.872 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:08.873 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:08.882 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:08.909 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:08.909+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:09.010 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:09.010 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:09.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:09.010 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:09.011 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:09.011 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:09.010+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:09.020 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:09.110 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:09.110+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:09.211 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:09.211+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:09.257 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:09.258 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:09.258 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:09.258 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:09.271 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:09.312 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:09.313+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:09.333 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:16:09.413 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:09.413+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:09.511 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:09.512 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:09.512 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:09.512 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:09.512 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:09.514 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:09.515+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:09.526 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:09.615 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:09.616+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:09.716 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:09.717+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:09.764 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:09.764 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:09.764 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:09.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:09.822 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:09.823+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:09.917 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:09.917 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:09.918 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:09.918 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:09.919 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:09.919+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:09.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:10.020 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:10.020+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:10.095 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:10.095 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:10.096 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:10.096 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:10.096 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:10.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:10.147 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:10.148+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:10.221 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:10.221+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:10.272 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:10.273 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:10.273 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:10.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:10.310 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:10.311 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:10.311 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2023-01-02T18:16:10.311 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:16:10.311 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:16:10.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2023-01-02T18:16:10.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:10.357 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:10.357+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:10.409 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:10.409 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:10.410 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:10.419 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:10.422 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:10.422+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:10.511 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-01-02T18:16:10.512 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:10.522 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:10.523+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:10.544 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:10.545 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:10.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:10.581 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:10.614 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:10.638 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:10.639+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:10.647 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:10.681 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:10.714 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:10.721 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:10.722 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:10.724 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:10.725+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:10.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:10.732 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:10.750 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:10.768 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:10.769 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:10.770 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:10.771 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:10.771 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:10.771 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:10.825 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:10.825+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:10.896 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:10.897 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:10.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:10.926 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:10.926+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:11.026 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:11.026+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:11.031 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:11.031 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:11.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:11.129 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:11.128+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:11.166 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:11.166 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:11.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:11.260 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:11.261+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:11.330 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:11.330+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:11.344 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:11.345 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:11.349 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:16:11.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:11.438 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:11.439+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:11.519 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:11.520 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:11.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:11.532 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:11.532+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:11.632 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:11.632+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:11.695 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:11.695 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:11.705 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:11.734 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:11.734+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:11.835 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:11.835+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:11.902 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:11.903 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:11.916 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:11.961 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:11.961+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:12.036 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:12.036+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:12.115 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:12.116 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:12.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:12.136 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:12.137+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:12.237 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:12.238+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:12.338 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:12.338+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:12.369 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:16:12.369 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:12.370 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:12.385 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:12.438 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:12.439+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:12.539 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:12.540+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:12.625 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:12.625 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:12.639 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:12.640 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:12.641+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:12.743 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:12.742+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:12.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:12.836 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:12.836 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:12.843 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:12.843+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:12.851 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:12.944 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:12.944+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:13.009 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:13.042 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:13.045 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:13.046+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:13.076 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:13.079 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:13.080 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:13.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:13.080 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:13.080 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:13.093 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:13.109 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:13.141 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:13.146 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:13.146+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:13.175 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:13.208 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:13.241 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:13.242 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:13.243 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:13.243 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:13.243 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:13.243 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:13.244 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:13.244 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:13.244 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:13.246 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:13.246+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:13.261 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:13.262 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:13.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:13.347 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:13.347+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:13.448 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:13.447+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:13.515 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:13.516 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:13.516 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:13.516 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:13.516 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:13.529 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:13.570 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:13.570+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:13.649 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:13.649+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:13.750 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:13.750+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:13.767 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:13.767 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:13.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:13.768 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:13.768 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:13.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:13.865 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:13.865+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:13.953 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:13.953+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:14.021 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:14.022 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:14.022 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:14.022 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:14.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:14.076 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:14.076+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:14.154 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:14.155+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:14.255 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:14.255+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:14.271 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:14.272 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:14.272 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:14.273 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:14.273 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:14.286 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:14.371 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:14.371+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:14.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:16:14.458 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:14.458+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:14.524 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:14.524 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:14.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:14.525 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:14.525 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:14.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:14.584 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:14.584+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:14.660 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:14.660+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:14.681 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:14.682 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:14.682 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:14.683 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:14.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:14.774 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:14.775+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:14.857 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:14.857 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:14.857 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:14.857 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:14.858 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:14.861 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:14.861+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:14.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:14.962 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:14.963+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:15.033 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:15.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:15.034 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:15.034 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:15.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:15.063 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:15.063+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:15.164 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:15.165+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:15.208 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:15.209 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:15.209 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:15.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:15.259 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:15.302 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:15.303+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:15.310 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:16:15.366 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:15.366+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:15.385 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:15.385 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:15.385 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:15.385 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:15.386 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:15.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:15.417 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:15.434 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:15.453 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:15.472 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:15.479 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:15.480+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:15.492 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:15.510 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:15.526 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:15.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-01-02T18:16:15.529 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:15.550 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:15.551 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:15.552 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:15.553 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:15.564 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:15.565 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:15.568 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:15.568+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:15.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:15.668 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:15.669+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:15.741 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:15.741 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:15.751 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:15.791 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:15.792+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:15.871 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:15.871+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:15.915 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:15.916 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:15.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:15.971 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:15.971+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:16.051 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:16.052 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:16.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:16.072 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:16.072+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:16.172 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:16.173+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:16.188 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:16.188 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:16.198 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:16.282 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:16.283+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:16.306 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.0 to 1 (10000) 2023-01-02T18:16:16.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-01-02T18:16:16.366 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:16.367 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:16.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:16.407 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:16.407+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:16.475 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:16.476+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:16.543 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:16.543 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:16.553 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:16.597 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:16.597+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:16.678 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:16.678+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:16.754 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:16.754 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:16.769 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:16.779 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:16.780+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:16.880 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:16.880+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:16.980 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:16.981+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:17.007 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:17.008 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:17.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:17.082 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:17.082+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:17.182 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:17.183+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:17.258 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:17.258 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:17.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:17.283 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:17.284+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:17.325 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.1 to 1 (10000) 2023-01-02T18:16:17.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:16:17.348 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-01-02T18:16:17.384 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:17.385+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:17.461 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:17.461 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:17.476 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:17.529 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:17.529+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:17.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:17.586 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:17.587+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:17.687 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:17.688+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:17.695 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:17.695 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:17.709 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:17.796 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:17.791+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:17.868 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:17.890 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:17.890+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:17.917 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:17.926 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:17.926 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:17.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:17.927 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:17.927 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:17.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:17.947 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:17.971 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:17.990 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:17.991+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:17.992 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:18.010 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:18.045 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:18.079 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:18.081 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:18.081 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:18.081 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:18.082 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:18.091 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:18.091+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:18.113 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:18.114 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:18.114 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:18.114 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:18.124 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:18.208 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:18.208+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:18.293 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:18.293+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:18.328 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.2 to 1 (10000) 2023-01-02T18:16:18.333 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:16:18.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2023-01-02T18:16:18.363 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:18.364 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:18.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:18.393 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:18.394+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:18.494 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:18.494+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:18.596 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:18.596+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:18.612 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:18.612 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:18.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:18.613 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:18.613 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:18.623 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:18.696 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:18.697+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:18.796 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:18.796+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:18.828 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:18.828 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:18.828 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:18.828 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:18.842 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:18.897 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:18.898+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:18.998 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:18.999+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:19.081 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:19.081 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:19.081 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:19.081 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:19.082 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:19.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:19.140 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:19.140+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:19.199 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:19.200+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:19.293 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:19.293 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:19.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:19.294 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:19.294 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:19.300 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:19.301+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:19.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:19.330 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.3 to 1 (10000) 2023-01-02T18:16:19.346 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2023-01-02T18:16:19.429 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:19.429+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:19.447 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:19.448 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:19.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:19.502 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:19.502+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:19.585 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:19.585 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:19.585 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:19.586 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:19.586 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:19.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:19.603 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:19.603+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:19.703 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:19.704+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:19.720 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:19.721 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:19.721 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:19.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:19.814 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:19.815+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:19.896 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:19.896 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:19.897 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:19.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:19.907 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:19.906+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:20.007 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:20.007+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:20.071 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:20.071 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:20.072 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:20.072 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:20.072 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:20.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:20.098 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:20.125 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:20.126+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:20.206 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:20.207 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:20.208 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:20.208+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:20.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:20.244 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:20.262 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:20.293 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:20.309 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:20.308+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:20.324 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:20.334 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.4 to 1 (10000) 2023-01-02T18:16:20.348 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:16:20.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2023-01-02T18:16:20.358 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:20.385 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:20.385 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:20.386 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:20.386 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:20.391 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:20.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:20.423 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:20.423 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:20.423+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:20.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:20.461 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:20.461 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:20.461 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:20.462 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:20.462 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:20.462 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:20.462 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:20.462 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:20.510 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:20.510+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:20.521 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:20.522 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:20.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:20.611 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:20.611+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:20.698 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:20.698 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:20.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:20.711 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:20.711+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:20.812 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:20.812+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:20.834 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:20.834 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:20.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:20.916 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:20.916+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:20.969 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:20.969 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:20.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:21.022 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:21.023+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:21.105 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:21.105 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:21.115 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:21.118 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:21.118+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:21.219 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:21.219+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:21.313 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:21.314 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:21.320 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:21.320+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:21.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:21.341 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.5 to 1 (10000) 2023-01-02T18:16:21.347 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:16:21.357 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2023-01-02T18:16:21.421 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:21.421+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:21.500 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:21.500 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:21.515 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:21.559 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:21.559+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:21.622 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:21.622+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:21.700 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:21.701 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:21.715 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:21.723 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:21.724+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:21.824 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:21.824+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:21.887 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:21.888 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:21.898 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:21.940 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:21.940+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:22.025 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:22.025+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:22.070 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:22.070 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:22.081 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:22.126 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:22.127+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:22.227 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:22.228+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:22.253 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:22.254 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:22.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:22.328 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:22.329+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:22.345 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.6 to 1 (10000) 2023-01-02T18:16:22.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2023-01-02T18:16:22.428 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:22.428 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:22.429 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:22.428+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:22.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:22.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:22.529 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:22.529+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:22.631 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:22.631+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:22.696 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:22.696 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:22.712 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:22.747 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:22.747 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:22.747+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:22.780 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:22.814 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:22.831 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:22.831+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:22.849 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:22.881 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:22.913 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:22.913 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:22.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:22.914 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:22.914 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:22.915 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:22.923 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:22.946 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:22.947 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:22.946+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:22.979 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:22.980 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:22.981 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:22.982 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:23.033 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:23.034+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:23.083 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:23.083 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:23.084 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:23.084 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:23.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:23.134 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:23.134+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:23.223 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:23.224 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:23.224 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:23.224 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:23.225 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:23.234 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:23.235 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:23.234+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:23.335 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:23.336+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:23.364 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.7 to 1 (10000) 2023-01-02T18:16:23.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:16:23.383 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-01-02T18:16:23.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:16:23.438 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:23.439 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:23.440 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:23.438+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:23.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:23.537 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:23.537+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:23.593 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:23.593 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:23.594 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:23.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:23.647 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:23.648+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:23.729 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:23.729 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:23.729 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:23.730 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:23.730 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:23.738 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:23.738+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:23.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:23.839 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:23.840+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:23.889 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:23.891 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:16:23.903 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2023-01-02T18:16:23.354941+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":41972,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":39168,"kb_avail":754932748,"statfs":{"total":773094113280,"available":773051133952,"internally_reserved":0,"allocated":2805760,"data_stored":1080654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40108032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-01-02T18:16:17.314788+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:16:17.314788+0000","last_peered":"2023-01-02T18:16:17.314788+0000","last_clean":"2023-01-02T18:16:17.314788+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:16:17.314788+0000","last_undegraded":"2023-01-02T18:16:17.314788+0000","last_fullsized":"2023-01-02T18:16:17.314788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:18.327340+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:16:18.327340+0000","last_peered":"2023-01-02T18:16:18.327340+0000","last_clean":"2023-01-02T18:16:18.327340+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:16:18.327340+0000","last_undegraded":"2023-01-02T18:16:18.327340+0000","last_fullsized":"2023-01-02T18:16:18.327340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:19.268844+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:16:19.268844+0000","last_peered":"2023-01-02T18:16:19.268844+0000","last_clean":"2023-01-02T18:16:19.268844+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:16:19.268844+0000","last_undegraded":"2023-01-02T18:16:19.268844+0000","last_fullsized":"2023-01-02T18:16:19.268844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:19.266854+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:16:19.266854+0000","last_peered":"2023-01-02T18:16:19.266854+0000","last_clean":"2023-01-02T18:16:19.266854+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:16:19.266854+0000","last_undegraded":"2023-01-02T18:16:19.266854+0000","last_fullsized":"2023-01-02T18:16:19.266854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:19.268828+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:16:19.268828+0000","last_peered":"2023-01-02T18:16:19.268828+0000","last_clean":"2023-01-02T18:16:19.268828+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:16:19.268828+0000","last_undegraded":"2023-01-02T18:16:19.268828+0000","last_fullsized":"2023-01-02T18:16:19.268828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:18.325489+0000","last_change":"2023-01-02T18:15:42.578753+0000","last_active":"2023-01-02T18:16:18.325489+0000","last_peered":"2023-01-02T18:16:18.325489+0000","last_clean":"2023-01-02T18:16:18.325489+0000","last_became_active":"2023-01-02T18:15:42.578479+0000","last_became_peered":"2023-01-02T18:15:42.578479+0000","last_unstale":"2023-01-02T18:16:18.325489+0000","last_undegraded":"2023-01-02T18:16:18.325489+0000","last_fullsized":"2023-01-02T18:16:18.325489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:19.266854+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:16:19.266854+0000","last_peered":"2023-01-02T18:16:19.266854+0000","last_clean":"2023-01-02T18:16:19.266854+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:16:19.266854+0000","last_undegraded":"2023-01-02T18:16:19.266854+0000","last_fullsized":"2023-01-02T18:16:19.266854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:18.325489+0000","last_change":"2023-01-02T18:15:42.581483+0000","last_active":"2023-01-02T18:16:18.325489+0000","last_peered":"2023-01-02T18:16:18.325489+0000","last_clean":"2023-01-02T18:16:18.325489+0000","last_became_active":"2023-01-02T18:15:42.581182+0000","last_became_peered":"2023-01-02T18:15:42.581182+0000","last_unstale":"2023-01-02T18:16:18.325489+0000","last_undegraded":"2023-01-02T18:16:18.325489+0000","last_fullsized":"2023-01-02T18:16:18.325489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:18.326663+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:16:18.326663+0000","last_peered":"2023-01-02T18:16:18.326663+0000","last_clean":"2023-01-02T18:16:18.326663+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:16:18.326663+0000","last_undegraded":"2023-01-02T18:16:18.326663+0000","last_fullsized":"2023-01-02T18:16:18.326663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5280,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366560,"statfs":{"total":96636764160,"available":96631357440,"internally_reserved":0,"allocated":352256,"data_stored":135773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":339968,"data_stored":130243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5292,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366548,"statfs":{"total":96636764160,"available":96631345152,"internally_reserved":0,"allocated":364544,"data_stored":141303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5280,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366560,"statfs":{"total":96636764160,"available":96631357440,"internally_reserved":0,"allocated":352256,"data_stored":135773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5292,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366548,"statfs":{"total":96636764160,"available":96631345152,"internally_reserved":0,"allocated":364544,"data_stored":141303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":339968,"data_stored":130243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.766}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.847}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5204,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":339968,"data_stored":130243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5216,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366624,"statfs":{"total":96636764160,"available":96631422976,"internally_reserved":0,"allocated":352256,"data_stored":135773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:16:23.905 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:16:23.906 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:23.906 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:23.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:23.906 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:23.906 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:23.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:23.955 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:23.956+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:24.041 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:24.041+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:24.079 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:24.080 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:24.080 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:24.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:24.142 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:24.142+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:24.242 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:24.242+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:24.254 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:24.255 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:24.255 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:24.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:24.343 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:24.344+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:24.378 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:16:24.390 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:24.390 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:24.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:24.391 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:24.391 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:24.400 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:24.477 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:24.484 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:16:24.485 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:24.485+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:24.495 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-01-02T18:16:24.367126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":41972,"kb_used_data":2740,"kb_used_omap":0,"kb_used_meta":39168,"kb_avail":754932748,"statfs":{"total":773094113280,"available":773051133952,"internally_reserved":0,"allocated":2805760,"data_stored":1080654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":40108032},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-01-02T18:16:17.314788+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:16:17.314788+0000","last_peered":"2023-01-02T18:16:17.314788+0000","last_clean":"2023-01-02T18:16:17.314788+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:16:17.314788+0000","last_undegraded":"2023-01-02T18:16:17.314788+0000","last_fullsized":"2023-01-02T18:16:17.314788+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:18.327340+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:16:18.327340+0000","last_peered":"2023-01-02T18:16:18.327340+0000","last_clean":"2023-01-02T18:16:18.327340+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:16:18.327340+0000","last_undegraded":"2023-01-02T18:16:18.327340+0000","last_fullsized":"2023-01-02T18:16:18.327340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:19.268844+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:16:19.268844+0000","last_peered":"2023-01-02T18:16:19.268844+0000","last_clean":"2023-01-02T18:16:19.268844+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:16:19.268844+0000","last_undegraded":"2023-01-02T18:16:19.268844+0000","last_fullsized":"2023-01-02T18:16:19.268844+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:19.266854+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:16:19.266854+0000","last_peered":"2023-01-02T18:16:19.266854+0000","last_clean":"2023-01-02T18:16:19.266854+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:16:19.266854+0000","last_undegraded":"2023-01-02T18:16:19.266854+0000","last_fullsized":"2023-01-02T18:16:19.266854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:19.268828+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:16:19.268828+0000","last_peered":"2023-01-02T18:16:19.268828+0000","last_clean":"2023-01-02T18:16:19.268828+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:16:19.268828+0000","last_undegraded":"2023-01-02T18:16:19.268828+0000","last_fullsized":"2023-01-02T18:16:19.268828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:18.325489+0000","last_change":"2023-01-02T18:15:42.578753+0000","last_active":"2023-01-02T18:16:18.325489+0000","last_peered":"2023-01-02T18:16:18.325489+0000","last_clean":"2023-01-02T18:16:18.325489+0000","last_became_active":"2023-01-02T18:15:42.578479+0000","last_became_peered":"2023-01-02T18:15:42.578479+0000","last_unstale":"2023-01-02T18:16:18.325489+0000","last_undegraded":"2023-01-02T18:16:18.325489+0000","last_fullsized":"2023-01-02T18:16:18.325489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:19.266854+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:16:19.266854+0000","last_peered":"2023-01-02T18:16:19.266854+0000","last_clean":"2023-01-02T18:16:19.266854+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:16:19.266854+0000","last_undegraded":"2023-01-02T18:16:19.266854+0000","last_fullsized":"2023-01-02T18:16:19.266854+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:18.325489+0000","last_change":"2023-01-02T18:15:42.581483+0000","last_active":"2023-01-02T18:16:18.325489+0000","last_peered":"2023-01-02T18:16:18.325489+0000","last_clean":"2023-01-02T18:16:18.325489+0000","last_became_active":"2023-01-02T18:15:42.581182+0000","last_became_peered":"2023-01-02T18:15:42.581182+0000","last_unstale":"2023-01-02T18:16:18.325489+0000","last_undegraded":"2023-01-02T18:16:18.325489+0000","last_fullsized":"2023-01-02T18:16:18.325489+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-01-02T18:16:18.326663+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:16:18.326663+0000","last_peered":"2023-01-02T18:16:18.326663+0000","last_clean":"2023-01-02T18:16:18.326663+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:16:18.326663+0000","last_undegraded":"2023-01-02T18:16:18.326663+0000","last_fullsized":"2023-01-02T18:16:18.326663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5280,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366560,"statfs":{"total":96636764160,"available":96631357440,"internally_reserved":0,"allocated":352256,"data_stored":135773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":339968,"data_stored":130243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5292,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366548,"statfs":{"total":96636764160,"available":96631345152,"internally_reserved":0,"allocated":364544,"data_stored":141303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5280,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366560,"statfs":{"total":96636764160,"available":96631357440,"internally_reserved":0,"allocated":352256,"data_stored":135773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.421}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5292,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":94366548,"statfs":{"total":96636764160,"available":96631345152,"internally_reserved":0,"allocated":364544,"data_stored":141303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5204,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":339968,"data_stored":130243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7170000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.766}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.847}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7430000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":5204,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366636,"statfs":{"total":96636764160,"available":96631435264,"internally_reserved":0,"allocated":339968,"data_stored":130243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5216,"kb_used_data":344,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366624,"statfs":{"total":96636764160,"available":96631422976,"internally_reserved":0,"allocated":352256,"data_stored":135773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:16:24.497 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-01-02T18:16:24.498 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:24.498 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2023-01-02T18:16:24.498 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:16:24.499 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:16:24.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2023-01-02T18:16:24.553 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:24.553+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:24.570 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:24.571 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:24.572 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:24.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:24.632 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:24.632 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-01-02T18:16:24.633 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:24.690 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:24.690+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:24.748 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:24.748+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:24.751 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:24.751 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:24.751 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:24.752 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:24.752 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:24.762 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:24.857 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:24.857+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:24.936 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:24.937 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:24.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:24.937 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:24.937 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:24.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:24.950 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:24.950+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:24.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:25.051 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:25.050+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:25.115 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:25.116 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:25.125 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:25.151 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:25.151+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:25.157 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:25.190 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:25.222 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:25.251 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:25.252+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:25.252 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:25.252 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:25.252 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:25.252 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:25.253 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:25.256 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:25.262 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:25.288 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:25.320 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:25.352 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:25.352 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:25.353+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:25.379 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:25.381 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:25.382 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:25.428 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:25.428 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:25.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:25.483 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:25.483+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:25.554 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:25.554+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:25.592 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:25.593 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:25.606 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:25.655 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:25.656+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:25.755 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:25.755+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:25.804 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:25.804 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:25.818 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:25.859 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:25.859+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:25.957 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:25.958+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:25.996 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:25.996 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:26.007 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:26.058 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:26.058+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:26.137 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:26.138 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:26.148 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:26.190 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:26.189+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:26.260 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:26.261+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:26.340 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:26.340 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:26.354 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:26.394 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:16:26.395 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:26.396+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:26.462 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:26.463+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:26.546 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:26.546 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:26.560 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:26.563 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:26.564+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:26.665 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:26.665+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:26.765 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:26.766 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:26.766+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:26.780 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:26.867 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:26.868+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:26.967 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:26.968+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:26.997 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:26.997 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:27.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:27.068 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:27.068+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:27.169 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:27.169+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:27.178 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:27.178 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:27.189 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:27.270 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:27.270+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:27.347 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:27.347 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:27.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:27.370 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:27.371+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:27.393 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:27.471 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:27.472+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:27.572 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:27.573+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:27.599 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:27.599 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:27.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:27.627 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:27.654 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:27.659 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:16:27.674 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:27.674+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:27.680 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:27.698 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:27.717 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:27.736 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:27.749 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:27.750 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:27.750 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:27.754 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:27.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:27.773 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:27.774 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:27.775+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:27.774 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:27.775 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:27.775 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:27.775 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:27.776 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:27.875 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:27.876+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:27.900 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:27.900 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:27.900 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:27.900 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:27.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:27.994 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:27.995+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:28.077 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:28.078 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:28.078 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:28.078+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:28.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:28.178 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:28.179+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:28.253 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:28.253 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:28.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:28.254 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:28.254 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:28.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:28.282 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:28.283+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:28.383 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:28.383+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:28.389 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:28.389 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:28.390 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:28.390 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:28.399 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:28.484 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:28.485+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:28.565 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:28.566 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:28.566 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:28.575 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:28.618 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:28.619+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:28.685 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:28.685+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:28.701 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:28.701 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:28.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:28.702 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:28.702 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:28.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:28.795 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:28.796+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:28.877 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:28.877 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:28.878 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:28.887 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:28.888 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:28.887+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:28.988 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:28.989+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:29.052 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:29.053 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:29.053 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:29.053 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:29.053 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:29.063 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:29.089 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:29.090+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:29.190 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:29.190+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:29.228 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:29.228 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:29.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:29.228 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:29.229 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:29.238 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:29.321 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:29.322+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:29.391 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:29.391+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:29.404 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:29.404 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:29.404 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:29.405 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:29.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:29.492 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:29.493+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:29.580 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:29.580 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:29.580 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:29.580 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:29.580 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:29.590 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:29.592 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:29.593+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:29.644 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:29.644 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:29.644 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2023-01-02T18:16:29.645 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:16:29.645 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:16:29.645 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2023-01-02T18:16:29.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:16:29.692 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:29.693+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:29.714 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:29.715 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:29.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:29.715 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:29.715 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:29.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:29.787 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:29.822 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:29.823 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-01-02T18:16:29.823 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:29.823 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:29.823+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:29.894 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:29.895+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:29.924 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:29.924 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:29.924 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:29.924 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:29.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:30.012 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:30.012 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:30.013+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:30.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:30.060 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:30.091 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:30.096 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:30.097+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:30.111 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:30.137 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:30.160 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:30.160 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:30.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:30.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:30.189 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:30.192 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:30.193 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:30.193 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:30.193 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:30.205 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:30.205+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:30.301 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:30.298+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:30.308 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:16:30.332 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:30.332 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:30.346 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:30.430 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:30.431+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:30.499 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:30.500+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:30.535 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:30.536 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:30.547 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:30.632 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:30.633+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:30.700 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:30.701+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:30.728 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:30.729 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:30.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:30.825 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:30.826+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:30.903 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:30.903+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:30.929 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:30.929 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:30.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:31.004 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:31.004+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:31.105 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:31.105+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:31.159 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:31.160 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:31.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:31.206 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:31.206+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:31.306 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:31.306+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:31.343 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:31.344 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:31.354 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:31.408 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:31.408+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:31.481 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:31.482 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:31.492 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:31.536 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:31.537+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:31.609 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:31.610+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:31.642 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:31.643 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:31.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:31.741 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:31.742+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:31.811 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:31.812+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:31.863 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:31.864 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:31.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:31.912 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:31.912+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:32.013 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:32.012+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:32.078 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:32.078 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:32.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:32.133 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:32.133+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:32.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:32.214 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:32.214+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:32.228 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:32.228 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:32.239 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:32.317 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:32.317+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:32.324 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:16:32.352 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:32.406 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:32.407 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:32.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:32.417 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:32.418+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:32.518 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:32.519+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:32.541 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:32.542 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:32.552 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:32.587 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:32.607 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:32.619 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:32.620+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:32.625 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:32.643 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:32.662 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:32.677 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:32.678 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:32.678 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:32.678 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:32.680 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:32.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:32.698 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:32.699 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:32.700 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:32.701 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:32.732 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:32.732+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:32.813 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:32.814 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:32.814 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:32.814 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:32.814 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:32.821 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:32.820+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:32.823 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:32.922 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:32.921+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:32.989 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:32.989 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:32.990 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:32.990 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:32.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:33.041 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:33.040+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:33.123 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:33.123+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:33.165 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:33.166 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:33.166 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:33.166 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:33.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:33.224 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:33.225+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:33.325 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:33.326+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:33.340 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:33.341 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:33.341 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:33.341 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:33.341 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:33.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:33.395 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:16:33.426 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:33.426+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:33.479 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:33.479 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:33.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:33.479 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:33.479 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:33.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:33.530 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:33.529+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:33.629 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:33.630+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:33.654 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:33.654 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:33.655 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:33.664 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:33.729 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:33.730+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:33.789 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:33.790 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:33.790 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:33.790 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:33.790 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:33.799 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:33.830 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:33.831+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:33.925 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:33.925 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:33.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:33.926 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:33.926 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:33.931 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:33.931+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:33.935 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:34.032 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:34.033+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:34.064 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:34.065 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:34.065 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:34.076 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:34.160 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:34.161+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:34.235 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:34.234+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:34.243 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:34.243 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:34.243 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:34.243 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:34.244 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:34.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:34.290 INFO:tasks.workunit.client.0.smithi007.stderr:Updating files: 99% (11637/11684) Updating files: 100% (11684/11684) Updating files: 100% (11684/11684), done. 2023-01-02T18:16:34.336 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:34.336+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:34.418 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:34.418 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:34.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:34.419 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:34.419 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:34.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:34.474 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:34.475+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:34.537 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:34.538+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:34.603 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:34.603 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:34.604 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:34.604 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:34.613 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:34.661 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:34.662+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:34.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:34.740 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:34.740+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:34.746 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:34.746 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:34.746 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:34.747 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:34.747 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:34.757 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:34.838 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:34.839 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:34.839 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-01-02T18:16:34.839 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.390220 2023-01-02T18:16:34.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.39021968802045015 2023-01-02T18:16:34.841 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:34.841+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:34.865 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:34.886 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:34.905 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:34.923 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:34.936 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:34.936 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:34.942 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:34.941+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:34.942 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:34.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:34.977 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:34.999 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:35.019 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:35.020 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:35.021 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:35.022 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:35.074 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:35.075+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:35.105 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '623bc557440f012d459eb3c5ded0a7dee57ecdb1'. 2023-01-02T18:16:35.106 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-02T18:16:35.106 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-01-02T18:16:35.106 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2023-01-02T18:16:35.106 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2023-01-02T18:16:35.107 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-02T18:16:35.107 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2023-01-02T18:16:35.107 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2023-01-02T18:16:35.107 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-02T18:16:35.107 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2023-01-02T18:16:35.108 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-02T18:16:35.108 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2023-01-02T18:16:35.108 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-02T18:16:35.108 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2023-01-02T18:16:35.108 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-02T18:16:35.109 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-01-02T18:16:35.109 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-01-02T18:16:35.109 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 623bc557440 xfstests repo link 2023-01-02T18:16:35.110 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:35.111 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:35.112 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-01-02T18:16:35.122 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:35.164 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:35.165+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:35.186 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-01-02T18:16:35.188 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-01-02T18:16:35.188 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-01-02T18:16:35.245 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:35.246+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:35.289 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:35.289 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:35.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:35.346 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:35.346+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:35.399 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.1 primary-affinity to 0.39022 (8255732) 2023-01-02T18:16:35.407 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:16:35.452 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:35.453+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:35.472 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:35.473 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:35.483 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:35.567 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:35.568+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:35.648 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:35.648+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:35.653 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:35.654 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:35.664 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:35.748 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:35.749+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:35.830 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:35.831 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:35.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:35.848 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-01-02T18:16:35.849 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:35.849+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:35.913 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-01-02T18:16:35.950 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:35.951+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:35.952 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-01-02T18:16:35.954 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-01-02T18:16:35.955 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-01-02T18:16:35.969 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:35.970 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:35.981 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:35.993 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-01-02T18:16:35.996 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-01-02T18:16:35.996 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-01-02T18:16:36.053 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:36.054+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:36.055 INFO:tasks.workunit:Running workunits matching rbd/test_librbd.sh on client.0... 2023-01-02T18:16:36.056 INFO:tasks.workunit:Running workunit rbd/test_librbd.sh... 2023-01-02T18:16:36.057 DEBUG:teuthology.orchestra.run.smithi007:workunit test rbd/test_librbd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=623bc557440f012d459eb3c5ded0a7dee57ecdb1 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RBD_FEATURES=61 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd.sh 2023-01-02T18:16:36.121 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:36.121 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:36.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:36.144 INFO:tasks.workunit.client.0.smithi007.stdout:seed 118686 2023-01-02T18:16:36.145 INFO:tasks.workunit.client.0.smithi007.stdout:[==========] Running 371 tests from 15 test suites. 2023-01-02T18:16:36.145 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] Global test environment set-up. 2023-01-02T18:16:36.146 INFO:tasks.workunit.client.0.smithi007.stdout:[----------] 128 tests from TestLibRBD 2023-01-02T18:16:36.175 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:36.175+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:36.176 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.CreateAndStat 2023-01-02T18:16:36.254 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:36.251+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:36.258 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:36.258 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:36.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:36.353 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:36.353+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:36.409 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:16:36.440 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:36.440 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:36.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:36.454 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:36.455+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:36.555 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:36.554+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:36.616 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:36.617 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:36.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:36.667 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:36.667+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:36.757 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:36.758+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:36.791 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:36.791 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:36.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:36.858 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:36.859+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:36.927 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:36.927 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:36.937 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:36.980 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:36.980+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:37.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:37.059 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:37.059+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:37.062 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:37.072 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:37.160 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:37.161+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:37.187 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:37.204 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:37.221 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:37.238 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:37.238 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:37.239 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:37.248 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:37.257 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:37.261 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:37.262+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:37.275 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:37.293 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:37.310 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:37.311 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:37.312 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:37.313 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:37.362 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:37.362+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:37.375 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:37.376 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:37.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:37.411 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:37.464 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:37.465+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:37.552 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:37.552 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:37.553 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:37.553 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:37.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:37.564 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:37.564+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:37.665 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:37.665+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:37.686 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:37.687 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:37.687 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:37.687 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:37.687 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:37.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:37.780 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:37.780+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:37.862 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:37.863 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:37.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:37.863 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [] 2023-01-02T18:16:37.863 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:37.866 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:37.866+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:37.872 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:37.967 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:37.967+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:38.008 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:38.009 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:38.009 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:38.009 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:38.018 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:38.068 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:38.068+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:38.146 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:38.147 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:38.148 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:38.148 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:38.157 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:38.200 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:38.201+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:38.271 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:38.271+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:38.281 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:38.281 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:38.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:38.282 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:38.282 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:38.291 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:38.375 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:38.376+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:38.422 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:16:38.461 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:38.462 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:38.462 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:38.472 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:38.474 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:38.474+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:38.575 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:38.574+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:38.640 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:38.641 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:38.641 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:38.641 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:38.641 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:38.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:38.675 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:38.675+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:38.776 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:38.776+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:38.778 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:38.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:6 3.1a e45/43 3:5cea7035:::rbd_info:head v 45'1, mlcod=0'0)", 2023-01-02T18:16:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:38.779 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.361953996, 2023-01-02T18:16:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998, 2023-01-02T18:16:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:38.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:16:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3349999999999997e-06 2023-01-02T18:16:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417398+0000", 2023-01-02T18:16:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7995999999999998e-05 2023-01-02T18:16:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417416+0000", 2023-01-02T18:16:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2250000000000003e-06 2023-01-02T18:16:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417423+0000", 2023-01-02T18:16:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6785e-05 2023-01-02T18:16:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417470+0000", 2023-01-02T18:16:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2886000000000001e-05 2023-01-02T18:16:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417492+0000", 2023-01-02T18:16:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070370800000000005 2023-01-02T18:16:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:38.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418196+0000", 2023-01-02T18:16:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1628999999999998e-05 2023-01-02T18:16:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:38.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418228+0000", 2023-01-02T18:16:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998 2023-01-02T18:16:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:38.790 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:38.791 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:38.791 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:38.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:38.877 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:38.876+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:38.918 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:38.918 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:38.919 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:38.919 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:38.928 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:38.978 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:38.979+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:39.053 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:39.054 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:39.054 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:39.054 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:39.054 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:39.063 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:39.104 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:39.105+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:39.180 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:39.180+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:39.228 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:39.229 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:39.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:39.229 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [] 2023-01-02T18:16:39.229 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:39.238 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:39.282 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:39.280+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:39.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:39.381 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:39.381+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:39.408 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:39.409 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:39.409 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:39.422 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:39.423 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:16:39.450 INFO:tasks.workunit.client.0.smithi007.stdout:image has size 2097152 and order 22 2023-01-02T18:16:39.451 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.CreateAndStat (3274 ms) 2023-01-02T18:16:39.451 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.CreateWithSameDataPool 2023-01-02T18:16:39.451 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.474 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.CreateWithSameDataPool (24 ms) 2023-01-02T18:16:39.475 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.CreateAndStatPP 2023-01-02T18:16:39.475 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:39.475 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.482 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:39.481+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:39.494 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:39.498 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.CreateAndStatPP (24 ms) 2023-01-02T18:16:39.498 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.GetId 2023-01-02T18:16:39.499 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.514 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:39.532 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.GetId (33 ms) 2023-01-02T18:16:39.532 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.GetIdPP 2023-01-02T18:16:39.532 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.533 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:39.555 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:39.561 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.GetIdPP (29 ms) 2023-01-02T18:16:39.561 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefix 2023-01-02T18:16:39.561 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.575 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:39.580 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.GetBlockNamePrefix (19 ms) 2023-01-02T18:16:39.580 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.GetBlockNamePrefixPP 2023-01-02T18:16:39.581 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.583 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:39.582+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:39.588 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:39.588 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:39.596 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:39.599 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:39.602 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.GetBlockNamePrefixPP (22 ms) 2023-01-02T18:16:39.602 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestGetCreateTimestamp 2023-01-02T18:16:39.602 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.617 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:39.619 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:39.620 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:39.620 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:39.620 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:39.621 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestGetCreateTimestamp (19 ms) 2023-01-02T18:16:39.621 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.GetCreateTimestampPP 2023-01-02T18:16:39.621 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.640 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.GetCreateTimestampPP (19 ms) 2023-01-02T18:16:39.640 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.OpenAio 2023-01-02T18:16:39.641 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.658 INFO:tasks.workunit.client.0.smithi007.stdout:image has size 2097152 and order 22 2023-01-02T18:16:39.658 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.OpenAio (18 ms) 2023-01-02T18:16:39.658 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.OpenAioFail 2023-01-02T18:16:39.661 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.OpenAioFail (3 ms) 2023-01-02T18:16:39.661 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.OpenAioPP 2023-01-02T18:16:39.661 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.684 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:39.684+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:39.694 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.OpenAioPP (34 ms) 2023-01-02T18:16:39.695 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.OpenAioFailPP 2023-01-02T18:16:39.697 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.OpenAioFailPP (3 ms) 2023-01-02T18:16:39.698 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.ResizeAndStat 2023-01-02T18:16:39.698 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.738 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:39.738 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:39.739 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.ResizeAndStat (42 ms) 2023-01-02T18:16:39.740 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.ResizeAndStatPP 2023-01-02T18:16:39.740 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:39.777 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.ResizeAndStatPP (37 ms) 2023-01-02T18:16:39.777 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResize 2023-01-02T18:16:39.778 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.792 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:39.792+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:39.818 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.UpdateWatchAndResize (41 ms) 2023-01-02T18:16:39.818 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.UpdateWatchAndResizePP 2023-01-02T18:16:39.818 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:39.852 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.UpdateWatchAndResizePP (35 ms) 2023-01-02T18:16:39.853 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestCreateLsDelete 2023-01-02T18:16:39.881 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:39.881 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:39.885 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:39.886+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:39.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:39.987 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:39.987+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:40.056 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:40.056 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:40.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:40.108 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:40.107+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:40.189 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:40.190+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:40.233 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:40.233 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:40.243 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:40.290 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:40.291+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:40.369 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:40.369 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:40.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:40.412 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:40.412 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:40.413 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:40.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 5 2023-01-02T18:16:40.423 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:40.423+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:40.492 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:40.493+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:40.507 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:40.508 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:40.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:40.593 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:40.594+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:40.693 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:40.694+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:40.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:40.739 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-01-02T18:16:40.739+0000 7fe18f96e700 -1 mon.a@0(leader).osd e47 definitely_dead 0 2023-01-02T18:16:40.794 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:40.795+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:40.820 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:40.821 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:40.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:40.895 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:40.894+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:40.957 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:40.957 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:40.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:41.008 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:41.009+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:41.097 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:41.098+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:41.133 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:41.133 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:41.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:41.198 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:41.198+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:41.268 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:41.269 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:41.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:41.322 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:41.322+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:41.399 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:41.398+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:41.405 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:41.405 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:41.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:41.437 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:16:41.447 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:41.450 INFO:teuthology.orchestra.run.smithi007.stderr:marked out osd.5. 2023-01-02T18:16:41.505 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:41.506+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:41.583 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:41.583 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:41.593 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:41.600 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:41.600+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:41.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:41.701 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:41.702+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:41.725 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:41.725 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:41.735 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:41.784 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:41.801 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:41.802 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:41.802+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:41.818 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:41.836 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:41.854 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:41.863 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:41.863 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:41.863 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:41.863 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:41.864 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:41.872 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:41.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:41.894 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:41.903 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:41.903+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:41.914 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:41.915 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:41.916 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:42.004 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:10 3.17 e46/43 3:ece625d0:::rbd_id.image1:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.431393+0000", 2023-01-02T18:16:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5727738900000001, 2023-01-02T18:16:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001058579, 2023-01-02T18:16:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431393+0000", 2023-01-02T18:16:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431393+0000", 2023-01-02T18:16:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:16:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431393+0000", 2023-01-02T18:16:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8380000000000002e-06 2023-01-02T18:16:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431401+0000", 2023-01-02T18:16:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0225e-05 2023-01-02T18:16:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431421+0000", 2023-01-02T18:16:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0044000000000001e-05 2023-01-02T18:16:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431431+0000", 2023-01-02T18:16:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3806000000000005e-05 2023-01-02T18:16:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431505+0000", 2023-01-02T18:16:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5550000000000001e-05 2023-01-02T18:16:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431531+0000", 2023-01-02T18:16:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086934800000000004 2023-01-02T18:16:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.432400+0000", 2023-01-02T18:16:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1996999999999997e-05 2023-01-02T18:16:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.432452+0000", 2023-01-02T18:16:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001058579 2023-01-02T18:16:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:11 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:16:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5708936470000001, 2023-01-02T18:16:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020029140000000002, 2023-01-02T18:16:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 11 2023-01-02T18:16:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:16:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:16:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433272+0000", 2023-01-02T18:16:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8709999999999999e-06 2023-01-02T18:16:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433279+0000", 2023-01-02T18:16:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0445000000000001e-05 2023-01-02T18:16:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433289+0000", 2023-01-02T18:16:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9549999999999992e-06 2023-01-02T18:16:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433297+0000", 2023-01-02T18:16:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9743999999999997e-05 2023-01-02T18:16:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433347+0000", 2023-01-02T18:16:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012520899999999999 2023-01-02T18:16:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433472+0000", 2023-01-02T18:16:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000183139 2023-01-02T18:16:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:16:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433655+0000", 2023-01-02T18:16:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062228000000000001 2023-01-02T18:16:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.434278+0000", 2023-01-02T18:16:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089530100000000004 2023-01-02T18:16:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435173+0000", 2023-01-02T18:16:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9444000000000002e-05 2023-01-02T18:16:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435232+0000", 2023-01-02T18:16:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4172000000000003e-05 2023-01-02T18:16:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435277+0000", 2023-01-02T18:16:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020029140000000002 2023-01-02T18:16:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:11 3.1 e46/43 ondisk, result = 0)", 2023-01-02T18:16:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435096+0000", 2023-01-02T18:16:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5690712009999999, 2023-01-02T18:16:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018805800000000001, 2023-01-02T18:16:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435096+0000", 2023-01-02T18:16:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435096+0000", 2023-01-02T18:16:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435095+0000", 2023-01-02T18:16:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1880000000000001e-06 2023-01-02T18:16:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435100+0000", 2023-01-02T18:16:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4849999999999998e-06 2023-01-02T18:16:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435110+0000", 2023-01-02T18:16:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4359999999999999e-06 2023-01-02T18:16:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435116+0000", 2023-01-02T18:16:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0108000000000003e-05 2023-01-02T18:16:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435156+0000", 2023-01-02T18:16:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2320000000000007e-06 2023-01-02T18:16:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435165+0000", 2023-01-02T18:16:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011869700000000001 2023-01-02T18:16:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435284+0000", 2023-01-02T18:16:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018805800000000001 2023-01-02T18:16:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:15 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.444621+0000", 2023-01-02T18:16:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5595466610000002, 2023-01-02T18:16:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029032599999999998, 2023-01-02T18:16:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 15 2023-01-02T18:16:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444621+0000", 2023-01-02T18:16:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444621+0000", 2023-01-02T18:16:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444619+0000", 2023-01-02T18:16:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2e-06 2023-01-02T18:16:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444628+0000", 2023-01-02T18:16:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2490000000000001e-05 2023-01-02T18:16:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444641+0000", 2023-01-02T18:16:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9830000000000001e-06 2023-01-02T18:16:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444647+0000", 2023-01-02T18:16:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5587000000000003e-05 2023-01-02T18:16:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444682+0000", 2023-01-02T18:16:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6471999999999996e-05 2023-01-02T18:16:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444749+0000", 2023-01-02T18:16:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016213600000000001 2023-01-02T18:16:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444911+0000", 2023-01-02T18:16:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029032599999999998 2023-01-02T18:16:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.444998+0000", 2023-01-02T18:16:42.057 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5591694299999999, 2023-01-02T18:16:42.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029192999999999998, 2023-01-02T18:16:42.057 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.057 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.058 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.058 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16 2023-01-02T18:16:42.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.058 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444998+0000", 2023-01-02T18:16:42.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444998+0000", 2023-01-02T18:16:42.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.444997+0000", 2023-01-02T18:16:42.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9370000000000003e-06 2023-01-02T18:16:42.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445002+0000", 2023-01-02T18:16:42.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4469999999999995e-06 2023-01-02T18:16:42.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445011+0000", 2023-01-02T18:16:42.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8930000000000002e-06 2023-01-02T18:16:42.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445017+0000", 2023-01-02T18:16:42.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4100000000000001e-05 2023-01-02T18:16:42.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445061+0000", 2023-01-02T18:16:42.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1048e-05 2023-01-02T18:16:42.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445152+0000", 2023-01-02T18:16:42.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013729000000000001 2023-01-02T18:16:42.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445290+0000", 2023-01-02T18:16:42.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029192999999999998 2023-01-02T18:16:42.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.068 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.068 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:17 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [call,call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.069 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.445360+0000", 2023-01-02T18:16:42.069 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5588071289999998, 2023-01-02T18:16:42.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020656200000000001, 2023-01-02T18:16:42.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.069 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.070 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.070 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.070 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.070 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 17 2023-01-02T18:16:42.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.071 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445360+0000", 2023-01-02T18:16:42.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445360+0000", 2023-01-02T18:16:42.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445359+0000", 2023-01-02T18:16:42.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8199999999999996e-06 2023-01-02T18:16:42.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445364+0000", 2023-01-02T18:16:42.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7719999999999994e-06 2023-01-02T18:16:42.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445372+0000", 2023-01-02T18:16:42.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2611e-05 2023-01-02T18:16:42.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445385+0000", 2023-01-02T18:16:42.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7287000000000001e-05 2023-01-02T18:16:42.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445412+0000", 2023-01-02T18:16:42.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3266999999999997e-05 2023-01-02T18:16:42.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445465+0000", 2023-01-02T18:16:42.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010155899999999999 2023-01-02T18:16:42.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445567+0000", 2023-01-02T18:16:42.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020656200000000001 2023-01-02T18:16:42.079 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.079 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.079 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.080 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:18 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.080 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.445635+0000", 2023-01-02T18:16:42.080 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5585322540000002, 2023-01-02T18:16:42.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026303299999999997, 2023-01-02T18:16:42.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.081 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.081 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.082 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.082 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 18 2023-01-02T18:16:42.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.082 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445635+0000", 2023-01-02T18:16:42.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445635+0000", 2023-01-02T18:16:42.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:42.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445634+0000", 2023-01-02T18:16:42.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.245e-06 2023-01-02T18:16:42.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445639+0000", 2023-01-02T18:16:42.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9900000000000003e-06 2023-01-02T18:16:42.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445648+0000", 2023-01-02T18:16:42.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.967e-06 2023-01-02T18:16:42.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445653+0000", 2023-01-02T18:16:42.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9977e-05 2023-01-02T18:16:42.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445693+0000", 2023-01-02T18:16:42.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8750000000000003e-05 2023-01-02T18:16:42.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445771+0000", 2023-01-02T18:16:42.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012676000000000001 2023-01-02T18:16:42.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.445898+0000", 2023-01-02T18:16:42.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026303299999999997 2023-01-02T18:16:42.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.091 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.092 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:19 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.092 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.446321+0000", 2023-01-02T18:16:42.092 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.557846617, 2023-01-02T18:16:42.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035493599999999998, 2023-01-02T18:16:42.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 19 2023-01-02T18:16:42.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.093 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446321+0000", 2023-01-02T18:16:42.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446321+0000", 2023-01-02T18:16:42.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:42.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446319+0000", 2023-01-02T18:16:42.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5789999999999998e-06 2023-01-02T18:16:42.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446327+0000", 2023-01-02T18:16:42.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4344e-05 2023-01-02T18:16:42.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446341+0000", 2023-01-02T18:16:42.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9140000000000002e-06 2023-01-02T18:16:42.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446348+0000", 2023-01-02T18:16:42.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8898999999999999e-05 2023-01-02T18:16:42.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446377+0000", 2023-01-02T18:16:42.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9806000000000002e-05 2023-01-02T18:16:42.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446447+0000", 2023-01-02T18:16:42.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022861999999999999 2023-01-02T18:16:42.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446676+0000", 2023-01-02T18:16:42.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035493599999999998 2023-01-02T18:16:42.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.102 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.103 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:20 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.103 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.446789+0000", 2023-01-02T18:16:42.103 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5573778850000002, 2023-01-02T18:16:42.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046301600000000001, 2023-01-02T18:16:42.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.105 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.105 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 20 2023-01-02T18:16:42.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.105 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446789+0000", 2023-01-02T18:16:42.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446789+0000", 2023-01-02T18:16:42.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446788+0000", 2023-01-02T18:16:42.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4579999999999998e-06 2023-01-02T18:16:42.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446795+0000", 2023-01-02T18:16:42.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:16:42.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446807+0000", 2023-01-02T18:16:42.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9780000000000002e-06 2023-01-02T18:16:42.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446813+0000", 2023-01-02T18:16:42.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1610000000000003e-05 2023-01-02T18:16:42.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446855+0000", 2023-01-02T18:16:42.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2247e-05 2023-01-02T18:16:42.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.446937+0000", 2023-01-02T18:16:42.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031523899999999998 2023-01-02T18:16:42.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447252+0000", 2023-01-02T18:16:42.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046301600000000001 2023-01-02T18:16:42.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.114 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.115 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:21 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.115 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.447355+0000", 2023-01-02T18:16:42.115 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5568126530000002, 2023-01-02T18:16:42.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000192957, 2023-01-02T18:16:42.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.116 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.116 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.116 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 21 2023-01-02T18:16:42.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.117 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447355+0000", 2023-01-02T18:16:42.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447355+0000", 2023-01-02T18:16:42.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447353+0000", 2023-01-02T18:16:42.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3239999999999999e-06 2023-01-02T18:16:42.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447360+0000", 2023-01-02T18:16:42.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3159999999999999e-05 2023-01-02T18:16:42.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447373+0000", 2023-01-02T18:16:42.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6329999999999996e-06 2023-01-02T18:16:42.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447381+0000", 2023-01-02T18:16:42.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2835e-05 2023-01-02T18:16:42.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447413+0000", 2023-01-02T18:16:42.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1289000000000003e-05 2023-01-02T18:16:42.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447465+0000", 2023-01-02T18:16:42.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2886999999999994e-05 2023-01-02T18:16:42.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.447548+0000", 2023-01-02T18:16:42.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000192957 2023-01-02T18:16:42.125 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.125 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.125 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.126 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:23 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.126 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.448467+0000", 2023-01-02T18:16:42.126 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5557000759999999, 2023-01-02T18:16:42.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029316299999999998, 2023-01-02T18:16:42.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.127 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.127 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.128 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 23 2023-01-02T18:16:42.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.128 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448467+0000", 2023-01-02T18:16:42.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448467+0000", 2023-01-02T18:16:42.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448466+0000", 2023-01-02T18:16:42.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1270000000000002e-06 2023-01-02T18:16:42.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448472+0000", 2023-01-02T18:16:42.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1488000000000001e-05 2023-01-02T18:16:42.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448483+0000", 2023-01-02T18:16:42.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4580000000000001e-06 2023-01-02T18:16:42.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448488+0000", 2023-01-02T18:16:42.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4566e-05 2023-01-02T18:16:42.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448533+0000", 2023-01-02T18:16:42.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5273999999999997e-05 2023-01-02T18:16:42.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448618+0000", 2023-01-02T18:16:42.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000142037 2023-01-02T18:16:42.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448760+0000", 2023-01-02T18:16:42.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029316299999999998 2023-01-02T18:16:42.137 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.137 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.137 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.137 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:24 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [watch watch cookie 140115456398928] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:42.138 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:16:42.138 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5552584899999999, 2023-01-02T18:16:42.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671591, 2023-01-02T18:16:42.138 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.138 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:42.139 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.139 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.139 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.139 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 24 2023-01-02T18:16:42.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.140 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:16:42.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:16:42.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448908+0000", 2023-01-02T18:16:42.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8049999999999997e-06 2023-01-02T18:16:42.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448913+0000", 2023-01-02T18:16:42.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6050000000000004e-06 2023-01-02T18:16:42.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448922+0000", 2023-01-02T18:16:42.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.296e-06 2023-01-02T18:16:42.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448927+0000", 2023-01-02T18:16:42.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2249999999999997e-05 2023-01-02T18:16:42.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448969+0000", 2023-01-02T18:16:42.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1073000000000001e-05 2023-01-02T18:16:42.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449050+0000", 2023-01-02T18:16:42.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019599400000000001 2023-01-02T18:16:42.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:16:42.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449246+0000", 2023-01-02T18:16:42.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055298399999999996 2023-01-02T18:16:42.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:42.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449799+0000", 2023-01-02T18:16:42.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067574099999999999 2023-01-02T18:16:42.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:42.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450475+0000", 2023-01-02T18:16:42.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2527999999999997e-05 2023-01-02T18:16:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450517+0000", 2023-01-02T18:16:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3255000000000003e-05 2023-01-02T18:16:42.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450580+0000", 2023-01-02T18:16:42.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671591 2023-01-02T18:16:42.151 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.151 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.152 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.152 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:24 3.1 e46/43 ondisk, result = 0)", 2023-01-02T18:16:42.152 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.450396+0000", 2023-01-02T18:16:42.152 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5537709139999998, 2023-01-02T18:16:42.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018846499999999999, 2023-01-02T18:16:42.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.153 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450396+0000", 2023-01-02T18:16:42.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450396+0000", 2023-01-02T18:16:42.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450395+0000", 2023-01-02T18:16:42.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8869999999999997e-06 2023-01-02T18:16:42.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450401+0000", 2023-01-02T18:16:42.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.344e-05 2023-01-02T18:16:42.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450415+0000", 2023-01-02T18:16:42.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.694e-06 2023-01-02T18:16:42.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450420+0000", 2023-01-02T18:16:42.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4388999999999998e-05 2023-01-02T18:16:42.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450465+0000", 2023-01-02T18:16:42.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3120000000000001e-06 2023-01-02T18:16:42.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450470+0000", 2023-01-02T18:16:42.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011487199999999999 2023-01-02T18:16:42.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450585+0000", 2023-01-02T18:16:42.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018846499999999999 2023-01-02T18:16:42.162 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.162 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.162 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.163 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:25 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [watch unwatch cookie 140115456398928] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:42.163 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:16:42.164 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5534109909999998, 2023-01-02T18:16:42.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001161561, 2023-01-02T18:16:42.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:42.164 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.165 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:42.165 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:42.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 25 2023-01-02T18:16:42.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.165 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:16:42.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:16:42.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450755+0000", 2023-01-02T18:16:42.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.575e-06 2023-01-02T18:16:42.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450761+0000", 2023-01-02T18:16:42.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0091e-05 2023-01-02T18:16:42.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450771+0000", 2023-01-02T18:16:42.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8749999999999999e-06 2023-01-02T18:16:42.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450776+0000", 2023-01-02T18:16:42.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0066e-05 2023-01-02T18:16:42.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450806+0000", 2023-01-02T18:16:42.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9995999999999998e-05 2023-01-02T18:16:42.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450886+0000", 2023-01-02T18:16:42.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014307999999999999 2023-01-02T18:16:42.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:16:42.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451029+0000", 2023-01-02T18:16:42.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044226600000000002 2023-01-02T18:16:42.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:42.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451471+0000", 2023-01-02T18:16:42.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036714799999999998 2023-01-02T18:16:42.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:42.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451838+0000", 2023-01-02T18:16:42.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6917999999999999e-05 2023-01-02T18:16:42.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:42.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451865+0000", 2023-01-02T18:16:42.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2561e-05 2023-01-02T18:16:42.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451918+0000", 2023-01-02T18:16:42.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001161561 2023-01-02T18:16:42.178 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.178 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.178 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.179 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:25 3.1 e46/43 ondisk, result = 0)", 2023-01-02T18:16:42.179 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.451779+0000", 2023-01-02T18:16:42.179 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.552387902, 2023-01-02T18:16:42.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141237, 2023-01-02T18:16:42.179 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.180 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451779+0000", 2023-01-02T18:16:42.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451779+0000", 2023-01-02T18:16:42.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:42.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451779+0000", 2023-01-02T18:16:42.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8160000000000001e-06 2023-01-02T18:16:42.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451784+0000", 2023-01-02T18:16:42.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3479999999999993e-06 2023-01-02T18:16:42.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451793+0000", 2023-01-02T18:16:42.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3889999999999998e-06 2023-01-02T18:16:42.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451797+0000", 2023-01-02T18:16:42.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2462000000000002e-05 2023-01-02T18:16:42.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451830+0000", 2023-01-02T18:16:42.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.284e-06 2023-01-02T18:16:42.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451834+0000", 2023-01-02T18:16:42.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6590999999999998e-05 2023-01-02T18:16:42.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451921+0000", 2023-01-02T18:16:42.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000141237 2023-01-02T18:16:42.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.188 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.189 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:33 3.3 e46/43 3:c76fae31:::rbd_object_map.12a21ad382ee:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:42.189 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.463293+0000", 2023-01-02T18:16:42.189 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5408738089999998, 2023-01-02T18:16:42.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094459399999999999, 2023-01-02T18:16:42.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:42.190 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.463293+0000", 2023-01-02T18:16:42.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.463293+0000", 2023-01-02T18:16:42.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:42.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.463292+0000", 2023-01-02T18:16:42.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.328e-05 2023-01-02T18:16:42.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.463305+0000", 2023-01-02T18:16:42.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7694999999999999e-05 2023-01-02T18:16:42.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.463323+0000", 2023-01-02T18:16:42.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2042e-05 2023-01-02T18:16:42.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.463345+0000", 2023-01-02T18:16:42.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8733000000000002e-05 2023-01-02T18:16:42.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.463404+0000", 2023-01-02T18:16:42.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9168999999999999e-05 2023-01-02T18:16:42.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.463423+0000", 2023-01-02T18:16:42.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078321200000000004 2023-01-02T18:16:42.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:42.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.464206+0000", 2023-01-02T18:16:42.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1958000000000001e-05 2023-01-02T18:16:42.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.464238+0000", 2023-01-02T18:16:42.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094459399999999999 2023-01-02T18:16:42.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.199 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.200 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.200 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:42.201 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:42.005+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:42.202 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:42.243 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:42.244+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:42.305 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:42.305+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:42.369 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:42.370 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:42.370 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:42.379 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:42.420 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:42.421+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:42.437 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:16:42.507 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:42.507+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:42.555 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:42.555 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:42.555 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:42.556 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:42.556 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:42.565 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:42.609 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:42.610+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:42.691 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:6 3.1a e45/43 3:5cea7035:::rbd_info:head v 45'1, mlcod=0'0)", 2023-01-02T18:16:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2745181509999997, 2023-01-02T18:16:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998, 2023-01-02T18:16:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:16:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3349999999999997e-06 2023-01-02T18:16:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417398+0000", 2023-01-02T18:16:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7995999999999998e-05 2023-01-02T18:16:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417416+0000", 2023-01-02T18:16:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2250000000000003e-06 2023-01-02T18:16:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417423+0000", 2023-01-02T18:16:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6785e-05 2023-01-02T18:16:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417470+0000", 2023-01-02T18:16:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2886000000000001e-05 2023-01-02T18:16:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417492+0000", 2023-01-02T18:16:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070370800000000005 2023-01-02T18:16:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418196+0000", 2023-01-02T18:16:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1628999999999998e-05 2023-01-02T18:16:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418228+0000", 2023-01-02T18:16:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998 2023-01-02T18:16:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.2679435799999998, 2023-01-02T18:16:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:16:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:16:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:16:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:16:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:16:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:16:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:16:42.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:16:42.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:16:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:16:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:16:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:16:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:16:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:16:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:16:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:16:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2 3.4 3:267905b2:::rbd_id.image3:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.2137939270000002, 2023-01-02T18:16:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018677900000000001, 2023-01-02T18:16:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2023-01-02T18:16:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478116+0000", 2023-01-02T18:16:42.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2775999999999999e-05 2023-01-02T18:16:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478129+0000", 2023-01-02T18:16:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.361e-05 2023-01-02T18:16:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478142+0000", 2023-01-02T18:16:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6750000000000001e-05 2023-01-02T18:16:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478159+0000", 2023-01-02T18:16:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4184999999999997e-05 2023-01-02T18:16:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478213+0000", 2023-01-02T18:16:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0367999999999999e-05 2023-01-02T18:16:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478303+0000", 2023-01-02T18:16:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018677900000000001 2023-01-02T18:16:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.2087438719999999, 2023-01-02T18:16:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:16:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:16:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:16:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:16:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:16:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:16:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:16:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:16:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:16:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:16:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:16:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:16:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:16:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:16:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:16:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:16:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:16:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:16:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:16:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:16:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:16:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:16:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:16:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:16:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:16:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4565.0:6 3.4 e46/43 ondisk, result = 0)", 2023-01-02T18:16:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.484598+0000", 2023-01-02T18:16:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.207312597, 2023-01-02T18:16:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136199999999999, 2023-01-02T18:16:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484598+0000", 2023-01-02T18:16:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484598+0000", 2023-01-02T18:16:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484597+0000", 2023-01-02T18:16:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.916e-06 2023-01-02T18:16:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484602+0000", 2023-01-02T18:16:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.081e-06 2023-01-02T18:16:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484611+0000", 2023-01-02T18:16:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7029999999999997e-06 2023-01-02T18:16:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484616+0000", 2023-01-02T18:16:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4335000000000002e-05 2023-01-02T18:16:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484650+0000", 2023-01-02T18:16:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8980000000000004e-06 2023-01-02T18:16:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484655+0000", 2023-01-02T18:16:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4293000000000001e-05 2023-01-02T18:16:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484739+0000", 2023-01-02T18:16:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136199999999999 2023-01-02T18:16:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:9 3.4 3:267905b2:::rbd_id.image3:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.2001209529999999, 2023-01-02T18:16:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027154600000000001, 2023-01-02T18:16:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 9 2023-01-02T18:16:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491788+0000", 2023-01-02T18:16:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6080000000000002e-06 2023-01-02T18:16:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491797+0000", 2023-01-02T18:16:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7750000000000001e-05 2023-01-02T18:16:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491815+0000", 2023-01-02T18:16:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6790000000000005e-06 2023-01-02T18:16:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491823+0000", 2023-01-02T18:16:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3060999999999999e-05 2023-01-02T18:16:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491876+0000", 2023-01-02T18:16:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.009e-05 2023-01-02T18:16:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491966+0000", 2023-01-02T18:16:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5279999999999996e-05 2023-01-02T18:16:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492061+0000", 2023-01-02T18:16:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027154600000000001 2023-01-02T18:16:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:10 3.4 3:267905b2:::rbd_id.image3:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.1997453519999999, 2023-01-02T18:16:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040530900000000002, 2023-01-02T18:16:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 10 2023-01-02T18:16:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492164+0000", 2023-01-02T18:16:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7980000000000006e-06 2023-01-02T18:16:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492172+0000", 2023-01-02T18:16:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:16:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492186+0000", 2023-01-02T18:16:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0129999999999993e-06 2023-01-02T18:16:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492194+0000", 2023-01-02T18:16:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0227e-05 2023-01-02T18:16:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492235+0000", 2023-01-02T18:16:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0649000000000007e-05 2023-01-02T18:16:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492315+0000", 2023-01-02T18:16:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000255271 2023-01-02T18:16:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492571+0000", 2023-01-02T18:16:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040530900000000002 2023-01-02T18:16:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.16 49/48 [PushOp(3:6b9a211e:::rbd_id.image12:head, version: 46'1, data_included: [0~15], data_size: 15, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b9a211e:::rbd_id.image12:head@46'1, size: 15, copy_subset: [0~15], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:15, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.24769400999999999, 2023-01-02T18:16:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044365099999999998, 2023-01-02T18:16:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444215+0000", 2023-01-02T18:16:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.014e-05 2023-01-02T18:16:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444235+0000", 2023-01-02T18:16:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3300999999999999e-05 2023-01-02T18:16:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444258+0000", 2023-01-02T18:16:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.278e-05 2023-01-02T18:16:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444271+0000", 2023-01-02T18:16:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9231000000000003e-05 2023-01-02T18:16:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444330+0000", 2023-01-02T18:16:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0796e-05 2023-01-02T18:16:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444341+0000", 2023-01-02T18:16:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031950400000000002 2023-01-02T18:16:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444660+0000", 2023-01-02T18:16:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044365099999999998 2023-01-02T18:16:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3d3f3250:::rbd_id.image2:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d3f3250:::rbd_id.image2:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.24451810700000001, 2023-01-02T18:16:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004, 2023-01-02T18:16:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447391+0000", 2023-01-02T18:16:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8275e-05 2023-01-02T18:16:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447410+0000", 2023-01-02T18:16:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3377999999999999e-05 2023-01-02T18:16:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447433+0000", 2023-01-02T18:16:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6303e-05 2023-01-02T18:16:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447449+0000", 2023-01-02T18:16:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000438212 2023-01-02T18:16:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447888+0000", 2023-01-02T18:16:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.169e-05 2023-01-02T18:16:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447899+0000", 2023-01-02T18:16:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035861500000000001 2023-01-02T18:16:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448258+0000", 2023-01-02T18:16:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004 2023-01-02T18:16:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3831950c:::rbd_directory:head, version: 46'16, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 30, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3831950c:::rbd_directory:head@46'16, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.24218825899999999, 2023-01-02T18:16:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048506899999999997, 2023-01-02T18:16:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449721+0000", 2023-01-02T18:16:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8507e-05 2023-01-02T18:16:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449749+0000", 2023-01-02T18:16:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1554999999999999e-05 2023-01-02T18:16:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449771+0000", 2023-01-02T18:16:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1626e-05 2023-01-02T18:16:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449783+0000", 2023-01-02T18:16:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6056999999999994e-05 2023-01-02T18:16:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449859+0000", 2023-01-02T18:16:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1284000000000001e-05 2023-01-02T18:16:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449870+0000", 2023-01-02T18:16:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000337447 2023-01-02T18:16:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.450207+0000", 2023-01-02T18:16:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048506899999999997 2023-01-02T18:16:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3f5a2831:::rbd_object_map.11d52421ce09:head, version: 46'21, data_included: [0~35], data_size: 35, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(3:3f5a2831:::rbd_object_map.11d52421ce09:head@46'21, size: 35, copy_subset: [0~35], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:35, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.24033943199999999, 2023-01-02T18:16:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036462199999999999, 2023-01-02T18:16:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451570+0000", 2023-01-02T18:16:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3141e-05 2023-01-02T18:16:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451584+0000", 2023-01-02T18:16:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5398000000000001e-05 2023-01-02T18:16:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451599+0000", 2023-01-02T18:16:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.011e-06 2023-01-02T18:16:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451607+0000", 2023-01-02T18:16:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9302000000000003e-05 2023-01-02T18:16:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451656+0000", 2023-01-02T18:16:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:16:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451662+0000", 2023-01-02T18:16:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027369500000000001 2023-01-02T18:16:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451936+0000", 2023-01-02T18:16:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036462199999999999 2023-01-02T18:16:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:42.818 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:42.818 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:42.819 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:42.820 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:42.820+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:42.920 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:42.920+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:42.986 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:42.986 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:42.987 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:42.996 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:43.037 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:43.038+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:43.122 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:43.122+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:43.161 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:43.161 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:43.161 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:43.162 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:43.162 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:43.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:43.223 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:43.223+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:43.297 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:43.298 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:43.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:43.298 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:43.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.298 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:43.299 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:43.299 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8148301130000002, 2023-01-02T18:16:43.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:16:43.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:43.299 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:43.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:43.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:43.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:16:43.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:16:43.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:16:43.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:16:43.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:16:43.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:16:43.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:16:43.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:16:43.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:16:43.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:16:43.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:16:43.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:16:43.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:43.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:16:43.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:16:43.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:16:43.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:16:43.310 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.310 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.310 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.311 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.5 49/48 [PushOp(3:a56581c2:::rbd_id.image9:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:a56581c2:::rbd_id.image9:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:43.311 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:43.311 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.836237868, 2023-01-02T18:16:43.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001, 2023-01-02T18:16:43.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.312 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:43.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:43.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:43.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462256+0000", 2023-01-02T18:16:43.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1099e-05 2023-01-02T18:16:43.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462268+0000", 2023-01-02T18:16:43.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4336e-05 2023-01-02T18:16:43.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462282+0000", 2023-01-02T18:16:43.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1552000000000001e-05 2023-01-02T18:16:43.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462293+0000", 2023-01-02T18:16:43.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1749999999999998e-05 2023-01-02T18:16:43.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462335+0000", 2023-01-02T18:16:43.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1909999999999999e-06 2023-01-02T18:16:43.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462340+0000", 2023-01-02T18:16:43.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029615499999999999 2023-01-02T18:16:43.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462637+0000", 2023-01-02T18:16:43.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001 2023-01-02T18:16:43.320 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.321 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.321 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.321 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.321 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.321 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:43.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:43.324 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:43.324+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:43.425 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:43.425+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:43.451 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:43.451 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:43.451 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:43.451 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:43.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:43.526 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:43.527+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:43.587 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:43.587 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:43.588 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:43.588 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:43.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:43.627 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:43.627+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:43.728 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:43.728+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:43.765 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:43.765 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:43.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:43.766 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:43.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.766 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4200.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected e41)", 2023-01-02T18:16:43.766 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:34.548654+0000", 2023-01-02T18:16:43.766 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.2157147439999996, 2023-01-02T18:16:43.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023200099999999999, 2023-01-02T18:16:43.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:43.767 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.767 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4200", 2023-01-02T18:16:43.768 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:16:43.768 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2023-01-02T18:16:43.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.768 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548654+0000", 2023-01-02T18:16:43.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548654+0000", 2023-01-02T18:16:43.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:43.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548652+0000", 2023-01-02T18:16:43.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6000000000000001e-06 2023-01-02T18:16:43.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548659+0000", 2023-01-02T18:16:43.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:16:43.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548670+0000", 2023-01-02T18:16:43.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2060000000000007e-06 2023-01-02T18:16:43.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548679+0000", 2023-01-02T18:16:43.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4505000000000007e-05 2023-01-02T18:16:43.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548743+0000", 2023-01-02T18:16:43.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014263599999999999 2023-01-02T18:16:43.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548886+0000", 2023-01-02T18:16:43.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023200099999999999 2023-01-02T18:16:43.776 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.777 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.778 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:43.778 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:43.778 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.3285195270000001, 2023-01-02T18:16:43.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:16:43.778 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:43.779 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.779 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:43.779 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:43.779 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:16:43.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.780 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:43.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:43.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:43.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:16:43.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:16:43.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:16:43.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:16:43.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:16:43.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:16:43.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:16:43.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:16:43.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:16:43.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:16:43.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:16:43.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:16:43.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:16:43.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:16:43.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:16:43.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:16:43.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:16:43.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:43.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:16:43.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:16:43.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:43.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:16:43.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:16:43.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:43.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:16:43.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:16:43.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:43.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:16:43.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:16:43.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:16:43.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:16:43.795 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.795 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.795 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.796 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:43.796 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:43.796 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2791345339999998, 2023-01-02T18:16:43.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:16:43.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:43.797 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.797 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.798 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:16:43.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.798 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:43.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:43.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:43.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:16:43.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:16:43.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:16:43.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:16:43.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:16:43.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:16:43.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:16:43.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:16:43.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:16:43.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:16:43.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:16:43.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:16:43.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:43.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:16:43.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:16:43.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:43.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:16:43.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:16:43.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:43.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:16:43.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:16:43.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:43.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:16:43.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:16:43.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:16:43.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:16:43.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.814 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.814 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4565.0:7 3.1e e46/43 ondisk, result = 0)", 2023-01-02T18:16:43.815 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.486789+0000", 2023-01-02T18:16:43.815 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2775793670000004, 2023-01-02T18:16:43.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021320200000000001, 2023-01-02T18:16:43.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.816 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486789+0000", 2023-01-02T18:16:43.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486789+0000", 2023-01-02T18:16:43.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:43.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486788+0000", 2023-01-02T18:16:43.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9319999999999999e-06 2023-01-02T18:16:43.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486795+0000", 2023-01-02T18:16:43.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4531e-05 2023-01-02T18:16:43.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486809+0000", 2023-01-02T18:16:43.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9409999999999996e-06 2023-01-02T18:16:43.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486818+0000", 2023-01-02T18:16:43.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7644e-05 2023-01-02T18:16:43.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486866+0000", 2023-01-02T18:16:43.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1919999999999994e-06 2023-01-02T18:16:43.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486875+0000", 2023-01-02T18:16:43.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127362 2023-01-02T18:16:43.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487002+0000", 2023-01-02T18:16:43.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021320200000000001 2023-01-02T18:16:43.824 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.825 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.825 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.826 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:8 3.18 3:1e96267a:::rbd_object_map.11d585d3810a:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:43.826 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:43.826 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.277324675, 2023-01-02T18:16:43.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087, 2023-01-02T18:16:43.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:43.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 8 2023-01-02T18:16:43.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.828 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:43.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:43.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:43.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487043+0000", 2023-01-02T18:16:43.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6100000000000002e-06 2023-01-02T18:16:43.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487049+0000", 2023-01-02T18:16:43.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:16:43.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487064+0000", 2023-01-02T18:16:43.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3280000000000006e-06 2023-01-02T18:16:43.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487072+0000", 2023-01-02T18:16:43.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5221e-05 2023-01-02T18:16:43.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487117+0000", 2023-01-02T18:16:43.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7274000000000005e-05 2023-01-02T18:16:43.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487204+0000", 2023-01-02T18:16:43.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013400700000000001 2023-01-02T18:16:43.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2023-01-02T18:16:43.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487338+0000", 2023-01-02T18:16:43.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083414299999999997 2023-01-02T18:16:43.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:43.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488173+0000", 2023-01-02T18:16:43.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020278700000000001 2023-01-02T18:16:43.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:43.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488375+0000", 2023-01-02T18:16:43.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6679999999999999e-05 2023-01-02T18:16:43.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:43.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488432+0000", 2023-01-02T18:16:43.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6842000000000003e-05 2023-01-02T18:16:43.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488479+0000", 2023-01-02T18:16:43.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087 2023-01-02T18:16:43.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.841 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.841 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.841 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:11 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:43.842 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:43.842 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2716867760000001, 2023-01-02T18:16:43.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00043998300000000002, 2023-01-02T18:16:43.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.843 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.843 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.843 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 11 2023-01-02T18:16:43.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.844 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:43.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:43.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:43.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492680+0000", 2023-01-02T18:16:43.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6859999999999995e-06 2023-01-02T18:16:43.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492689+0000", 2023-01-02T18:16:43.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6410999999999999e-05 2023-01-02T18:16:43.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492705+0000", 2023-01-02T18:16:43.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2620000000000001e-06 2023-01-02T18:16:43.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492712+0000", 2023-01-02T18:16:43.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0547000000000002e-05 2023-01-02T18:16:43.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492763+0000", 2023-01-02T18:16:43.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2423000000000006e-05 2023-01-02T18:16:43.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492855+0000", 2023-01-02T18:16:43.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026637399999999999 2023-01-02T18:16:43.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493122+0000", 2023-01-02T18:16:43.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00043998300000000002 2023-01-02T18:16:43.853 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.853 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.853 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.854 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:13 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call,call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:43.854 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:43.854 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2708614279999999, 2023-01-02T18:16:43.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035003500000000001, 2023-01-02T18:16:43.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.855 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.855 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.855 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.855 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.856 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 13 2023-01-02T18:16:43.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.856 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:43.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:43.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:43.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493506+0000", 2023-01-02T18:16:43.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7309999999999993e-06 2023-01-02T18:16:43.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493513+0000", 2023-01-02T18:16:43.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4613999999999999e-05 2023-01-02T18:16:43.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493528+0000", 2023-01-02T18:16:43.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9720000000000003e-06 2023-01-02T18:16:43.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493535+0000", 2023-01-02T18:16:43.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4150000000000003e-05 2023-01-02T18:16:43.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493579+0000", 2023-01-02T18:16:43.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3683000000000005e-05 2023-01-02T18:16:43.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493663+0000", 2023-01-02T18:16:43.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000194124 2023-01-02T18:16:43.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493857+0000", 2023-01-02T18:16:43.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035003500000000001 2023-01-02T18:16:43.865 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.865 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.866 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.867 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:15 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:43.867 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:43.867 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2698497729999998, 2023-01-02T18:16:43.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056168199999999998, 2023-01-02T18:16:43.868 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.869 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.869 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.870 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 15 2023-01-02T18:16:43.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.871 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:43.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:43.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:43.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494517+0000", 2023-01-02T18:16:43.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5499999999999997e-06 2023-01-02T18:16:43.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494525+0000", 2023-01-02T18:16:43.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5101e-05 2023-01-02T18:16:43.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494540+0000", 2023-01-02T18:16:43.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3910000000000003e-06 2023-01-02T18:16:43.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494547+0000", 2023-01-02T18:16:43.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3065000000000002e-05 2023-01-02T18:16:43.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494590+0000", 2023-01-02T18:16:43.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0383999999999994e-05 2023-01-02T18:16:43.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494680+0000", 2023-01-02T18:16:43.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040034000000000001 2023-01-02T18:16:43.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495080+0000", 2023-01-02T18:16:43.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056168199999999998 2023-01-02T18:16:43.887 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.888 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.888 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.889 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:16 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:43.889 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:43.890 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2691877199999997, 2023-01-02T18:16:43.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030933600000000001, 2023-01-02T18:16:43.890 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.890 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.890 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.891 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.891 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.891 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16 2023-01-02T18:16:43.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.891 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:43.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:43.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:43.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495179+0000", 2023-01-02T18:16:43.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6599999999999998e-06 2023-01-02T18:16:43.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495186+0000", 2023-01-02T18:16:43.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4070000000000001e-05 2023-01-02T18:16:43.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495200+0000", 2023-01-02T18:16:43.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9140000000000002e-06 2023-01-02T18:16:43.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495207+0000", 2023-01-02T18:16:43.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3915999999999999e-05 2023-01-02T18:16:43.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495241+0000", 2023-01-02T18:16:43.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3961000000000001e-05 2023-01-02T18:16:43.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495295+0000", 2023-01-02T18:16:43.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019502899999999999 2023-01-02T18:16:43.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495490+0000", 2023-01-02T18:16:43.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030933600000000001 2023-01-02T18:16:43.902 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.902 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.902 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.903 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:17 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:43.903 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.495585+0000", 2023-01-02T18:16:43.903 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2687837569999996, 2023-01-02T18:16:43.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029335199999999998, 2023-01-02T18:16:43.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.904 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.904 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.904 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.904 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 17 2023-01-02T18:16:43.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.905 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495585+0000", 2023-01-02T18:16:43.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495585+0000", 2023-01-02T18:16:43.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:43.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495584+0000", 2023-01-02T18:16:43.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4910000000000002e-06 2023-01-02T18:16:43.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495590+0000", 2023-01-02T18:16:43.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.482e-05 2023-01-02T18:16:43.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495605+0000", 2023-01-02T18:16:43.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0001e-05 2023-01-02T18:16:43.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495615+0000", 2023-01-02T18:16:43.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4645999999999999e-05 2023-01-02T18:16:43.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495660+0000", 2023-01-02T18:16:43.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3973000000000004e-05 2023-01-02T18:16:43.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495743+0000", 2023-01-02T18:16:43.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013452399999999999 2023-01-02T18:16:43.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495878+0000", 2023-01-02T18:16:43.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029335199999999998 2023-01-02T18:16:43.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.915 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.916 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:20 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [watch watch cookie 140114919540112] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:43.916 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:43.916 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.267259192, 2023-01-02T18:16:43.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013849540000000001, 2023-01-02T18:16:43.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:43.918 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.918 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.919 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.919 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 20 2023-01-02T18:16:43.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.920 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:43.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:43.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:43.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497108+0000", 2023-01-02T18:16:43.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6219999999999997e-06 2023-01-02T18:16:43.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497114+0000", 2023-01-02T18:16:43.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4440000000000001e-05 2023-01-02T18:16:43.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497128+0000", 2023-01-02T18:16:43.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6989999999999997e-06 2023-01-02T18:16:43.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497135+0000", 2023-01-02T18:16:43.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8272999999999998e-05 2023-01-02T18:16:43.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497173+0000", 2023-01-02T18:16:43.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5973000000000002e-05 2023-01-02T18:16:43.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497219+0000", 2023-01-02T18:16:43.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010911 2023-01-02T18:16:43.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:43.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497328+0000", 2023-01-02T18:16:43.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051081399999999995 2023-01-02T18:16:43.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:43.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497839+0000", 2023-01-02T18:16:43.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057482300000000002 2023-01-02T18:16:43.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:43.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498414+0000", 2023-01-02T18:16:43.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7160000000000003e-05 2023-01-02T18:16:43.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:43.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498451+0000", 2023-01-02T18:16:43.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2978000000000001e-05 2023-01-02T18:16:43.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498494+0000", 2023-01-02T18:16:43.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013849540000000001 2023-01-02T18:16:43.936 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.936 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.936 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.937 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:21 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [watch unwatch cookie 140114919540112] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:43.937 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:43.937 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2657050390000002, 2023-01-02T18:16:43.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011449139999999999, 2023-01-02T18:16:43.938 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.938 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:43.938 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.938 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.939 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.939 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 21 2023-01-02T18:16:43.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.939 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:43.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:43.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:43.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498662+0000", 2023-01-02T18:16:43.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9529999999999999e-06 2023-01-02T18:16:43.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498670+0000", 2023-01-02T18:16:43.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5307000000000001e-05 2023-01-02T18:16:43.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498685+0000", 2023-01-02T18:16:43.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1289999999999998e-06 2023-01-02T18:16:43.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498692+0000", 2023-01-02T18:16:43.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1134999999999999e-05 2023-01-02T18:16:43.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498723+0000", 2023-01-02T18:16:43.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3186999999999998e-05 2023-01-02T18:16:43.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498767+0000", 2023-01-02T18:16:43.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4067000000000006e-05 2023-01-02T18:16:43.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:43.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498861+0000", 2023-01-02T18:16:43.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036586499999999999 2023-01-02T18:16:43.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:43.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499226+0000", 2023-01-02T18:16:43.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000519073 2023-01-02T18:16:43.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:43.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499746+0000", 2023-01-02T18:16:43.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6923e-05 2023-01-02T18:16:43.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:43.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499772+0000", 2023-01-02T18:16:43.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5809000000000002e-05 2023-01-02T18:16:43.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499808+0000", 2023-01-02T18:16:43.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011449139999999999 2023-01-02T18:16:43.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.953 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.954 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:52 3.8 3:105263f9:::rbd_id.image4:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:43.954 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:43.954 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2594366700000004, 2023-01-02T18:16:43.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001, 2023-01-02T18:16:43.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:43.955 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.955 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:43.955 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:43.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 52 2023-01-02T18:16:43.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.956 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:43.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:43.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:43.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504931+0000", 2023-01-02T18:16:43.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5480000000000004e-06 2023-01-02T18:16:43.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504938+0000", 2023-01-02T18:16:43.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2118e-05 2023-01-02T18:16:43.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504950+0000", 2023-01-02T18:16:43.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.259e-06 2023-01-02T18:16:43.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504956+0000", 2023-01-02T18:16:43.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1742999999999997e-05 2023-01-02T18:16:43.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504987+0000", 2023-01-02T18:16:43.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3327999999999999e-05 2023-01-02T18:16:43.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505071+0000", 2023-01-02T18:16:43.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012434100000000001 2023-01-02T18:16:43.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:43.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505195+0000", 2023-01-02T18:16:43.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083202299999999999 2023-01-02T18:16:43.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:43.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506027+0000", 2023-01-02T18:16:43.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031725600000000003 2023-01-02T18:16:43.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:43.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506344+0000", 2023-01-02T18:16:43.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9904e-05 2023-01-02T18:16:43.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:43.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506374+0000", 2023-01-02T18:16:43.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9748e-05 2023-01-02T18:16:43.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506414+0000", 2023-01-02T18:16:43.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001 2023-01-02T18:16:43.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.969 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.970 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.970 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:55 3.8 3:105263f9:::rbd_id.image4:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:43.971 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:43.971 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2463294930000002, 2023-01-02T18:16:43.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031460599999999999, 2023-01-02T18:16:43.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.971 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.972 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:43.972 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:43.972 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 55 2023-01-02T18:16:43.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.973 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:43.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:43.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:43.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518037+0000", 2023-01-02T18:16:43.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1866e-05 2023-01-02T18:16:43.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518049+0000", 2023-01-02T18:16:43.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.658e-05 2023-01-02T18:16:43.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518066+0000", 2023-01-02T18:16:43.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9979999999999998e-06 2023-01-02T18:16:43.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518076+0000", 2023-01-02T18:16:43.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8603999999999996e-05 2023-01-02T18:16:43.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518144+0000", 2023-01-02T18:16:43.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000102503 2023-01-02T18:16:43.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518247+0000", 2023-01-02T18:16:43.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106745 2023-01-02T18:16:43.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518354+0000", 2023-01-02T18:16:43.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031460599999999999 2023-01-02T18:16:43.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.982 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.983 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:56 3.8 3:105263f9:::rbd_id.image4:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:43.983 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:43.983 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2459246960000003, 2023-01-02T18:16:43.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000468531, 2023-01-02T18:16:43.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:43.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:43.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:43.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 56 2023-01-02T18:16:43.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.985 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:43.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:43.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:43.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:43.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:43.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518443+0000", 2023-01-02T18:16:43.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7650000000000001e-06 2023-01-02T18:16:43.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:43.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518448+0000", 2023-01-02T18:16:43.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8490000000000006e-06 2023-01-02T18:16:43.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:43.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518456+0000", 2023-01-02T18:16:43.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6070000000000001e-06 2023-01-02T18:16:43.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:43.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518460+0000", 2023-01-02T18:16:43.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7370999999999998e-05 2023-01-02T18:16:43.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:43.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518507+0000", 2023-01-02T18:16:43.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7069000000000002e-05 2023-01-02T18:16:43.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518605+0000", 2023-01-02T18:16:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000307683 2023-01-02T18:16:43.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518912+0000", 2023-01-02T18:16:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000468531 2023-01-02T18:16:43.994 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.995 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:22 3.2 3:47cb2124:::image5.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:43.996 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.534012+0000", 2023-01-02T18:16:43.996 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2303566029999997, 2023-01-02T18:16:43.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021694800000000001, 2023-01-02T18:16:43.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:43.996 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:43.997 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:43.997 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:43.997 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:43.997 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 22 2023-01-02T18:16:43.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.998 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:43.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:43.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534012+0000", 2023-01-02T18:16:43.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:43.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:43.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:43.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:44.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534012+0000", 2023-01-02T18:16:44.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:44.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:44.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534011+0000", 2023-01-02T18:16:44.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3030000000000002e-06 2023-01-02T18:16:44.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:44.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534018+0000", 2023-01-02T18:16:44.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2373e-05 2023-01-02T18:16:44.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534030+0000", 2023-01-02T18:16:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3380000000000001e-06 2023-01-02T18:16:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534037+0000", 2023-01-02T18:16:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7234999999999997e-05 2023-01-02T18:16:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534094+0000", 2023-01-02T18:16:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013479200000000001 2023-01-02T18:16:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534229+0000", 2023-01-02T18:16:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021694800000000001 2023-01-02T18:16:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.17 49/48 [PushOp(3:ece625d0:::rbd_id.image1:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:ece625d0:::rbd_id.image1:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.3259573570000001, 2023-01-02T18:16:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077156600000000001, 2023-01-02T18:16:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:44.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:44.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438410+0000", 2023-01-02T18:16:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6705999999999999e-05 2023-01-02T18:16:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438427+0000", 2023-01-02T18:16:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6349e-05 2023-01-02T18:16:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438473+0000", 2023-01-02T18:16:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2814e-05 2023-01-02T18:16:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438486+0000", 2023-01-02T18:16:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8907999999999997e-05 2023-01-02T18:16:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438565+0000", 2023-01-02T18:16:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7960000000000007e-06 2023-01-02T18:16:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438575+0000", 2023-01-02T18:16:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060776299999999999 2023-01-02T18:16:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.439183+0000", 2023-01-02T18:16:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077156600000000001 2023-01-02T18:16:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPushReply(3.c 49/48 [PushReplyOp(3:34a1c61b:::rbd_object_map.12a24bcb1df7:head)])", 2023-01-02T18:16:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.3164274819999999, 2023-01-02T18:16:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032333900000000002, 2023-01-02T18:16:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4070000000000001e-06 2023-01-02T18:16:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447946+0000", 2023-01-02T18:16:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3749999999999992e-06 2023-01-02T18:16:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447955+0000", 2023-01-02T18:16:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8009999999999998e-06 2023-01-02T18:16:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447962+0000", 2023-01-02T18:16:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0476000000000002e-05 2023-01-02T18:16:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448023+0000", 2023-01-02T18:16:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024165999999999999 2023-01-02T18:16:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448264+0000", 2023-01-02T18:16:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032333900000000002 2023-01-02T18:16:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPushReply(3.2 49/48 [PushReplyOp(3:46824f4d:::rbd_header.11d5388773ee:head)])", 2023-01-02T18:16:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.308948038, 2023-01-02T18:16:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032223899999999999, 2023-01-02T18:16:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1250000000000001e-06 2023-01-02T18:16:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455425+0000", 2023-01-02T18:16:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3523000000000001e-05 2023-01-02T18:16:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455439+0000", 2023-01-02T18:16:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8339999999999999e-06 2023-01-02T18:16:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455446+0000", 2023-01-02T18:16:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1134000000000003e-05 2023-01-02T18:16:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455488+0000", 2023-01-02T18:16:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025502700000000001 2023-01-02T18:16:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455743+0000", 2023-01-02T18:16:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032223899999999999 2023-01-02T18:16:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:268 4.1a e50/47 4:5cea7035:::rbd_info:head v 50'1, mlcod=0'0)", 2023-01-02T18:16:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.32484739400000001, 2023-01-02T18:16:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089829000000000005, 2023-01-02T18:16:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6930000000000007e-06 2023-01-02T18:16:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439528+0000", 2023-01-02T18:16:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3871e-05 2023-01-02T18:16:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439542+0000", 2023-01-02T18:16:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2069999999999995e-06 2023-01-02T18:16:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439550+0000", 2023-01-02T18:16:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2681e-05 2023-01-02T18:16:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439593+0000", 2023-01-02T18:16:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7476999999999999e-05 2023-01-02T18:16:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439611+0000", 2023-01-02T18:16:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077682200000000004 2023-01-02T18:16:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.440387+0000", 2023-01-02T18:16:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1906000000000003e-05 2023-01-02T18:16:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.440419+0000", 2023-01-02T18:16:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089829000000000005 2023-01-02T18:16:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:44.051 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:44.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:44.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:44.054 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:44.053+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:44.153 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:44.154+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:44.193 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:44.193 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:44.194 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:44.194 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:44.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:44.236 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:44.253 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:44.254 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:44.255+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:44.271 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:44.288 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:44.312 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:44.316 INFO:tasks.workunit.client.0.smithi007.stdout:image: image18 2023-01-02T18:16:44.317 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image18 2023-01-02T18:16:44.317 INFO:tasks.workunit.client.0.smithi007.stdout:found image18 2023-01-02T18:16:44.317 INFO:tasks.workunit.client.0.smithi007.stdout:erased image18 2023-01-02T18:16:44.317 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:44.331 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:44.335 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:44.336 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:44.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:44.351 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:44.370 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:44.371 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:44.372 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:44.372 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:44.372 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:44.372 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:44.372 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:44.373 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:44.373 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:44.391 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:44.392+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:44.401 INFO:tasks.workunit.client.0.smithi007.stdout:image: image18 2023-01-02T18:16:44.402 INFO:tasks.workunit.client.0.smithi007.stdout:image: image19 2023-01-02T18:16:44.402 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image18 2023-01-02T18:16:44.402 INFO:tasks.workunit.client.0.smithi007.stdout:found image18 2023-01-02T18:16:44.402 INFO:tasks.workunit.client.0.smithi007.stdout:erased image18 2023-01-02T18:16:44.402 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image19 2023-01-02T18:16:44.402 INFO:tasks.workunit.client.0.smithi007.stdout:found image19 2023-01-02T18:16:44.403 INFO:tasks.workunit.client.0.smithi007.stdout:erased image19 2023-01-02T18:16:44.403 INFO:tasks.workunit.client.0.smithi007.stdout:image: image19 2023-01-02T18:16:44.403 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image19 2023-01-02T18:16:44.403 INFO:tasks.workunit.client.0.smithi007.stdout:found image19 2023-01-02T18:16:44.403 INFO:tasks.workunit.client.0.smithi007.stdout:erased image19 2023-01-02T18:16:44.404 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestCreateLsDelete (4549 ms) 2023-01-02T18:16:44.404 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestCreateLsDeletePP 2023-01-02T18:16:44.454 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:16:44.456 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:44.457+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:44.476 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:44.476 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:44.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:44.570 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:44.571+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:44.653 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:44.654 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:44.658 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:44.659+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:44.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:44.759 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:44.760+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:44.828 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:44.829 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:44.838 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:44.882 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:44.883+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:44.961 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:44.962+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:44.964 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:44.964 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:44.974 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:45.062 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:45.063+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:45.139 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:45.140 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:45.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:45.192 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:45.193+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:45.263 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:45.264+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:45.274 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:45.274 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:45.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:45.308 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:16:45.366 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:45.367+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:45.449 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:45.450 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:45.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:45.464 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:45.465+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:45.565 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:45.566+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:45.627 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:45.627 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:45.637 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:45.667 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:45.667+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:45.762 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:45.762 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:45.767 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:45.768+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:45.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:45.868 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:45.869+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:45.937 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:45.937 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:45.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:45.968 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:45.969+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:46.069 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:46.070+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:46.086 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:46.087 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:46.097 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:46.181 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:46.182+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:46.263 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:46.263 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:46.270 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:46.271+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:46.272 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:46.312 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:46.371 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:46.372+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:46.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:46.441 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:46.442 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:46.452 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:46.464 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 6, 7] out_osds: [5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:46.465 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:46.465 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 4, 6, 7] 2023-01-02T18:16:46.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2023-01-02T18:16:46.472 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:46.472+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:46.530 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:46.550 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:46.567 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:46.573 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:46.573+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:46.583 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:46.583 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:46.583 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:46.584 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:46.586 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:46.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:46.605 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:46.626 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:46.645 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:46.663 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:46.665 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:46.666 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:46.674 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:46.674+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:46.734 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:46.734 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:46.735 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:46.735 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:46.744 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:46.775 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:46.775+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:46.819 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-01-02T18:16:46.819+0000 7fe18f96e700 -1 mon.a@0(leader).osd e53 definitely_dead 0 2023-01-02T18:16:46.870 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:46.871 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:46.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:46.871 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:46.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.871 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:6 3.1a e45/43 3:5cea7035:::rbd_info:head v 45'1, mlcod=0'0)", 2023-01-02T18:16:46.872 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:46.872 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4535346790000006, 2023-01-02T18:16:46.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998, 2023-01-02T18:16:46.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:46.873 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:46.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:46.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:16:46.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:46.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3349999999999997e-06 2023-01-02T18:16:46.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417398+0000", 2023-01-02T18:16:46.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7995999999999998e-05 2023-01-02T18:16:46.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417416+0000", 2023-01-02T18:16:46.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2250000000000003e-06 2023-01-02T18:16:46.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417423+0000", 2023-01-02T18:16:46.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6785e-05 2023-01-02T18:16:46.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417470+0000", 2023-01-02T18:16:46.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2886000000000001e-05 2023-01-02T18:16:46.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:46.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417492+0000", 2023-01-02T18:16:46.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070370800000000005 2023-01-02T18:16:46.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:46.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418196+0000", 2023-01-02T18:16:46.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1628999999999998e-05 2023-01-02T18:16:46.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:46.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418228+0000", 2023-01-02T18:16:46.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998 2023-01-02T18:16:46.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.889 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:46.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.891 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:46.891 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:46.891 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.4469601079999999, 2023-01-02T18:16:46.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:16:46.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:46.893 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:46.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:46.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:46.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:46.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:16:46.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:16:46.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:16:46.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:16:46.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:16:46.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:16:46.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:16:46.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:16:46.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:16:46.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:46.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:16:46.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:16:46.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:46.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:16:46.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:16:46.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:46.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:16:46.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:16:46.906 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.906 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:46.907 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.907 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2 3.4 3:267905b2:::rbd_id.image3:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:46.907 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:46.908 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.3928104550000002, 2023-01-02T18:16:46.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018677900000000001, 2023-01-02T18:16:46.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:46.908 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:46.908 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:46.909 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:46.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2023-01-02T18:16:46.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.909 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:46.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:46.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:46.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478116+0000", 2023-01-02T18:16:46.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2775999999999999e-05 2023-01-02T18:16:46.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478129+0000", 2023-01-02T18:16:46.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.361e-05 2023-01-02T18:16:46.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478142+0000", 2023-01-02T18:16:46.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6750000000000001e-05 2023-01-02T18:16:46.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478159+0000", 2023-01-02T18:16:46.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4184999999999997e-05 2023-01-02T18:16:46.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478213+0000", 2023-01-02T18:16:46.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0367999999999999e-05 2023-01-02T18:16:46.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:46.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478303+0000", 2023-01-02T18:16:46.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018677900000000001 2023-01-02T18:16:46.917 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.917 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:46.917 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.918 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:46.918 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:46.918 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.3877604000000003, 2023-01-02T18:16:46.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:16:46.919 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.919 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:46.919 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:46.919 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:46.919 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:46.920 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:16:46.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.920 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:46.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:46.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:46.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:16:46.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:16:46.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:16:46.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:16:46.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:16:46.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:16:46.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:16:46.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:16:46.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:16:46.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:16:46.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:46.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:16:46.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:16:46.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:16:46.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:16:46.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:16:46.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:46.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:16:46.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:16:46.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:46.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:16:46.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:16:46.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:46.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:16:46.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:16:46.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:46.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:16:46.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:16:46.933 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.933 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:46.933 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.934 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4565.0:6 3.4 e46/43 ondisk, result = 0)", 2023-01-02T18:16:46.934 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.484598+0000", 2023-01-02T18:16:46.934 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.3863291249999996, 2023-01-02T18:16:46.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136199999999999, 2023-01-02T18:16:46.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:46.935 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484598+0000", 2023-01-02T18:16:46.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484598+0000", 2023-01-02T18:16:46.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:46.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484597+0000", 2023-01-02T18:16:46.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.916e-06 2023-01-02T18:16:46.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484602+0000", 2023-01-02T18:16:46.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.081e-06 2023-01-02T18:16:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484611+0000", 2023-01-02T18:16:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7029999999999997e-06 2023-01-02T18:16:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484616+0000", 2023-01-02T18:16:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4335000000000002e-05 2023-01-02T18:16:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484650+0000", 2023-01-02T18:16:46.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8980000000000004e-06 2023-01-02T18:16:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484655+0000", 2023-01-02T18:16:46.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4293000000000001e-05 2023-01-02T18:16:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484739+0000", 2023-01-02T18:16:46.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014136199999999999 2023-01-02T18:16:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:9 3.4 3:267905b2:::rbd_id.image3:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.3791374809999999, 2023-01-02T18:16:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027154600000000001, 2023-01-02T18:16:46.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:46.949 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 9 2023-01-02T18:16:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491788+0000", 2023-01-02T18:16:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6080000000000002e-06 2023-01-02T18:16:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491797+0000", 2023-01-02T18:16:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7750000000000001e-05 2023-01-02T18:16:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491815+0000", 2023-01-02T18:16:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6790000000000005e-06 2023-01-02T18:16:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491823+0000", 2023-01-02T18:16:46.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3060999999999999e-05 2023-01-02T18:16:46.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491876+0000", 2023-01-02T18:16:46.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.009e-05 2023-01-02T18:16:46.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:46.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491966+0000", 2023-01-02T18:16:46.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5279999999999996e-05 2023-01-02T18:16:46.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:46.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492061+0000", 2023-01-02T18:16:46.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027154600000000001 2023-01-02T18:16:46.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.961 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:46.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.962 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:10 3.4 3:267905b2:::rbd_id.image3:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:46.963 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:46.963 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.3787618799999999, 2023-01-02T18:16:46.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040530900000000002, 2023-01-02T18:16:46.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:46.964 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:46.964 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:46.965 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:46.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 10 2023-01-02T18:16:46.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.966 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:46.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:46.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:46.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492164+0000", 2023-01-02T18:16:46.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7980000000000006e-06 2023-01-02T18:16:46.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492172+0000", 2023-01-02T18:16:46.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:16:46.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492186+0000", 2023-01-02T18:16:46.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0129999999999993e-06 2023-01-02T18:16:46.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492194+0000", 2023-01-02T18:16:46.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0227e-05 2023-01-02T18:16:46.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492235+0000", 2023-01-02T18:16:46.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0649000000000007e-05 2023-01-02T18:16:46.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:46.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492315+0000", 2023-01-02T18:16:46.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000255271 2023-01-02T18:16:46.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:46.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492571+0000", 2023-01-02T18:16:46.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040530900000000002 2023-01-02T18:16:46.976 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.976 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:46.976 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.977 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.16 49/48 [PushOp(3:6b9a211e:::rbd_id.image12:head, version: 46'1, data_included: [0~15], data_size: 15, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b9a211e:::rbd_id.image12:head@46'1, size: 15, copy_subset: [0~15], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:15, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:46.977 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:46.977 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.426710538, 2023-01-02T18:16:46.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044365099999999998, 2023-01-02T18:16:46.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:46.978 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:46.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:46.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:46.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444215+0000", 2023-01-02T18:16:46.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.014e-05 2023-01-02T18:16:46.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444235+0000", 2023-01-02T18:16:46.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3300999999999999e-05 2023-01-02T18:16:46.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444258+0000", 2023-01-02T18:16:46.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.278e-05 2023-01-02T18:16:46.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444271+0000", 2023-01-02T18:16:46.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9231000000000003e-05 2023-01-02T18:16:46.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444330+0000", 2023-01-02T18:16:46.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0796e-05 2023-01-02T18:16:46.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:46.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444341+0000", 2023-01-02T18:16:46.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031950400000000002 2023-01-02T18:16:46.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:46.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444660+0000", 2023-01-02T18:16:46.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044365099999999998 2023-01-02T18:16:46.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.987 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:46.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:46.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.988 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3d3f3250:::rbd_id.image2:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d3f3250:::rbd_id.image2:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:46.988 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:46.988 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4235346350000002, 2023-01-02T18:16:46.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004, 2023-01-02T18:16:46.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:46.989 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:46.989 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:46.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:46.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:46.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:46.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:46.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:46.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:46.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:46.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447391+0000", 2023-01-02T18:16:46.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8275e-05 2023-01-02T18:16:46.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:46.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447410+0000", 2023-01-02T18:16:46.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3377999999999999e-05 2023-01-02T18:16:46.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:46.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447433+0000", 2023-01-02T18:16:46.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6303e-05 2023-01-02T18:16:46.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:46.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447449+0000", 2023-01-02T18:16:46.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000438212 2023-01-02T18:16:46.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:46.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447888+0000", 2023-01-02T18:16:46.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.169e-05 2023-01-02T18:16:46.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:46.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:46.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:47.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447899+0000", 2023-01-02T18:16:47.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035861500000000001 2023-01-02T18:16:47.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:47.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448258+0000", 2023-01-02T18:16:47.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004 2023-01-02T18:16:47.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.001 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.002 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3831950c:::rbd_directory:head, version: 46'16, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 30, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3831950c:::rbd_directory:head@46'16, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:47.002 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:47.002 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4212047869999997, 2023-01-02T18:16:47.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048506899999999997, 2023-01-02T18:16:47.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:47.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:47.003 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:47.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:47.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:47.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:47.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:47.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:47.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:47.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:47.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449721+0000", 2023-01-02T18:16:47.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8507e-05 2023-01-02T18:16:47.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:47.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449749+0000", 2023-01-02T18:16:47.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1554999999999999e-05 2023-01-02T18:16:47.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:47.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449771+0000", 2023-01-02T18:16:47.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1626e-05 2023-01-02T18:16:47.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:47.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449783+0000", 2023-01-02T18:16:47.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6056999999999994e-05 2023-01-02T18:16:47.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:47.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449859+0000", 2023-01-02T18:16:47.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1284000000000001e-05 2023-01-02T18:16:47.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:47.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449870+0000", 2023-01-02T18:16:47.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000337447 2023-01-02T18:16:47.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:47.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.450207+0000", 2023-01-02T18:16:47.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048506899999999997 2023-01-02T18:16:47.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.012 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.013 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3f5a2831:::rbd_object_map.11d52421ce09:head, version: 46'21, data_included: [0~35], data_size: 35, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(3:3f5a2831:::rbd_object_map.11d52421ce09:head@46'21, size: 35, copy_subset: [0~35], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:35, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:47.013 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:47.013 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4193559599999999, 2023-01-02T18:16:47.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036462199999999999, 2023-01-02T18:16:47.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:47.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:47.014 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:47.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:47.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:47.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:47.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:47.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:47.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:47.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:47.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451570+0000", 2023-01-02T18:16:47.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3141e-05 2023-01-02T18:16:47.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:47.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451584+0000", 2023-01-02T18:16:47.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5398000000000001e-05 2023-01-02T18:16:47.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:47.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451599+0000", 2023-01-02T18:16:47.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.011e-06 2023-01-02T18:16:47.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:47.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451607+0000", 2023-01-02T18:16:47.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9302000000000003e-05 2023-01-02T18:16:47.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:47.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451656+0000", 2023-01-02T18:16:47.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:16:47.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:47.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451662+0000", 2023-01-02T18:16:47.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027369500000000001 2023-01-02T18:16:47.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:47.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451936+0000", 2023-01-02T18:16:47.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036462199999999999 2023-01-02T18:16:47.025 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.025 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.025 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.026 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.026 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:47.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:47.030 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:47.029+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:47.129 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:47.130+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:47.195 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:47.196 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:47.196 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:47.196 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:47.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:47.250 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:47.251+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:47.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:16:47.324 INFO:teuthology.orchestra.run.smithi007.stderr:marked out osd.4. 2023-01-02T18:16:47.331 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:47.331+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:47.342 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:47.342 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:47.342 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:47.342 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:47.343 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:47.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:47.432 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:47.432+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:47.525 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:47.525 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:47.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:47.526 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:47.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.526 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:47.526 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:47.526 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.0422967619999994, 2023-01-02T18:16:47.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:16:47.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:47.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:47.527 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:47.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:47.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:47.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:47.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:47.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:47.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:47.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:47.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:16:47.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:16:47.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:47.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:16:47.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:16:47.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:47.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:16:47.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:16:47.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:47.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:16:47.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:16:47.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:47.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:16:47.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:16:47.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:47.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:16:47.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:16:47.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:47.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:16:47.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:16:47.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:47.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:16:47.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:16:47.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.537 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.538 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.5 49/48 [PushOp(3:a56581c2:::rbd_id.image9:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:a56581c2:::rbd_id.image9:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:47.538 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:47.538 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.0637045169999997, 2023-01-02T18:16:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001, 2023-01-02T18:16:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:47.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462256+0000", 2023-01-02T18:16:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1099e-05 2023-01-02T18:16:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:47.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462268+0000", 2023-01-02T18:16:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4336e-05 2023-01-02T18:16:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:47.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462282+0000", 2023-01-02T18:16:47.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1552000000000001e-05 2023-01-02T18:16:47.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:47.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462293+0000", 2023-01-02T18:16:47.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1749999999999998e-05 2023-01-02T18:16:47.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:47.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462335+0000", 2023-01-02T18:16:47.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1909999999999999e-06 2023-01-02T18:16:47.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:47.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462340+0000", 2023-01-02T18:16:47.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029615499999999999 2023-01-02T18:16:47.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:47.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462637+0000", 2023-01-02T18:16:47.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001 2023-01-02T18:16:47.548 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.548 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.548 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.548 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.549 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.549 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:47.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:47.551 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:47.550+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:47.651 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:47.652+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:47.677 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:47.677 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:47.677 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:47.677 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:47.687 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:47.752 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:47.753+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:47.812 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:47.812 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:47.812 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:47.812 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:47.813 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:47.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:47.866 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:47.867+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:47.949 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:47.949 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:47.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4200.0:2 2.1 2:88c1567c:::rbd_trash_purge_schedule:head [omap-get-vals] snapc 0=[] ondisk+read+known_if_redirected e41)", 2023-01-02T18:16:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:34.548654+0000", 2023-01-02T18:16:47.950 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.399998195, 2023-01-02T18:16:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023200099999999999, 2023-01-02T18:16:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:47.951 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4200", 2023-01-02T18:16:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:16:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2023-01-02T18:16:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:47.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:47.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548654+0000", 2023-01-02T18:16:47.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:47.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548654+0000", 2023-01-02T18:16:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:47.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548652+0000", 2023-01-02T18:16:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6000000000000001e-06 2023-01-02T18:16:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:47.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548659+0000", 2023-01-02T18:16:47.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:16:47.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:47.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548670+0000", 2023-01-02T18:16:47.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2060000000000007e-06 2023-01-02T18:16:47.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548679+0000", 2023-01-02T18:16:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4505000000000007e-05 2023-01-02T18:16:47.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:47.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548743+0000", 2023-01-02T18:16:47.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014263599999999999 2023-01-02T18:16:47.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:47.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:34.548886+0000", 2023-01-02T18:16:47.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023200099999999999 2023-01-02T18:16:47.963 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.963 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.964 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.965 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:47.965 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:47.965 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.5128029779999999, 2023-01-02T18:16:47.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:16:47.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:47.966 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:47.966 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:47.967 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:47.967 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:47.967 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:16:47.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.967 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:47.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:47.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:47.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:47.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:47.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:47.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:47.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:47.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:16:47.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:16:47.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:47.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:16:47.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:16:47.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:16:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:16:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:47.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:16:47.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:16:47.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:16:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:16:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:16:47.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:16:47.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:16:47.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:16:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:16:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:47.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:16:47.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:16:47.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:47.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:16:47.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:16:47.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:16:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:16:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:47.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:16:47.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:16:47.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:47.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:16:47.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:16:47.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:47.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:16:47.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:16:47.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.982 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.982 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.983 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:47.983 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:47.983 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4634179849999995, 2023-01-02T18:16:47.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:16:47.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:47.984 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:47.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:47.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:47.984 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:16:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:47.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:16:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:16:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:16:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:16:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:16:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:16:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:16:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:16:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:16:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:16:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:16:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:16:47.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:16:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:16:47.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:16:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:16:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:16:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:16:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:16:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:16:47.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:16:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:16:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.998 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:47.999 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4565.0:7 3.1e e46/43 ondisk, result = 0)", 2023-01-02T18:16:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.486789+0000", 2023-01-02T18:16:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4618628180000002, 2023-01-02T18:16:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021320200000000001, 2023-01-02T18:16:48.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486789+0000", 2023-01-02T18:16:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486789+0000", 2023-01-02T18:16:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486788+0000", 2023-01-02T18:16:48.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9319999999999999e-06 2023-01-02T18:16:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486795+0000", 2023-01-02T18:16:48.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4531e-05 2023-01-02T18:16:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486809+0000", 2023-01-02T18:16:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9409999999999996e-06 2023-01-02T18:16:48.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486818+0000", 2023-01-02T18:16:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7644e-05 2023-01-02T18:16:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486866+0000", 2023-01-02T18:16:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1919999999999994e-06 2023-01-02T18:16:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486875+0000", 2023-01-02T18:16:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127362 2023-01-02T18:16:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487002+0000", 2023-01-02T18:16:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021320200000000001 2023-01-02T18:16:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:8 3.18 3:1e96267a:::rbd_object_map.11d585d3810a:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:48.015 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4616081259999998, 2023-01-02T18:16:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087, 2023-01-02T18:16:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 8 2023-01-02T18:16:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487043+0000", 2023-01-02T18:16:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6100000000000002e-06 2023-01-02T18:16:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487049+0000", 2023-01-02T18:16:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:16:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487064+0000", 2023-01-02T18:16:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3280000000000006e-06 2023-01-02T18:16:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487072+0000", 2023-01-02T18:16:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5221e-05 2023-01-02T18:16:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487117+0000", 2023-01-02T18:16:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7274000000000005e-05 2023-01-02T18:16:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487204+0000", 2023-01-02T18:16:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013400700000000001 2023-01-02T18:16:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2023-01-02T18:16:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487338+0000", 2023-01-02T18:16:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083414299999999997 2023-01-02T18:16:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488173+0000", 2023-01-02T18:16:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020278700000000001 2023-01-02T18:16:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488375+0000", 2023-01-02T18:16:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6679999999999999e-05 2023-01-02T18:16:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:48.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488432+0000", 2023-01-02T18:16:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6842000000000003e-05 2023-01-02T18:16:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488479+0000", 2023-01-02T18:16:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087 2023-01-02T18:16:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.030 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:11 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4559702269999999, 2023-01-02T18:16:48.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00043998300000000002, 2023-01-02T18:16:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.032 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 11 2023-01-02T18:16:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492680+0000", 2023-01-02T18:16:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6859999999999995e-06 2023-01-02T18:16:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492689+0000", 2023-01-02T18:16:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6410999999999999e-05 2023-01-02T18:16:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492705+0000", 2023-01-02T18:16:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2620000000000001e-06 2023-01-02T18:16:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492712+0000", 2023-01-02T18:16:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0547000000000002e-05 2023-01-02T18:16:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492763+0000", 2023-01-02T18:16:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2423000000000006e-05 2023-01-02T18:16:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492855+0000", 2023-01-02T18:16:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026637399999999999 2023-01-02T18:16:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493122+0000", 2023-01-02T18:16:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00043998300000000002 2023-01-02T18:16:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:13 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call,call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4551448790000006, 2023-01-02T18:16:48.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035003500000000001, 2023-01-02T18:16:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.044 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 13 2023-01-02T18:16:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493506+0000", 2023-01-02T18:16:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7309999999999993e-06 2023-01-02T18:16:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493513+0000", 2023-01-02T18:16:48.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4613999999999999e-05 2023-01-02T18:16:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493528+0000", 2023-01-02T18:16:48.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9720000000000003e-06 2023-01-02T18:16:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493535+0000", 2023-01-02T18:16:48.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4150000000000003e-05 2023-01-02T18:16:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493579+0000", 2023-01-02T18:16:48.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3683000000000005e-05 2023-01-02T18:16:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493663+0000", 2023-01-02T18:16:48.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000194124 2023-01-02T18:16:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493857+0000", 2023-01-02T18:16:48.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035003500000000001 2023-01-02T18:16:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.054 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:15 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4541332239999996, 2023-01-02T18:16:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056168199999999998, 2023-01-02T18:16:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 15 2023-01-02T18:16:48.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:48.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494517+0000", 2023-01-02T18:16:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5499999999999997e-06 2023-01-02T18:16:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494525+0000", 2023-01-02T18:16:48.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5101e-05 2023-01-02T18:16:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494540+0000", 2023-01-02T18:16:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3910000000000003e-06 2023-01-02T18:16:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494547+0000", 2023-01-02T18:16:48.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3065000000000002e-05 2023-01-02T18:16:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494590+0000", 2023-01-02T18:16:48.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0383999999999994e-05 2023-01-02T18:16:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494680+0000", 2023-01-02T18:16:48.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040034000000000001 2023-01-02T18:16:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495080+0000", 2023-01-02T18:16:48.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056168199999999998 2023-01-02T18:16:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:16 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4534711710000003, 2023-01-02T18:16:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030933600000000001, 2023-01-02T18:16:48.070 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.071 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16 2023-01-02T18:16:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495179+0000", 2023-01-02T18:16:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6599999999999998e-06 2023-01-02T18:16:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495186+0000", 2023-01-02T18:16:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4070000000000001e-05 2023-01-02T18:16:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495200+0000", 2023-01-02T18:16:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9140000000000002e-06 2023-01-02T18:16:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495207+0000", 2023-01-02T18:16:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3915999999999999e-05 2023-01-02T18:16:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495241+0000", 2023-01-02T18:16:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3961000000000001e-05 2023-01-02T18:16:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495295+0000", 2023-01-02T18:16:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019502899999999999 2023-01-02T18:16:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495490+0000", 2023-01-02T18:16:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030933600000000001 2023-01-02T18:16:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:17 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.495585+0000", 2023-01-02T18:16:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4530672080000002, 2023-01-02T18:16:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029335199999999998, 2023-01-02T18:16:48.082 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 17 2023-01-02T18:16:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495585+0000", 2023-01-02T18:16:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495585+0000", 2023-01-02T18:16:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495584+0000", 2023-01-02T18:16:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4910000000000002e-06 2023-01-02T18:16:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495590+0000", 2023-01-02T18:16:48.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.482e-05 2023-01-02T18:16:48.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495605+0000", 2023-01-02T18:16:48.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0001e-05 2023-01-02T18:16:48.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495615+0000", 2023-01-02T18:16:48.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4645999999999999e-05 2023-01-02T18:16:48.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495660+0000", 2023-01-02T18:16:48.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3973000000000004e-05 2023-01-02T18:16:48.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495743+0000", 2023-01-02T18:16:48.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013452399999999999 2023-01-02T18:16:48.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495878+0000", 2023-01-02T18:16:48.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029335199999999998 2023-01-02T18:16:48.093 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.093 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.093 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.094 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:20 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [watch watch cookie 140114919540112] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:48.094 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:48.094 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4515426429999998, 2023-01-02T18:16:48.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013849540000000001, 2023-01-02T18:16:48.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.095 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.095 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.096 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.096 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 20 2023-01-02T18:16:48.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.096 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:48.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:48.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497108+0000", 2023-01-02T18:16:48.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6219999999999997e-06 2023-01-02T18:16:48.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497114+0000", 2023-01-02T18:16:48.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4440000000000001e-05 2023-01-02T18:16:48.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497128+0000", 2023-01-02T18:16:48.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6989999999999997e-06 2023-01-02T18:16:48.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497135+0000", 2023-01-02T18:16:48.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8272999999999998e-05 2023-01-02T18:16:48.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497173+0000", 2023-01-02T18:16:48.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5973000000000002e-05 2023-01-02T18:16:48.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497219+0000", 2023-01-02T18:16:48.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010911 2023-01-02T18:16:48.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:48.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497328+0000", 2023-01-02T18:16:48.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051081399999999995 2023-01-02T18:16:48.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497839+0000", 2023-01-02T18:16:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057482300000000002 2023-01-02T18:16:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498414+0000", 2023-01-02T18:16:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7160000000000003e-05 2023-01-02T18:16:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498451+0000", 2023-01-02T18:16:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2978000000000001e-05 2023-01-02T18:16:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498494+0000", 2023-01-02T18:16:48.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013849540000000001 2023-01-02T18:16:48.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.109 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.110 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:21 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [watch unwatch cookie 140114919540112] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:48.110 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:48.111 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4499884900000009, 2023-01-02T18:16:48.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011449139999999999, 2023-01-02T18:16:48.111 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.111 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.111 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.112 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.112 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.112 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 21 2023-01-02T18:16:48.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.112 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:48.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:48.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:48.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498662+0000", 2023-01-02T18:16:48.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9529999999999999e-06 2023-01-02T18:16:48.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498670+0000", 2023-01-02T18:16:48.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5307000000000001e-05 2023-01-02T18:16:48.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498685+0000", 2023-01-02T18:16:48.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1289999999999998e-06 2023-01-02T18:16:48.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498692+0000", 2023-01-02T18:16:48.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1134999999999999e-05 2023-01-02T18:16:48.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498723+0000", 2023-01-02T18:16:48.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3186999999999998e-05 2023-01-02T18:16:48.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498767+0000", 2023-01-02T18:16:48.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4067000000000006e-05 2023-01-02T18:16:48.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:48.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498861+0000", 2023-01-02T18:16:48.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036586499999999999 2023-01-02T18:16:48.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:48.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499226+0000", 2023-01-02T18:16:48.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000519073 2023-01-02T18:16:48.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499746+0000", 2023-01-02T18:16:48.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6923e-05 2023-01-02T18:16:48.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:48.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499772+0000", 2023-01-02T18:16:48.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5809000000000002e-05 2023-01-02T18:16:48.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499808+0000", 2023-01-02T18:16:48.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011449139999999999 2023-01-02T18:16:48.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.127 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.127 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.127 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:52 3.8 3:105263f9:::rbd_id.image4:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:48.128 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:48.128 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4437201210000001, 2023-01-02T18:16:48.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001, 2023-01-02T18:16:48.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.128 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.129 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:48.129 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.129 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 52 2023-01-02T18:16:48.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.130 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:48.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:48.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504931+0000", 2023-01-02T18:16:48.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5480000000000004e-06 2023-01-02T18:16:48.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504938+0000", 2023-01-02T18:16:48.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2118e-05 2023-01-02T18:16:48.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504950+0000", 2023-01-02T18:16:48.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.259e-06 2023-01-02T18:16:48.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504956+0000", 2023-01-02T18:16:48.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1742999999999997e-05 2023-01-02T18:16:48.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504987+0000", 2023-01-02T18:16:48.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3327999999999999e-05 2023-01-02T18:16:48.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505071+0000", 2023-01-02T18:16:48.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012434100000000001 2023-01-02T18:16:48.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:48.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505195+0000", 2023-01-02T18:16:48.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083202299999999999 2023-01-02T18:16:48.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:48.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506027+0000", 2023-01-02T18:16:48.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031725600000000003 2023-01-02T18:16:48.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506344+0000", 2023-01-02T18:16:48.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9904e-05 2023-01-02T18:16:48.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:48.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506374+0000", 2023-01-02T18:16:48.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9748e-05 2023-01-02T18:16:48.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506414+0000", 2023-01-02T18:16:48.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001 2023-01-02T18:16:48.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.145 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.146 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.147 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:55 3.8 3:105263f9:::rbd_id.image4:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:48.147 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:48.147 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4306129439999999, 2023-01-02T18:16:48.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031460599999999999, 2023-01-02T18:16:48.148 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.148 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.149 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:48.149 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.149 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 55 2023-01-02T18:16:48.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.150 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:48.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:48.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:48.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518037+0000", 2023-01-02T18:16:48.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1866e-05 2023-01-02T18:16:48.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518049+0000", 2023-01-02T18:16:48.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.658e-05 2023-01-02T18:16:48.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518066+0000", 2023-01-02T18:16:48.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9979999999999998e-06 2023-01-02T18:16:48.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518076+0000", 2023-01-02T18:16:48.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8603999999999996e-05 2023-01-02T18:16:48.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518144+0000", 2023-01-02T18:16:48.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000102503 2023-01-02T18:16:48.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518247+0000", 2023-01-02T18:16:48.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106745 2023-01-02T18:16:48.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518354+0000", 2023-01-02T18:16:48.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031460599999999999 2023-01-02T18:16:48.159 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.159 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.159 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.160 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:56 3.8 3:105263f9:::rbd_id.image4:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:48.160 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:48.160 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4302081470000001, 2023-01-02T18:16:48.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000468531, 2023-01-02T18:16:48.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.161 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.161 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.161 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:48.162 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 56 2023-01-02T18:16:48.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.162 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:48.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:48.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518443+0000", 2023-01-02T18:16:48.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7650000000000001e-06 2023-01-02T18:16:48.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518448+0000", 2023-01-02T18:16:48.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8490000000000006e-06 2023-01-02T18:16:48.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518456+0000", 2023-01-02T18:16:48.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6070000000000001e-06 2023-01-02T18:16:48.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518460+0000", 2023-01-02T18:16:48.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7370999999999998e-05 2023-01-02T18:16:48.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518507+0000", 2023-01-02T18:16:48.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7069000000000002e-05 2023-01-02T18:16:48.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518605+0000", 2023-01-02T18:16:48.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000307683 2023-01-02T18:16:48.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518912+0000", 2023-01-02T18:16:48.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000468531 2023-01-02T18:16:48.172 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.172 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.172 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.173 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:22 3.2 3:47cb2124:::image5.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:48.173 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.534012+0000", 2023-01-02T18:16:48.173 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4146400539999995, 2023-01-02T18:16:48.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021694800000000001, 2023-01-02T18:16:48.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.174 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:48.174 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:48.175 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:48.175 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:48.175 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 22 2023-01-02T18:16:48.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.175 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534012+0000", 2023-01-02T18:16:48.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534012+0000", 2023-01-02T18:16:48.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534011+0000", 2023-01-02T18:16:48.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3030000000000002e-06 2023-01-02T18:16:48.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534018+0000", 2023-01-02T18:16:48.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2373e-05 2023-01-02T18:16:48.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534030+0000", 2023-01-02T18:16:48.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3380000000000001e-06 2023-01-02T18:16:48.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534037+0000", 2023-01-02T18:16:48.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7234999999999997e-05 2023-01-02T18:16:48.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534094+0000", 2023-01-02T18:16:48.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013479200000000001 2023-01-02T18:16:48.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.534229+0000", 2023-01-02T18:16:48.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021694800000000001 2023-01-02T18:16:48.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.184 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.185 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.17 49/48 [PushOp(3:ece625d0:::rbd_id.image1:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:ece625d0:::rbd_id.image1:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:48.185 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:48.185 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.5102408079999998, 2023-01-02T18:16:48.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077156600000000001, 2023-01-02T18:16:48.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:48.186 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:48.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:48.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438410+0000", 2023-01-02T18:16:48.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6705999999999999e-05 2023-01-02T18:16:48.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438427+0000", 2023-01-02T18:16:48.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6349e-05 2023-01-02T18:16:48.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438473+0000", 2023-01-02T18:16:48.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2814e-05 2023-01-02T18:16:48.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438486+0000", 2023-01-02T18:16:48.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8907999999999997e-05 2023-01-02T18:16:48.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438565+0000", 2023-01-02T18:16:48.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7960000000000007e-06 2023-01-02T18:16:48.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438575+0000", 2023-01-02T18:16:48.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060776299999999999 2023-01-02T18:16:48.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.439183+0000", 2023-01-02T18:16:48.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077156600000000001 2023-01-02T18:16:48.196 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.196 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.196 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.197 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPushReply(3.c 49/48 [PushReplyOp(3:34a1c61b:::rbd_object_map.12a24bcb1df7:head)])", 2023-01-02T18:16:48.197 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:48.197 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.5007109329999997, 2023-01-02T18:16:48.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032333900000000002, 2023-01-02T18:16:48.198 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.198 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:48.198 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:48.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:48.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:48.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:48.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4070000000000001e-06 2023-01-02T18:16:48.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447946+0000", 2023-01-02T18:16:48.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3749999999999992e-06 2023-01-02T18:16:48.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447955+0000", 2023-01-02T18:16:48.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8009999999999998e-06 2023-01-02T18:16:48.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447962+0000", 2023-01-02T18:16:48.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0476000000000002e-05 2023-01-02T18:16:48.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448023+0000", 2023-01-02T18:16:48.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024165999999999999 2023-01-02T18:16:48.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448264+0000", 2023-01-02T18:16:48.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032333900000000002 2023-01-02T18:16:48.209 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.209 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.209 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.210 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPushReply(3.2 49/48 [PushReplyOp(3:46824f4d:::rbd_header.11d5388773ee:head)])", 2023-01-02T18:16:48.211 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:48.211 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.4932314890000002, 2023-01-02T18:16:48.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032223899999999999, 2023-01-02T18:16:48.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:48.212 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:48.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:48.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:48.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:48.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1250000000000001e-06 2023-01-02T18:16:48.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455425+0000", 2023-01-02T18:16:48.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3523000000000001e-05 2023-01-02T18:16:48.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455439+0000", 2023-01-02T18:16:48.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8339999999999999e-06 2023-01-02T18:16:48.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455446+0000", 2023-01-02T18:16:48.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1134000000000003e-05 2023-01-02T18:16:48.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455488+0000", 2023-01-02T18:16:48.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025502700000000001 2023-01-02T18:16:48.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455743+0000", 2023-01-02T18:16:48.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032223899999999999 2023-01-02T18:16:48.220 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.220 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.221 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.221 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:268 4.1a e50/47 4:5cea7035:::rbd_info:head v 50'1, mlcod=0'0)", 2023-01-02T18:16:48.222 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:48.222 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.5091308449999996, 2023-01-02T18:16:48.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089829000000000005, 2023-01-02T18:16:48.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:48.222 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.222 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:48.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:48.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:48.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:48.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:48.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:48.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:48.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:48.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:48.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6930000000000007e-06 2023-01-02T18:16:48.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:48.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439528+0000", 2023-01-02T18:16:48.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3871e-05 2023-01-02T18:16:48.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:48.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439542+0000", 2023-01-02T18:16:48.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2069999999999995e-06 2023-01-02T18:16:48.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439550+0000", 2023-01-02T18:16:48.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2681e-05 2023-01-02T18:16:48.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:48.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439593+0000", 2023-01-02T18:16:48.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7476999999999999e-05 2023-01-02T18:16:48.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:48.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439611+0000", 2023-01-02T18:16:48.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077682200000000004 2023-01-02T18:16:48.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:48.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.440387+0000", 2023-01-02T18:16:48.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1906000000000003e-05 2023-01-02T18:16:48.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:48.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:48.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:48.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.440419+0000", 2023-01-02T18:16:48.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089829000000000005 2023-01-02T18:16:48.233 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.233 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.233 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.233 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:48.234 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:48.234 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:48.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:48.236 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:48.236+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:48.332 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:16:48.337 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:48.337+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:48.391 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:48.391 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:48.391 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:48.391 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:48.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:48.442 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:48.443+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:48.538 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:48.539+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:48.567 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:48.567 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:48.568 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:48.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:48.639 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:48.640+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:48.677 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:48.703 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:48.704 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:48.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:48.704 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:16:48.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.704 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1 3.1a 3:5bdd5772:::image1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:16:48.705 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:48.705 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.288835520999999, 2023-01-02T18:16:48.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839, 2023-01-02T18:16:48.705 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.705 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:16:48.706 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:48.706 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:48.706 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.706 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1 2023-01-02T18:16:48.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.706 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:48.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:48.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413949+0000", 2023-01-02T18:16:48.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8359999999999999e-06 2023-01-02T18:16:48.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413954+0000", 2023-01-02T18:16:48.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2023-01-02T18:16:48.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413961+0000", 2023-01-02T18:16:48.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7519999999999999e-06 2023-01-02T18:16:48.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413968+0000", 2023-01-02T18:16:48.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0071999999999999e-05 2023-01-02T18:16:48.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414008+0000", 2023-01-02T18:16:48.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1890000000000001e-06 2023-01-02T18:16:48.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:16:48.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414015+0000", 2023-01-02T18:16:48.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013744829999999999 2023-01-02T18:16:48.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415389+0000", 2023-01-02T18:16:48.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1655000000000003e-05 2023-01-02T18:16:48.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415471+0000", 2023-01-02T18:16:48.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839 2023-01-02T18:16:48.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.716 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.717 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:16:48.717 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:48.718 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.287885734, 2023-01-02T18:16:48.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:16:48.718 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.718 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.718 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:48.718 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:48.719 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.719 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:16:48.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.719 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:48.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:48.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:48.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:16:48.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:16:48.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:16:48.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:16:48.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:16:48.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:16:48.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:16:48.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:16:48.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:16:48.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:16:48.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:48.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:16:48.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:16:48.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:16:48.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:16:48.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:16:48.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:16:48.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:48.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:16:48.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:16:48.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:16:48.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:16:48.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:48.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:16:48.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:16:48.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:16:48.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:16:48.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:16:48.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:16:48.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.734 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.735 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:48.735 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:48.735 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2822174719999992, 2023-01-02T18:16:48.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:16:48.735 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.736 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.736 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:48.736 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:48.736 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.736 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:16:48.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.737 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:48.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:48.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:16:48.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:16:48.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:16:48.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:16:48.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:16:48.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:16:48.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:16:48.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:16:48.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:16:48.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:16:48.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:16:48.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:48.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:16:48.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:16:48.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:16:48.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:16:48.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:16:48.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:16:48.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:48.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:16:48.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:16:48.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:48.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:16:48.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:16:48.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:16:48.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:16:48.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:16:48.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:16:48.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:16:48.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:16:48.751 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.751 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.751 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.752 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:48.752 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:48.752 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2766838099999998, 2023-01-02T18:16:48.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:16:48.753 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.753 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.753 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:48.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:48.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:48.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:16:48.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:16:48.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:16:48.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:16:48.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:16:48.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:16:48.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:16:48.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:16:48.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:16:48.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:16:48.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:16:48.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:16:48.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:16:48.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:16:48.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:16:48.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:16:48.763 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.763 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.763 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.764 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:11 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:48.764 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:48.764 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2689808100000004, 2023-01-02T18:16:48.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152, 2023-01-02T18:16:48.765 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.765 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.765 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:48.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:48.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:48.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:48.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:16:48.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433810+0000", 2023-01-02T18:16:48.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1821000000000001e-05 2023-01-02T18:16:48.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433822+0000", 2023-01-02T18:16:48.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4549999999999998e-06 2023-01-02T18:16:48.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433829+0000", 2023-01-02T18:16:48.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6005000000000003e-05 2023-01-02T18:16:48.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433885+0000", 2023-01-02T18:16:48.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.16e-05 2023-01-02T18:16:48.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433907+0000", 2023-01-02T18:16:48.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011094480000000001 2023-01-02T18:16:48.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435016+0000", 2023-01-02T18:16:48.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8626999999999999e-05 2023-01-02T18:16:48.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435045+0000", 2023-01-02T18:16:48.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152 2023-01-02T18:16:48.775 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.775 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.775 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.776 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:24 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:48.776 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:48.776 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.253352306, 2023-01-02T18:16:48.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997, 2023-01-02T18:16:48.776 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.777 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.777 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:48.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:48.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:48.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449431+0000", 2023-01-02T18:16:48.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7706e-05 2023-01-02T18:16:48.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449449+0000", 2023-01-02T18:16:48.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0883999999999998e-05 2023-01-02T18:16:48.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449480+0000", 2023-01-02T18:16:48.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4416000000000001e-05 2023-01-02T18:16:48.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449494+0000", 2023-01-02T18:16:48.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6549000000000001e-05 2023-01-02T18:16:48.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449581+0000", 2023-01-02T18:16:48.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9669000000000003e-05 2023-01-02T18:16:48.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449620+0000", 2023-01-02T18:16:48.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0006958 2023-01-02T18:16:48.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450316+0000", 2023-01-02T18:16:48.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0188e-05 2023-01-02T18:16:48.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450346+0000", 2023-01-02T18:16:48.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997 2023-01-02T18:16:48.787 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.787 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.787 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.787 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:30 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:48.788 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:48.788 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2459498, 2023-01-02T18:16:48.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003, 2023-01-02T18:16:48.788 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.788 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.789 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:48.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:48.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456835+0000", 2023-01-02T18:16:48.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7504999999999999e-05 2023-01-02T18:16:48.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456852+0000", 2023-01-02T18:16:48.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2356e-05 2023-01-02T18:16:48.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456865+0000", 2023-01-02T18:16:48.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.421e-06 2023-01-02T18:16:48.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456871+0000", 2023-01-02T18:16:48.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8040999999999997e-05 2023-01-02T18:16:48.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456909+0000", 2023-01-02T18:16:48.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5384e-05 2023-01-02T18:16:48.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456925+0000", 2023-01-02T18:16:48.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074633700000000002 2023-01-02T18:16:48.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457671+0000", 2023-01-02T18:16:48.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7826000000000001e-05 2023-01-02T18:16:48.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457699+0000", 2023-01-02T18:16:48.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003 2023-01-02T18:16:48.798 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.799 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.799 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.799 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:31 3.1c e46/43 3:3d3f3250:::rbd_id.image2:head v 46'3, mlcod=46'1)", 2023-01-02T18:16:48.799 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:48.800 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2443213170000007, 2023-01-02T18:16:48.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999, 2023-01-02T18:16:48.800 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.800 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.800 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:48.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:48.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458463+0000", 2023-01-02T18:16:48.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3389999999999998e-06 2023-01-02T18:16:48.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458470+0000", 2023-01-02T18:16:48.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.205e-05 2023-01-02T18:16:48.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458482+0000", 2023-01-02T18:16:48.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5809999999999996e-06 2023-01-02T18:16:48.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458487+0000", 2023-01-02T18:16:48.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8702000000000001e-05 2023-01-02T18:16:48.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458546+0000", 2023-01-02T18:16:48.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2495e-05 2023-01-02T18:16:48.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458559+0000", 2023-01-02T18:16:48.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001846735 2023-01-02T18:16:48.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460405+0000", 2023-01-02T18:16:48.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9183000000000002e-05 2023-01-02T18:16:48.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460435+0000", 2023-01-02T18:16:48.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999 2023-01-02T18:16:48.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.810 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.811 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:32 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:48.811 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:48.811 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2409716080000006, 2023-01-02T18:16:48.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997, 2023-01-02T18:16:48.812 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.812 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.812 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:48.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:48.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:48.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:48.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3030000000000001e-06 2023-01-02T18:16:48.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461818+0000", 2023-01-02T18:16:48.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0964999999999999e-05 2023-01-02T18:16:48.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461829+0000", 2023-01-02T18:16:48.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8039999999999998e-06 2023-01-02T18:16:48.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461835+0000", 2023-01-02T18:16:48.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8708999999999997e-05 2023-01-02T18:16:48.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461884+0000", 2023-01-02T18:16:48.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5057e-05 2023-01-02T18:16:48.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461899+0000", 2023-01-02T18:16:48.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061687999999999999 2023-01-02T18:16:48.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462515+0000", 2023-01-02T18:16:48.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1633e-05 2023-01-02T18:16:48.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462547+0000", 2023-01-02T18:16:48.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997 2023-01-02T18:16:48.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.822 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.822 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:33 3.3 3:c76fae31:::rbd_object_map.12a21ad382ee:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:48.823 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:48.823 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2399287549999993, 2023-01-02T18:16:48.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001, 2023-01-02T18:16:48.823 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.823 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:48.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:48.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.824 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33 2023-01-02T18:16:48.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.825 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:48.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:48.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462856+0000", 2023-01-02T18:16:48.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4710000000000004e-06 2023-01-02T18:16:48.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462862+0000", 2023-01-02T18:16:48.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:16:48.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462875+0000", 2023-01-02T18:16:48.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.491e-05 2023-01-02T18:16:48.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462890+0000", 2023-01-02T18:16:48.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9657999999999999e-05 2023-01-02T18:16:48.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462930+0000", 2023-01-02T18:16:48.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1362999999999999e-05 2023-01-02T18:16:48.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463021+0000", 2023-01-02T18:16:48.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015166800000000001 2023-01-02T18:16:48.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:16:48.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463173+0000", 2023-01-02T18:16:48.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074740899999999999 2023-01-02T18:16:48.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:48.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463920+0000", 2023-01-02T18:16:48.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045107699999999998 2023-01-02T18:16:48.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464372+0000", 2023-01-02T18:16:48.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6213e-05 2023-01-02T18:16:48.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464408+0000", 2023-01-02T18:16:48.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.535e-05 2023-01-02T18:16:48.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464433+0000", 2023-01-02T18:16:48.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001 2023-01-02T18:16:48.837 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.837 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.837 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.838 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:45 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:48.838 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:48.838 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2292191490000004, 2023-01-02T18:16:48.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892, 2023-01-02T18:16:48.839 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.839 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.839 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:48.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:48.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473565+0000", 2023-01-02T18:16:48.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5140000000000004e-06 2023-01-02T18:16:48.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473573+0000", 2023-01-02T18:16:48.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2473000000000001e-05 2023-01-02T18:16:48.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473585+0000", 2023-01-02T18:16:48.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2159999999999997e-06 2023-01-02T18:16:48.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473591+0000", 2023-01-02T18:16:48.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0025999999999999e-05 2023-01-02T18:16:48.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473631+0000", 2023-01-02T18:16:48.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3309000000000001e-05 2023-01-02T18:16:48.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473644+0000", 2023-01-02T18:16:48.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057332800000000001 2023-01-02T18:16:48.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474217+0000", 2023-01-02T18:16:48.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0043999999999999e-05 2023-01-02T18:16:48.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474247+0000", 2023-01-02T18:16:48.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892 2023-01-02T18:16:48.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.849 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.850 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:46 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'3, mlcod=46'1)", 2023-01-02T18:16:48.850 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:48.850 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.2278873870000009, 2023-01-02T18:16:48.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997, 2023-01-02T18:16:48.850 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.851 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.851 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:48.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:48.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474897+0000", 2023-01-02T18:16:48.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8789999999999992e-06 2023-01-02T18:16:48.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474906+0000", 2023-01-02T18:16:48.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3468e-05 2023-01-02T18:16:48.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474920+0000", 2023-01-02T18:16:48.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8460000000000002e-06 2023-01-02T18:16:48.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474926+0000", 2023-01-02T18:16:48.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6996000000000003e-05 2023-01-02T18:16:48.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474963+0000", 2023-01-02T18:16:48.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2276000000000001e-05 2023-01-02T18:16:48.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474976+0000", 2023-01-02T18:16:48.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066849900000000002 2023-01-02T18:16:48.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475644+0000", 2023-01-02T18:16:48.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2233999999999997e-05 2023-01-02T18:16:48.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475676+0000", 2023-01-02T18:16:48.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997 2023-01-02T18:16:48.860 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.860 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.861 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.861 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:53 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:48.861 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:48.862 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.1929751979999992, 2023-01-02T18:16:48.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082, 2023-01-02T18:16:48.862 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.862 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.862 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:48.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:48.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:48.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:48.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3499999999999996e-06 2023-01-02T18:16:48.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509815+0000", 2023-01-02T18:16:48.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0020999999999999e-05 2023-01-02T18:16:48.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509825+0000", 2023-01-02T18:16:48.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1399999999999997e-06 2023-01-02T18:16:48.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509832+0000", 2023-01-02T18:16:48.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3279999999999999e-05 2023-01-02T18:16:48.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509875+0000", 2023-01-02T18:16:48.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0288e-05 2023-01-02T18:16:48.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509895+0000", 2023-01-02T18:16:48.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000905152 2023-01-02T18:16:48.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510800+0000", 2023-01-02T18:16:48.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1238000000000001e-05 2023-01-02T18:16:48.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510832+0000", 2023-01-02T18:16:48.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082 2023-01-02T18:16:48.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.872 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.873 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:16:48.873 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:48.873 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.1909846569999996, 2023-01-02T18:16:48.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:16:48.874 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.874 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.874 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:48.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:48.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:16:48.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:16:48.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:16:48.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:16:48.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:16:48.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:16:48.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:16:48.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:16:48.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:16:48.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:16:48.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:16:48.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:16:48.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:16:48.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:16:48.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:16:48.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:16:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.884 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:66 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:48.885 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:48.885 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.1798265000000008, 2023-01-02T18:16:48.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997, 2023-01-02T18:16:48.885 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.885 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.886 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:48.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:48.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522958+0000", 2023-01-02T18:16:48.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6449999999999994e-06 2023-01-02T18:16:48.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522967+0000", 2023-01-02T18:16:48.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3166000000000001e-05 2023-01-02T18:16:48.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522980+0000", 2023-01-02T18:16:48.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:16:48.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522987+0000", 2023-01-02T18:16:48.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4501000000000001e-05 2023-01-02T18:16:48.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523022+0000", 2023-01-02T18:16:48.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5023e-05 2023-01-02T18:16:48.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523037+0000", 2023-01-02T18:16:48.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057705099999999997 2023-01-02T18:16:48.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523614+0000", 2023-01-02T18:16:48.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1579999999999999e-05 2023-01-02T18:16:48.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523645+0000", 2023-01-02T18:16:48.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997 2023-01-02T18:16:48.895 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.895 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.895 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.896 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:26 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'6, mlcod=46'4)", 2023-01-02T18:16:48.896 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:48.896 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.1644618940000004, 2023-01-02T18:16:48.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005, 2023-01-02T18:16:48.897 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.897 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.897 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:48.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:48.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538323+0000", 2023-01-02T18:16:48.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8736000000000002e-05 2023-01-02T18:16:48.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538342+0000", 2023-01-02T18:16:48.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6739999999999992e-06 2023-01-02T18:16:48.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538351+0000", 2023-01-02T18:16:48.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6460000000000001e-06 2023-01-02T18:16:48.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538356+0000", 2023-01-02T18:16:48.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.57e-05 2023-01-02T18:16:48.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538402+0000", 2023-01-02T18:16:48.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6050999999999998e-05 2023-01-02T18:16:48.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538428+0000", 2023-01-02T18:16:48.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055106199999999995 2023-01-02T18:16:48.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538979+0000", 2023-01-02T18:16:48.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7333000000000001e-05 2023-01-02T18:16:48.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539006+0000", 2023-01-02T18:16:48.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005 2023-01-02T18:16:48.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.907 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.907 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.908 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:27 3.f e46/43 3:f63788c7:::rbd_id.image5:head v 46'6, mlcod=46'4)", 2023-01-02T18:16:48.908 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:48.908 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.1631418230000001, 2023-01-02T18:16:48.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001, 2023-01-02T18:16:48.908 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.908 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.909 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:48.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:48.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:48.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539643+0000", 2023-01-02T18:16:48.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0418999999999999e-05 2023-01-02T18:16:48.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539663+0000", 2023-01-02T18:16:48.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3852999999999999e-05 2023-01-02T18:16:48.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539677+0000", 2023-01-02T18:16:48.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5100000000000004e-06 2023-01-02T18:16:48.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539684+0000", 2023-01-02T18:16:48.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9595999999999998e-05 2023-01-02T18:16:48.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539723+0000", 2023-01-02T18:16:48.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7207999999999999e-05 2023-01-02T18:16:48.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539741+0000", 2023-01-02T18:16:48.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063475200000000004 2023-01-02T18:16:48.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540375+0000", 2023-01-02T18:16:48.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5425e-05 2023-01-02T18:16:48.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540411+0000", 2023-01-02T18:16:48.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001 2023-01-02T18:16:48.918 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.918 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.919 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.919 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:16:48.919 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:48.920 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.2690289940000001, 2023-01-02T18:16:48.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:16:48.920 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.920 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.920 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:48.921 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:48.921 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.921 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:16:48.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.921 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:48.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:48.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:16:48.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:16:48.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:16:48.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:16:48.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:16:48.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:16:48.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:16:48.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:16:48.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:16:48.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:16:48.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:16:48.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:48.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:16:48.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:16:48.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:16:48.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:16:48.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:16:48.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:16:48.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:16:48.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:16:48.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:16:48.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:48.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:16:48.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:16:48.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:16:48.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:16:48.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:16:48.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:16:48.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:16:48.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:16:48.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.936 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.937 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:16:48.937 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:48.937 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.404247936, 2023-01-02T18:16:48.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:16:48.937 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.938 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.938 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:48.938 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:48.938 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.938 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:16:48.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.939 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:48.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:48.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:48.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:16:48.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:16:48.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:16:48.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:16:48.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:16:48.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:16:48.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:16:48.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:16:48.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:16:48.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:16:48.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:48.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:16:48.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:16:48.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:16:48.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:16:48.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:16:48.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:16:48.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:16:48.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:16:48.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:16:48.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:16:48.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:16:48.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:48.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:16:48.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:16:48.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:16:48.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:16:48.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:16:48.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:16:48.953 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.953 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.953 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.954 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:272 4.9 4:911e4614:::rbd_id.image18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:16:48.954 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:48.954 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.3926194159999996, 2023-01-02T18:16:48.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999, 2023-01-02T18:16:48.955 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:48.955 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:48.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:48.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:48.955 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:48.956 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 272 2023-01-02T18:16:48.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.956 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:48.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:48.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:48.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:48.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:48.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:48.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:48.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:48.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310165+0000", 2023-01-02T18:16:48.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.628e-06 2023-01-02T18:16:48.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:48.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310174+0000", 2023-01-02T18:16:48.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2023-01-02T18:16:48.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:48.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310190+0000", 2023-01-02T18:16:48.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:16:48.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:48.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310198+0000", 2023-01-02T18:16:48.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6770000000000001e-05 2023-01-02T18:16:48.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:48.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310245+0000", 2023-01-02T18:16:48.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159517 2023-01-02T18:16:48.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:48.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310404+0000", 2023-01-02T18:16:48.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023075600000000001 2023-01-02T18:16:48.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:48.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310635+0000", 2023-01-02T18:16:48.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088889700000000004 2023-01-02T18:16:48.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:48.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311524+0000", 2023-01-02T18:16:48.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011021 2023-01-02T18:16:48.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:48.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311634+0000", 2023-01-02T18:16:48.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2626000000000002e-05 2023-01-02T18:16:48.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:48.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311667+0000", 2023-01-02T18:16:48.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9774000000000002e-05 2023-01-02T18:16:48.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:48.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:48.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:48.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311706+0000", 2023-01-02T18:16:48.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999 2023-01-02T18:16:48.968 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.968 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:48.969 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:48.969 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:48.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:48.972 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:48.972 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:48.973 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:48.973 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:48.973 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:48.973 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:48.973 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:48.974 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:48.974 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:48.975 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:48.975 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:48.975 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:48.975 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:48.975 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:48.976 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:48.976 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:48.976 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:48.971+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:49.071 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:49.072+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:49.139 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:49.139 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:49.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:49.192 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:49.193+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:49.273 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:49.273+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:49.274 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:49.274 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:49.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:49.322 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 1 2023-01-02T18:16:49.323 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:16:49.323 INFO:tasks.workunit.client.0.smithi007.stdout:image: image20 2023-01-02T18:16:49.323 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image20 2023-01-02T18:16:49.323 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:49.333 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 2 2023-01-02T18:16:49.334 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:16:49.334 INFO:tasks.workunit.client.0.smithi007.stdout:image: image20 2023-01-02T18:16:49.334 INFO:tasks.workunit.client.0.smithi007.stdout:image: image21 2023-01-02T18:16:49.334 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image20 2023-01-02T18:16:49.334 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image21 2023-01-02T18:16:49.374 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:49.375+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:49.401 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 1 2023-01-02T18:16:49.401 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:16:49.401 INFO:tasks.workunit.client.0.smithi007.stdout:image: image21 2023-01-02T18:16:49.402 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image21 2023-01-02T18:16:49.402 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestCreateLsDeletePP (4999 ms) 2023-01-02T18:16:49.402 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestCopy 2023-01-02T18:16:49.459 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:49.459 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:49.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:49.475 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:49.476+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:49.575 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:49.576+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:49.595 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:49.595 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:49.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:49.676 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:49.677+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:49.730 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:49.730 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:49.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:49.781 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:49.782+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:49.878 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:49.878+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:49.905 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:49.906 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:49.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:50.000 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:50.001+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:50.081 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:50.082 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:50.083 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:50.084+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:50.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:50.184 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:50.185+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:50.256 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:50.257 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:50.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:50.310 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:50.311+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:50.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:16:50.386 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:50.387+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:50.395 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:50.395 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:50.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:50.487 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:50.488+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:50.541 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:50.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:50.593 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:50.594+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:50.688 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:50.689+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:50.717 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:50.717 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:50.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:50.811 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:50.812+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:50.890 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:50.891+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:50.892 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:50.892 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:50.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:50.977 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:50.991 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:50.992+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:51.069 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:51.069 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:51.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:51.123 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:51.124+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:51.129 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:51.146 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:51.163 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:51.181 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:51.193 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:51.194+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:51.200 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:51.208 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:51.208 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:51.209 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:51.218 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:51.219 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:51.236 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:51.254 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:51.256 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:51.256 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:51.256 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:51.256 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:51.257 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:51.294 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:51.295+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:51.345 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:16:51.345 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:51.379 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:51.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:6 3.1a e45/43 3:5cea7035:::rbd_info:head v 45'1, mlcod=0'0)", 2023-01-02T18:16:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.961929940999999, 2023-01-02T18:16:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998, 2023-01-02T18:16:51.381 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:51.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:51.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:16:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:51.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3349999999999997e-06 2023-01-02T18:16:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417398+0000", 2023-01-02T18:16:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7995999999999998e-05 2023-01-02T18:16:51.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417416+0000", 2023-01-02T18:16:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2250000000000003e-06 2023-01-02T18:16:51.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417423+0000", 2023-01-02T18:16:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6785e-05 2023-01-02T18:16:51.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417470+0000", 2023-01-02T18:16:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2886000000000001e-05 2023-01-02T18:16:51.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417492+0000", 2023-01-02T18:16:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070370800000000005 2023-01-02T18:16:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:51.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418196+0000", 2023-01-02T18:16:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1628999999999998e-05 2023-01-02T18:16:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418228+0000", 2023-01-02T18:16:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998 2023-01-02T18:16:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.955355369999999, 2023-01-02T18:16:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:16:51.393 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:51.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:16:51.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:16:51.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:16:51.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:16:51.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:16:51.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:16:51.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:16:51.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:16:51.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:16:51.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:16:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:16:51.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:16:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:16:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:16:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:16:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.405 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.406 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.406 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2 3.4 3:267905b2:::rbd_id.image3:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:51.406 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:51.407 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.901205717, 2023-01-02T18:16:51.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018677900000000001, 2023-01-02T18:16:51.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:51.407 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:51.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:51.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:51.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2 2023-01-02T18:16:51.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.408 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:51.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478117+0000", 2023-01-02T18:16:51.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478116+0000", 2023-01-02T18:16:51.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2775999999999999e-05 2023-01-02T18:16:51.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478129+0000", 2023-01-02T18:16:51.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.361e-05 2023-01-02T18:16:51.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478142+0000", 2023-01-02T18:16:51.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6750000000000001e-05 2023-01-02T18:16:51.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478159+0000", 2023-01-02T18:16:51.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4184999999999997e-05 2023-01-02T18:16:51.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478213+0000", 2023-01-02T18:16:51.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0367999999999999e-05 2023-01-02T18:16:51.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.478303+0000", 2023-01-02T18:16:51.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018677900000000001 2023-01-02T18:16:51.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.417 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.418 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:51.418 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:51.419 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.896155662, 2023-01-02T18:16:51.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:16:51.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:51.420 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:51.420 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:51.420 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:51.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:16:51.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.421 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:51.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:51.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:51.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:16:51.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:16:51.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:16:51.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:16:51.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:16:51.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:16:51.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:16:51.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:16:51.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:16:51.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:16:51.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:16:51.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:16:51.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:16:51.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:16:51.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:16:51.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:51.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:16:51.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:16:51.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:51.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:16:51.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:16:51.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:51.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:16:51.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:16:51.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:16:51.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:16:51.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.434 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.434 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.434 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:9 3.4 3:267905b2:::rbd_id.image3:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:51.435 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:51.435 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.887532743, 2023-01-02T18:16:51.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027154600000000001, 2023-01-02T18:16:51.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:51.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:51.436 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:51.436 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 9 2023-01-02T18:16:51.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.436 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:51.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491790+0000", 2023-01-02T18:16:51.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:51.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491788+0000", 2023-01-02T18:16:51.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6080000000000002e-06 2023-01-02T18:16:51.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491797+0000", 2023-01-02T18:16:51.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7750000000000001e-05 2023-01-02T18:16:51.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491815+0000", 2023-01-02T18:16:51.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6790000000000005e-06 2023-01-02T18:16:51.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491823+0000", 2023-01-02T18:16:51.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3060999999999999e-05 2023-01-02T18:16:51.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491876+0000", 2023-01-02T18:16:51.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.009e-05 2023-01-02T18:16:51.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.491966+0000", 2023-01-02T18:16:51.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5279999999999996e-05 2023-01-02T18:16:51.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492061+0000", 2023-01-02T18:16:51.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027154600000000001 2023-01-02T18:16:51.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.447 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.448 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:10 3.4 3:267905b2:::rbd_id.image3:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:51.448 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:51.448 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.887157142, 2023-01-02T18:16:51.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040530900000000002, 2023-01-02T18:16:51.448 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.449 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:51.449 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:51.449 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:51.449 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 10 2023-01-02T18:16:51.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.450 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:51.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492165+0000", 2023-01-02T18:16:51.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492164+0000", 2023-01-02T18:16:51.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7980000000000006e-06 2023-01-02T18:16:51.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492172+0000", 2023-01-02T18:16:51.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:16:51.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492186+0000", 2023-01-02T18:16:51.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0129999999999993e-06 2023-01-02T18:16:51.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492194+0000", 2023-01-02T18:16:51.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0227e-05 2023-01-02T18:16:51.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492235+0000", 2023-01-02T18:16:51.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0649000000000007e-05 2023-01-02T18:16:51.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492315+0000", 2023-01-02T18:16:51.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000255271 2023-01-02T18:16:51.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492571+0000", 2023-01-02T18:16:51.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040530900000000002 2023-01-02T18:16:51.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.458 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.459 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.16 49/48 [PushOp(3:6b9a211e:::rbd_id.image12:head, version: 46'1, data_included: [0~15], data_size: 15, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:6b9a211e:::rbd_id.image12:head@46'1, size: 15, copy_subset: [0~15], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:15, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.459 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:51.460 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.9351058000000005, 2023-01-02T18:16:51.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044365099999999998, 2023-01-02T18:16:51.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.461 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:51.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444217+0000", 2023-01-02T18:16:51.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:51.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444215+0000", 2023-01-02T18:16:51.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.014e-05 2023-01-02T18:16:51.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444235+0000", 2023-01-02T18:16:51.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3300999999999999e-05 2023-01-02T18:16:51.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444258+0000", 2023-01-02T18:16:51.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.278e-05 2023-01-02T18:16:51.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444271+0000", 2023-01-02T18:16:51.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9231000000000003e-05 2023-01-02T18:16:51.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444330+0000", 2023-01-02T18:16:51.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0796e-05 2023-01-02T18:16:51.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444341+0000", 2023-01-02T18:16:51.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031950400000000002 2023-01-02T18:16:51.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.444660+0000", 2023-01-02T18:16:51.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044365099999999998 2023-01-02T18:16:51.470 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.471 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.471 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.471 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3d3f3250:::rbd_id.image2:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d3f3250:::rbd_id.image2:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.471 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:51.472 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.9319298969999998, 2023-01-02T18:16:51.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004, 2023-01-02T18:16:51.472 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.472 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.472 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:51.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:51.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447391+0000", 2023-01-02T18:16:51.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8275e-05 2023-01-02T18:16:51.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447410+0000", 2023-01-02T18:16:51.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3377999999999999e-05 2023-01-02T18:16:51.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447433+0000", 2023-01-02T18:16:51.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6303e-05 2023-01-02T18:16:51.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447449+0000", 2023-01-02T18:16:51.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000438212 2023-01-02T18:16:51.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447888+0000", 2023-01-02T18:16:51.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.169e-05 2023-01-02T18:16:51.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447899+0000", 2023-01-02T18:16:51.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035861500000000001 2023-01-02T18:16:51.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448258+0000", 2023-01-02T18:16:51.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004 2023-01-02T18:16:51.482 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.482 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.483 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.483 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3831950c:::rbd_directory:head, version: 46'16, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 30, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3831950c:::rbd_directory:head@46'16, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.484 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:51.484 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.9296000489999994, 2023-01-02T18:16:51.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048506899999999997, 2023-01-02T18:16:51.484 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.484 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:51.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449722+0000", 2023-01-02T18:16:51.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:51.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449721+0000", 2023-01-02T18:16:51.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8507e-05 2023-01-02T18:16:51.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449749+0000", 2023-01-02T18:16:51.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1554999999999999e-05 2023-01-02T18:16:51.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449771+0000", 2023-01-02T18:16:51.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1626e-05 2023-01-02T18:16:51.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449783+0000", 2023-01-02T18:16:51.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6056999999999994e-05 2023-01-02T18:16:51.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449859+0000", 2023-01-02T18:16:51.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1284000000000001e-05 2023-01-02T18:16:51.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.449870+0000", 2023-01-02T18:16:51.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000337447 2023-01-02T18:16:51.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.450207+0000", 2023-01-02T18:16:51.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00048506899999999997 2023-01-02T18:16:51.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.493 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.494 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3f5a2831:::rbd_object_map.11d52421ce09:head, version: 46'21, data_included: [0~35], data_size: 35, omap_header_size: 0, omap_entries_size: 0, attrset_size: 3, recovery_info: ObjectRecoveryInfo(3:3f5a2831:::rbd_object_map.11d52421ce09:head@46'21, size: 35, copy_subset: [0~35], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:35, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.494 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:51.494 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.9277512219999995, 2023-01-02T18:16:51.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036462199999999999, 2023-01-02T18:16:51.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.495 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:51.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451571+0000", 2023-01-02T18:16:51.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451570+0000", 2023-01-02T18:16:51.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3141e-05 2023-01-02T18:16:51.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451584+0000", 2023-01-02T18:16:51.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5398000000000001e-05 2023-01-02T18:16:51.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451599+0000", 2023-01-02T18:16:51.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.011e-06 2023-01-02T18:16:51.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451607+0000", 2023-01-02T18:16:51.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9302000000000003e-05 2023-01-02T18:16:51.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451656+0000", 2023-01-02T18:16:51.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:16:51.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451662+0000", 2023-01-02T18:16:51.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027369500000000001 2023-01-02T18:16:51.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.451936+0000", 2023-01-02T18:16:51.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036462199999999999 2023-01-02T18:16:51.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.505 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.506 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:16:51.506 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:16:51.506 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.0507948210000002, 2023-01-02T18:16:51.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:16:51.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:51.507 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:16:51.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:16:51.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:51.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:16:51.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:16:51.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:16:51.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:16:51.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:16:51.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:16:51.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:16:51.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:16:51.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:16:51.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:16:51.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:16:51.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:16:51.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:51.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:16:51.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:16:51.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:16:51.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:16:51.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.518 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPull(3.1c e55/54 cost 1049576)", 2023-01-02T18:16:51.518 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328973+0000", 2023-01-02T18:16:51.518 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.0503498809999998, 2023-01-02T18:16:51.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040595699999999998, 2023-01-02T18:16:51.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:51.519 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328973+0000", 2023-01-02T18:16:51.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328973+0000", 2023-01-02T18:16:51.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328972+0000", 2023-01-02T18:16:51.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1433999999999999e-05 2023-01-02T18:16:51.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328983+0000", 2023-01-02T18:16:51.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8810000000000008e-06 2023-01-02T18:16:51.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328993+0000", 2023-01-02T18:16:51.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7190000000000004e-06 2023-01-02T18:16:51.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.329000+0000", 2023-01-02T18:16:51.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119434 2023-01-02T18:16:51.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.329119+0000", 2023-01-02T18:16:51.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025935999999999998 2023-01-02T18:16:51.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.329378+0000", 2023-01-02T18:16:51.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040595699999999998 2023-01-02T18:16:51.527 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.527 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.527 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.528 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPushReply(3.1a 55/54 [PushReplyOp(3:5cea7035:::rbd_info:head)])", 2023-01-02T18:16:51.528 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.332377+0000", 2023-01-02T18:16:51.529 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.0469454969999998, 2023-01-02T18:16:51.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033405899999999999, 2023-01-02T18:16:51.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.529 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:51.529 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.332377+0000", 2023-01-02T18:16:51.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.332377+0000", 2023-01-02T18:16:51.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.332376+0000", 2023-01-02T18:16:51.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8290000000000008e-06 2023-01-02T18:16:51.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.332384+0000", 2023-01-02T18:16:51.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5427999999999999e-05 2023-01-02T18:16:51.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.332399+0000", 2023-01-02T18:16:51.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5340000000000002e-06 2023-01-02T18:16:51.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.332407+0000", 2023-01-02T18:16:51.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9345000000000003e-05 2023-01-02T18:16:51.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.332456+0000", 2023-01-02T18:16:51.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025487300000000002 2023-01-02T18:16:51.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.332711+0000", 2023-01-02T18:16:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033405899999999999 2023-01-02T18:16:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.537 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.538 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPushReply(3.1a 55/54 [PushReplyOp(3:5cbdda84:::rbd_id.image6:head)])", 2023-01-02T18:16:51.538 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.334087+0000", 2023-01-02T18:16:51.539 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.045235431, 2023-01-02T18:16:51.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242854, 2023-01-02T18:16:51.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:51.539 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.334087+0000", 2023-01-02T18:16:51.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.334087+0000", 2023-01-02T18:16:51.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:51.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.334087+0000", 2023-01-02T18:16:51.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3680000000000004e-06 2023-01-02T18:16:51.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.334091+0000", 2023-01-02T18:16:51.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.098e-06 2023-01-02T18:16:51.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.334100+0000", 2023-01-02T18:16:51.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:16:51.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.334107+0000", 2023-01-02T18:16:51.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9456000000000003e-05 2023-01-02T18:16:51.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.334146+0000", 2023-01-02T18:16:51.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000183587 2023-01-02T18:16:51.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.334330+0000", 2023-01-02T18:16:51.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000242854 2023-01-02T18:16:51.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.547 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.548 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.548 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPull(3.1c e55/54 cost 1049576)", 2023-01-02T18:16:51.548 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.336472+0000", 2023-01-02T18:16:51.549 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.0428500729999999, 2023-01-02T18:16:51.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032949500000000002, 2023-01-02T18:16:51.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:51.549 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336472+0000", 2023-01-02T18:16:51.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336472+0000", 2023-01-02T18:16:51.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:51.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336472+0000", 2023-01-02T18:16:51.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.893e-06 2023-01-02T18:16:51.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336482+0000", 2023-01-02T18:16:51.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.776e-06 2023-01-02T18:16:51.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336489+0000", 2023-01-02T18:16:51.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5589999999999996e-06 2023-01-02T18:16:51.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336494+0000", 2023-01-02T18:16:51.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4327999999999999e-05 2023-01-02T18:16:51.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336549+0000", 2023-01-02T18:16:51.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025328900000000002 2023-01-02T18:16:51.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336802+0000", 2023-01-02T18:16:51.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032949500000000002 2023-01-02T18:16:51.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.557 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.558 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.e 55/54 [PushOp(3:7262dcae:::rbd_header.11d53c951be7:head, version: 46'7, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 8, attrset_size: 3, recovery_info: ObjectRecoveryInfo(3:7262dcae:::rbd_header.11d53c951be7:head@46'7, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.558 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.346043+0000", 2023-01-02T18:16:51.558 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.033279469, 2023-01-02T18:16:51.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033170999999999998, 2023-01-02T18:16:51.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.559 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346043+0000", 2023-01-02T18:16:51.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346043+0000", 2023-01-02T18:16:51.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346042+0000", 2023-01-02T18:16:51.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2644e-05 2023-01-02T18:16:51.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346055+0000", 2023-01-02T18:16:51.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4097000000000001e-05 2023-01-02T18:16:51.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346069+0000", 2023-01-02T18:16:51.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2099999999999999e-06 2023-01-02T18:16:51.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346078+0000", 2023-01-02T18:16:51.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1792999999999997e-05 2023-01-02T18:16:51.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346130+0000", 2023-01-02T18:16:51.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3800000000000002e-06 2023-01-02T18:16:51.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346135+0000", 2023-01-02T18:16:51.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000239397 2023-01-02T18:16:51.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.346375+0000", 2023-01-02T18:16:51.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033170999999999998 2023-01-02T18:16:51.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.569 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.570 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.a 55/54 [PushOp(3:50d44281:::rbd_header.12a21ad382ee:head, version: 46'3, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 8, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:50d44281:::rbd_header.12a21ad382ee:head@46'3, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.570 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.347806+0000", 2023-01-02T18:16:51.570 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.0315163489999999, 2023-01-02T18:16:51.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030866500000000001, 2023-01-02T18:16:51.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.571 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.347806+0000", 2023-01-02T18:16:51.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.347806+0000", 2023-01-02T18:16:51.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.347805+0000", 2023-01-02T18:16:51.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2201000000000001e-05 2023-01-02T18:16:51.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.347817+0000", 2023-01-02T18:16:51.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4545000000000001e-05 2023-01-02T18:16:51.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.347832+0000", 2023-01-02T18:16:51.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2719999999999997e-06 2023-01-02T18:16:51.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.347840+0000", 2023-01-02T18:16:51.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9648999999999998e-05 2023-01-02T18:16:51.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.347890+0000", 2023-01-02T18:16:51.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3890000000000002e-06 2023-01-02T18:16:51.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.347896+0000", 2023-01-02T18:16:51.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021846999999999999 2023-01-02T18:16:51.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.348115+0000", 2023-01-02T18:16:51.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030866500000000001 2023-01-02T18:16:51.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.580 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.581 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.a 55/54 [PushOp(3:50a78d8b:::rbd_id.image7:head, version: 46'4, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:50a78d8b:::rbd_id.image7:head@46'4, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.581 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.349084+0000", 2023-01-02T18:16:51.581 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.030238867, 2023-01-02T18:16:51.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034340299999999999, 2023-01-02T18:16:51.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.582 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349084+0000", 2023-01-02T18:16:51.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349084+0000", 2023-01-02T18:16:51.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:51.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349083+0000", 2023-01-02T18:16:51.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.309e-05 2023-01-02T18:16:51.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349096+0000", 2023-01-02T18:16:51.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.413e-05 2023-01-02T18:16:51.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349110+0000", 2023-01-02T18:16:51.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1039999999999996e-06 2023-01-02T18:16:51.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349119+0000", 2023-01-02T18:16:51.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0936000000000002e-05 2023-01-02T18:16:51.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349170+0000", 2023-01-02T18:16:51.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.493e-06 2023-01-02T18:16:51.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349175+0000", 2023-01-02T18:16:51.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025237600000000001 2023-01-02T18:16:51.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.349427+0000", 2023-01-02T18:16:51.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034340299999999999 2023-01-02T18:16:51.591 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.591 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.591 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.592 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(4.e 55/54 [PushOp(4:72a1f1bc:::rbd_header.12a27fd753dc:head, version: 51'1, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 8, attrset_size: 2, recovery_info: ObjectRecoveryInfo(4:72a1f1bc:::rbd_header.12a27fd753dc:head@51'1, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.592 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.351270+0000", 2023-01-02T18:16:51.592 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.0280525119999999, 2023-01-02T18:16:51.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030042099999999999, 2023-01-02T18:16:51.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.593 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351270+0000", 2023-01-02T18:16:51.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351270+0000", 2023-01-02T18:16:51.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:51.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351269+0000", 2023-01-02T18:16:51.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1789000000000001e-05 2023-01-02T18:16:51.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351291+0000", 2023-01-02T18:16:51.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4070000000000001e-05 2023-01-02T18:16:51.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351305+0000", 2023-01-02T18:16:51.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1580000000000005e-06 2023-01-02T18:16:51.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351313+0000", 2023-01-02T18:16:51.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1e-05 2023-01-02T18:16:51.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351354+0000", 2023-01-02T18:16:51.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3499999999999999e-06 2023-01-02T18:16:51.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351359+0000", 2023-01-02T18:16:51.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021164799999999999 2023-01-02T18:16:51.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.351570+0000", 2023-01-02T18:16:51.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030042099999999999 2023-01-02T18:16:51.602 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.603 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.603 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.603 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1d 55/54 [PushOp(3:b9d66927:::rbd_object_map.12a25a28a34d:head, version: 46'1, data_included: [0~35], data_size: 35, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:b9d66927:::rbd_object_map.12a25a28a34d:head@46'1, size: 35, copy_subset: [0~35], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:35, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:51.604 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.353470+0000", 2023-01-02T18:16:51.604 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.025852821, 2023-01-02T18:16:51.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034360199999999998, 2023-01-02T18:16:51.604 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:51.604 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:51.605 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:51.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:51.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353470+0000", 2023-01-02T18:16:51.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:51.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:51.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353470+0000", 2023-01-02T18:16:51.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:51.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:51.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353469+0000", 2023-01-02T18:16:51.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3257e-05 2023-01-02T18:16:51.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:51.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353482+0000", 2023-01-02T18:16:51.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4507e-05 2023-01-02T18:16:51.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:51.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353497+0000", 2023-01-02T18:16:51.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0489999999999998e-06 2023-01-02T18:16:51.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:51.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353504+0000", 2023-01-02T18:16:51.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1941999999999999e-05 2023-01-02T18:16:51.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:51.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353546+0000", 2023-01-02T18:16:51.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8490000000000002e-06 2023-01-02T18:16:51.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:51.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353552+0000", 2023-01-02T18:16:51.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026168099999999999 2023-01-02T18:16:51.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:51.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:51.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:51.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.353813+0000", 2023-01-02T18:16:51.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034360199999999998 2023-01-02T18:16:51.614 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.614 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.614 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.614 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:51.614 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:51.615 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:51.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:51.617 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:51.616+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:51.716 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:51.717+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:51.784 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:51.784 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:51.785 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:51.785 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:51.794 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:51.838 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:51.839+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:51.918 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:51.919+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:51.919 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:51.920 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:51.920 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:51.920 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:51.921 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:51.930 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:52.019 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:52.020+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:52.096 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.613637712999999, 2023-01-02T18:16:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:16:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:16:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:16:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:16:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:16:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:16:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:16:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:16:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:16:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:16:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:16:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:16:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:16:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:16:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:16:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:16:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:16:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.5 49/48 [PushOp(3:a56581c2:::rbd_id.image9:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:a56581c2:::rbd_id.image9:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6350454679999995, 2023-01-02T18:16:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001, 2023-01-02T18:16:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462256+0000", 2023-01-02T18:16:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1099e-05 2023-01-02T18:16:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462268+0000", 2023-01-02T18:16:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4336e-05 2023-01-02T18:16:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462282+0000", 2023-01-02T18:16:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1552000000000001e-05 2023-01-02T18:16:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462293+0000", 2023-01-02T18:16:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1749999999999998e-05 2023-01-02T18:16:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462335+0000", 2023-01-02T18:16:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1909999999999999e-06 2023-01-02T18:16:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462340+0000", 2023-01-02T18:16:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029615499999999999 2023-01-02T18:16:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462637+0000", 2023-01-02T18:16:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001 2023-01-02T18:16:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1a 55/54 [PushOp(3:5cea7035:::rbd_info:head, version: 46'2, data_included: [0~19], data_size: 19, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5cea7035:::rbd_info:head@46'2, size: 19, copy_subset: [0~19], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:19, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:16:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7661882260000001, 2023-01-02T18:16:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055757599999999995, 2023-01-02T18:16:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:16:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:16:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331113+0000", 2023-01-02T18:16:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7773000000000001e-05 2023-01-02T18:16:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331131+0000", 2023-01-02T18:16:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2946999999999999e-05 2023-01-02T18:16:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331154+0000", 2023-01-02T18:16:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3988999999999999e-05 2023-01-02T18:16:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331168+0000", 2023-01-02T18:16:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8967999999999994e-05 2023-01-02T18:16:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331237+0000", 2023-01-02T18:16:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.302e-06 2023-01-02T18:16:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331246+0000", 2023-01-02T18:16:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042547499999999997 2023-01-02T18:16:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331672+0000", 2023-01-02T18:16:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055757599999999995 2023-01-02T18:16:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1a 55/54 [PushOp(3:5cbdda84:::rbd_id.image6:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5cbdda84:::rbd_id.image6:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:16:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.764236532, 2023-01-02T18:16:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041118300000000002, 2023-01-02T18:16:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:16:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:16:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333065+0000", 2023-01-02T18:16:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2023-01-02T18:16:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333081+0000", 2023-01-02T18:16:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0083999999999999e-05 2023-01-02T18:16:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333102+0000", 2023-01-02T18:16:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0118e-05 2023-01-02T18:16:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333112+0000", 2023-01-02T18:16:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4228000000000003e-05 2023-01-02T18:16:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333166+0000", 2023-01-02T18:16:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:16:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333171+0000", 2023-01-02T18:16:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030649399999999998 2023-01-02T18:16:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333477+0000", 2023-01-02T18:16:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041118300000000002 2023-01-02T18:16:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.142 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.142 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.142 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:52.144 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:52.144 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:52.144+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:52.244 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:52.245+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:52.310 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:52.310 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:52.310 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:52.311 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:52.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:52.336 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7] out_osds: [5, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:52.337 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:52.337 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2023-01-02T18:16:52.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2023-01-02T18:16:52.345 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:52.346+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:52.446 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:52.447+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:52.491 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:52.492 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:52.492 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:52.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:52.548 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:52.548+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:52.631 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:52.631 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:52.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:52.631 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:52.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.632 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:52.632 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:52.632 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.194331439000001, 2023-01-02T18:16:52.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:16:52.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.633 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:52.633 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.633 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:52.634 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:52.634 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:16:52.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.634 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:52.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:52.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:52.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:16:52.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:16:52.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:16:52.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:16:52.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:16:52.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:16:52.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:16:52.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:16:52.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:16:52.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:16:52.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:16:52.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:16:52.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:16:52.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:16:52.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:16:52.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:16:52.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:16:52.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:52.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:16:52.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:16:52.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:52.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:16:52.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:16:52.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:52.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:16:52.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:16:52.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:52.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:16:52.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:16:52.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:16:52.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:16:52.651 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.651 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.651 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.651 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.144946446000001, 2023-01-02T18:16:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:16:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.652 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:16:52.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.654 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:52.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:52.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:52.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:16:52.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:16:52.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:16:52.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:16:52.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:16:52.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:16:52.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:16:52.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:16:52.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:16:52.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:16:52.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:16:52.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:16:52.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:52.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:16:52.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:16:52.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:52.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:16:52.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:16:52.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:52.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:16:52.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:16:52.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:52.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:16:52.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:16:52.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:16:52.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:16:52.667 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.667 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.667 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.668 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:8 3.18 3:1e96267a:::rbd_object_map.11d585d3810a:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:52.668 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:52.668 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.143136587000001, 2023-01-02T18:16:52.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087, 2023-01-02T18:16:52.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:52.669 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.669 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:52.669 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:52.670 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 8 2023-01-02T18:16:52.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.670 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:52.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:52.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487043+0000", 2023-01-02T18:16:52.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6100000000000002e-06 2023-01-02T18:16:52.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487049+0000", 2023-01-02T18:16:52.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:16:52.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487064+0000", 2023-01-02T18:16:52.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3280000000000006e-06 2023-01-02T18:16:52.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487072+0000", 2023-01-02T18:16:52.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5221e-05 2023-01-02T18:16:52.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487117+0000", 2023-01-02T18:16:52.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7274000000000005e-05 2023-01-02T18:16:52.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487204+0000", 2023-01-02T18:16:52.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013400700000000001 2023-01-02T18:16:52.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2023-01-02T18:16:52.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487338+0000", 2023-01-02T18:16:52.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083414299999999997 2023-01-02T18:16:52.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:52.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488173+0000", 2023-01-02T18:16:52.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020278700000000001 2023-01-02T18:16:52.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:52.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488375+0000", 2023-01-02T18:16:52.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6679999999999999e-05 2023-01-02T18:16:52.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:52.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488432+0000", 2023-01-02T18:16:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6842000000000003e-05 2023-01-02T18:16:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488479+0000", 2023-01-02T18:16:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087 2023-01-02T18:16:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:11 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call rbd.get_size in=11b,call,call rbd.get_features in=15b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.137498688000001, 2023-01-02T18:16:52.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00043998300000000002, 2023-01-02T18:16:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:52.685 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 11 2023-01-02T18:16:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492682+0000", 2023-01-02T18:16:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492680+0000", 2023-01-02T18:16:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6859999999999995e-06 2023-01-02T18:16:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492689+0000", 2023-01-02T18:16:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6410999999999999e-05 2023-01-02T18:16:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492705+0000", 2023-01-02T18:16:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2620000000000001e-06 2023-01-02T18:16:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492712+0000", 2023-01-02T18:16:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0547000000000002e-05 2023-01-02T18:16:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492763+0000", 2023-01-02T18:16:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2423000000000006e-05 2023-01-02T18:16:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.492855+0000", 2023-01-02T18:16:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00026637399999999999 2023-01-02T18:16:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493122+0000", 2023-01-02T18:16:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00043998300000000002 2023-01-02T18:16:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.695 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.696 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:13 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call,call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:52.696 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:52.697 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.13667334, 2023-01-02T18:16:52.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035003500000000001, 2023-01-02T18:16:52.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.697 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:52.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:52.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 13 2023-01-02T18:16:52.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.698 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:52.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493507+0000", 2023-01-02T18:16:52.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:52.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493506+0000", 2023-01-02T18:16:52.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7309999999999993e-06 2023-01-02T18:16:52.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493513+0000", 2023-01-02T18:16:52.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4613999999999999e-05 2023-01-02T18:16:52.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493528+0000", 2023-01-02T18:16:52.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9720000000000003e-06 2023-01-02T18:16:52.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493535+0000", 2023-01-02T18:16:52.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4150000000000003e-05 2023-01-02T18:16:52.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493579+0000", 2023-01-02T18:16:52.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3683000000000005e-05 2023-01-02T18:16:52.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493663+0000", 2023-01-02T18:16:52.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000194124 2023-01-02T18:16:52.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.493857+0000", 2023-01-02T18:16:52.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035003500000000001 2023-01-02T18:16:52.707 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.708 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.708 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.709 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:15 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call rbd.get_size in=11b,call rbd.get_features in=15b,call rbd.get_flags in=12b,call,call lock.get_info in=12b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:52.709 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:52.709 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.135661685000001, 2023-01-02T18:16:52.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056168199999999998, 2023-01-02T18:16:52.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.710 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.710 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:52.710 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:52.710 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 15 2023-01-02T18:16:52.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.711 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:52.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494519+0000", 2023-01-02T18:16:52.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494517+0000", 2023-01-02T18:16:52.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5499999999999997e-06 2023-01-02T18:16:52.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494525+0000", 2023-01-02T18:16:52.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5101e-05 2023-01-02T18:16:52.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494540+0000", 2023-01-02T18:16:52.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3910000000000003e-06 2023-01-02T18:16:52.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494547+0000", 2023-01-02T18:16:52.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3065000000000002e-05 2023-01-02T18:16:52.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494590+0000", 2023-01-02T18:16:52.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0383999999999994e-05 2023-01-02T18:16:52.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.494680+0000", 2023-01-02T18:16:52.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040034000000000001 2023-01-02T18:16:52.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495080+0000", 2023-01-02T18:16:52.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056168199999999998 2023-01-02T18:16:52.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.720 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.721 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:16 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [call,call rbd.parent_overlap_get in=21b] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:52.721 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:52.721 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.134999632, 2023-01-02T18:16:52.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030933600000000001, 2023-01-02T18:16:52.721 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.722 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.722 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:52.722 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:52.722 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16 2023-01-02T18:16:52.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.723 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:52.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495181+0000", 2023-01-02T18:16:52.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:52.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495179+0000", 2023-01-02T18:16:52.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6599999999999998e-06 2023-01-02T18:16:52.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495186+0000", 2023-01-02T18:16:52.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4070000000000001e-05 2023-01-02T18:16:52.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495200+0000", 2023-01-02T18:16:52.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9140000000000002e-06 2023-01-02T18:16:52.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495207+0000", 2023-01-02T18:16:52.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3915999999999999e-05 2023-01-02T18:16:52.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495241+0000", 2023-01-02T18:16:52.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3961000000000001e-05 2023-01-02T18:16:52.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495295+0000", 2023-01-02T18:16:52.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019502899999999999 2023-01-02T18:16:52.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.495490+0000", 2023-01-02T18:16:52.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030933600000000001 2023-01-02T18:16:52.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.732 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.733 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:20 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [watch watch cookie 140114919540112] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:52.733 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:52.733 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.133071104000001, 2023-01-02T18:16:52.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013849540000000001, 2023-01-02T18:16:52.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:52.734 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.734 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:52.734 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:52.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 20 2023-01-02T18:16:52.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.735 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:52.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497109+0000", 2023-01-02T18:16:52.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497108+0000", 2023-01-02T18:16:52.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6219999999999997e-06 2023-01-02T18:16:52.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497114+0000", 2023-01-02T18:16:52.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4440000000000001e-05 2023-01-02T18:16:52.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497128+0000", 2023-01-02T18:16:52.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6989999999999997e-06 2023-01-02T18:16:52.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497135+0000", 2023-01-02T18:16:52.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8272999999999998e-05 2023-01-02T18:16:52.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497173+0000", 2023-01-02T18:16:52.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5973000000000002e-05 2023-01-02T18:16:52.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497219+0000", 2023-01-02T18:16:52.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010911 2023-01-02T18:16:52.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:52.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497328+0000", 2023-01-02T18:16:52.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051081399999999995 2023-01-02T18:16:52.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:52.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.497839+0000", 2023-01-02T18:16:52.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057482300000000002 2023-01-02T18:16:52.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:52.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498414+0000", 2023-01-02T18:16:52.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7160000000000003e-05 2023-01-02T18:16:52.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:52.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498451+0000", 2023-01-02T18:16:52.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2978000000000001e-05 2023-01-02T18:16:52.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498494+0000", 2023-01-02T18:16:52.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013849540000000001 2023-01-02T18:16:52.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.748 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.749 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:21 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [watch unwatch cookie 140114919540112] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:52.749 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:52.749 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.131516951, 2023-01-02T18:16:52.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011449139999999999, 2023-01-02T18:16:52.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:52.750 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.750 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:52.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:52.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 21 2023-01-02T18:16:52.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.751 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:52.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498663+0000", 2023-01-02T18:16:52.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:52.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498662+0000", 2023-01-02T18:16:52.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9529999999999999e-06 2023-01-02T18:16:52.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498670+0000", 2023-01-02T18:16:52.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5307000000000001e-05 2023-01-02T18:16:52.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498685+0000", 2023-01-02T18:16:52.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1289999999999998e-06 2023-01-02T18:16:52.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498692+0000", 2023-01-02T18:16:52.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1134999999999999e-05 2023-01-02T18:16:52.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498723+0000", 2023-01-02T18:16:52.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3186999999999998e-05 2023-01-02T18:16:52.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498767+0000", 2023-01-02T18:16:52.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4067000000000006e-05 2023-01-02T18:16:52.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:52.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.498861+0000", 2023-01-02T18:16:52.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036586499999999999 2023-01-02T18:16:52.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:52.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499226+0000", 2023-01-02T18:16:52.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000519073 2023-01-02T18:16:52.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499746+0000", 2023-01-02T18:16:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6923e-05 2023-01-02T18:16:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:52.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499772+0000", 2023-01-02T18:16:52.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5809000000000002e-05 2023-01-02T18:16:52.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.499808+0000", 2023-01-02T18:16:52.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011449139999999999 2023-01-02T18:16:52.764 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.764 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.764 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.765 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:52 3.8 3:105263f9:::rbd_id.image4:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:52.765 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:52.765 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.125248581999999, 2023-01-02T18:16:52.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001, 2023-01-02T18:16:52.766 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.766 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:52.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:52.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:52.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 52 2023-01-02T18:16:52.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.767 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:52.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:52.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504931+0000", 2023-01-02T18:16:52.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5480000000000004e-06 2023-01-02T18:16:52.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504938+0000", 2023-01-02T18:16:52.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2118e-05 2023-01-02T18:16:52.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504950+0000", 2023-01-02T18:16:52.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.259e-06 2023-01-02T18:16:52.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504956+0000", 2023-01-02T18:16:52.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1742999999999997e-05 2023-01-02T18:16:52.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504987+0000", 2023-01-02T18:16:52.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3327999999999999e-05 2023-01-02T18:16:52.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505071+0000", 2023-01-02T18:16:52.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012434100000000001 2023-01-02T18:16:52.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:52.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505195+0000", 2023-01-02T18:16:52.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083202299999999999 2023-01-02T18:16:52.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:52.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506027+0000", 2023-01-02T18:16:52.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031725600000000003 2023-01-02T18:16:52.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:52.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506344+0000", 2023-01-02T18:16:52.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9904e-05 2023-01-02T18:16:52.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:52.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506374+0000", 2023-01-02T18:16:52.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9748e-05 2023-01-02T18:16:52.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506414+0000", 2023-01-02T18:16:52.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001 2023-01-02T18:16:52.780 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.780 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.780 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.781 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:55 3.8 3:105263f9:::rbd_id.image4:head [stat] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:52.781 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:52.781 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.112141404999999, 2023-01-02T18:16:52.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031460599999999999, 2023-01-02T18:16:52.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:52.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:52.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 55 2023-01-02T18:16:52.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:52.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518039+0000", 2023-01-02T18:16:52.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518037+0000", 2023-01-02T18:16:52.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1866e-05 2023-01-02T18:16:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518049+0000", 2023-01-02T18:16:52.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.658e-05 2023-01-02T18:16:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518066+0000", 2023-01-02T18:16:52.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9979999999999998e-06 2023-01-02T18:16:52.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518076+0000", 2023-01-02T18:16:52.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8603999999999996e-05 2023-01-02T18:16:52.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518144+0000", 2023-01-02T18:16:52.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000102503 2023-01-02T18:16:52.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518247+0000", 2023-01-02T18:16:52.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106745 2023-01-02T18:16:52.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518354+0000", 2023-01-02T18:16:52.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031460599999999999 2023-01-02T18:16:52.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.792 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.792 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.792 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:56 3.8 3:105263f9:::rbd_id.image4:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:16:52.792 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:52.793 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.111736607999999, 2023-01-02T18:16:52.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000468531, 2023-01-02T18:16:52.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 56 2023-01-02T18:16:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.794 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:52.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518444+0000", 2023-01-02T18:16:52.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518443+0000", 2023-01-02T18:16:52.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7650000000000001e-06 2023-01-02T18:16:52.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518448+0000", 2023-01-02T18:16:52.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8490000000000006e-06 2023-01-02T18:16:52.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518456+0000", 2023-01-02T18:16:52.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6070000000000001e-06 2023-01-02T18:16:52.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518460+0000", 2023-01-02T18:16:52.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7370999999999998e-05 2023-01-02T18:16:52.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518507+0000", 2023-01-02T18:16:52.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7069000000000002e-05 2023-01-02T18:16:52.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518605+0000", 2023-01-02T18:16:52.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000307683 2023-01-02T18:16:52.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.518912+0000", 2023-01-02T18:16:52.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000468531 2023-01-02T18:16:52.803 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.803 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.804 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.804 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.17 49/48 [PushOp(3:ece625d0:::rbd_id.image1:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:ece625d0:::rbd_id.image1:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:52.804 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:52.804 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.191769269, 2023-01-02T18:16:52.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077156600000000001, 2023-01-02T18:16:52.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.805 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.805 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:52.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438411+0000", 2023-01-02T18:16:52.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438410+0000", 2023-01-02T18:16:52.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6705999999999999e-05 2023-01-02T18:16:52.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438427+0000", 2023-01-02T18:16:52.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6349e-05 2023-01-02T18:16:52.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438473+0000", 2023-01-02T18:16:52.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2814e-05 2023-01-02T18:16:52.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438486+0000", 2023-01-02T18:16:52.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8907999999999997e-05 2023-01-02T18:16:52.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438565+0000", 2023-01-02T18:16:52.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7960000000000007e-06 2023-01-02T18:16:52.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.438575+0000", 2023-01-02T18:16:52.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060776299999999999 2023-01-02T18:16:52.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.439183+0000", 2023-01-02T18:16:52.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077156600000000001 2023-01-02T18:16:52.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.814 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.815 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPushReply(3.c 49/48 [PushReplyOp(3:34a1c61b:::rbd_object_map.12a24bcb1df7:head)])", 2023-01-02T18:16:52.815 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:52.815 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.182239394, 2023-01-02T18:16:52.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032333900000000002, 2023-01-02T18:16:52.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:52.816 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:52.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:52.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:52.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447941+0000", 2023-01-02T18:16:52.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4070000000000001e-06 2023-01-02T18:16:52.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447946+0000", 2023-01-02T18:16:52.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3749999999999992e-06 2023-01-02T18:16:52.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447955+0000", 2023-01-02T18:16:52.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8009999999999998e-06 2023-01-02T18:16:52.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447962+0000", 2023-01-02T18:16:52.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0476000000000002e-05 2023-01-02T18:16:52.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448023+0000", 2023-01-02T18:16:52.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024165999999999999 2023-01-02T18:16:52.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448264+0000", 2023-01-02T18:16:52.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032333900000000002 2023-01-02T18:16:52.823 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.824 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.824 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.824 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPushReply(3.2 49/48 [PushReplyOp(3:46824f4d:::rbd_header.11d5388773ee:head)])", 2023-01-02T18:16:52.825 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:52.825 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.17475995, 2023-01-02T18:16:52.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032223899999999999, 2023-01-02T18:16:52.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:16:52.826 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:52.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:52.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:52.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455420+0000", 2023-01-02T18:16:52.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1250000000000001e-06 2023-01-02T18:16:52.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455425+0000", 2023-01-02T18:16:52.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3523000000000001e-05 2023-01-02T18:16:52.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455439+0000", 2023-01-02T18:16:52.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8339999999999999e-06 2023-01-02T18:16:52.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455446+0000", 2023-01-02T18:16:52.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1134000000000003e-05 2023-01-02T18:16:52.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455488+0000", 2023-01-02T18:16:52.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025502700000000001 2023-01-02T18:16:52.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.455743+0000", 2023-01-02T18:16:52.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032223899999999999 2023-01-02T18:16:52.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.834 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.834 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:268 4.1a e50/47 4:5cea7035:::rbd_info:head v 50'1, mlcod=0'0)", 2023-01-02T18:16:52.835 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:52.835 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.1906593060000006, 2023-01-02T18:16:52.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089829000000000005, 2023-01-02T18:16:52.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:52.836 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:52.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:52.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:52.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439521+0000", 2023-01-02T18:16:52.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6930000000000007e-06 2023-01-02T18:16:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439528+0000", 2023-01-02T18:16:52.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3871e-05 2023-01-02T18:16:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439542+0000", 2023-01-02T18:16:52.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2069999999999995e-06 2023-01-02T18:16:52.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439550+0000", 2023-01-02T18:16:52.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2681e-05 2023-01-02T18:16:52.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439593+0000", 2023-01-02T18:16:52.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7476999999999999e-05 2023-01-02T18:16:52.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.439611+0000", 2023-01-02T18:16:52.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077682200000000004 2023-01-02T18:16:52.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:52.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.440387+0000", 2023-01-02T18:16:52.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1906000000000003e-05 2023-01-02T18:16:52.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:43.440419+0000", 2023-01-02T18:16:52.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089829000000000005 2023-01-02T18:16:52.845 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.845 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.846 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.846 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1 55/54 [PushOp(3:826f36d4:::rbd_header.12a2b7720443:head, version: 46'3, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 8, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:826f36d4:::rbd_header.12a2b7720443:head@46'3, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:52.846 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.335711+0000", 2023-01-02T18:16:52.847 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2944697170000001, 2023-01-02T18:16:52.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039667400000000002, 2023-01-02T18:16:52.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.847 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.847 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.335711+0000", 2023-01-02T18:16:52.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.335711+0000", 2023-01-02T18:16:52.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.335709+0000", 2023-01-02T18:16:52.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8821000000000002e-05 2023-01-02T18:16:52.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.335728+0000", 2023-01-02T18:16:52.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1997999999999998e-05 2023-01-02T18:16:52.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.335750+0000", 2023-01-02T18:16:52.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1932e-05 2023-01-02T18:16:52.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.335762+0000", 2023-01-02T18:16:52.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103686 2023-01-02T18:16:52.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.335866+0000", 2023-01-02T18:16:52.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1289999999999996e-06 2023-01-02T18:16:52.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.335874+0000", 2023-01-02T18:16:52.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000233248 2023-01-02T18:16:52.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336107+0000", 2023-01-02T18:16:52.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039667400000000002 2023-01-02T18:16:52.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.857 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.857 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.857 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1 55/54 [PushOp(3:80bf5b62:::rbd_object_map.12a279b662cb:head, version: 46'4, data_included: [0~30], data_size: 30, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:80bf5b62:::rbd_object_map.12a279b662cb:head@46'4, size: 30, copy_subset: [0~30], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:30, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:52.857 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.337771+0000", 2023-01-02T18:16:52.858 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2924093909999996, 2023-01-02T18:16:52.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051429000000000004, 2023-01-02T18:16:52.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.858 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.337771+0000", 2023-01-02T18:16:52.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.337771+0000", 2023-01-02T18:16:52.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.337770+0000", 2023-01-02T18:16:52.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2652e-05 2023-01-02T18:16:52.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.337783+0000", 2023-01-02T18:16:52.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6113999999999999e-05 2023-01-02T18:16:52.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.337799+0000", 2023-01-02T18:16:52.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7219999999999999e-06 2023-01-02T18:16:52.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.337807+0000", 2023-01-02T18:16:52.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0865999999999995e-05 2023-01-02T18:16:52.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.337877+0000", 2023-01-02T18:16:52.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0282000000000001e-05 2023-01-02T18:16:52.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.337888+0000", 2023-01-02T18:16:52.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000397475 2023-01-02T18:16:52.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.338285+0000", 2023-01-02T18:16:52.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051429000000000004 2023-01-02T18:16:52.867 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.867 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.868 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.868 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1 55/54 [PushOp(3:8430d359:::rbd_object_map.12a249b21fdb:head, version: 46'5, data_included: [0~30], data_size: 30, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:8430d359:::rbd_object_map.12a249b21fdb:head@46'5, size: 30, copy_subset: [0~30], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:30, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:52.868 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.339495+0000", 2023-01-02T18:16:52.868 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.290685388, 2023-01-02T18:16:52.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054665400000000004, 2023-01-02T18:16:52.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.869 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.339495+0000", 2023-01-02T18:16:52.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.339495+0000", 2023-01-02T18:16:52.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.339494+0000", 2023-01-02T18:16:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2551000000000001e-05 2023-01-02T18:16:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.339507+0000", 2023-01-02T18:16:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5616000000000001e-05 2023-01-02T18:16:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.339522+0000", 2023-01-02T18:16:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1600000000000001e-06 2023-01-02T18:16:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.339529+0000", 2023-01-02T18:16:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0679000000000005e-05 2023-01-02T18:16:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.339600+0000", 2023-01-02T18:16:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4530000000000008e-06 2023-01-02T18:16:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.339610+0000", 2023-01-02T18:16:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00043207500000000003 2023-01-02T18:16:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.340042+0000", 2023-01-02T18:16:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054665400000000004 2023-01-02T18:16:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.878 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.879 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.879 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1 55/54 [PushOp(3:86ee0603:::rbd_header.12a295212ba1:head, version: 46'13, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 8, attrset_size: 3, recovery_info: ObjectRecoveryInfo(3:86ee0603:::rbd_header.12a295212ba1:head@46'13, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:52.879 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.341318+0000", 2023-01-02T18:16:52.879 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2888619959999996, 2023-01-02T18:16:52.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033935600000000002, 2023-01-02T18:16:52.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:52.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:52.880 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:52.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:52.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341318+0000", 2023-01-02T18:16:52.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:52.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341318+0000", 2023-01-02T18:16:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341318+0000", 2023-01-02T18:16:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6526999999999999e-05 2023-01-02T18:16:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:52.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341334+0000", 2023-01-02T18:16:52.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4761e-05 2023-01-02T18:16:52.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:52.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341349+0000", 2023-01-02T18:16:52.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9110000000000004e-06 2023-01-02T18:16:52.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:52.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341356+0000", 2023-01-02T18:16:52.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3645999999999993e-05 2023-01-02T18:16:52.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:52.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341419+0000", 2023-01-02T18:16:52.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7469999999999994e-06 2023-01-02T18:16:52.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:52.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341428+0000", 2023-01-02T18:16:52.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022954099999999999 2023-01-02T18:16:52.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:52.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:52.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:52.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.341658+0000", 2023-01-02T18:16:52.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033935600000000002 2023-01-02T18:16:52.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.889 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:52.889 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:52.890 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:52.891 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:52.892 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 274 (0%) 2023-01-02T18:16:52.892 INFO:teuthology.orchestra.run.smithi007.stdout:avg 45.6667 2023-01-02T18:16:52.892 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 7.67391 -> 7.67391 (expected baseline 6.16892) 2023-01-02T18:16:52.893 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 32 -> 32 pgs (0.70073 -> 0.70073 * mean) 2023-01-02T18:16:52.893 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 55 -> 55 pgs (1.20438 -> 1.20438 * mean) 2023-01-02T18:16:52.893 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:52.893 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:16:52.893 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 3 2023-01-02T18:16:52.893 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:16:52.894 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:16:52.894 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0006 2023-01-02T18:16:52.895 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:16:52.895 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2023-01-02T18:16:52.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 3.0 2023-01-02T18:16:52.896 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:52.892+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:52.992 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:52.992+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:53.036 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:53.036 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:53.037 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:53.037 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:53.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:53.131 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:53.132+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:53.193 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:53.194+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:53.213 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:53.213 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:53.213 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:53.214 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:53.214 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:53.223 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:53.231 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 274 (0%) 2023-01-02T18:16:53.232 INFO:teuthology.orchestra.run.smithi007.stdout:avg 45.6667 2023-01-02T18:16:53.232 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 7.67391 -> 7.67391 (expected baseline 6.16892) 2023-01-02T18:16:53.232 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 32 -> 32 pgs (0.70073 -> 0.70073 * mean) 2023-01-02T18:16:53.232 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 55 -> 55 pgs (1.20438 -> 1.20438 * mean) 2023-01-02T18:16:53.233 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:53.233 INFO:teuthology.orchestra.run.smithi007.stdout:oload 110 2023-01-02T18:16:53.233 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 3 2023-01-02T18:16:53.233 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:16:53.233 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:16:53.233 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0001 2023-01-02T18:16:53.234 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:16:53.245 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2023-01-02T18:16:53.245 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2023-01-02T18:16:53.268 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:53.306 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:53.307+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:53.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:16:53.393 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:16:53.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1 3.1a 3:5bdd5772:::image1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:16:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.979228079, 2023-01-02T18:16:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839, 2023-01-02T18:16:53.395 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:16:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:53.396 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1 2023-01-02T18:16:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413949+0000", 2023-01-02T18:16:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8359999999999999e-06 2023-01-02T18:16:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413954+0000", 2023-01-02T18:16:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2023-01-02T18:16:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413961+0000", 2023-01-02T18:16:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7519999999999999e-06 2023-01-02T18:16:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413968+0000", 2023-01-02T18:16:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0071999999999999e-05 2023-01-02T18:16:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414008+0000", 2023-01-02T18:16:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1890000000000001e-06 2023-01-02T18:16:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:16:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414015+0000", 2023-01-02T18:16:53.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013744829999999999 2023-01-02T18:16:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415389+0000", 2023-01-02T18:16:53.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1655000000000003e-05 2023-01-02T18:16:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415471+0000", 2023-01-02T18:16:53.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839 2023-01-02T18:16:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:16:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.978278292000001, 2023-01-02T18:16:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:16:53.408 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:53.409 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:16:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:16:53.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:16:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:16:53.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:16:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:16:53.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:16:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:16:53.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:16:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:16:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:16:53.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:16:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:16:53.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:16:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:16:53.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:16:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:16:53.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:16:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:16:53.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:16:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:16:53.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:16:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:16:53.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:16:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:16:53.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:16:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:16:53.424 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.425 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.97261003, 2023-01-02T18:16:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:16:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.426 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:16:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.427 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:53.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:16:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:16:53.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:16:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:16:53.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:16:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:16:53.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:16:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:16:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:16:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:16:53.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:16:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:16:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:16:53.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:16:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:16:53.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:16:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:16:53.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:16:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:16:53.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:16:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:16:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:16:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:16:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:16:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:16:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:16:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:16:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.442 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:53.443 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.967076368000001, 2023-01-02T18:16:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:16:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.444 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:16:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:16:53.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:16:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:16:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:16:53.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:16:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:16:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:16:53.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:16:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:16:53.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:16:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:16:53.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:16:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:16:53.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:16:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:16:53.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.455 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:11 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.959373368, 2023-01-02T18:16:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152, 2023-01-02T18:16:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.456 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:53.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:53.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:53.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:16:53.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433810+0000", 2023-01-02T18:16:53.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1821000000000001e-05 2023-01-02T18:16:53.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433822+0000", 2023-01-02T18:16:53.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4549999999999998e-06 2023-01-02T18:16:53.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433829+0000", 2023-01-02T18:16:53.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6005000000000003e-05 2023-01-02T18:16:53.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433885+0000", 2023-01-02T18:16:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.16e-05 2023-01-02T18:16:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433907+0000", 2023-01-02T18:16:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011094480000000001 2023-01-02T18:16:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435016+0000", 2023-01-02T18:16:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8626999999999999e-05 2023-01-02T18:16:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435045+0000", 2023-01-02T18:16:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152 2023-01-02T18:16:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.466 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:24 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:53.467 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.943744863999999, 2023-01-02T18:16:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997, 2023-01-02T18:16:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449431+0000", 2023-01-02T18:16:53.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7706e-05 2023-01-02T18:16:53.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449449+0000", 2023-01-02T18:16:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0883999999999998e-05 2023-01-02T18:16:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449480+0000", 2023-01-02T18:16:53.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4416000000000001e-05 2023-01-02T18:16:53.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449494+0000", 2023-01-02T18:16:53.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6549000000000001e-05 2023-01-02T18:16:53.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449581+0000", 2023-01-02T18:16:53.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9669000000000003e-05 2023-01-02T18:16:53.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449620+0000", 2023-01-02T18:16:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0006958 2023-01-02T18:16:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450316+0000", 2023-01-02T18:16:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0188e-05 2023-01-02T18:16:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450346+0000", 2023-01-02T18:16:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997 2023-01-02T18:16:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.478 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:30 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:53.479 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.936342357999999, 2023-01-02T18:16:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003, 2023-01-02T18:16:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456835+0000", 2023-01-02T18:16:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7504999999999999e-05 2023-01-02T18:16:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456852+0000", 2023-01-02T18:16:53.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2356e-05 2023-01-02T18:16:53.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456865+0000", 2023-01-02T18:16:53.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.421e-06 2023-01-02T18:16:53.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456871+0000", 2023-01-02T18:16:53.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8040999999999997e-05 2023-01-02T18:16:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456909+0000", 2023-01-02T18:16:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5384e-05 2023-01-02T18:16:53.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456925+0000", 2023-01-02T18:16:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074633700000000002 2023-01-02T18:16:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457671+0000", 2023-01-02T18:16:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7826000000000001e-05 2023-01-02T18:16:53.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457699+0000", 2023-01-02T18:16:53.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003 2023-01-02T18:16:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.491 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:31 3.1c e46/43 3:3d3f3250:::rbd_id.image2:head v 46'3, mlcod=46'1)", 2023-01-02T18:16:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.934713875, 2023-01-02T18:16:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999, 2023-01-02T18:16:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.492 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:53.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458463+0000", 2023-01-02T18:16:53.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3389999999999998e-06 2023-01-02T18:16:53.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458470+0000", 2023-01-02T18:16:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.205e-05 2023-01-02T18:16:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458482+0000", 2023-01-02T18:16:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5809999999999996e-06 2023-01-02T18:16:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458487+0000", 2023-01-02T18:16:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8702000000000001e-05 2023-01-02T18:16:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458546+0000", 2023-01-02T18:16:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2495e-05 2023-01-02T18:16:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458559+0000", 2023-01-02T18:16:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001846735 2023-01-02T18:16:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460405+0000", 2023-01-02T18:16:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9183000000000002e-05 2023-01-02T18:16:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460435+0000", 2023-01-02T18:16:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999 2023-01-02T18:16:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:32 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.931364166, 2023-01-02T18:16:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997, 2023-01-02T18:16:53.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:53.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:53.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:53.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3030000000000001e-06 2023-01-02T18:16:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461818+0000", 2023-01-02T18:16:53.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0964999999999999e-05 2023-01-02T18:16:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461829+0000", 2023-01-02T18:16:53.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8039999999999998e-06 2023-01-02T18:16:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461835+0000", 2023-01-02T18:16:53.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8708999999999997e-05 2023-01-02T18:16:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461884+0000", 2023-01-02T18:16:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5057e-05 2023-01-02T18:16:53.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461899+0000", 2023-01-02T18:16:53.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061687999999999999 2023-01-02T18:16:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462515+0000", 2023-01-02T18:16:53.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1633e-05 2023-01-02T18:16:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462547+0000", 2023-01-02T18:16:53.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997 2023-01-02T18:16:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:33 3.3 3:c76fae31:::rbd_object_map.12a21ad382ee:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.930321313, 2023-01-02T18:16:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001, 2023-01-02T18:16:53.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:53.517 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33 2023-01-02T18:16:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462856+0000", 2023-01-02T18:16:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4710000000000004e-06 2023-01-02T18:16:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462862+0000", 2023-01-02T18:16:53.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:16:53.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462875+0000", 2023-01-02T18:16:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.491e-05 2023-01-02T18:16:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462890+0000", 2023-01-02T18:16:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9657999999999999e-05 2023-01-02T18:16:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462930+0000", 2023-01-02T18:16:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1362999999999999e-05 2023-01-02T18:16:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463021+0000", 2023-01-02T18:16:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015166800000000001 2023-01-02T18:16:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:16:53.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463173+0000", 2023-01-02T18:16:53.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074740899999999999 2023-01-02T18:16:53.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463920+0000", 2023-01-02T18:16:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045107699999999998 2023-01-02T18:16:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:53.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464372+0000", 2023-01-02T18:16:53.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6213e-05 2023-01-02T18:16:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464408+0000", 2023-01-02T18:16:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.535e-05 2023-01-02T18:16:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464433+0000", 2023-01-02T18:16:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001 2023-01-02T18:16:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:45 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.919611707, 2023-01-02T18:16:53.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892, 2023-01-02T18:16:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473565+0000", 2023-01-02T18:16:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5140000000000004e-06 2023-01-02T18:16:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473573+0000", 2023-01-02T18:16:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2473000000000001e-05 2023-01-02T18:16:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473585+0000", 2023-01-02T18:16:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2159999999999997e-06 2023-01-02T18:16:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473591+0000", 2023-01-02T18:16:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0025999999999999e-05 2023-01-02T18:16:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473631+0000", 2023-01-02T18:16:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3309000000000001e-05 2023-01-02T18:16:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473644+0000", 2023-01-02T18:16:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057332800000000001 2023-01-02T18:16:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474217+0000", 2023-01-02T18:16:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0043999999999999e-05 2023-01-02T18:16:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474247+0000", 2023-01-02T18:16:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892 2023-01-02T18:16:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:46 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'3, mlcod=46'1)", 2023-01-02T18:16:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:53.545 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.918279945, 2023-01-02T18:16:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997, 2023-01-02T18:16:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474897+0000", 2023-01-02T18:16:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8789999999999992e-06 2023-01-02T18:16:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474906+0000", 2023-01-02T18:16:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3468e-05 2023-01-02T18:16:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474920+0000", 2023-01-02T18:16:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8460000000000002e-06 2023-01-02T18:16:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474926+0000", 2023-01-02T18:16:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6996000000000003e-05 2023-01-02T18:16:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474963+0000", 2023-01-02T18:16:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2276000000000001e-05 2023-01-02T18:16:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474976+0000", 2023-01-02T18:16:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066849900000000002 2023-01-02T18:16:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475644+0000", 2023-01-02T18:16:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2233999999999997e-05 2023-01-02T18:16:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475676+0000", 2023-01-02T18:16:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997 2023-01-02T18:16:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:53 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:53.557 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.883367756, 2023-01-02T18:16:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082, 2023-01-02T18:16:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3499999999999996e-06 2023-01-02T18:16:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509815+0000", 2023-01-02T18:16:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0020999999999999e-05 2023-01-02T18:16:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509825+0000", 2023-01-02T18:16:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1399999999999997e-06 2023-01-02T18:16:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509832+0000", 2023-01-02T18:16:53.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3279999999999999e-05 2023-01-02T18:16:53.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509875+0000", 2023-01-02T18:16:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0288e-05 2023-01-02T18:16:53.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509895+0000", 2023-01-02T18:16:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000905152 2023-01-02T18:16:53.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510800+0000", 2023-01-02T18:16:53.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1238000000000001e-05 2023-01-02T18:16:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510832+0000", 2023-01-02T18:16:53.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082 2023-01-02T18:16:53.569 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.569 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.569 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:16:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.881377215000001, 2023-01-02T18:16:53.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:16:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:16:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:16:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:16:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:16:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:16:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:16:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:16:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:16:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:16:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:16:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:16:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:16:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:16:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:16:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:16:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:16:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.581 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:66 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:53.582 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.870219058, 2023-01-02T18:16:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997, 2023-01-02T18:16:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.583 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522958+0000", 2023-01-02T18:16:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6449999999999994e-06 2023-01-02T18:16:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522967+0000", 2023-01-02T18:16:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3166000000000001e-05 2023-01-02T18:16:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522980+0000", 2023-01-02T18:16:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:16:53.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522987+0000", 2023-01-02T18:16:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4501000000000001e-05 2023-01-02T18:16:53.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523022+0000", 2023-01-02T18:16:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5023e-05 2023-01-02T18:16:53.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523037+0000", 2023-01-02T18:16:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057705099999999997 2023-01-02T18:16:53.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523614+0000", 2023-01-02T18:16:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1579999999999999e-05 2023-01-02T18:16:53.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523645+0000", 2023-01-02T18:16:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997 2023-01-02T18:16:53.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.594 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.594 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:26 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'6, mlcod=46'4)", 2023-01-02T18:16:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.854854452, 2023-01-02T18:16:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005, 2023-01-02T18:16:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.595 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.596 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:53.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538323+0000", 2023-01-02T18:16:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8736000000000002e-05 2023-01-02T18:16:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538342+0000", 2023-01-02T18:16:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6739999999999992e-06 2023-01-02T18:16:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538351+0000", 2023-01-02T18:16:53.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6460000000000001e-06 2023-01-02T18:16:53.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538356+0000", 2023-01-02T18:16:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.57e-05 2023-01-02T18:16:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538402+0000", 2023-01-02T18:16:53.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6050999999999998e-05 2023-01-02T18:16:53.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538428+0000", 2023-01-02T18:16:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055106199999999995 2023-01-02T18:16:53.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538979+0000", 2023-01-02T18:16:53.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7333000000000001e-05 2023-01-02T18:16:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539006+0000", 2023-01-02T18:16:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005 2023-01-02T18:16:53.606 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.607 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:27 3.f e46/43 3:f63788c7:::rbd_id.image5:head v 46'6, mlcod=46'4)", 2023-01-02T18:16:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.853534380999999, 2023-01-02T18:16:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001, 2023-01-02T18:16:53.608 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.609 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.609 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539643+0000", 2023-01-02T18:16:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0418999999999999e-05 2023-01-02T18:16:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539663+0000", 2023-01-02T18:16:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3852999999999999e-05 2023-01-02T18:16:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539677+0000", 2023-01-02T18:16:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5100000000000004e-06 2023-01-02T18:16:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539684+0000", 2023-01-02T18:16:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9595999999999998e-05 2023-01-02T18:16:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539723+0000", 2023-01-02T18:16:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7207999999999999e-05 2023-01-02T18:16:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539741+0000", 2023-01-02T18:16:53.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063475200000000004 2023-01-02T18:16:53.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540375+0000", 2023-01-02T18:16:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5425e-05 2023-01-02T18:16:53.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540411+0000", 2023-01-02T18:16:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001 2023-01-02T18:16:53.619 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.620 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:16:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.9594215520000002, 2023-01-02T18:16:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:16:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.621 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:16:53.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:53.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:16:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:16:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:16:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:16:53.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:16:53.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:16:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:16:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:16:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:16:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:16:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:16:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:53.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:16:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:16:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:16:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:16:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:16:53.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:16:53.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:16:53.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:16:53.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:16:53.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:53.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:16:53.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:16:53.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:53.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:16:53.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:16:53.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:16:53.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:16:53.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:16:53.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:16:53.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.638 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.639 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:16:53.639 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:53.639 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0946404940000001, 2023-01-02T18:16:53.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:16:53.639 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.640 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.640 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:53.640 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:53.640 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:53.640 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:16:53.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.641 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:53.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:53.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:53.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:16:53.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:16:53.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:16:53.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:16:53.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:16:53.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:16:53.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:16:53.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:16:53.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:16:53.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:16:53.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:53.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:16:53.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:16:53.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:16:53.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:16:53.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:16:53.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:16:53.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:16:53.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:16:53.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:16:53.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:53.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:16:53.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:16:53.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:53.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:16:53.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:16:53.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:16:53.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:16:53.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:16:53.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:16:53.656 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.656 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.656 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.657 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:272 4.9 4:911e4614:::rbd_id.image18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:16:53.657 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:53.657 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0830119739999997, 2023-01-02T18:16:53.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999, 2023-01-02T18:16:53.658 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:53.658 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:53.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:53.658 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:53.659 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:53.659 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 272 2023-01-02T18:16:53.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.659 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:53.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:53.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:53.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:53.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:53.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:53.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:53.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:53.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310165+0000", 2023-01-02T18:16:53.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.628e-06 2023-01-02T18:16:53.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:53.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310174+0000", 2023-01-02T18:16:53.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2023-01-02T18:16:53.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:53.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310190+0000", 2023-01-02T18:16:53.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:16:53.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:53.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310198+0000", 2023-01-02T18:16:53.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6770000000000001e-05 2023-01-02T18:16:53.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:53.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310245+0000", 2023-01-02T18:16:53.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159517 2023-01-02T18:16:53.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:53.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310404+0000", 2023-01-02T18:16:53.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023075600000000001 2023-01-02T18:16:53.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:53.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310635+0000", 2023-01-02T18:16:53.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088889700000000004 2023-01-02T18:16:53.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:53.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311524+0000", 2023-01-02T18:16:53.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011021 2023-01-02T18:16:53.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:53.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311634+0000", 2023-01-02T18:16:53.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2626000000000002e-05 2023-01-02T18:16:53.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:53.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311667+0000", 2023-01-02T18:16:53.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9774000000000002e-05 2023-01-02T18:16:53.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:53.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:53.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:53.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311706+0000", 2023-01-02T18:16:53.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999 2023-01-02T18:16:53.673 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.673 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.673 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:53.674 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:53.674 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:53.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:53.677 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:53.676+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:53.678 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:53.678 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:53.678 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:53.678 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:53.678 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:53.679 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:53.679 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:53.679 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:53.679 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:53.680 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:53.681 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:53.681 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 274 (0%) 2023-01-02T18:16:53.681 INFO:teuthology.orchestra.run.smithi007.stdout:avg 45.6667 2023-01-02T18:16:53.682 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 7.67391 -> 7.67391 (expected baseline 6.16892) 2023-01-02T18:16:53.682 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 32 -> 32 pgs (0.70073 -> 0.70073 * mean) 2023-01-02T18:16:53.682 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 55 -> 55 pgs (1.20438 -> 1.20438 * mean) 2023-01-02T18:16:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:53.683 INFO:teuthology.orchestra.run.smithi007.stdout:oload 110 2023-01-02T18:16:53.683 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 1 2023-01-02T18:16:53.683 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:16:53.683 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:16:53.683 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0001 2023-01-02T18:16:53.685 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:16:53.685 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2023-01-02T18:16:53.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2023-01-02T18:16:53.777 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:53.777+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:53.789 INFO:tasks.workunit.client.0.smithi007.stdout:image: image22 2023-01-02T18:16:53.789 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image22 2023-01-02T18:16:53.789 INFO:tasks.workunit.client.0.smithi007.stdout:found image22 2023-01-02T18:16:53.789 INFO:tasks.workunit.client.0.smithi007.stdout:erased image22 2023-01-02T18:16:53.790 INFO:tasks.workunit.client.0.smithi007.stdout:image: image22 2023-01-02T18:16:53.790 INFO:tasks.workunit.client.0.smithi007.stdout:image: image23 2023-01-02T18:16:53.790 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image22 2023-01-02T18:16:53.790 INFO:tasks.workunit.client.0.smithi007.stdout:found image22 2023-01-02T18:16:53.790 INFO:tasks.workunit.client.0.smithi007.stdout:erased image22 2023-01-02T18:16:53.791 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image23 2023-01-02T18:16:53.791 INFO:tasks.workunit.client.0.smithi007.stdout:found image23 2023-01-02T18:16:53.791 INFO:tasks.workunit.client.0.smithi007.stdout:erased image23 2023-01-02T18:16:53.791 INFO:tasks.workunit.client.0.smithi007.stdout:100.00% done 2023-01-02T18:16:53.791 INFO:tasks.workunit.client.0.smithi007.stdout:image: image22 2023-01-02T18:16:53.792 INFO:tasks.workunit.client.0.smithi007.stdout:image: image23 2023-01-02T18:16:53.792 INFO:tasks.workunit.client.0.smithi007.stdout:image: image24 2023-01-02T18:16:53.792 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image22 2023-01-02T18:16:53.792 INFO:tasks.workunit.client.0.smithi007.stdout:found image22 2023-01-02T18:16:53.793 INFO:tasks.workunit.client.0.smithi007.stdout:erased image22 2023-01-02T18:16:53.793 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image23 2023-01-02T18:16:53.793 INFO:tasks.workunit.client.0.smithi007.stdout:found image23 2023-01-02T18:16:53.794 INFO:tasks.workunit.client.0.smithi007.stdout:erased image23 2023-01-02T18:16:53.794 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image24 2023-01-02T18:16:53.794 INFO:tasks.workunit.client.0.smithi007.stdout:found image24 2023-01-02T18:16:53.794 INFO:tasks.workunit.client.0.smithi007.stdout:erased image24 2023-01-02T18:16:53.795 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestCopy (4388 ms) 2023-01-02T18:16:53.795 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestCopyPP 2023-01-02T18:16:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:53.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:53.877 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:53.877+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:53.978 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:53.979+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:53.999 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 274 (0%) 2023-01-02T18:16:53.999 INFO:teuthology.orchestra.run.smithi007.stdout:avg 45.6667 2023-01-02T18:16:54.000 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 7.67391 -> 7.67391 (expected baseline 6.16892) 2023-01-02T18:16:54.000 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 32 -> 32 pgs (0.70073 -> 0.70073 * mean) 2023-01-02T18:16:54.000 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 55 -> 55 pgs (1.20438 -> 1.20438 * mean) 2023-01-02T18:16:54.001 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:54.001 INFO:teuthology.orchestra.run.smithi007.stdout:oload 110 2023-01-02T18:16:54.002 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 1 2023-01-02T18:16:54.002 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:16:54.002 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:16:54.003 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0001 2023-01-02T18:16:54.004 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:16:54.012 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2023-01-02T18:16:54.013 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2023-01-02T18:16:54.024 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:54.025 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:54.035 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:54.097 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:54.097+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:54.180 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:54.179+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:54.200 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:54.200 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:54.210 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:54.281 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:54.281+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:54.314 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:16:54.341 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:54.342 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:54.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:54.364 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 338 (0%) 2023-01-02T18:16:54.365 INFO:teuthology.orchestra.run.smithi007.stdout:avg 56.3333 2023-01-02T18:16:54.365 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 8.03465 -> 8.03465 (expected baseline 6.8516) 2023-01-02T18:16:54.365 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 41 -> 41 pgs (0.727811 -> 0.727811 * mean) 2023-01-02T18:16:54.365 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 65 -> 65 pgs (1.15385 -> 1.15385 * mean) 2023-01-02T18:16:54.366 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:54.366 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:16:54.366 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 0.05 2023-01-02T18:16:54.366 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:16:54.366 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:16:54.367 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0006 2023-01-02T18:16:54.367 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:16:54.396 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:54.397+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:54.478 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:54.478 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:54.482 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:54.482+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:54.490 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:54.583 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:54.583+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:54.655 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:54.656 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:54.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:54.709 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:54.710+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:54.785 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:54.785+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:54.791 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:54.791 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:54.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:54.886 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:54.886+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:54.968 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:54.968 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:54.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:54.987 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:54.987+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:55.088 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:55.088+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:55.104 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:55.104 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:55.114 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:55.188 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:55.189+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:55.254 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:55.254 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:55.264 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:55.311 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:55.309+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:55.312 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:55.391 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:55.391+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:55.401 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:55.401 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:55.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:55.492 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:55.492+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:55.581 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:55.581 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:55.591 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:16:55.597 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:55.593+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:55.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:16:55.719 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:55.720 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:55.720 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:55.719+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:55.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:16:55.818 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:55.818+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:55.830 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:55.847 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:55.867 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:55.884 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:55.895 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:55.895+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:55.902 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:55.902 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:55.902 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:55.903 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:55.903 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:55.903 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:55.912 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:16:55.921 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:55.939 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:55.958 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:55.959 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:16:55.959 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:16:55.959 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:16:55.960 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:16:55.960 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:16:55.960 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:16:55.960 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:16:55.961 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:16:55.997 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:55.997+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:56.050 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:56.050 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:56.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:56.051 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:56.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.051 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:6 3.1a e45/43 3:5cea7035:::rbd_info:head v 45'1, mlcod=0'0)", 2023-01-02T18:16:56.051 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:56.051 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.63183274, 2023-01-02T18:16:56.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998, 2023-01-02T18:16:56.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.052 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:56.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:56.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:16:56.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:16:56.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3349999999999997e-06 2023-01-02T18:16:56.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417398+0000", 2023-01-02T18:16:56.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7995999999999998e-05 2023-01-02T18:16:56.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417416+0000", 2023-01-02T18:16:56.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2250000000000003e-06 2023-01-02T18:16:56.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417423+0000", 2023-01-02T18:16:56.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6785e-05 2023-01-02T18:16:56.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417470+0000", 2023-01-02T18:16:56.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2886000000000001e-05 2023-01-02T18:16:56.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417492+0000", 2023-01-02T18:16:56.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070370800000000005 2023-01-02T18:16:56.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418196+0000", 2023-01-02T18:16:56.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1628999999999998e-05 2023-01-02T18:16:56.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418228+0000", 2023-01-02T18:16:56.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998 2023-01-02T18:16:56.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.062 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.063 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:56.063 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:56.063 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.625258168999999, 2023-01-02T18:16:56.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:16:56.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.064 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.064 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:56.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:56.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:56.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:16:56.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:16:56.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:16:56.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:16:56.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:16:56.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:16:56.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:16:56.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:16:56.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:16:56.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:16:56.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:16:56.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:16:56.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:16:56.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:16:56.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:16:56.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:16:56.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.073 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.074 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:56.074 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:56.075 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.566058461000001, 2023-01-02T18:16:56.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:16:56.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.075 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.075 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:56.076 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:56.076 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:56.076 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:16:56.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.076 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:56.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:16:56.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:56.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:16:56.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:16:56.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:16:56.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:16:56.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:16:56.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:16:56.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:16:56.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:16:56.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:16:56.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:16:56.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:16:56.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:16:56.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:16:56.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:16:56.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:16:56.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:56.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:16:56.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:16:56.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:56.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:16:56.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:16:56.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:16:56.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:16:56.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:16:56.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:16:56.089 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.089 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.089 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.090 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3d3f3250:::rbd_id.image2:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d3f3250:::rbd_id.image2:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:56.090 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:56.090 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.601832696000001, 2023-01-02T18:16:56.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004, 2023-01-02T18:16:56.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:56.091 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:56.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:16:56.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:56.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447391+0000", 2023-01-02T18:16:56.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8275e-05 2023-01-02T18:16:56.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447410+0000", 2023-01-02T18:16:56.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3377999999999999e-05 2023-01-02T18:16:56.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447433+0000", 2023-01-02T18:16:56.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6303e-05 2023-01-02T18:16:56.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447449+0000", 2023-01-02T18:16:56.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000438212 2023-01-02T18:16:56.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447888+0000", 2023-01-02T18:16:56.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.169e-05 2023-01-02T18:16:56.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447899+0000", 2023-01-02T18:16:56.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035861500000000001 2023-01-02T18:16:56.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448258+0000", 2023-01-02T18:16:56.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004 2023-01-02T18:16:56.099 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.099 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.100 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:16:56.100 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:16:56.100 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.7206976200000001, 2023-01-02T18:16:56.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:16:56.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.101 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.101 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:16:56.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:16:56.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:56.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:16:56.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:16:56.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:16:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:16:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:16:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:16:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:16:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:16:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:16:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:16:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:16:56.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:16:56.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:16:56.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:16:56.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:16:56.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:16:56.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.111 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.112 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:16:56.112 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:16:56.112 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.708261818, 2023-01-02T18:16:56.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:16:56.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.113 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:16:56.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:16:56.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:16:56.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:16:56.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:16:56.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:16:56.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:16:56.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:16:56.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:16:56.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:16:56.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:16:56.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:16:56.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:16:56.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:16:56.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:16:56.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:16:56.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:16:56.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:16:56.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:16:56.122 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.123 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.123 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.123 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:402 6.1a e60/57 6:5cea7035:::rbd_info:head v 60'2, mlcod=0'0)", 2023-01-02T18:16:56.124 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.346179+0000", 2023-01-02T18:16:56.124 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.7030459210000002, 2023-01-02T18:16:56.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069543000000000003, 2023-01-02T18:16:56.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.125 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346179+0000", 2023-01-02T18:16:56.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346179+0000", 2023-01-02T18:16:56.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:56.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346179+0000", 2023-01-02T18:16:56.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9920000000000004e-06 2023-01-02T18:16:56.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346185+0000", 2023-01-02T18:16:56.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2836999999999999e-05 2023-01-02T18:16:56.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346198+0000", 2023-01-02T18:16:56.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1910000000000003e-06 2023-01-02T18:16:56.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346205+0000", 2023-01-02T18:16:56.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9830000000000002e-05 2023-01-02T18:16:56.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346255+0000", 2023-01-02T18:16:56.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8848999999999999e-05 2023-01-02T18:16:56.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346274+0000", 2023-01-02T18:16:56.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056604400000000003 2023-01-02T18:16:56.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346840+0000", 2023-01-02T18:16:56.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5083999999999998e-05 2023-01-02T18:16:56.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.346875+0000", 2023-01-02T18:16:56.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069543000000000003 2023-01-02T18:16:56.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.134 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.135 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:405 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'1, mlcod=0'0)", 2023-01-02T18:16:56.135 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.351921+0000", 2023-01-02T18:16:56.135 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.697304371, 2023-01-02T18:16:56.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075132400000000005, 2023-01-02T18:16:56.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.136 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351921+0000", 2023-01-02T18:16:56.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351921+0000", 2023-01-02T18:16:56.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:56.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351920+0000", 2023-01-02T18:16:56.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4540000000000001e-06 2023-01-02T18:16:56.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351928+0000", 2023-01-02T18:16:56.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3553999999999999e-05 2023-01-02T18:16:56.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351941+0000", 2023-01-02T18:16:56.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0916e-05 2023-01-02T18:16:56.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351952+0000", 2023-01-02T18:16:56.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3973e-05 2023-01-02T18:16:56.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352006+0000", 2023-01-02T18:16:56.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3898999999999999e-05 2023-01-02T18:16:56.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352030+0000", 2023-01-02T18:16:56.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060174100000000004 2023-01-02T18:16:56.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352632+0000", 2023-01-02T18:16:56.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0311000000000001e-05 2023-01-02T18:16:56.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352672+0000", 2023-01-02T18:16:56.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075132400000000005 2023-01-02T18:16:56.146 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.146 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.146 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.147 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:436 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'5, mlcod=60'3)", 2023-01-02T18:16:56.147 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.371104+0000", 2023-01-02T18:16:56.147 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.67812165, 2023-01-02T18:16:56.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073074399999999997, 2023-01-02T18:16:56.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.148 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.148 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371104+0000", 2023-01-02T18:16:56.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371104+0000", 2023-01-02T18:16:56.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:56.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371102+0000", 2023-01-02T18:16:56.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0803e-05 2023-01-02T18:16:56.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371113+0000", 2023-01-02T18:16:56.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6314e-05 2023-01-02T18:16:56.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371129+0000", 2023-01-02T18:16:56.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0219999999999999e-06 2023-01-02T18:16:56.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371136+0000", 2023-01-02T18:16:56.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3279000000000001e-05 2023-01-02T18:16:56.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371210+0000", 2023-01-02T18:16:56.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5660000000000002e-05 2023-01-02T18:16:56.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371235+0000", 2023-01-02T18:16:56.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055612499999999998 2023-01-02T18:16:56.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371791+0000", 2023-01-02T18:16:56.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2886999999999998e-05 2023-01-02T18:16:56.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371834+0000", 2023-01-02T18:16:56.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073074399999999997 2023-01-02T18:16:56.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.157 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.158 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.158 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:16:56.158 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:16:56.159 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.6735890800000002, 2023-01-02T18:16:56.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:16:56.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.159 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.159 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:16:56.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:16:56.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:56.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:16:56.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:16:56.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:16:56.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:16:56.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:16:56.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:16:56.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:16:56.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:16:56.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:16:56.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:16:56.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:16:56.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:16:56.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:16:56.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:16:56.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:16:56.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:16:56.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.169 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.170 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:452 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'7, mlcod=60'5)", 2023-01-02T18:16:56.170 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.380926+0000", 2023-01-02T18:16:56.170 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.6682993819999998, 2023-01-02T18:16:56.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076907699999999996, 2023-01-02T18:16:56.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.171 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.380926+0000", 2023-01-02T18:16:56.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.380926+0000", 2023-01-02T18:16:56.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:56.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.380924+0000", 2023-01-02T18:16:56.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3444999999999999e-05 2023-01-02T18:16:56.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.380938+0000", 2023-01-02T18:16:56.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0220999999999998e-05 2023-01-02T18:16:56.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.380958+0000", 2023-01-02T18:16:56.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.268e-06 2023-01-02T18:16:56.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.380967+0000", 2023-01-02T18:16:56.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4645000000000001e-05 2023-01-02T18:16:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.381042+0000", 2023-01-02T18:16:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1416e-05 2023-01-02T18:16:56.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.381063+0000", 2023-01-02T18:16:56.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059418000000000003 2023-01-02T18:16:56.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.381658+0000", 2023-01-02T18:16:56.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7336000000000003e-05 2023-01-02T18:16:56.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.381695+0000", 2023-01-02T18:16:56.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076907699999999996 2023-01-02T18:16:56.180 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.180 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.181 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.181 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:16:56.181 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:16:56.182 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.6633120610000001, 2023-01-02T18:16:56.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:16:56.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.182 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:16:56.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:16:56.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:56.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:16:56.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:16:56.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:16:56.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:16:56.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:16:56.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:16:56.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:16:56.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:16:56.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:16:56.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:16:56.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:16:56.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:16:56.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:16:56.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:16:56.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:16:56.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:16:56.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.192 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.192 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.193 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:468 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'9, mlcod=60'7)", 2023-01-02T18:16:56.193 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.391044+0000", 2023-01-02T18:16:56.193 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.6581813919999999, 2023-01-02T18:16:56.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070458700000000001, 2023-01-02T18:16:56.194 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.194 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.194 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391044+0000", 2023-01-02T18:16:56.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391044+0000", 2023-01-02T18:16:56.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:56.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391042+0000", 2023-01-02T18:16:56.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3369e-05 2023-01-02T18:16:56.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391056+0000", 2023-01-02T18:16:56.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.467e-05 2023-01-02T18:16:56.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391070+0000", 2023-01-02T18:16:56.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0279999999999997e-06 2023-01-02T18:16:56.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391077+0000", 2023-01-02T18:16:56.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0547000000000002e-05 2023-01-02T18:16:56.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391127+0000", 2023-01-02T18:16:56.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8235999999999999e-05 2023-01-02T18:16:56.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391155+0000", 2023-01-02T18:16:56.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055219100000000005 2023-01-02T18:16:56.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391707+0000", 2023-01-02T18:16:56.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0917000000000001e-05 2023-01-02T18:16:56.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.391748+0000", 2023-01-02T18:16:56.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070458700000000001 2023-01-02T18:16:56.203 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.204 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.204 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.204 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:476 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'10, mlcod=60'8)", 2023-01-02T18:16:56.205 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.395591+0000", 2023-01-02T18:16:56.205 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.653634066, 2023-01-02T18:16:56.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071941699999999997, 2023-01-02T18:16:56.205 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.205 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.205 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.395591+0000", 2023-01-02T18:16:56.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.395591+0000", 2023-01-02T18:16:56.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:56.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.395590+0000", 2023-01-02T18:16:56.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4178999999999999e-05 2023-01-02T18:16:56.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.395604+0000", 2023-01-02T18:16:56.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0687999999999999e-05 2023-01-02T18:16:56.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.395625+0000", 2023-01-02T18:16:56.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5110000000000003e-06 2023-01-02T18:16:56.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.395633+0000", 2023-01-02T18:16:56.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8733000000000002e-05 2023-01-02T18:16:56.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.395692+0000", 2023-01-02T18:16:56.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9108e-05 2023-01-02T18:16:56.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.395721+0000", 2023-01-02T18:16:56.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056141000000000003 2023-01-02T18:16:56.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.396282+0000", 2023-01-02T18:16:56.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8248000000000001e-05 2023-01-02T18:16:56.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.396311+0000", 2023-01-02T18:16:56.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071941699999999997 2023-01-02T18:16:56.215 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.215 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.215 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.216 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:556 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'20, mlcod=60'18)", 2023-01-02T18:16:56.216 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.439869+0000", 2023-01-02T18:16:56.216 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.6093557559999998, 2023-01-02T18:16:56.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078681900000000002, 2023-01-02T18:16:56.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.217 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439869+0000", 2023-01-02T18:16:56.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439869+0000", 2023-01-02T18:16:56.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:56.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439868+0000", 2023-01-02T18:16:56.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0736e-05 2023-01-02T18:16:56.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439879+0000", 2023-01-02T18:16:56.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8017e-05 2023-01-02T18:16:56.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439897+0000", 2023-01-02T18:16:56.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7259999999999996e-06 2023-01-02T18:16:56.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439904+0000", 2023-01-02T18:16:56.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5453e-05 2023-01-02T18:16:56.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439949+0000", 2023-01-02T18:16:56.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4899999999999999e-05 2023-01-02T18:16:56.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439974+0000", 2023-01-02T18:16:56.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064138400000000005 2023-01-02T18:16:56.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440616+0000", 2023-01-02T18:16:56.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0667999999999998e-05 2023-01-02T18:16:56.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440656+0000", 2023-01-02T18:16:56.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078681900000000002 2023-01-02T18:16:56.227 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.227 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.227 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.227 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:564 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'21, mlcod=60'19)", 2023-01-02T18:16:56.228 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.444987+0000", 2023-01-02T18:16:56.228 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.6042382380000002, 2023-01-02T18:16:56.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073715, 2023-01-02T18:16:56.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.229 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444987+0000", 2023-01-02T18:16:56.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444987+0000", 2023-01-02T18:16:56.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:56.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444986+0000", 2023-01-02T18:16:56.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0784e-05 2023-01-02T18:16:56.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444997+0000", 2023-01-02T18:16:56.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3801999999999999e-05 2023-01-02T18:16:56.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445011+0000", 2023-01-02T18:16:56.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9370000000000004e-06 2023-01-02T18:16:56.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445019+0000", 2023-01-02T18:16:56.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9991000000000003e-05 2023-01-02T18:16:56.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445069+0000", 2023-01-02T18:16:56.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7696999999999999e-05 2023-01-02T18:16:56.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445096+0000", 2023-01-02T18:16:56.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058830199999999997 2023-01-02T18:16:56.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445685+0000", 2023-01-02T18:16:56.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9610999999999997e-05 2023-01-02T18:16:56.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445724+0000", 2023-01-02T18:16:56.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073715 2023-01-02T18:16:56.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.238 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.238 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.239 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:572 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'22, mlcod=60'20)", 2023-01-02T18:16:56.239 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:16:56.239 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.599419819, 2023-01-02T18:16:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078864600000000005, 2023-01-02T18:16:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:16:56.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:16:56.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:56.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449804+0000", 2023-01-02T18:16:56.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.401e-05 2023-01-02T18:16:56.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449818+0000", 2023-01-02T18:16:56.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0809999999999999e-05 2023-01-02T18:16:56.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449838+0000", 2023-01-02T18:16:56.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5199999999999997e-06 2023-01-02T18:16:56.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449847+0000", 2023-01-02T18:16:56.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9821999999999996e-05 2023-01-02T18:16:56.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449927+0000", 2023-01-02T18:16:56.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7619000000000001e-05 2023-01-02T18:16:56.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449954+0000", 2023-01-02T18:16:56.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060264800000000001 2023-01-02T18:16:56.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450557+0000", 2023-01-02T18:16:56.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7101000000000003e-05 2023-01-02T18:16:56.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450594+0000", 2023-01-02T18:16:56.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078864600000000005 2023-01-02T18:16:56.249 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.250 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.250 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.250 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:580 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'23, mlcod=60'21)", 2023-01-02T18:16:56.251 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.454705+0000", 2023-01-02T18:16:56.251 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.5945201290000002, 2023-01-02T18:16:56.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000778679, 2023-01-02T18:16:56.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.252 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454705+0000", 2023-01-02T18:16:56.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454705+0000", 2023-01-02T18:16:56.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:56.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454704+0000", 2023-01-02T18:16:56.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1161e-05 2023-01-02T18:16:56.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454715+0000", 2023-01-02T18:16:56.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7254000000000001e-05 2023-01-02T18:16:56.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454732+0000", 2023-01-02T18:16:56.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9e-06 2023-01-02T18:16:56.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454739+0000", 2023-01-02T18:16:56.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6258000000000003e-05 2023-01-02T18:16:56.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454785+0000", 2023-01-02T18:16:56.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:16:56.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454811+0000", 2023-01-02T18:16:56.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063813100000000001 2023-01-02T18:16:56.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.455449+0000", 2023-01-02T18:16:56.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4975000000000003e-05 2023-01-02T18:16:56.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.455484+0000", 2023-01-02T18:16:56.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000778679 2023-01-02T18:16:56.261 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.261 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.261 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.262 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:605 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'27, mlcod=60'25)", 2023-01-02T18:16:56.262 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.469161+0000", 2023-01-02T18:16:56.262 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.580064084, 2023-01-02T18:16:56.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073625800000000005, 2023-01-02T18:16:56.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.263 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.263 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469161+0000", 2023-01-02T18:16:56.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469161+0000", 2023-01-02T18:16:56.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:56.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469160+0000", 2023-01-02T18:16:56.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2199e-05 2023-01-02T18:16:56.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469172+0000", 2023-01-02T18:16:56.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6200000000000001e-05 2023-01-02T18:16:56.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469188+0000", 2023-01-02T18:16:56.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3019999999999997e-06 2023-01-02T18:16:56.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469195+0000", 2023-01-02T18:16:56.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9588e-05 2023-01-02T18:16:56.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469245+0000", 2023-01-02T18:16:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9190000000000001e-05 2023-01-02T18:16:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469264+0000", 2023-01-02T18:16:56.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060372099999999999 2023-01-02T18:16:56.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469868+0000", 2023-01-02T18:16:56.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9507999999999999e-05 2023-01-02T18:16:56.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469897+0000", 2023-01-02T18:16:56.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073625800000000005 2023-01-02T18:16:56.272 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.273 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.273 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.273 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:629 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'30, mlcod=60'28)", 2023-01-02T18:16:56.274 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:16:56.274 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.567480835, 2023-01-02T18:16:56.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083191500000000002, 2023-01-02T18:16:56.274 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.274 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.275 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:16:56.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:16:56.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:56.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481743+0000", 2023-01-02T18:16:56.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4339999999999992e-06 2023-01-02T18:16:56.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481752+0000", 2023-01-02T18:16:56.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4435e-05 2023-01-02T18:16:56.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481766+0000", 2023-01-02T18:16:56.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0129999999999996e-06 2023-01-02T18:16:56.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481773+0000", 2023-01-02T18:16:56.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8954000000000004e-05 2023-01-02T18:16:56.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481842+0000", 2023-01-02T18:16:56.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5635000000000001e-05 2023-01-02T18:16:56.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481868+0000", 2023-01-02T18:16:56.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067504900000000005 2023-01-02T18:16:56.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482543+0000", 2023-01-02T18:16:56.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3379e-05 2023-01-02T18:16:56.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482576+0000", 2023-01-02T18:16:56.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083191500000000002 2023-01-02T18:16:56.284 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.284 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.284 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.285 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.285 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.285 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:56.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:16:56.287 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:56.286+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:56.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:16:56.387 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:56.388+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:56.459 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:56.460 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:56.460 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:56.460 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:56.470 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:16:56.487 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:56.488+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:56.588 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:56.589+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:56.597 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:56.597 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:56.597 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:56.598 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:56.598 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:56.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:16:56.689 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:56.689+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:56.733 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:56.733 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:56.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:56.734 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:56.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.734 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:56.734 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:56.734 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.2501639, 2023-01-02T18:16:56.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:16:56.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.735 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:56.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:16:56.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:56.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:16:56.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:16:56.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:16:56.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:16:56.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:16:56.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:16:56.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:16:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:16:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:16:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:16:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:16:56.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:16:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:16:56.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:16:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:16:56.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:16:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.5 49/48 [PushOp(3:a56581c2:::rbd_id.image9:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:a56581c2:::rbd_id.image9:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.271571655000001, 2023-01-02T18:16:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001, 2023-01-02T18:16:56.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:56.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:16:56.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462256+0000", 2023-01-02T18:16:56.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1099e-05 2023-01-02T18:16:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462268+0000", 2023-01-02T18:16:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4336e-05 2023-01-02T18:16:56.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462282+0000", 2023-01-02T18:16:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1552000000000001e-05 2023-01-02T18:16:56.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462293+0000", 2023-01-02T18:16:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1749999999999998e-05 2023-01-02T18:16:56.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462335+0000", 2023-01-02T18:16:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1909999999999999e-06 2023-01-02T18:16:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462340+0000", 2023-01-02T18:16:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029615499999999999 2023-01-02T18:16:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462637+0000", 2023-01-02T18:16:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001 2023-01-02T18:16:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.755 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1a 55/54 [PushOp(3:5cea7035:::rbd_info:head, version: 46'2, data_included: [0~19], data_size: 19, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5cea7035:::rbd_info:head@46'2, size: 19, copy_subset: [0~19], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:19, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:16:56.756 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.402714413, 2023-01-02T18:16:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055757599999999995, 2023-01-02T18:16:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:16:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:16:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:56.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331113+0000", 2023-01-02T18:16:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7773000000000001e-05 2023-01-02T18:16:56.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331131+0000", 2023-01-02T18:16:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2946999999999999e-05 2023-01-02T18:16:56.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331154+0000", 2023-01-02T18:16:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3988999999999999e-05 2023-01-02T18:16:56.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331168+0000", 2023-01-02T18:16:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8967999999999994e-05 2023-01-02T18:16:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331237+0000", 2023-01-02T18:16:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.302e-06 2023-01-02T18:16:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331246+0000", 2023-01-02T18:16:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042547499999999997 2023-01-02T18:16:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331672+0000", 2023-01-02T18:16:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055757599999999995 2023-01-02T18:16:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.766 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1a 55/54 [PushOp(3:5cbdda84:::rbd_id.image6:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5cbdda84:::rbd_id.image6:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:16:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:16:56.767 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4007627189999994, 2023-01-02T18:16:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041118300000000002, 2023-01-02T18:16:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:16:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:16:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333065+0000", 2023-01-02T18:16:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2023-01-02T18:16:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333081+0000", 2023-01-02T18:16:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0083999999999999e-05 2023-01-02T18:16:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333102+0000", 2023-01-02T18:16:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0118e-05 2023-01-02T18:16:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333112+0000", 2023-01-02T18:16:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4228000000000003e-05 2023-01-02T18:16:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333166+0000", 2023-01-02T18:16:56.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:16:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333171+0000", 2023-01-02T18:16:56.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030649399999999998 2023-01-02T18:16:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333477+0000", 2023-01-02T18:16:56.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041118300000000002 2023-01-02T18:16:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:16:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:16:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3860973699999999, 2023-01-02T18:16:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:16:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:16:56.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:16:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:56.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:16:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:16:56.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:16:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:16:56.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:16:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:16:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:16:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:16:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:16:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:16:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:16:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:16:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:16:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:16:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:16:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:16:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.788 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:16:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:16:56.789 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.384417757, 2023-01-02T18:16:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:16:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:16:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:16:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:16:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:16:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:16:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:16:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:56.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:16:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:16:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:56.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:16:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:16:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:56.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:16:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:16:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:56.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:16:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:16:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:16:56.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:16:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:16:56.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:16:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:56.800 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:56.801 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:56.802 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:16:56.803 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:56.802+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:56.903 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:56.903+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:56.928 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:56.928 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:16:56.928 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:56.938 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:16:57.004 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:57.005+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:57.063 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:57.063 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:16:57.064 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:16:57.064 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:16:57.064 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:57.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:16:57.106 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:57.107+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:57.201 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:16:57.202 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:16:57.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:16:57.202 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:16:57.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.202 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:57.203 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:57.203 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.764645433999998, 2023-01-02T18:16:57.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:16:57.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.204 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.204 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.204 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:16:57.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.205 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:57.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:16:57.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:57.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:16:57.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:16:57.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:16:57.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:16:57.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:16:57.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:16:57.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:16:57.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:16:57.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:16:57.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:16:57.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:16:57.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:16:57.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:16:57.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:16:57.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:16:57.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:16:57.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:16:57.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:57.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:16:57.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:16:57.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:16:57.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:16:57.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:16:57.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:16:57.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:16:57.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:16:57.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:16:57.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:16:57.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.219 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.220 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:57.220 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:57.220 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.715260441000002, 2023-01-02T18:16:57.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:16:57.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.221 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.221 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:57.221 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:57.221 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:16:57.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.222 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:57.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:16:57.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:16:57.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:16:57.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:16:57.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:16:57.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:16:57.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:16:57.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:16:57.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:16:57.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:16:57.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:16:57.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:16:57.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:16:57.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:16:57.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:16:57.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:16:57.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:16:57.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:16:57.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:16:57.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:16:57.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:16:57.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:16:57.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:16:57.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:16:57.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:16:57.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.234 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.235 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:8 3.18 3:1e96267a:::rbd_object_map.11d585d3810a:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:57.235 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:57.235 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.713450582, 2023-01-02T18:16:57.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087, 2023-01-02T18:16:57.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.236 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.236 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:16:57.236 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:16:57.236 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 8 2023-01-02T18:16:57.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.237 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:57.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:16:57.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487043+0000", 2023-01-02T18:16:57.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6100000000000002e-06 2023-01-02T18:16:57.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487049+0000", 2023-01-02T18:16:57.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:16:57.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487064+0000", 2023-01-02T18:16:57.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3280000000000006e-06 2023-01-02T18:16:57.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487072+0000", 2023-01-02T18:16:57.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5221e-05 2023-01-02T18:16:57.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487117+0000", 2023-01-02T18:16:57.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7274000000000005e-05 2023-01-02T18:16:57.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487204+0000", 2023-01-02T18:16:57.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013400700000000001 2023-01-02T18:16:57.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2023-01-02T18:16:57.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487338+0000", 2023-01-02T18:16:57.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083414299999999997 2023-01-02T18:16:57.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488173+0000", 2023-01-02T18:16:57.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020278700000000001 2023-01-02T18:16:57.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488375+0000", 2023-01-02T18:16:57.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6679999999999999e-05 2023-01-02T18:16:57.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488432+0000", 2023-01-02T18:16:57.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6842000000000003e-05 2023-01-02T18:16:57.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488479+0000", 2023-01-02T18:16:57.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087 2023-01-02T18:16:57.249 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.249 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.249 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.250 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:52 3.8 3:105263f9:::rbd_id.image4:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:57.250 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:57.250 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.695562577, 2023-01-02T18:16:57.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001, 2023-01-02T18:16:57.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.251 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.251 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.251 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.252 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.252 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 52 2023-01-02T18:16:57.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.252 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:57.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:16:57.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504931+0000", 2023-01-02T18:16:57.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5480000000000004e-06 2023-01-02T18:16:57.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504938+0000", 2023-01-02T18:16:57.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2118e-05 2023-01-02T18:16:57.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504950+0000", 2023-01-02T18:16:57.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.259e-06 2023-01-02T18:16:57.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504956+0000", 2023-01-02T18:16:57.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1742999999999997e-05 2023-01-02T18:16:57.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504987+0000", 2023-01-02T18:16:57.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3327999999999999e-05 2023-01-02T18:16:57.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505071+0000", 2023-01-02T18:16:57.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012434100000000001 2023-01-02T18:16:57.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505195+0000", 2023-01-02T18:16:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083202299999999999 2023-01-02T18:16:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506027+0000", 2023-01-02T18:16:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031725600000000003 2023-01-02T18:16:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506344+0000", 2023-01-02T18:16:57.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9904e-05 2023-01-02T18:16:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506374+0000", 2023-01-02T18:16:57.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9748e-05 2023-01-02T18:16:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506414+0000", 2023-01-02T18:16:57.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001 2023-01-02T18:16:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.265 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:405 6.7 6:e7d57d29:::rbd_header.12a269152854:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.266 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.351417+0000", 2023-01-02T18:16:57.266 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8490768800000001, 2023-01-02T18:16:57.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001403437, 2023-01-02T18:16:57.266 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.267 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.267 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.267 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.267 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 405 2023-01-02T18:16:57.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.268 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351417+0000", 2023-01-02T18:16:57.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351417+0000", 2023-01-02T18:16:57.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:57.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351415+0000", 2023-01-02T18:16:57.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2652e-05 2023-01-02T18:16:57.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351428+0000", 2023-01-02T18:16:57.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6478e-05 2023-01-02T18:16:57.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351454+0000", 2023-01-02T18:16:57.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8449999999999992e-06 2023-01-02T18:16:57.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351463+0000", 2023-01-02T18:16:57.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6406999999999998e-05 2023-01-02T18:16:57.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351510+0000", 2023-01-02T18:16:57.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104737 2023-01-02T18:16:57.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351614+0000", 2023-01-02T18:16:57.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015807000000000001 2023-01-02T18:16:57.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351772+0000", 2023-01-02T18:16:57.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061278299999999999 2023-01-02T18:16:57.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352385+0000", 2023-01-02T18:16:57.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000382092 2023-01-02T18:16:57.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352767+0000", 2023-01-02T18:16:57.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9799e-05 2023-01-02T18:16:57.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352797+0000", 2023-01-02T18:16:57.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3726999999999998e-05 2023-01-02T18:16:57.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352821+0000", 2023-01-02T18:16:57.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001403437 2023-01-02T18:16:57.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.280 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:427 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:16:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8345421850000001, 2023-01-02T18:16:57.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001, 2023-01-02T18:16:57.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.282 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.282 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 427 2023-01-02T18:16:57.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.283 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:16:57.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:16:57.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365951+0000", 2023-01-02T18:16:57.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4900000000000002e-06 2023-01-02T18:16:57.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365956+0000", 2023-01-02T18:16:57.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5820000000000004e-06 2023-01-02T18:16:57.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365963+0000", 2023-01-02T18:16:57.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8339999999999998e-06 2023-01-02T18:16:57.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365968+0000", 2023-01-02T18:16:57.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000271091 2023-01-02T18:16:57.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366239+0000", 2023-01-02T18:16:57.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2132000000000006e-05 2023-01-02T18:16:57.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366321+0000", 2023-01-02T18:16:57.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000222733 2023-01-02T18:16:57.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366544+0000", 2023-01-02T18:16:57.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056500799999999998 2023-01-02T18:16:57.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367109+0000", 2023-01-02T18:16:57.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030673499999999998 2023-01-02T18:16:57.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367416+0000", 2023-01-02T18:16:57.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3107000000000003e-05 2023-01-02T18:16:57.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367489+0000", 2023-01-02T18:16:57.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3927000000000001e-05 2023-01-02T18:16:57.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367543+0000", 2023-01-02T18:16:57.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001 2023-01-02T18:16:57.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.295 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.296 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:428 6.7 6:e7d57d29:::rbd_header.12a269152854:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected e60)", 2023-01-02T18:16:57.296 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.366287+0000", 2023-01-02T18:16:57.296 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.834206827, 2023-01-02T18:16:57.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014153939999999999, 2023-01-02T18:16:57.297 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.297 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:57.297 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.297 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.298 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.298 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 428 2023-01-02T18:16:57.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.298 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366287+0000", 2023-01-02T18:16:57.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366287+0000", 2023-01-02T18:16:57.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366287+0000", 2023-01-02T18:16:57.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9550000000000003e-06 2023-01-02T18:16:57.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366293+0000", 2023-01-02T18:16:57.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0108999999999999e-05 2023-01-02T18:16:57.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366304+0000", 2023-01-02T18:16:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7049999999999996e-06 2023-01-02T18:16:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366309+0000", 2023-01-02T18:16:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050785499999999998 2023-01-02T18:16:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366817+0000", 2023-01-02T18:16:57.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8709999999999997e-05 2023-01-02T18:16:57.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:16:57.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366896+0000", 2023-01-02T18:16:57.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068481300000000004 2023-01-02T18:16:57.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367581+0000", 2023-01-02T18:16:57.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2064000000000002e-05 2023-01-02T18:16:57.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367633+0000", 2023-01-02T18:16:57.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0135000000000005e-05 2023-01-02T18:16:57.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367703+0000", 2023-01-02T18:16:57.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014153939999999999 2023-01-02T18:16:57.308 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.309 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.309 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:436 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.310 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.370626+0000", 2023-01-02T18:16:57.310 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8298684280000002, 2023-01-02T18:16:57.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014215510000000001, 2023-01-02T18:16:57.310 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.310 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.311 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 436 2023-01-02T18:16:57.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.311 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370626+0000", 2023-01-02T18:16:57.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370626+0000", 2023-01-02T18:16:57.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370625+0000", 2023-01-02T18:16:57.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6279999999999999e-06 2023-01-02T18:16:57.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370631+0000", 2023-01-02T18:16:57.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4763000000000001e-05 2023-01-02T18:16:57.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370646+0000", 2023-01-02T18:16:57.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.878e-06 2023-01-02T18:16:57.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370653+0000", 2023-01-02T18:16:57.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6273999999999998e-05 2023-01-02T18:16:57.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370699+0000", 2023-01-02T18:16:57.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6454999999999998e-05 2023-01-02T18:16:57.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370786+0000", 2023-01-02T18:16:57.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022532100000000001 2023-01-02T18:16:57.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371011+0000", 2023-01-02T18:16:57.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000659711 2023-01-02T18:16:57.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371671+0000", 2023-01-02T18:16:57.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028084200000000001 2023-01-02T18:16:57.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371952+0000", 2023-01-02T18:16:57.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3022000000000002e-05 2023-01-02T18:16:57.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.372005+0000", 2023-01-02T18:16:57.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2778000000000003e-05 2023-01-02T18:16:57.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.372047+0000", 2023-01-02T18:16:57.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014215510000000001 2023-01-02T18:16:57.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.324 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.324 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:444 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.325 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:16:57.325 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.825244208, 2023-01-02T18:16:57.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489, 2023-01-02T18:16:57.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.326 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 444 2023-01-02T18:16:57.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.327 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:16:57.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:16:57.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375249+0000", 2023-01-02T18:16:57.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9409999999999998e-06 2023-01-02T18:16:57.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375254+0000", 2023-01-02T18:16:57.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5210000000000008e-06 2023-01-02T18:16:57.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375264+0000", 2023-01-02T18:16:57.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9629999999999997e-06 2023-01-02T18:16:57.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375269+0000", 2023-01-02T18:16:57.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.333e-05 2023-01-02T18:16:57.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375312+0000", 2023-01-02T18:16:57.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6695999999999998e-05 2023-01-02T18:16:57.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375399+0000", 2023-01-02T18:16:57.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016210000000000001 2023-01-02T18:16:57.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375561+0000", 2023-01-02T18:16:57.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087961699999999996 2023-01-02T18:16:57.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376440+0000", 2023-01-02T18:16:57.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055437200000000002 2023-01-02T18:16:57.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376995+0000", 2023-01-02T18:16:57.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6236999999999997e-05 2023-01-02T18:16:57.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377051+0000", 2023-01-02T18:16:57.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0509e-05 2023-01-02T18:16:57.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377102+0000", 2023-01-02T18:16:57.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489 2023-01-02T18:16:57.339 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.339 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.339 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.339 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.340 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:16:57.340 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.814936967, 2023-01-02T18:16:57.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:16:57.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.341 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.341 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.341 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:16:57.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.342 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:16:57.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:16:57.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:16:57.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:16:57.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:16:57.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:16:57.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:16:57.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:16:57.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:16:57.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:16:57.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:16:57.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:16:57.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:16:57.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:16:57.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:16:57.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:16:57.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:16:57.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:16:57.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:16:57.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:16:57.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:16:57.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:16:57.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:16:57.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:16:57.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.354 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.355 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:556 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.355 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:16:57.355 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7610878689999998, 2023-01-02T18:16:57.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001475292, 2023-01-02T18:16:57.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.356 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 556 2023-01-02T18:16:57.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.357 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:16:57.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:16:57.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439405+0000", 2023-01-02T18:16:57.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2149999999999998e-06 2023-01-02T18:16:57.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439412+0000", 2023-01-02T18:16:57.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2879e-05 2023-01-02T18:16:57.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439425+0000", 2023-01-02T18:16:57.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2339999999999999e-06 2023-01-02T18:16:57.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439431+0000", 2023-01-02T18:16:57.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1504e-05 2023-01-02T18:16:57.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439482+0000", 2023-01-02T18:16:57.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7194000000000006e-05 2023-01-02T18:16:57.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439569+0000", 2023-01-02T18:16:57.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000215632 2023-01-02T18:16:57.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439785+0000", 2023-01-02T18:16:57.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059054099999999998 2023-01-02T18:16:57.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440376+0000", 2023-01-02T18:16:57.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000404671 2023-01-02T18:16:57.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440780+0000", 2023-01-02T18:16:57.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5293000000000001e-05 2023-01-02T18:16:57.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440836+0000", 2023-01-02T18:16:57.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6108e-05 2023-01-02T18:16:57.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440882+0000", 2023-01-02T18:16:57.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001475292 2023-01-02T18:16:57.369 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.369 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.369 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.370 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:564 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.370 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:16:57.370 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7559682400000001, 2023-01-02T18:16:57.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001451564, 2023-01-02T18:16:57.370 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.370 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.371 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.371 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.371 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.371 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 564 2023-01-02T18:16:57.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.372 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:16:57.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:16:57.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444525+0000", 2023-01-02T18:16:57.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1768e-05 2023-01-02T18:16:57.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444537+0000", 2023-01-02T18:16:57.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8800000000000003e-06 2023-01-02T18:16:57.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444547+0000", 2023-01-02T18:16:57.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2220000000000004e-06 2023-01-02T18:16:57.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444551+0000", 2023-01-02T18:16:57.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6570000000000003e-05 2023-01-02T18:16:57.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444598+0000", 2023-01-02T18:16:57.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9318000000000001e-05 2023-01-02T18:16:57.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444687+0000", 2023-01-02T18:16:57.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022138 2023-01-02T18:16:57.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444908+0000", 2023-01-02T18:16:57.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061683899999999999 2023-01-02T18:16:57.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445525+0000", 2023-01-02T18:16:57.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035056600000000002 2023-01-02T18:16:57.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445876+0000", 2023-01-02T18:16:57.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6709000000000002e-05 2023-01-02T18:16:57.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445933+0000", 2023-01-02T18:16:57.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5068999999999998e-05 2023-01-02T18:16:57.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445978+0000", 2023-01-02T18:16:57.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001451564 2023-01-02T18:16:57.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.384 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.385 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:572 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.385 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:16:57.385 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7511743609999999, 2023-01-02T18:16:57.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001474445, 2023-01-02T18:16:57.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.386 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.386 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.386 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 572 2023-01-02T18:16:57.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.387 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:16:57.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:16:57.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:57.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449319+0000", 2023-01-02T18:16:57.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6760000000000001e-06 2023-01-02T18:16:57.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449325+0000", 2023-01-02T18:16:57.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3584000000000001e-05 2023-01-02T18:16:57.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449339+0000", 2023-01-02T18:16:57.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6309999999999997e-06 2023-01-02T18:16:57.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449346+0000", 2023-01-02T18:16:57.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6709000000000003e-05 2023-01-02T18:16:57.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449392+0000", 2023-01-02T18:16:57.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6323000000000006e-05 2023-01-02T18:16:57.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449489+0000", 2023-01-02T18:16:57.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000220089 2023-01-02T18:16:57.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449709+0000", 2023-01-02T18:16:57.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063770000000000005 2023-01-02T18:16:57.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450346+0000", 2023-01-02T18:16:57.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035778300000000003 2023-01-02T18:16:57.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450704+0000", 2023-01-02T18:16:57.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2308000000000001e-05 2023-01-02T18:16:57.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450757+0000", 2023-01-02T18:16:57.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7868999999999999e-05 2023-01-02T18:16:57.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450794+0000", 2023-01-02T18:16:57.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001474445 2023-01-02T18:16:57.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.399 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.400 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:580 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.400 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.454250+0000", 2023-01-02T18:16:57.400 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7462440620000002, 2023-01-02T18:16:57.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013994859999999999, 2023-01-02T18:16:57.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.401 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 580 2023-01-02T18:16:57.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.402 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454250+0000", 2023-01-02T18:16:57.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454250+0000", 2023-01-02T18:16:57.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454249+0000", 2023-01-02T18:16:57.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2473000000000001e-05 2023-01-02T18:16:57.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454262+0000", 2023-01-02T18:16:57.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8889999999999997e-06 2023-01-02T18:16:57.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454272+0000", 2023-01-02T18:16:57.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3259999999999997e-06 2023-01-02T18:16:57.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454276+0000", 2023-01-02T18:16:57.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5964999999999998e-05 2023-01-02T18:16:57.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454322+0000", 2023-01-02T18:16:57.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7717000000000001e-05 2023-01-02T18:16:57.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454410+0000", 2023-01-02T18:16:57.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00021907400000000001 2023-01-02T18:16:57.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454629+0000", 2023-01-02T18:16:57.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072568600000000002 2023-01-02T18:16:57.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.455355+0000", 2023-01-02T18:16:57.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000230282 2023-01-02T18:16:57.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.455585+0000", 2023-01-02T18:16:57.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8838000000000001e-05 2023-01-02T18:16:57.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.455614+0000", 2023-01-02T18:16:57.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6049e-05 2023-01-02T18:16:57.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.455650+0000", 2023-01-02T18:16:57.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013994859999999999 2023-01-02T18:16:57.414 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.414 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.414 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.415 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:585 6.7 6:e7d57d29:::rbd_header.12a269152854:head [watch reconnect cookie 140115456398800 gen 1] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.415 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.457302+0000", 2023-01-02T18:16:57.415 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7431921290000001, 2023-01-02T18:16:57.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001388893, 2023-01-02T18:16:57.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.416 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:16:57.416 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.416 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.416 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 585 2023-01-02T18:16:57.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.417 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.457302+0000", 2023-01-02T18:16:57.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.457302+0000", 2023-01-02T18:16:57.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:57.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.457302+0000", 2023-01-02T18:16:57.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1389999999999999e-06 2023-01-02T18:16:57.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.457305+0000", 2023-01-02T18:16:57.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8280000000000003e-06 2023-01-02T18:16:57.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.457313+0000", 2023-01-02T18:16:57.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5830000000000001e-06 2023-01-02T18:16:57.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.457315+0000", 2023-01-02T18:16:57.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045744500000000001 2023-01-02T18:16:57.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.457773+0000", 2023-01-02T18:16:57.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0445999999999997e-05 2023-01-02T18:16:57.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.457833+0000", 2023-01-02T18:16:57.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00085790900000000002 2023-01-02T18:16:57.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.458691+0000", 2023-01-02T18:16:57.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001388893 2023-01-02T18:16:57.426 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.426 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.426 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.427 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:605 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.427 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.468731+0000", 2023-01-02T18:16:57.427 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7317637160000001, 2023-01-02T18:16:57.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001393825, 2023-01-02T18:16:57.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.428 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.428 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.428 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 605 2023-01-02T18:16:57.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.429 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.468731+0000", 2023-01-02T18:16:57.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.468731+0000", 2023-01-02T18:16:57.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:57.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.468730+0000", 2023-01-02T18:16:57.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6530000000000002e-06 2023-01-02T18:16:57.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.468735+0000", 2023-01-02T18:16:57.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4660000000000005e-06 2023-01-02T18:16:57.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.468744+0000", 2023-01-02T18:16:57.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7939999999999999e-06 2023-01-02T18:16:57.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.468750+0000", 2023-01-02T18:16:57.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6742000000000001e-05 2023-01-02T18:16:57.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.468797+0000", 2023-01-02T18:16:57.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3771999999999997e-05 2023-01-02T18:16:57.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.468880+0000", 2023-01-02T18:16:57.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019859500000000001 2023-01-02T18:16:57.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469079+0000", 2023-01-02T18:16:57.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063217999999999998 2023-01-02T18:16:57.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.469711+0000", 2023-01-02T18:16:57.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000313725 2023-01-02T18:16:57.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.470025+0000", 2023-01-02T18:16:57.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5021000000000001e-05 2023-01-02T18:16:57.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.470080+0000", 2023-01-02T18:16:57.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4582000000000001e-05 2023-01-02T18:16:57.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.470124+0000", 2023-01-02T18:16:57.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001393825 2023-01-02T18:16:57.441 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.441 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.441 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.442 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:629 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.442 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:16:57.442 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.719216007, 2023-01-02T18:16:57.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999, 2023-01-02T18:16:57.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.443 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.443 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.443 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.443 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.443 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 629 2023-01-02T18:16:57.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.444 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:16:57.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:16:57.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481277+0000", 2023-01-02T18:16:57.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.981e-06 2023-01-02T18:16:57.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481283+0000", 2023-01-02T18:16:57.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3018e-05 2023-01-02T18:16:57.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481296+0000", 2023-01-02T18:16:57.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0430000000000004e-06 2023-01-02T18:16:57.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481302+0000", 2023-01-02T18:16:57.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7145999999999999e-05 2023-01-02T18:16:57.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481349+0000", 2023-01-02T18:16:57.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6058999999999996e-05 2023-01-02T18:16:57.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481445+0000", 2023-01-02T18:16:57.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000219621 2023-01-02T18:16:57.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481665+0000", 2023-01-02T18:16:57.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076564299999999999 2023-01-02T18:16:57.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482431+0000", 2023-01-02T18:16:57.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027227600000000001 2023-01-02T18:16:57.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482703+0000", 2023-01-02T18:16:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5970000000000001e-05 2023-01-02T18:16:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482759+0000", 2023-01-02T18:16:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2224000000000001e-05 2023-01-02T18:16:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482801+0000", 2023-01-02T18:16:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999 2023-01-02T18:16:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:661 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.499787+0000", 2023-01-02T18:16:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7007070350000002, 2023-01-02T18:16:57.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001397241, 2023-01-02T18:16:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.458 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 661 2023-01-02T18:16:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.499787+0000", 2023-01-02T18:16:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.499787+0000", 2023-01-02T18:16:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.499786+0000", 2023-01-02T18:16:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.669e-06 2023-01-02T18:16:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.499793+0000", 2023-01-02T18:16:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4817000000000001e-05 2023-01-02T18:16:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.499808+0000", 2023-01-02T18:16:57.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9489999999999999e-06 2023-01-02T18:16:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.499815+0000", 2023-01-02T18:16:57.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3721999999999999e-05 2023-01-02T18:16:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.499858+0000", 2023-01-02T18:16:57.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5468000000000002e-05 2023-01-02T18:16:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.499944+0000", 2023-01-02T18:16:57.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019946499999999999 2023-01-02T18:16:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.500143+0000", 2023-01-02T18:16:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065345699999999997 2023-01-02T18:16:57.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.500797+0000", 2023-01-02T18:16:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028681399999999998 2023-01-02T18:16:57.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.501084+0000", 2023-01-02T18:16:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7074999999999998e-05 2023-01-02T18:16:57.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.501141+0000", 2023-01-02T18:16:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3894999999999999e-05 2023-01-02T18:16:57.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.501185+0000", 2023-01-02T18:16:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001397241 2023-01-02T18:16:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.471 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:677 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.472 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:16:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.6915247629999999, 2023-01-02T18:16:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911, 2023-01-02T18:16:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.473 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 677 2023-01-02T18:16:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:16:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:16:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508969+0000", 2023-01-02T18:16:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.268e-06 2023-01-02T18:16:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508975+0000", 2023-01-02T18:16:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4151000000000001e-05 2023-01-02T18:16:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508989+0000", 2023-01-02T18:16:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9569999999999996e-06 2023-01-02T18:16:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508996+0000", 2023-01-02T18:16:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6683e-05 2023-01-02T18:16:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509043+0000", 2023-01-02T18:16:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6942999999999997e-05 2023-01-02T18:16:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509130+0000", 2023-01-02T18:16:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020122099999999999 2023-01-02T18:16:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509331+0000", 2023-01-02T18:16:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063843400000000001 2023-01-02T18:16:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509969+0000", 2023-01-02T18:16:57.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062000599999999999 2023-01-02T18:16:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510589+0000", 2023-01-02T18:16:57.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8503000000000001e-05 2023-01-02T18:16:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510618+0000", 2023-01-02T18:16:57.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7784999999999998e-05 2023-01-02T18:16:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510655+0000", 2023-01-02T18:16:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911 2023-01-02T18:16:57.486 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.487 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:709 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:16:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:16:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.6725023499999998, 2023-01-02T18:16:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999, 2023-01-02T18:16:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:16:57.488 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:16:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:16:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 709 2023-01-02T18:16:57.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:16:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:16:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:16:57.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:16:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:16:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:16:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:16:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527991+0000", 2023-01-02T18:16:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5170000000000001e-06 2023-01-02T18:16:57.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:16:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527996+0000", 2023-01-02T18:16:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2990000000000002e-06 2023-01-02T18:16:57.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:16:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528005+0000", 2023-01-02T18:16:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7049999999999996e-06 2023-01-02T18:16:57.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528011+0000", 2023-01-02T18:16:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3952999999999998e-05 2023-01-02T18:16:57.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:16:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528045+0000", 2023-01-02T18:16:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1950999999999998e-05 2023-01-02T18:16:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:16:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528097+0000", 2023-01-02T18:16:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000157078 2023-01-02T18:16:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528254+0000", 2023-01-02T18:16:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076010699999999999 2023-01-02T18:16:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:16:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529014+0000", 2023-01-02T18:16:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045062500000000002 2023-01-02T18:16:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529464+0000", 2023-01-02T18:16:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1790999999999999e-05 2023-01-02T18:16:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:16:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529516+0000", 2023-01-02T18:16:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1063999999999999e-05 2023-01-02T18:16:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:16:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:16:57.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:16:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529557+0000", 2023-01-02T18:16:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999 2023-01-02T18:16:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:16:57.503 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:16:57.503 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:16:57.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:16:57.506 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:16:57.506 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:57.505+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:57.605 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:57.605+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:57.639 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 1 2023-01-02T18:16:57.640 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:16:57.640 INFO:tasks.workunit.client.0.smithi007.stdout:image: image25 2023-01-02T18:16:57.640 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image25 2023-01-02T18:16:57.641 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:57.641 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:57.641 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:57.641 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:57.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:16:57.660 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 2 2023-01-02T18:16:57.660 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:16:57.660 INFO:tasks.workunit.client.0.smithi007.stdout:image: image25 2023-01-02T18:16:57.660 INFO:tasks.workunit.client.0.smithi007.stdout:image: image26 2023-01-02T18:16:57.661 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image25 2023-01-02T18:16:57.661 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image26 2023-01-02T18:16:57.706 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:57.706+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:57.708 INFO:tasks.workunit.client.0.smithi007.stdout:100.00% done 2023-01-02T18:16:57.708 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 3 2023-01-02T18:16:57.708 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 3 2023-01-02T18:16:57.709 INFO:tasks.workunit.client.0.smithi007.stdout:image: image25 2023-01-02T18:16:57.709 INFO:tasks.workunit.client.0.smithi007.stdout:image: image26 2023-01-02T18:16:57.709 INFO:tasks.workunit.client.0.smithi007.stdout:image: image27 2023-01-02T18:16:57.709 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image25 2023-01-02T18:16:57.709 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image26 2023-01-02T18:16:57.710 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image27 2023-01-02T18:16:57.742 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestCopyPP (3953 ms) 2023-01-02T18:16:57.742 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestDeepCopy 2023-01-02T18:16:57.778 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:57.778 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:57.778 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:16:57.779 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:16:57.779 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:57.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:16:57.831 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:57.832+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:16:57.908 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:57.909+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:57.915 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:57.915 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:16:57.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:16:57.915 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:16:57.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.916 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1 3.1a 3:5bdd5772:::image1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:16:57.916 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:57.916 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 20.500694383999999, 2023-01-02T18:16:57.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839, 2023-01-02T18:16:57.917 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:57.917 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:16:57.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:57.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:57.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.918 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1 2023-01-02T18:16:57.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.918 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:57.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:57.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:57.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:57.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:57.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:16:57.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:57.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:57.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413949+0000", 2023-01-02T18:16:57.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8359999999999999e-06 2023-01-02T18:16:57.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:57.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413954+0000", 2023-01-02T18:16:57.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2023-01-02T18:16:57.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:57.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413961+0000", 2023-01-02T18:16:57.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7519999999999999e-06 2023-01-02T18:16:57.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413968+0000", 2023-01-02T18:16:57.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0071999999999999e-05 2023-01-02T18:16:57.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414008+0000", 2023-01-02T18:16:57.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1890000000000001e-06 2023-01-02T18:16:57.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:16:57.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414015+0000", 2023-01-02T18:16:57.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013744829999999999 2023-01-02T18:16:57.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415389+0000", 2023-01-02T18:16:57.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1655000000000003e-05 2023-01-02T18:16:57.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:57.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415471+0000", 2023-01-02T18:16:57.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839 2023-01-02T18:16:57.927 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.928 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:57.928 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.928 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:16:57.929 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:57.929 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.499744596999999, 2023-01-02T18:16:57.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:16:57.929 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:57.929 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.930 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:57.930 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:57.930 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.930 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:16:57.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.931 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:57.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:57.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:57.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:57.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:57.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:16:57.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:57.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:57.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:16:57.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:16:57.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:57.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:16:57.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:16:57.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:57.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:16:57.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:16:57.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:16:57.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:16:57.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:16:57.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:16:57.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:57.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:16:57.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:16:57.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:16:57.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:16:57.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:57.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:16:57.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:16:57.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:16:57.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:16:57.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:16:57.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:16:57.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:57.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:16:57.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:16:57.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:57.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:16:57.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:16:57.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:57.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:16:57.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:16:57.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.945 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:57.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.946 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:57.946 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:57.946 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.494076334999999, 2023-01-02T18:16:57.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:16:57.947 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:57.947 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:57.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:57.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:57.948 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:16:57.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.948 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:57.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:57.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:57.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:57.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:57.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:16:57.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:16:57.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:57.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:16:57.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:16:57.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:57.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:16:57.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:16:57.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:57.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:16:57.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:16:57.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:16:57.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:16:57.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:16:57.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:16:57.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:57.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:16:57.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:16:57.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:16:57.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:16:57.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:57.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:16:57.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:16:57.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:57.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:16:57.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:16:57.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:57.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:16:57.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:16:57.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:57.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:16:57.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:16:57.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:16:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:16:57.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:57.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:16:57.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:16:57.962 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.963 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:57.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.963 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:57.964 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:57.964 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.488542673000001, 2023-01-02T18:16:57.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:16:57.964 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:57.964 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.965 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:57.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:57.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:57.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:57.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:57.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:16:57.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:57.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:57.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:16:57.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:16:57.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:57.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:16:57.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:16:57.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:57.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:16:57.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:16:57.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:16:57.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:16:57.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:16:57.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:16:57.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:57.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:16:57.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:16:57.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:57.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:16:57.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:16:57.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:57.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:16:57.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:16:57.974 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.974 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:57.974 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.975 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:11 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:57.975 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:57.975 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.480839672999998, 2023-01-02T18:16:57.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152, 2023-01-02T18:16:57.976 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:57.976 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.976 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:57.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:57.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:57.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:57.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:57.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:57.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:57.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:57.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:16:57.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:16:57.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:57.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433810+0000", 2023-01-02T18:16:57.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1821000000000001e-05 2023-01-02T18:16:57.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:57.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433822+0000", 2023-01-02T18:16:57.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4549999999999998e-06 2023-01-02T18:16:57.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433829+0000", 2023-01-02T18:16:57.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6005000000000003e-05 2023-01-02T18:16:57.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433885+0000", 2023-01-02T18:16:57.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.16e-05 2023-01-02T18:16:57.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:57.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433907+0000", 2023-01-02T18:16:57.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011094480000000001 2023-01-02T18:16:57.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:57.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435016+0000", 2023-01-02T18:16:57.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8626999999999999e-05 2023-01-02T18:16:57.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:57.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435045+0000", 2023-01-02T18:16:57.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152 2023-01-02T18:16:57.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.986 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:57.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.987 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:24 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:57.987 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:57.987 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.465211169, 2023-01-02T18:16:57.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997, 2023-01-02T18:16:57.987 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:57.988 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:57.988 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:57.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:57.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:57.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:57.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:57.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:16:57.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:16:57.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:57.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449431+0000", 2023-01-02T18:16:57.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7706e-05 2023-01-02T18:16:57.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:57.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449449+0000", 2023-01-02T18:16:57.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0883999999999998e-05 2023-01-02T18:16:57.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:57.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449480+0000", 2023-01-02T18:16:57.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4416000000000001e-05 2023-01-02T18:16:57.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:57.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449494+0000", 2023-01-02T18:16:57.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6549000000000001e-05 2023-01-02T18:16:57.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:57.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449581+0000", 2023-01-02T18:16:57.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9669000000000003e-05 2023-01-02T18:16:57.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:57.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449620+0000", 2023-01-02T18:16:57.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0006958 2023-01-02T18:16:57.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:57.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450316+0000", 2023-01-02T18:16:57.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0188e-05 2023-01-02T18:16:57.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:57.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450346+0000", 2023-01-02T18:16:57.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997 2023-01-02T18:16:57.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.998 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:57.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:57.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:57.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:57.999 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:30 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:57.999 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:57.999 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.457808663000002, 2023-01-02T18:16:57.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003, 2023-01-02T18:16:57.999 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.000 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.000 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:58.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:16:58.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456835+0000", 2023-01-02T18:16:58.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7504999999999999e-05 2023-01-02T18:16:58.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456852+0000", 2023-01-02T18:16:58.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2356e-05 2023-01-02T18:16:58.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456865+0000", 2023-01-02T18:16:58.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.421e-06 2023-01-02T18:16:58.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456871+0000", 2023-01-02T18:16:58.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8040999999999997e-05 2023-01-02T18:16:58.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456909+0000", 2023-01-02T18:16:58.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5384e-05 2023-01-02T18:16:58.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456925+0000", 2023-01-02T18:16:58.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074633700000000002 2023-01-02T18:16:58.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457671+0000", 2023-01-02T18:16:58.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7826000000000001e-05 2023-01-02T18:16:58.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457699+0000", 2023-01-02T18:16:58.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003 2023-01-02T18:16:58.009 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.010 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.010 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.010 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:31 3.1c e46/43 3:3d3f3250:::rbd_id.image2:head v 46'3, mlcod=46'1)", 2023-01-02T18:16:58.011 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:58.011 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.45618018, 2023-01-02T18:16:58.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999, 2023-01-02T18:16:58.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.011 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.012 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:58.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:16:58.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458463+0000", 2023-01-02T18:16:58.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3389999999999998e-06 2023-01-02T18:16:58.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458470+0000", 2023-01-02T18:16:58.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.205e-05 2023-01-02T18:16:58.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458482+0000", 2023-01-02T18:16:58.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5809999999999996e-06 2023-01-02T18:16:58.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458487+0000", 2023-01-02T18:16:58.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8702000000000001e-05 2023-01-02T18:16:58.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458546+0000", 2023-01-02T18:16:58.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2495e-05 2023-01-02T18:16:58.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458559+0000", 2023-01-02T18:16:58.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001846735 2023-01-02T18:16:58.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460405+0000", 2023-01-02T18:16:58.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9183000000000002e-05 2023-01-02T18:16:58.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460435+0000", 2023-01-02T18:16:58.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999 2023-01-02T18:16:58.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.021 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.021 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.022 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:32 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:58.022 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:58.022 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.452830470999999, 2023-01-02T18:16:58.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997, 2023-01-02T18:16:58.023 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.023 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.023 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:58.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:58.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:58.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:16:58.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3030000000000001e-06 2023-01-02T18:16:58.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461818+0000", 2023-01-02T18:16:58.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0964999999999999e-05 2023-01-02T18:16:58.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461829+0000", 2023-01-02T18:16:58.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8039999999999998e-06 2023-01-02T18:16:58.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461835+0000", 2023-01-02T18:16:58.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8708999999999997e-05 2023-01-02T18:16:58.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461884+0000", 2023-01-02T18:16:58.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5057e-05 2023-01-02T18:16:58.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461899+0000", 2023-01-02T18:16:58.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061687999999999999 2023-01-02T18:16:58.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462515+0000", 2023-01-02T18:16:58.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1633e-05 2023-01-02T18:16:58.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462547+0000", 2023-01-02T18:16:58.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997 2023-01-02T18:16:58.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.033 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.033 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.033 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:33 3.3 3:c76fae31:::rbd_object_map.12a21ad382ee:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:16:58.034 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:58.034 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.451787618000001, 2023-01-02T18:16:58.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001, 2023-01-02T18:16:58.034 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.034 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.035 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:58.035 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:58.035 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:58.035 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33 2023-01-02T18:16:58.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.036 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:58.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:16:58.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462856+0000", 2023-01-02T18:16:58.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4710000000000004e-06 2023-01-02T18:16:58.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462862+0000", 2023-01-02T18:16:58.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:16:58.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462875+0000", 2023-01-02T18:16:58.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.491e-05 2023-01-02T18:16:58.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462890+0000", 2023-01-02T18:16:58.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9657999999999999e-05 2023-01-02T18:16:58.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462930+0000", 2023-01-02T18:16:58.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1362999999999999e-05 2023-01-02T18:16:58.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463021+0000", 2023-01-02T18:16:58.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015166800000000001 2023-01-02T18:16:58.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:16:58.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463173+0000", 2023-01-02T18:16:58.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074740899999999999 2023-01-02T18:16:58.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:58.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463920+0000", 2023-01-02T18:16:58.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045107699999999998 2023-01-02T18:16:58.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:58.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464372+0000", 2023-01-02T18:16:58.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6213e-05 2023-01-02T18:16:58.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464408+0000", 2023-01-02T18:16:58.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.535e-05 2023-01-02T18:16:58.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464433+0000", 2023-01-02T18:16:58.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001 2023-01-02T18:16:58.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.048 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.049 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.049 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:45 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:58.050 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:58.050 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.441078011999998, 2023-01-02T18:16:58.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892, 2023-01-02T18:16:58.050 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.050 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.050 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:58.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:16:58.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473565+0000", 2023-01-02T18:16:58.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5140000000000004e-06 2023-01-02T18:16:58.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473573+0000", 2023-01-02T18:16:58.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2473000000000001e-05 2023-01-02T18:16:58.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473585+0000", 2023-01-02T18:16:58.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2159999999999997e-06 2023-01-02T18:16:58.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473591+0000", 2023-01-02T18:16:58.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0025999999999999e-05 2023-01-02T18:16:58.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473631+0000", 2023-01-02T18:16:58.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3309000000000001e-05 2023-01-02T18:16:58.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473644+0000", 2023-01-02T18:16:58.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057332800000000001 2023-01-02T18:16:58.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474217+0000", 2023-01-02T18:16:58.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0043999999999999e-05 2023-01-02T18:16:58.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474247+0000", 2023-01-02T18:16:58.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892 2023-01-02T18:16:58.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.061 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:46 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'3, mlcod=46'1)", 2023-01-02T18:16:58.061 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:58.061 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.439746249999999, 2023-01-02T18:16:58.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997, 2023-01-02T18:16:58.062 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.062 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.062 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:58.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:16:58.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474897+0000", 2023-01-02T18:16:58.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8789999999999992e-06 2023-01-02T18:16:58.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474906+0000", 2023-01-02T18:16:58.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3468e-05 2023-01-02T18:16:58.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474920+0000", 2023-01-02T18:16:58.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8460000000000002e-06 2023-01-02T18:16:58.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474926+0000", 2023-01-02T18:16:58.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6996000000000003e-05 2023-01-02T18:16:58.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474963+0000", 2023-01-02T18:16:58.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2276000000000001e-05 2023-01-02T18:16:58.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474976+0000", 2023-01-02T18:16:58.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066849900000000002 2023-01-02T18:16:58.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475644+0000", 2023-01-02T18:16:58.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2233999999999997e-05 2023-01-02T18:16:58.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475676+0000", 2023-01-02T18:16:58.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997 2023-01-02T18:16:58.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.072 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.072 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.072 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:53 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'1, mlcod=0'0)", 2023-01-02T18:16:58.073 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:58.073 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.404834060999999, 2023-01-02T18:16:58.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082, 2023-01-02T18:16:58.073 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.073 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.074 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:58.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:58.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:16:58.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:16:58.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3499999999999996e-06 2023-01-02T18:16:58.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509815+0000", 2023-01-02T18:16:58.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0020999999999999e-05 2023-01-02T18:16:58.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509825+0000", 2023-01-02T18:16:58.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1399999999999997e-06 2023-01-02T18:16:58.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509832+0000", 2023-01-02T18:16:58.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3279999999999999e-05 2023-01-02T18:16:58.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509875+0000", 2023-01-02T18:16:58.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0288e-05 2023-01-02T18:16:58.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509895+0000", 2023-01-02T18:16:58.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000905152 2023-01-02T18:16:58.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510800+0000", 2023-01-02T18:16:58.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1238000000000001e-05 2023-01-02T18:16:58.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510832+0000", 2023-01-02T18:16:58.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082 2023-01-02T18:16:58.083 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.083 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.083 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.084 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:16:58.084 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:58.084 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.402843520000001, 2023-01-02T18:16:58.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:16:58.084 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.085 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.085 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:58.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:16:58.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:16:58.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:16:58.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:16:58.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:16:58.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:16:58.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:16:58.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:16:58.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:16:58.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:16:58.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:16:58.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:16:58.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:16:58.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:16:58.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:16:58.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:16:58.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:16:58.094 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.095 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.095 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.095 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:66 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'2, mlcod=0'0)", 2023-01-02T18:16:58.095 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:58.096 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.391685363000001, 2023-01-02T18:16:58.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997, 2023-01-02T18:16:58.096 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.096 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.096 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:58.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:16:58.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522958+0000", 2023-01-02T18:16:58.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6449999999999994e-06 2023-01-02T18:16:58.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522967+0000", 2023-01-02T18:16:58.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3166000000000001e-05 2023-01-02T18:16:58.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522980+0000", 2023-01-02T18:16:58.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:16:58.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522987+0000", 2023-01-02T18:16:58.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4501000000000001e-05 2023-01-02T18:16:58.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523022+0000", 2023-01-02T18:16:58.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5023e-05 2023-01-02T18:16:58.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523037+0000", 2023-01-02T18:16:58.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057705099999999997 2023-01-02T18:16:58.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523614+0000", 2023-01-02T18:16:58.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1579999999999999e-05 2023-01-02T18:16:58.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523645+0000", 2023-01-02T18:16:58.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997 2023-01-02T18:16:58.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.107 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:26 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'6, mlcod=46'4)", 2023-01-02T18:16:58.107 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:58.107 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.376320756999998, 2023-01-02T18:16:58.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005, 2023-01-02T18:16:58.108 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.108 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.108 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:58.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:16:58.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538323+0000", 2023-01-02T18:16:58.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8736000000000002e-05 2023-01-02T18:16:58.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538342+0000", 2023-01-02T18:16:58.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6739999999999992e-06 2023-01-02T18:16:58.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538351+0000", 2023-01-02T18:16:58.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6460000000000001e-06 2023-01-02T18:16:58.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538356+0000", 2023-01-02T18:16:58.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.57e-05 2023-01-02T18:16:58.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538402+0000", 2023-01-02T18:16:58.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6050999999999998e-05 2023-01-02T18:16:58.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538428+0000", 2023-01-02T18:16:58.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055106199999999995 2023-01-02T18:16:58.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538979+0000", 2023-01-02T18:16:58.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7333000000000001e-05 2023-01-02T18:16:58.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539006+0000", 2023-01-02T18:16:58.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005 2023-01-02T18:16:58.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.118 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.118 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:27 3.f e46/43 3:f63788c7:::rbd_id.image5:head v 46'6, mlcod=46'4)", 2023-01-02T18:16:58.119 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:58.119 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.375000686, 2023-01-02T18:16:58.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001, 2023-01-02T18:16:58.119 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.119 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.120 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:58.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:16:58.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:16:58.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539643+0000", 2023-01-02T18:16:58.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0418999999999999e-05 2023-01-02T18:16:58.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539663+0000", 2023-01-02T18:16:58.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3852999999999999e-05 2023-01-02T18:16:58.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539677+0000", 2023-01-02T18:16:58.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5100000000000004e-06 2023-01-02T18:16:58.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539684+0000", 2023-01-02T18:16:58.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9595999999999998e-05 2023-01-02T18:16:58.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539723+0000", 2023-01-02T18:16:58.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7207999999999999e-05 2023-01-02T18:16:58.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539741+0000", 2023-01-02T18:16:58.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063475200000000004 2023-01-02T18:16:58.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540375+0000", 2023-01-02T18:16:58.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5425e-05 2023-01-02T18:16:58.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540411+0000", 2023-01-02T18:16:58.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001 2023-01-02T18:16:58.129 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.129 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.130 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:16:58.130 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:58.131 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.480887857000001, 2023-01-02T18:16:58.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:16:58.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.131 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.131 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:58.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:58.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:58.132 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:16:58.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.132 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:58.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:16:58.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:16:58.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:16:58.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:16:58.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:16:58.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:16:58.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:16:58.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:16:58.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:16:58.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:16:58.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:16:58.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:16:58.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:16:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:16:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:16:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:16:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:16:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:16:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:16:58.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:16:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:16:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:16:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:16:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:16:58.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:16:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:16:58.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:16:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:16:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:16:58.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:16:58.147 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.616106799000001, 2023-01-02T18:16:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:16:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.148 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:16:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.149 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:16:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:16:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:16:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:16:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:16:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:16:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:16:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:16:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:16:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:16:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:16:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:16:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:16:58.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:16:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:16:58.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:16:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:16:58.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:16:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:16:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:16:58.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:16:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:16:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:16:58.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:16:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:16:58.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:16:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:16:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:16:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:16:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.163 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:272 4.9 4:911e4614:::rbd_id.image18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:16:58.164 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.604478279, 2023-01-02T18:16:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999, 2023-01-02T18:16:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:16:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:16:58.165 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:16:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:16:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:16:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 272 2023-01-02T18:16:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.166 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:16:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:16:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:16:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:16:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:16:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:16:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:16:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310165+0000", 2023-01-02T18:16:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.628e-06 2023-01-02T18:16:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:16:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310174+0000", 2023-01-02T18:16:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2023-01-02T18:16:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:16:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310190+0000", 2023-01-02T18:16:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:16:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:16:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310198+0000", 2023-01-02T18:16:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6770000000000001e-05 2023-01-02T18:16:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:16:58.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310245+0000", 2023-01-02T18:16:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159517 2023-01-02T18:16:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:16:58.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310404+0000", 2023-01-02T18:16:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023075600000000001 2023-01-02T18:16:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:16:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310635+0000", 2023-01-02T18:16:58.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088889700000000004 2023-01-02T18:16:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:16:58.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311524+0000", 2023-01-02T18:16:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011021 2023-01-02T18:16:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:16:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311634+0000", 2023-01-02T18:16:58.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2626000000000002e-05 2023-01-02T18:16:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:16:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311667+0000", 2023-01-02T18:16:58.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9774000000000002e-05 2023-01-02T18:16:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:16:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:16:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:16:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311706+0000", 2023-01-02T18:16:58.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999 2023-01-02T18:16:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:16:58.179 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:16:58.179 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:58.180 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:16:58.181 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:58.181+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:58.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:16:58.282 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:58.282+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:58.324 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:16:58.341 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:16:58.350 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:16:58.350 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:16:58.350 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:16:58.351 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:16:58.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:16:58.366 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:16:58.382 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:58.382+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:58.383 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:16:58.401 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:16:58.418 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:16:58.436 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:16:58.454 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:16:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:16:58.455 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:16:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:16:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:16:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:16:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:16:58.456 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:16:58.457 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:16:58.490 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:58.490 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:58.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:16:58.507 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:16:58.507+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:16:58.584 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:58.585+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:58.625 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:58.626 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:58.635 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:16:58.685 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:58.685+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:58.785 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:16:58.786+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:16:58.800 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:58.801 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:58.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:16:58.887 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:58.887+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:58.936 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:58.937 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:58.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:16:58.987 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:16:58.988+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:16:59.088 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:59.088+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:59.112 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:59.112 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:59.122 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:16:59.206 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:59.207+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:59.288 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:59.288 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:59.289 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:59.290+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:59.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:16:59.316 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:16:59.379 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7] out_osds: [5, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:16:59.379 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:16:59.379 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2023-01-02T18:16:59.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2023-01-02T18:16:59.390 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:59.390+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:59.465 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:59.465 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:59.475 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:16:59.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:16:59.516 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:16:59.517+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:16:59.592 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:59.592+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:59.641 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:59.641 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:59.651 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:16:59.695 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:16:59.695+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:16:59.703 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 402 (0%) 2023-01-02T18:16:59.704 INFO:teuthology.orchestra.run.smithi007.stdout:avg 67 2023-01-02T18:16:59.704 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 8.40635 -> 8.40635 (expected baseline 7.47217) 2023-01-02T18:16:59.704 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 50 -> 50 pgs (0.746269 -> 0.746269 * mean) 2023-01-02T18:16:59.704 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.3 with 74 -> 74 pgs (1.10448 -> 1.10448 * mean) 2023-01-02T18:16:59.704 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:16:59.705 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:16:59.705 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 1 2023-01-02T18:16:59.705 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:16:59.705 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:16:59.706 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0007 2023-01-02T18:16:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:16:59.717 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2023-01-02T18:16:59.718 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2023-01-02T18:16:59.780 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:59.781 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:59.791 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:16:59.794 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:16:59.794+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:16:59.895 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:16:59.895+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:16:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:16:59.963 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:16:59.973 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:16:59.996 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:16:59.997+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:00.068 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 402 (0%) 2023-01-02T18:17:00.068 INFO:teuthology.orchestra.run.smithi007.stdout:avg 67 2023-01-02T18:17:00.068 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 8.40635 -> 8.40635 (expected baseline 7.47217) 2023-01-02T18:17:00.069 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 50 -> 50 pgs (0.746269 -> 0.746269 * mean) 2023-01-02T18:17:00.069 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.3 with 74 -> 74 pgs (1.10448 -> 1.10448 * mean) 2023-01-02T18:17:00.069 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:00.069 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:17:00.069 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 0.05 2023-01-02T18:17:00.070 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:00.070 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:00.070 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0007 2023-01-02T18:17:00.071 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:17:00.082 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2023-01-02T18:17:00.082 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2023-01-02T18:17:00.097 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:00.097+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:00.100 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:00.100 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:00.111 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:00.198 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:00.198+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:00.281 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:00.281 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:00.291 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:00.300 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:00.299+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:00.307 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:17:00.396 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 402 (0%) 2023-01-02T18:17:00.397 INFO:teuthology.orchestra.run.smithi007.stdout:avg 67 2023-01-02T18:17:00.397 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 8.40635 -> 8.40635 (expected baseline 7.47217) 2023-01-02T18:17:00.397 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 50 -> 50 pgs (0.746269 -> 0.746269 * mean) 2023-01-02T18:17:00.397 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.3 with 74 -> 74 pgs (1.10448 -> 1.10448 * mean) 2023-01-02T18:17:00.398 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:00.398 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:17:00.398 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 1 2023-01-02T18:17:00.398 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:00.398 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:00.398 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0007 2023-01-02T18:17:00.399 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:17:00.400 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:00.399+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:00.410 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-01-02T18:17:00.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2023-01-02T18:17:00.422 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:00.422 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:00.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:00.467 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:00.500 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:00.501+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:00.601 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:00.602+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:00.622 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:00.622 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:00.633 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:00.633 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:00.650 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:00.668 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:00.687 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:00.702 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:00.703+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:00.705 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:00.723 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:00.742 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:00.760 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:00.761 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:00.762 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:00.763 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:00.763 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:00.763 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:00.764 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:00.764 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:00.764 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 402 (0%) 2023-01-02T18:17:00.765 INFO:teuthology.orchestra.run.smithi007.stdout:avg 67 2023-01-02T18:17:00.765 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 8.40635 -> 8.40635 (expected baseline 7.47217) 2023-01-02T18:17:00.765 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 50 -> 50 pgs (0.746269 -> 0.746269 * mean) 2023-01-02T18:17:00.765 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.3 with 74 -> 74 pgs (1.10448 -> 1.10448 * mean) 2023-01-02T18:17:00.765 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:00.766 INFO:teuthology.orchestra.run.smithi007.stdout:oload 110 2023-01-02T18:17:00.766 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 0.05 2023-01-02T18:17:00.766 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:00.766 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:00.766 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0001 2023-01-02T18:17:00.767 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:17:00.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:00.781 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-01-02T18:17:00.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 3.0 2023-01-02T18:17:00.803 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:00.804+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:00.904 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:00.905+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:00.949 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:00.950 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:00.950 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:00.950 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:00.950 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:00.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:01.007 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:01.007+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:01.092 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:01.092 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:01.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:01.092 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:01.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.093 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:01.093 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:01.093 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.608322058999999, 2023-01-02T18:17:01.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:01.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.094 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.094 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:01.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:01.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:01.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:01.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:01.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:01.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:01.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:01.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:01.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:01.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:01.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:01.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:01.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:01.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:01.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:01.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:01.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:01.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:01.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.107 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.108 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.5 49/48 [PushOp(3:a56581c2:::rbd_id.image9:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:a56581c2:::rbd_id.image9:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:17:01.108 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:17:01.109 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.629729814000001, 2023-01-02T18:17:01.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001, 2023-01-02T18:17:01.109 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:01.110 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:17:01.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462257+0000", 2023-01-02T18:17:01.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:01.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462256+0000", 2023-01-02T18:17:01.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1099e-05 2023-01-02T18:17:01.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462268+0000", 2023-01-02T18:17:01.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4336e-05 2023-01-02T18:17:01.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462282+0000", 2023-01-02T18:17:01.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1552000000000001e-05 2023-01-02T18:17:01.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462293+0000", 2023-01-02T18:17:01.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1749999999999998e-05 2023-01-02T18:17:01.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462335+0000", 2023-01-02T18:17:01.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1909999999999999e-06 2023-01-02T18:17:01.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462340+0000", 2023-01-02T18:17:01.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029615499999999999 2023-01-02T18:17:01.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.462637+0000", 2023-01-02T18:17:01.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00037945900000000001 2023-01-02T18:17:01.119 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.119 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.119 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.119 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1a 55/54 [PushOp(3:5cea7035:::rbd_info:head, version: 46'2, data_included: [0~19], data_size: 19, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5cea7035:::rbd_info:head@46'2, size: 19, copy_subset: [0~19], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:19, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:17:01.120 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:17:01.120 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.760872572, 2023-01-02T18:17:01.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055757599999999995, 2023-01-02T18:17:01.120 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.120 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:01.121 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:17:01.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331114+0000", 2023-01-02T18:17:01.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331113+0000", 2023-01-02T18:17:01.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7773000000000001e-05 2023-01-02T18:17:01.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331131+0000", 2023-01-02T18:17:01.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2946999999999999e-05 2023-01-02T18:17:01.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331154+0000", 2023-01-02T18:17:01.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3988999999999999e-05 2023-01-02T18:17:01.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331168+0000", 2023-01-02T18:17:01.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8967999999999994e-05 2023-01-02T18:17:01.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331237+0000", 2023-01-02T18:17:01.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.302e-06 2023-01-02T18:17:01.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331246+0000", 2023-01-02T18:17:01.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042547499999999997 2023-01-02T18:17:01.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.331672+0000", 2023-01-02T18:17:01.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055757599999999995 2023-01-02T18:17:01.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.131 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.132 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1a 55/54 [PushOp(3:5cbdda84:::rbd_id.image6:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:5cbdda84:::rbd_id.image6:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:17:01.132 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:17:01.132 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.758920878, 2023-01-02T18:17:01.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041118300000000002, 2023-01-02T18:17:01.133 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.133 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:01.133 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:17:01.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333066+0000", 2023-01-02T18:17:01.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333065+0000", 2023-01-02T18:17:01.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6552999999999999e-05 2023-01-02T18:17:01.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333081+0000", 2023-01-02T18:17:01.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0083999999999999e-05 2023-01-02T18:17:01.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333102+0000", 2023-01-02T18:17:01.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0118e-05 2023-01-02T18:17:01.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333112+0000", 2023-01-02T18:17:01.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4228000000000003e-05 2023-01-02T18:17:01.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333166+0000", 2023-01-02T18:17:01.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:17:01.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333171+0000", 2023-01-02T18:17:01.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030649399999999998 2023-01-02T18:17:01.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.333477+0000", 2023-01-02T18:17:01.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041118300000000002 2023-01-02T18:17:01.144 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.144 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.146 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:01.146 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:01.146 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.7442555290000001, 2023-01-02T18:17:01.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:01.146 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.147 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:01.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:01.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:01.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:01.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:01.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:01.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:01.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:01.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:01.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:01.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:01.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:01.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:01.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:01.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:01.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:01.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:01.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:01.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:01.156 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.157 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.157 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:01.157 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:01.158 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.7425759159999998, 2023-01-02T18:17:01.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:01.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.158 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:01.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:01.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:01.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:01.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:01.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:01.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:01.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:01.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:01.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:01.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:01.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:01.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:01.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:01.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:01.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:01.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:01.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:01.168 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.168 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.168 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.169 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:01.169 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:01.169 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7757480320000001, 2023-01-02T18:17:01.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:01.170 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.170 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.170 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:01.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:01.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:01.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:01.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:01.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:01.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:01.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:01.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:01.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:01.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:01.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:01.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:01.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:01.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:01.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:01.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:01.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:01.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:01.179 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.179 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.180 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.180 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:01.180 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:01.181 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4456104879999998, 2023-01-02T18:17:01.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:01.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.181 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:01.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:01.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:01.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:01.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:01.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:01.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:01.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:01.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:01.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:01.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:01.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:01.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:01.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:01.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:01.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:01.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:01.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:01.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:01.191 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.191 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.191 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.192 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:965 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'2, mlcod=0'0)", 2023-01-02T18:17:01.192 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.647794+0000", 2023-01-02T18:17:01.192 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4441924560000001, 2023-01-02T18:17:01.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059280400000000005, 2023-01-02T18:17:01.192 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.192 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.193 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647794+0000", 2023-01-02T18:17:01.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647794+0000", 2023-01-02T18:17:01.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647793+0000", 2023-01-02T18:17:01.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5939999999999999e-06 2023-01-02T18:17:01.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647800+0000", 2023-01-02T18:17:01.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0746e-05 2023-01-02T18:17:01.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647811+0000", 2023-01-02T18:17:01.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2400000000000004e-06 2023-01-02T18:17:01.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647817+0000", 2023-01-02T18:17:01.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4517999999999997e-05 2023-01-02T18:17:01.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647852+0000", 2023-01-02T18:17:01.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4409999999999999e-05 2023-01-02T18:17:01.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647866+0000", 2023-01-02T18:17:01.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00049916100000000003 2023-01-02T18:17:01.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648365+0000", 2023-01-02T18:17:01.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2110999999999999e-05 2023-01-02T18:17:01.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648387+0000", 2023-01-02T18:17:01.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059280400000000005 2023-01-02T18:17:01.202 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.202 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.202 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.203 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:978 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'3, mlcod=64'1)", 2023-01-02T18:17:01.203 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.655741+0000", 2023-01-02T18:17:01.203 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4362461799999999, 2023-01-02T18:17:01.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057132299999999999, 2023-01-02T18:17:01.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.204 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.204 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655741+0000", 2023-01-02T18:17:01.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655741+0000", 2023-01-02T18:17:01.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655740+0000", 2023-01-02T18:17:01.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9850000000000006e-06 2023-01-02T18:17:01.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655748+0000", 2023-01-02T18:17:01.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4679e-05 2023-01-02T18:17:01.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655763+0000", 2023-01-02T18:17:01.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1250000000000004e-06 2023-01-02T18:17:01.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655770+0000", 2023-01-02T18:17:01.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5355999999999998e-05 2023-01-02T18:17:01.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655805+0000", 2023-01-02T18:17:01.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:17:01.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655828+0000", 2023-01-02T18:17:01.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045868299999999999 2023-01-02T18:17:01.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.656286+0000", 2023-01-02T18:17:01.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5843999999999999e-05 2023-01-02T18:17:01.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.656312+0000", 2023-01-02T18:17:01.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057132299999999999 2023-01-02T18:17:01.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.213 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.214 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.214 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:981 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'4, mlcod=64'2)", 2023-01-02T18:17:01.214 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:01.215 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.433270791, 2023-01-02T18:17:01.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003, 2023-01-02T18:17:01.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.215 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:01.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:01.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658715+0000", 2023-01-02T18:17:01.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2509999999999997e-06 2023-01-02T18:17:01.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658723+0000", 2023-01-02T18:17:01.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6970000000000005e-06 2023-01-02T18:17:01.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658732+0000", 2023-01-02T18:17:01.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3159999999999998e-06 2023-01-02T18:17:01.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658737+0000", 2023-01-02T18:17:01.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2293000000000003e-05 2023-01-02T18:17:01.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658779+0000", 2023-01-02T18:17:01.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2996000000000001e-05 2023-01-02T18:17:01.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658802+0000", 2023-01-02T18:17:01.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066023399999999999 2023-01-02T18:17:01.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659462+0000", 2023-01-02T18:17:01.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4413000000000002e-05 2023-01-02T18:17:01.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659487+0000", 2023-01-02T18:17:01.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003 2023-01-02T18:17:01.225 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.225 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.225 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.226 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:982 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'5, mlcod=64'3)", 2023-01-02T18:17:01.226 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.660035+0000", 2023-01-02T18:17:01.226 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.431951717, 2023-01-02T18:17:01.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634300000000005, 2023-01-02T18:17:01.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.227 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.227 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660035+0000", 2023-01-02T18:17:01.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660035+0000", 2023-01-02T18:17:01.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660034+0000", 2023-01-02T18:17:01.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1739999999999997e-06 2023-01-02T18:17:01.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660041+0000", 2023-01-02T18:17:01.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8799999999999997e-06 2023-01-02T18:17:01.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660050+0000", 2023-01-02T18:17:01.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3470000000000001e-06 2023-01-02T18:17:01.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660054+0000", 2023-01-02T18:17:01.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7392999999999999e-05 2023-01-02T18:17:01.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660091+0000", 2023-01-02T18:17:01.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3625000000000002e-05 2023-01-02T18:17:01.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660115+0000", 2023-01-02T18:17:01.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040956 2023-01-02T18:17:01.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660524+0000", 2023-01-02T18:17:01.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7095000000000001e-05 2023-01-02T18:17:01.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.660552+0000", 2023-01-02T18:17:01.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634300000000005 2023-01-02T18:17:01.236 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.236 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.237 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.237 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:998 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'6, mlcod=64'4)", 2023-01-02T18:17:01.238 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.668042+0000", 2023-01-02T18:17:01.238 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4239444049999999, 2023-01-02T18:17:01.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000512449, 2023-01-02T18:17:01.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.238 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.238 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668042+0000", 2023-01-02T18:17:01.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668042+0000", 2023-01-02T18:17:01.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668042+0000", 2023-01-02T18:17:01.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2589999999999997e-06 2023-01-02T18:17:01.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668048+0000", 2023-01-02T18:17:01.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0583e-05 2023-01-02T18:17:01.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668059+0000", 2023-01-02T18:17:01.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.578e-06 2023-01-02T18:17:01.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668063+0000", 2023-01-02T18:17:01.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9057999999999999e-05 2023-01-02T18:17:01.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668092+0000", 2023-01-02T18:17:01.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2223e-05 2023-01-02T18:17:01.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668104+0000", 2023-01-02T18:17:01.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00041655499999999999 2023-01-02T18:17:01.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668521+0000", 2023-01-02T18:17:01.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3964999999999998e-05 2023-01-02T18:17:01.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668555+0000", 2023-01-02T18:17:01.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000512449 2023-01-02T18:17:01.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.248 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.248 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:1184 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'7, mlcod=64'5)", 2023-01-02T18:17:01.249 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.738046+0000", 2023-01-02T18:17:01.249 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3539413759999999, 2023-01-02T18:17:01.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065147299999999996, 2023-01-02T18:17:01.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.250 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738046+0000", 2023-01-02T18:17:01.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738046+0000", 2023-01-02T18:17:01.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738045+0000", 2023-01-02T18:17:01.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1324e-05 2023-01-02T18:17:01.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738056+0000", 2023-01-02T18:17:01.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3044000000000001e-05 2023-01-02T18:17:01.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738069+0000", 2023-01-02T18:17:01.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1770000000000003e-06 2023-01-02T18:17:01.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738075+0000", 2023-01-02T18:17:01.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3909999999999997e-05 2023-01-02T18:17:01.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738129+0000", 2023-01-02T18:17:01.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7912999999999999e-05 2023-01-02T18:17:01.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738157+0000", 2023-01-02T18:17:01.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051079900000000004 2023-01-02T18:17:01.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738668+0000", 2023-01-02T18:17:01.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9269999999999999e-05 2023-01-02T18:17:01.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738697+0000", 2023-01-02T18:17:01.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065147299999999996 2023-01-02T18:17:01.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.259 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.259 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.260 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:01.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:01.262 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 402 (0%) 2023-01-02T18:17:01.262 INFO:teuthology.orchestra.run.smithi007.stdout:avg 67 2023-01-02T18:17:01.262 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 8.40635 -> 8.40635 (expected baseline 7.47217) 2023-01-02T18:17:01.262 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 50 -> 50 pgs (0.746269 -> 0.746269 * mean) 2023-01-02T18:17:01.263 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.3 with 74 -> 74 pgs (1.10448 -> 1.10448 * mean) 2023-01-02T18:17:01.263 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:01.263 INFO:teuthology.orchestra.run.smithi007.stdout:oload 110 2023-01-02T18:17:01.263 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 3 2023-01-02T18:17:01.263 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:01.264 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:01.264 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0001 2023-01-02T18:17:01.264 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:17:01.265 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:01.261+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:01.361 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:01.362+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:01.445 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:01.445 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:01.445 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:01.446 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:01.456 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:01.462 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:01.463+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:01.563 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:01.563+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:01.591 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:01.591 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:01.592 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:01.592 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:01.592 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:01.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:01.688 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:01.688+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:01.765 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:01.764+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:01.775 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:01.775 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:01.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:01.775 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:01.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.776 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:01.776 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:01.776 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.338100872999998, 2023-01-02T18:17:01.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:01.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.777 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.777 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.777 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:01.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.778 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:01.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:01.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:01.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:01.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:01.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:01.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:01.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:01.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:01.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:01.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:01.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:01.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:01.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:01.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:01.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:01.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:01.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:01.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:01.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:01.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:01.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:01.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:01.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:01.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:01.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:01.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:01.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:01.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:01.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:01.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:01.792 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.792 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.792 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.793 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:01.793 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:01.793 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.288715880000002, 2023-01-02T18:17:01.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:17:01.794 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.794 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.794 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:01.795 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:01.795 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:17:01.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.795 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:01.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:01.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:01.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:17:01.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:17:01.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:17:01.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:17:01.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:17:01.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:17:01.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:17:01.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:17:01.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:17:01.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:17:01.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:17:01.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:17:01.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:01.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:17:01.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:17:01.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:17:01.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:17:01.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:17:01.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:17:01.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:17:01.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:17:01.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:17:01.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:17:01.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.808 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.809 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:8 3.18 3:1e96267a:::rbd_object_map.11d585d3810a:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:01.809 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:17:01.809 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.286906021, 2023-01-02T18:17:01.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087, 2023-01-02T18:17:01.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.810 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.810 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:01.811 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:01.811 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 8 2023-01-02T18:17:01.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.811 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:17:01.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:17:01.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487043+0000", 2023-01-02T18:17:01.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6100000000000002e-06 2023-01-02T18:17:01.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487049+0000", 2023-01-02T18:17:01.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:01.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487064+0000", 2023-01-02T18:17:01.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3280000000000006e-06 2023-01-02T18:17:01.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487072+0000", 2023-01-02T18:17:01.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5221e-05 2023-01-02T18:17:01.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487117+0000", 2023-01-02T18:17:01.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7274000000000005e-05 2023-01-02T18:17:01.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487204+0000", 2023-01-02T18:17:01.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013400700000000001 2023-01-02T18:17:01.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2023-01-02T18:17:01.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487338+0000", 2023-01-02T18:17:01.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083414299999999997 2023-01-02T18:17:01.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488173+0000", 2023-01-02T18:17:01.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020278700000000001 2023-01-02T18:17:01.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488375+0000", 2023-01-02T18:17:01.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6679999999999999e-05 2023-01-02T18:17:01.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488432+0000", 2023-01-02T18:17:01.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6842000000000003e-05 2023-01-02T18:17:01.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488479+0000", 2023-01-02T18:17:01.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087 2023-01-02T18:17:01.823 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.824 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.824 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.824 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:52 3.8 3:105263f9:::rbd_id.image4:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:01.825 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:01.825 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.269018016, 2023-01-02T18:17:01.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001, 2023-01-02T18:17:01.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.825 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.826 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.826 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.826 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.826 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 52 2023-01-02T18:17:01.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.827 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:01.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:01.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504931+0000", 2023-01-02T18:17:01.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5480000000000004e-06 2023-01-02T18:17:01.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504938+0000", 2023-01-02T18:17:01.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2118e-05 2023-01-02T18:17:01.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504950+0000", 2023-01-02T18:17:01.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.259e-06 2023-01-02T18:17:01.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504956+0000", 2023-01-02T18:17:01.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1742999999999997e-05 2023-01-02T18:17:01.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504987+0000", 2023-01-02T18:17:01.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3327999999999999e-05 2023-01-02T18:17:01.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505071+0000", 2023-01-02T18:17:01.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012434100000000001 2023-01-02T18:17:01.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505195+0000", 2023-01-02T18:17:01.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083202299999999999 2023-01-02T18:17:01.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506027+0000", 2023-01-02T18:17:01.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031725600000000003 2023-01-02T18:17:01.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506344+0000", 2023-01-02T18:17:01.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9904e-05 2023-01-02T18:17:01.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506374+0000", 2023-01-02T18:17:01.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9748e-05 2023-01-02T18:17:01.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506414+0000", 2023-01-02T18:17:01.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001 2023-01-02T18:17:01.839 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.839 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.839 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.840 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:405 6.7 6:e7d57d29:::rbd_header.12a269152854:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.840 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.351417+0000", 2023-01-02T18:17:01.840 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4225323190000001, 2023-01-02T18:17:01.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001403437, 2023-01-02T18:17:01.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.841 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.841 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.841 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.841 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 405 2023-01-02T18:17:01.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.842 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351417+0000", 2023-01-02T18:17:01.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351417+0000", 2023-01-02T18:17:01.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:01.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351415+0000", 2023-01-02T18:17:01.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2652e-05 2023-01-02T18:17:01.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351428+0000", 2023-01-02T18:17:01.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6478e-05 2023-01-02T18:17:01.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351454+0000", 2023-01-02T18:17:01.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8449999999999992e-06 2023-01-02T18:17:01.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351463+0000", 2023-01-02T18:17:01.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6406999999999998e-05 2023-01-02T18:17:01.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351510+0000", 2023-01-02T18:17:01.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104737 2023-01-02T18:17:01.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351614+0000", 2023-01-02T18:17:01.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015807000000000001 2023-01-02T18:17:01.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351772+0000", 2023-01-02T18:17:01.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061278299999999999 2023-01-02T18:17:01.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352385+0000", 2023-01-02T18:17:01.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000382092 2023-01-02T18:17:01.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352767+0000", 2023-01-02T18:17:01.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9799e-05 2023-01-02T18:17:01.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352797+0000", 2023-01-02T18:17:01.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3726999999999998e-05 2023-01-02T18:17:01.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.352821+0000", 2023-01-02T18:17:01.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001403437 2023-01-02T18:17:01.854 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.854 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.854 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.855 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:427 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.855 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:01.855 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4079976240000001, 2023-01-02T18:17:01.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001, 2023-01-02T18:17:01.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.856 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.856 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.856 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.857 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 427 2023-01-02T18:17:01.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.857 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:01.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:01.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365951+0000", 2023-01-02T18:17:01.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4900000000000002e-06 2023-01-02T18:17:01.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365956+0000", 2023-01-02T18:17:01.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5820000000000004e-06 2023-01-02T18:17:01.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365963+0000", 2023-01-02T18:17:01.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8339999999999998e-06 2023-01-02T18:17:01.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365968+0000", 2023-01-02T18:17:01.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000271091 2023-01-02T18:17:01.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366239+0000", 2023-01-02T18:17:01.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2132000000000006e-05 2023-01-02T18:17:01.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366321+0000", 2023-01-02T18:17:01.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000222733 2023-01-02T18:17:01.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366544+0000", 2023-01-02T18:17:01.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056500799999999998 2023-01-02T18:17:01.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367109+0000", 2023-01-02T18:17:01.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030673499999999998 2023-01-02T18:17:01.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367416+0000", 2023-01-02T18:17:01.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3107000000000003e-05 2023-01-02T18:17:01.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367489+0000", 2023-01-02T18:17:01.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3927000000000001e-05 2023-01-02T18:17:01.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367543+0000", 2023-01-02T18:17:01.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001 2023-01-02T18:17:01.869 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.869 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.870 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.870 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:428 6.7 6:e7d57d29:::rbd_header.12a269152854:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected e60)", 2023-01-02T18:17:01.870 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.366287+0000", 2023-01-02T18:17:01.871 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4076622660000009, 2023-01-02T18:17:01.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014153939999999999, 2023-01-02T18:17:01.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.871 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:01.871 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.872 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.872 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.872 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 428 2023-01-02T18:17:01.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.872 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366287+0000", 2023-01-02T18:17:01.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366287+0000", 2023-01-02T18:17:01.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366287+0000", 2023-01-02T18:17:01.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9550000000000003e-06 2023-01-02T18:17:01.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366293+0000", 2023-01-02T18:17:01.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0108999999999999e-05 2023-01-02T18:17:01.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366304+0000", 2023-01-02T18:17:01.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7049999999999996e-06 2023-01-02T18:17:01.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366309+0000", 2023-01-02T18:17:01.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050785499999999998 2023-01-02T18:17:01.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366817+0000", 2023-01-02T18:17:01.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8709999999999997e-05 2023-01-02T18:17:01.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:17:01.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366896+0000", 2023-01-02T18:17:01.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068481300000000004 2023-01-02T18:17:01.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367581+0000", 2023-01-02T18:17:01.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2064000000000002e-05 2023-01-02T18:17:01.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367633+0000", 2023-01-02T18:17:01.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0135000000000005e-05 2023-01-02T18:17:01.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367703+0000", 2023-01-02T18:17:01.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014153939999999999 2023-01-02T18:17:01.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.883 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.884 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:436 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.884 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.370626+0000", 2023-01-02T18:17:01.884 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.4033238669999992, 2023-01-02T18:17:01.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014215510000000001, 2023-01-02T18:17:01.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.885 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.885 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.886 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 436 2023-01-02T18:17:01.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.886 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370626+0000", 2023-01-02T18:17:01.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370626+0000", 2023-01-02T18:17:01.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370625+0000", 2023-01-02T18:17:01.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6279999999999999e-06 2023-01-02T18:17:01.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370631+0000", 2023-01-02T18:17:01.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4763000000000001e-05 2023-01-02T18:17:01.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370646+0000", 2023-01-02T18:17:01.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.878e-06 2023-01-02T18:17:01.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370653+0000", 2023-01-02T18:17:01.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6273999999999998e-05 2023-01-02T18:17:01.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370699+0000", 2023-01-02T18:17:01.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6454999999999998e-05 2023-01-02T18:17:01.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.370786+0000", 2023-01-02T18:17:01.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022532100000000001 2023-01-02T18:17:01.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371011+0000", 2023-01-02T18:17:01.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000659711 2023-01-02T18:17:01.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371671+0000", 2023-01-02T18:17:01.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028084200000000001 2023-01-02T18:17:01.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.371952+0000", 2023-01-02T18:17:01.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3022000000000002e-05 2023-01-02T18:17:01.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.372005+0000", 2023-01-02T18:17:01.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2778000000000003e-05 2023-01-02T18:17:01.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.372047+0000", 2023-01-02T18:17:01.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014215510000000001 2023-01-02T18:17:01.898 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.898 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.898 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.899 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:444 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.899 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:01.899 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3986996470000008, 2023-01-02T18:17:01.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489, 2023-01-02T18:17:01.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.900 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.900 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.900 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.900 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.900 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 444 2023-01-02T18:17:01.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.901 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:01.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:01.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375249+0000", 2023-01-02T18:17:01.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9409999999999998e-06 2023-01-02T18:17:01.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375254+0000", 2023-01-02T18:17:01.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5210000000000008e-06 2023-01-02T18:17:01.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375264+0000", 2023-01-02T18:17:01.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9629999999999997e-06 2023-01-02T18:17:01.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375269+0000", 2023-01-02T18:17:01.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.333e-05 2023-01-02T18:17:01.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375312+0000", 2023-01-02T18:17:01.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6695999999999998e-05 2023-01-02T18:17:01.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375399+0000", 2023-01-02T18:17:01.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016210000000000001 2023-01-02T18:17:01.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375561+0000", 2023-01-02T18:17:01.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087961699999999996 2023-01-02T18:17:01.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376440+0000", 2023-01-02T18:17:01.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055437200000000002 2023-01-02T18:17:01.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376995+0000", 2023-01-02T18:17:01.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6236999999999997e-05 2023-01-02T18:17:01.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377051+0000", 2023-01-02T18:17:01.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0509e-05 2023-01-02T18:17:01.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377102+0000", 2023-01-02T18:17:01.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489 2023-01-02T18:17:01.913 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.913 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.913 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.913 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.914 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:01.914 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3883924059999995, 2023-01-02T18:17:01.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:17:01.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.915 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.915 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.915 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.915 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:17:01.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.915 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:01.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:01.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:17:01.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:17:01.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:17:01.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:17:01.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:17:01.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:17:01.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:17:01.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:17:01.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:17:01.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:17:01.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:17:01.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:17:01.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:17:01.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:17:01.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:17:01.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:17:01.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:17:01.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:17:01.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:17:01.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:17:01.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:17:01.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:17:01.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.928 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.928 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:556 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.928 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:17:01.929 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3345433080000006, 2023-01-02T18:17:01.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001475292, 2023-01-02T18:17:01.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.929 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.930 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 556 2023-01-02T18:17:01.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.930 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:17:01.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:17:01.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439405+0000", 2023-01-02T18:17:01.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2149999999999998e-06 2023-01-02T18:17:01.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439412+0000", 2023-01-02T18:17:01.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2879e-05 2023-01-02T18:17:01.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439425+0000", 2023-01-02T18:17:01.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2339999999999999e-06 2023-01-02T18:17:01.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439431+0000", 2023-01-02T18:17:01.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1504e-05 2023-01-02T18:17:01.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439482+0000", 2023-01-02T18:17:01.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7194000000000006e-05 2023-01-02T18:17:01.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439569+0000", 2023-01-02T18:17:01.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000215632 2023-01-02T18:17:01.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439785+0000", 2023-01-02T18:17:01.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059054099999999998 2023-01-02T18:17:01.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440376+0000", 2023-01-02T18:17:01.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000404671 2023-01-02T18:17:01.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440780+0000", 2023-01-02T18:17:01.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5293000000000001e-05 2023-01-02T18:17:01.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440836+0000", 2023-01-02T18:17:01.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6108e-05 2023-01-02T18:17:01.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440882+0000", 2023-01-02T18:17:01.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001475292 2023-01-02T18:17:01.943 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.943 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.943 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.943 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:564 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.944 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:17:01.944 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3294236789999996, 2023-01-02T18:17:01.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001451564, 2023-01-02T18:17:01.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.945 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.945 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.945 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 564 2023-01-02T18:17:01.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.946 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:17:01.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:17:01.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444525+0000", 2023-01-02T18:17:01.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1768e-05 2023-01-02T18:17:01.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444537+0000", 2023-01-02T18:17:01.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8800000000000003e-06 2023-01-02T18:17:01.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444547+0000", 2023-01-02T18:17:01.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2220000000000004e-06 2023-01-02T18:17:01.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444551+0000", 2023-01-02T18:17:01.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6570000000000003e-05 2023-01-02T18:17:01.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444598+0000", 2023-01-02T18:17:01.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9318000000000001e-05 2023-01-02T18:17:01.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444687+0000", 2023-01-02T18:17:01.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022138 2023-01-02T18:17:01.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444908+0000", 2023-01-02T18:17:01.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061683899999999999 2023-01-02T18:17:01.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445525+0000", 2023-01-02T18:17:01.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035056600000000002 2023-01-02T18:17:01.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445876+0000", 2023-01-02T18:17:01.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6709000000000002e-05 2023-01-02T18:17:01.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445933+0000", 2023-01-02T18:17:01.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5068999999999998e-05 2023-01-02T18:17:01.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445978+0000", 2023-01-02T18:17:01.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001451564 2023-01-02T18:17:01.958 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.958 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.958 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.959 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:572 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.959 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:17:01.959 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3246298000000003, 2023-01-02T18:17:01.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001474445, 2023-01-02T18:17:01.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 572 2023-01-02T18:17:01.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.961 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:17:01.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:17:01.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:01.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449319+0000", 2023-01-02T18:17:01.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6760000000000001e-06 2023-01-02T18:17:01.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449325+0000", 2023-01-02T18:17:01.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3584000000000001e-05 2023-01-02T18:17:01.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449339+0000", 2023-01-02T18:17:01.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6309999999999997e-06 2023-01-02T18:17:01.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449346+0000", 2023-01-02T18:17:01.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6709000000000003e-05 2023-01-02T18:17:01.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449392+0000", 2023-01-02T18:17:01.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6323000000000006e-05 2023-01-02T18:17:01.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449489+0000", 2023-01-02T18:17:01.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000220089 2023-01-02T18:17:01.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449709+0000", 2023-01-02T18:17:01.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063770000000000005 2023-01-02T18:17:01.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450346+0000", 2023-01-02T18:17:01.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035778300000000003 2023-01-02T18:17:01.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450704+0000", 2023-01-02T18:17:01.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2308000000000001e-05 2023-01-02T18:17:01.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450757+0000", 2023-01-02T18:17:01.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7868999999999999e-05 2023-01-02T18:17:01.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450794+0000", 2023-01-02T18:17:01.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001474445 2023-01-02T18:17:01.973 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.973 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.973 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.974 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:629 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.974 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:01.974 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.2926714459999999, 2023-01-02T18:17:01.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999, 2023-01-02T18:17:01.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.975 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.975 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.975 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.975 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 629 2023-01-02T18:17:01.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.976 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:01.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:01.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481277+0000", 2023-01-02T18:17:01.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.981e-06 2023-01-02T18:17:01.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481283+0000", 2023-01-02T18:17:01.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3018e-05 2023-01-02T18:17:01.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481296+0000", 2023-01-02T18:17:01.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0430000000000004e-06 2023-01-02T18:17:01.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481302+0000", 2023-01-02T18:17:01.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7145999999999999e-05 2023-01-02T18:17:01.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481349+0000", 2023-01-02T18:17:01.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6058999999999996e-05 2023-01-02T18:17:01.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481445+0000", 2023-01-02T18:17:01.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000219621 2023-01-02T18:17:01.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481665+0000", 2023-01-02T18:17:01.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076564299999999999 2023-01-02T18:17:01.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:01.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482431+0000", 2023-01-02T18:17:01.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027227600000000001 2023-01-02T18:17:01.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:01.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482703+0000", 2023-01-02T18:17:01.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5970000000000001e-05 2023-01-02T18:17:01.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:01.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482759+0000", 2023-01-02T18:17:01.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2224000000000001e-05 2023-01-02T18:17:01.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:01.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482801+0000", 2023-01-02T18:17:01.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999 2023-01-02T18:17:01.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.988 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:01.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:01.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.989 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:677 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:01.989 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:01.989 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.2649802020000003, 2023-01-02T18:17:01.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911, 2023-01-02T18:17:01.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:01.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:01.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:01.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:01.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:01.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 677 2023-01-02T18:17:01.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.991 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:01.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:01.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:01.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:01.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:01.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:01.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:01.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:01.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508969+0000", 2023-01-02T18:17:01.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.268e-06 2023-01-02T18:17:01.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:01.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508975+0000", 2023-01-02T18:17:01.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4151000000000001e-05 2023-01-02T18:17:01.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:01.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508989+0000", 2023-01-02T18:17:01.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9569999999999996e-06 2023-01-02T18:17:01.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:01.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508996+0000", 2023-01-02T18:17:01.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6683e-05 2023-01-02T18:17:01.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:01.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509043+0000", 2023-01-02T18:17:01.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6942999999999997e-05 2023-01-02T18:17:01.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:01.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509130+0000", 2023-01-02T18:17:01.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020122099999999999 2023-01-02T18:17:01.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:01.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:01.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:01.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509331+0000", 2023-01-02T18:17:01.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063843400000000001 2023-01-02T18:17:02.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:02.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509969+0000", 2023-01-02T18:17:02.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062000599999999999 2023-01-02T18:17:02.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510589+0000", 2023-01-02T18:17:02.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8503000000000001e-05 2023-01-02T18:17:02.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:02.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510618+0000", 2023-01-02T18:17:02.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7784999999999998e-05 2023-01-02T18:17:02.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:02.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510655+0000", 2023-01-02T18:17:02.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911 2023-01-02T18:17:02.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.003 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:02.004 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.004 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:709 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:02.004 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:02.005 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.2459577890000002, 2023-01-02T18:17:02.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999, 2023-01-02T18:17:02.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:02.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.005 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:02.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:02.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 709 2023-01-02T18:17:02.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.006 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:02.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:02.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:02.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:02.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:02.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:02.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:02.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527991+0000", 2023-01-02T18:17:02.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5170000000000001e-06 2023-01-02T18:17:02.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:02.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527996+0000", 2023-01-02T18:17:02.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2990000000000002e-06 2023-01-02T18:17:02.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:02.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528005+0000", 2023-01-02T18:17:02.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7049999999999996e-06 2023-01-02T18:17:02.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528011+0000", 2023-01-02T18:17:02.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3952999999999998e-05 2023-01-02T18:17:02.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:02.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528045+0000", 2023-01-02T18:17:02.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1950999999999998e-05 2023-01-02T18:17:02.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:02.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528097+0000", 2023-01-02T18:17:02.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000157078 2023-01-02T18:17:02.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:02.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528254+0000", 2023-01-02T18:17:02.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076010699999999999 2023-01-02T18:17:02.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:02.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529014+0000", 2023-01-02T18:17:02.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045062500000000002 2023-01-02T18:17:02.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529464+0000", 2023-01-02T18:17:02.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1790999999999999e-05 2023-01-02T18:17:02.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:02.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529516+0000", 2023-01-02T18:17:02.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1063999999999999e-05 2023-01-02T18:17:02.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:02.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529557+0000", 2023-01-02T18:17:02.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999 2023-01-02T18:17:02.018 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.019 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:02.019 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.019 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:02.019 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:02.020 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4645607639999998, 2023-01-02T18:17:02.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:02.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:02.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.020 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:02.021 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:02.021 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:02.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:02.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.021 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:02.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:02.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:02.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:02.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:02.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:02.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:02.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:02.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:02.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:02.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:02.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:02.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:02.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:02.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:02.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:02.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:02.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:02.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:02.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:02.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:02.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:02.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:02.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:02.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:02.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:02.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:02.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:02.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:02.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:02.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:02.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:02.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:02.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:02.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:02.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:02.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:02.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:02.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:02.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:02.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:02.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:02.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:02.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:02.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.036 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:02.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.037 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:372 7.1 7:83feba0f:::rbd_object_map.11d56649889d:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:02.037 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:02.037 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4546217009999998, 2023-01-02T18:17:02.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479, 2023-01-02T18:17:02.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:02.038 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.038 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:02.038 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:02.038 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:02.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 372 2023-01-02T18:17:02.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.039 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:02.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:02.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:02.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:02.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:02.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:02.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:02.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:02.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319326+0000", 2023-01-02T18:17:02.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1199999999999996e-06 2023-01-02T18:17:02.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:02.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319334+0000", 2023-01-02T18:17:02.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2170999999999999e-05 2023-01-02T18:17:02.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:02.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319346+0000", 2023-01-02T18:17:02.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7789999999999996e-06 2023-01-02T18:17:02.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319353+0000", 2023-01-02T18:17:02.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8445999999999997e-05 2023-01-02T18:17:02.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:02.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319392+0000", 2023-01-02T18:17:02.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010474700000000001 2023-01-02T18:17:02.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:02.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319497+0000", 2023-01-02T18:17:02.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138159 2023-01-02T18:17:02.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:02.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319635+0000", 2023-01-02T18:17:02.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071603699999999999 2023-01-02T18:17:02.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:02.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320351+0000", 2023-01-02T18:17:02.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063369800000000003 2023-01-02T18:17:02.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320985+0000", 2023-01-02T18:17:02.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5822000000000002e-05 2023-01-02T18:17:02.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:02.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321040+0000", 2023-01-02T18:17:02.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4125999999999997e-05 2023-01-02T18:17:02.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:02.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321085+0000", 2023-01-02T18:17:02.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479 2023-01-02T18:17:02.051 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.051 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:02.051 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.052 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:964 7.14 7:2d7624f7:::rbd_id.image26:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:02.052 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.645860+0000", 2023-01-02T18:17:02.052 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.1280896839999999, 2023-01-02T18:17:02.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014729560000000001, 2023-01-02T18:17:02.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:02.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.053 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:02.053 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:02.053 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:02.054 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 964 2023-01-02T18:17:02.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.054 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:02.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:02.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645860+0000", 2023-01-02T18:17:02.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:02.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:02.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645860+0000", 2023-01-02T18:17:02.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:02.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645859+0000", 2023-01-02T18:17:02.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2050000000000001e-06 2023-01-02T18:17:02.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:02.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645864+0000", 2023-01-02T18:17:02.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0960000000000007e-06 2023-01-02T18:17:02.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:02.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645873+0000", 2023-01-02T18:17:02.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3030000000000001e-06 2023-01-02T18:17:02.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645878+0000", 2023-01-02T18:17:02.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9790999999999999e-05 2023-01-02T18:17:02.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:02.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645918+0000", 2023-01-02T18:17:02.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014038899999999999 2023-01-02T18:17:02.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:02.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646058+0000", 2023-01-02T18:17:02.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000203926 2023-01-02T18:17:02.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:02.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646262+0000", 2023-01-02T18:17:02.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077879399999999997 2023-01-02T18:17:02.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:02.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647041+0000", 2023-01-02T18:17:02.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024163599999999999 2023-01-02T18:17:02.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647282+0000", 2023-01-02T18:17:02.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9030000000000002e-05 2023-01-02T18:17:02.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:02.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647311+0000", 2023-01-02T18:17:02.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1744000000000001e-05 2023-01-02T18:17:02.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:02.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647333+0000", 2023-01-02T18:17:02.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014729560000000001 2023-01-02T18:17:02.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.067 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:02.067 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.067 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1953 8.8 8:1376a730:::rbd_id.image30:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:02.068 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:02.068 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.117537277, 2023-01-02T18:17:02.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939, 2023-01-02T18:17:02.068 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:02.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.069 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:02.069 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:02.069 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1953 2023-01-02T18:17:02.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.070 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:02.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:02.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:02.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:02.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:02.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:02.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:02.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:02.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656411+0000", 2023-01-02T18:17:02.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5109999999999992e-06 2023-01-02T18:17:02.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:02.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656421+0000", 2023-01-02T18:17:02.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3118000000000001e-05 2023-01-02T18:17:02.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:02.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656444+0000", 2023-01-02T18:17:02.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.841e-06 2023-01-02T18:17:02.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656452+0000", 2023-01-02T18:17:02.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8368000000000003e-05 2023-01-02T18:17:02.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:02.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656490+0000", 2023-01-02T18:17:02.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6940000000000004e-05 2023-01-02T18:17:02.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:02.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656587+0000", 2023-01-02T18:17:02.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013780300000000001 2023-01-02T18:17:02.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:02.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656725+0000", 2023-01-02T18:17:02.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000707375 2023-01-02T18:17:02.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:02.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.657432+0000", 2023-01-02T18:17:02.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062476800000000005 2023-01-02T18:17:02.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658057+0000", 2023-01-02T18:17:02.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4223000000000001e-05 2023-01-02T18:17:02.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:02.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658091+0000", 2023-01-02T18:17:02.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5299e-05 2023-01-02T18:17:02.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:02.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:02.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:02.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658116+0000", 2023-01-02T18:17:02.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939 2023-01-02T18:17:02.081 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.081 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:02.082 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.082 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:02.082 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:02.082 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:02.084 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:02.085 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:02.084+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:02.185 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:02.185+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:02.212 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:02.213 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:02.213 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:02.213 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:02.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:02.286 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:02.286+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:02.319 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:17:02.348 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:02.348 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:02.349 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:17:02.349 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:17:02.349 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:02.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:02.387 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:02.387+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:02.486 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:17:02.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:17:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:17:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1 3.1a 3:5bdd5772:::image1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:17:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:02.487 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 25.071765255999999, 2023-01-02T18:17:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839, 2023-01-02T18:17:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:17:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:02.488 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1 2023-01-02T18:17:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413949+0000", 2023-01-02T18:17:02.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8359999999999999e-06 2023-01-02T18:17:02.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413954+0000", 2023-01-02T18:17:02.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2023-01-02T18:17:02.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413961+0000", 2023-01-02T18:17:02.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7519999999999999e-06 2023-01-02T18:17:02.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413968+0000", 2023-01-02T18:17:02.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0071999999999999e-05 2023-01-02T18:17:02.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414008+0000", 2023-01-02T18:17:02.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1890000000000001e-06 2023-01-02T18:17:02.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:17:02.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414015+0000", 2023-01-02T18:17:02.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013744829999999999 2023-01-02T18:17:02.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415389+0000", 2023-01-02T18:17:02.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1655000000000003e-05 2023-01-02T18:17:02.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415471+0000", 2023-01-02T18:17:02.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839 2023-01-02T18:17:02.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.499 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.499 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.499 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:17:02.500 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:02.500 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.070815468999999, 2023-01-02T18:17:02.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:17:02.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.500 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.501 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:02.501 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:02.501 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.501 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:17:02.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.502 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:02.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:02.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:02.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:17:02.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:17:02.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:17:02.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:17:02.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:17:02.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:17:02.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:17:02.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:17:02.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:17:02.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:17:02.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:02.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:17:02.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:17:02.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:17:02.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:17:02.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:17:02.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:17:02.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:02.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:17:02.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:17:02.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:17:02.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:17:02.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:02.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:17:02.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:17:02.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:17:02.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:17:02.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:17:02.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:17:02.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.515 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.516 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:02.516 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:02.516 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.065147206999999, 2023-01-02T18:17:02.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:17:02.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.517 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:02.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:02.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.518 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:17:02.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.518 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:02.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:02.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:02.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:17:02.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:17:02.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:17:02.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:17:02.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:17:02.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:17:02.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:17:02.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:17:02.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:17:02.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:17:02.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:02.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:17:02.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:17:02.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:17:02.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:17:02.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:17:02.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:17:02.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:02.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:17:02.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:17:02.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:02.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:17:02.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:17:02.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:17:02.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:17:02.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:17:02.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:17:02.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:17:02.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:17:02.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.532 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.532 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.533 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:02.533 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:02.533 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.059613545000001, 2023-01-02T18:17:02.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:17:02.534 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.534 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.534 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:02.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:02.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:02.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:17:02.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:17:02.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:17:02.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:17:02.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:17:02.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:17:02.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:17:02.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:17:02.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:17:02.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:17:02.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:17:02.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:17:02.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:17:02.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:17:02.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:17:02.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:17:02.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.543 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.544 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:11 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:02.544 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:02.544 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.051910544999998, 2023-01-02T18:17:02.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152, 2023-01-02T18:17:02.544 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.545 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.545 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:02.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:02.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:02.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:02.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:17:02.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433810+0000", 2023-01-02T18:17:02.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1821000000000001e-05 2023-01-02T18:17:02.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433822+0000", 2023-01-02T18:17:02.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4549999999999998e-06 2023-01-02T18:17:02.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433829+0000", 2023-01-02T18:17:02.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6005000000000003e-05 2023-01-02T18:17:02.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433885+0000", 2023-01-02T18:17:02.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.16e-05 2023-01-02T18:17:02.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433907+0000", 2023-01-02T18:17:02.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011094480000000001 2023-01-02T18:17:02.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435016+0000", 2023-01-02T18:17:02.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8626999999999999e-05 2023-01-02T18:17:02.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435045+0000", 2023-01-02T18:17:02.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152 2023-01-02T18:17:02.556 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.556 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.557 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.557 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:24 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:02.557 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:02.557 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.036282041, 2023-01-02T18:17:02.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997, 2023-01-02T18:17:02.558 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.558 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.558 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:02.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:02.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:02.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449431+0000", 2023-01-02T18:17:02.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7706e-05 2023-01-02T18:17:02.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449449+0000", 2023-01-02T18:17:02.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0883999999999998e-05 2023-01-02T18:17:02.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449480+0000", 2023-01-02T18:17:02.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4416000000000001e-05 2023-01-02T18:17:02.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449494+0000", 2023-01-02T18:17:02.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6549000000000001e-05 2023-01-02T18:17:02.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449581+0000", 2023-01-02T18:17:02.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9669000000000003e-05 2023-01-02T18:17:02.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449620+0000", 2023-01-02T18:17:02.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0006958 2023-01-02T18:17:02.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450316+0000", 2023-01-02T18:17:02.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0188e-05 2023-01-02T18:17:02.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450346+0000", 2023-01-02T18:17:02.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997 2023-01-02T18:17:02.567 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.568 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.568 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:30 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:02.568 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:02.569 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.028879535000002, 2023-01-02T18:17:02.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003, 2023-01-02T18:17:02.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.569 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.569 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:02.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:02.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456835+0000", 2023-01-02T18:17:02.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7504999999999999e-05 2023-01-02T18:17:02.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456852+0000", 2023-01-02T18:17:02.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2356e-05 2023-01-02T18:17:02.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456865+0000", 2023-01-02T18:17:02.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.421e-06 2023-01-02T18:17:02.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456871+0000", 2023-01-02T18:17:02.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8040999999999997e-05 2023-01-02T18:17:02.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456909+0000", 2023-01-02T18:17:02.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5384e-05 2023-01-02T18:17:02.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456925+0000", 2023-01-02T18:17:02.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074633700000000002 2023-01-02T18:17:02.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457671+0000", 2023-01-02T18:17:02.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7826000000000001e-05 2023-01-02T18:17:02.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457699+0000", 2023-01-02T18:17:02.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003 2023-01-02T18:17:02.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.579 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:31 3.1c e46/43 3:3d3f3250:::rbd_id.image2:head v 46'3, mlcod=46'1)", 2023-01-02T18:17:02.579 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:02.580 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.027251052, 2023-01-02T18:17:02.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999, 2023-01-02T18:17:02.580 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.580 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.580 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:02.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:02.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458463+0000", 2023-01-02T18:17:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3389999999999998e-06 2023-01-02T18:17:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458470+0000", 2023-01-02T18:17:02.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.205e-05 2023-01-02T18:17:02.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458482+0000", 2023-01-02T18:17:02.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5809999999999996e-06 2023-01-02T18:17:02.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458487+0000", 2023-01-02T18:17:02.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8702000000000001e-05 2023-01-02T18:17:02.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458546+0000", 2023-01-02T18:17:02.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2495e-05 2023-01-02T18:17:02.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458559+0000", 2023-01-02T18:17:02.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001846735 2023-01-02T18:17:02.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460405+0000", 2023-01-02T18:17:02.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9183000000000002e-05 2023-01-02T18:17:02.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460435+0000", 2023-01-02T18:17:02.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999 2023-01-02T18:17:02.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.590 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.590 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.590 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:32 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:02.591 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:02.591 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.023901342999999, 2023-01-02T18:17:02.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997, 2023-01-02T18:17:02.591 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.591 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.592 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:02.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:02.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:02.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:02.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3030000000000001e-06 2023-01-02T18:17:02.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461818+0000", 2023-01-02T18:17:02.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0964999999999999e-05 2023-01-02T18:17:02.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461829+0000", 2023-01-02T18:17:02.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8039999999999998e-06 2023-01-02T18:17:02.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461835+0000", 2023-01-02T18:17:02.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8708999999999997e-05 2023-01-02T18:17:02.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461884+0000", 2023-01-02T18:17:02.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5057e-05 2023-01-02T18:17:02.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461899+0000", 2023-01-02T18:17:02.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061687999999999999 2023-01-02T18:17:02.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462515+0000", 2023-01-02T18:17:02.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1633e-05 2023-01-02T18:17:02.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462547+0000", 2023-01-02T18:17:02.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997 2023-01-02T18:17:02.601 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.601 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.602 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.602 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:33 3.3 3:c76fae31:::rbd_object_map.12a21ad382ee:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:02.602 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:02.602 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.022858490000001, 2023-01-02T18:17:02.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001, 2023-01-02T18:17:02.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.603 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.603 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:02.603 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:02.604 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.604 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33 2023-01-02T18:17:02.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.604 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:02.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:02.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462856+0000", 2023-01-02T18:17:02.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4710000000000004e-06 2023-01-02T18:17:02.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462862+0000", 2023-01-02T18:17:02.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:17:02.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462875+0000", 2023-01-02T18:17:02.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.491e-05 2023-01-02T18:17:02.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462890+0000", 2023-01-02T18:17:02.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9657999999999999e-05 2023-01-02T18:17:02.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462930+0000", 2023-01-02T18:17:02.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1362999999999999e-05 2023-01-02T18:17:02.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463021+0000", 2023-01-02T18:17:02.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015166800000000001 2023-01-02T18:17:02.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:17:02.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463173+0000", 2023-01-02T18:17:02.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074740899999999999 2023-01-02T18:17:02.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:02.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463920+0000", 2023-01-02T18:17:02.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045107699999999998 2023-01-02T18:17:02.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464372+0000", 2023-01-02T18:17:02.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6213e-05 2023-01-02T18:17:02.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464408+0000", 2023-01-02T18:17:02.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.535e-05 2023-01-02T18:17:02.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464433+0000", 2023-01-02T18:17:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001 2023-01-02T18:17:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:45 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.012148883999998, 2023-01-02T18:17:02.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892, 2023-01-02T18:17:02.618 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.618 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.618 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:02.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:02.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473565+0000", 2023-01-02T18:17:02.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5140000000000004e-06 2023-01-02T18:17:02.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473573+0000", 2023-01-02T18:17:02.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2473000000000001e-05 2023-01-02T18:17:02.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473585+0000", 2023-01-02T18:17:02.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2159999999999997e-06 2023-01-02T18:17:02.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473591+0000", 2023-01-02T18:17:02.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0025999999999999e-05 2023-01-02T18:17:02.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473631+0000", 2023-01-02T18:17:02.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3309000000000001e-05 2023-01-02T18:17:02.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473644+0000", 2023-01-02T18:17:02.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057332800000000001 2023-01-02T18:17:02.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474217+0000", 2023-01-02T18:17:02.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0043999999999999e-05 2023-01-02T18:17:02.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474247+0000", 2023-01-02T18:17:02.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892 2023-01-02T18:17:02.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.627 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.628 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:46 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'3, mlcod=46'1)", 2023-01-02T18:17:02.628 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:02.628 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.010817121999999, 2023-01-02T18:17:02.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997, 2023-01-02T18:17:02.629 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.629 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.629 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:02.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:02.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474897+0000", 2023-01-02T18:17:02.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8789999999999992e-06 2023-01-02T18:17:02.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474906+0000", 2023-01-02T18:17:02.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3468e-05 2023-01-02T18:17:02.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474920+0000", 2023-01-02T18:17:02.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8460000000000002e-06 2023-01-02T18:17:02.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474926+0000", 2023-01-02T18:17:02.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6996000000000003e-05 2023-01-02T18:17:02.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474963+0000", 2023-01-02T18:17:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2276000000000001e-05 2023-01-02T18:17:02.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474976+0000", 2023-01-02T18:17:02.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066849900000000002 2023-01-02T18:17:02.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475644+0000", 2023-01-02T18:17:02.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2233999999999997e-05 2023-01-02T18:17:02.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475676+0000", 2023-01-02T18:17:02.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997 2023-01-02T18:17:02.638 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.639 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.639 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.639 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:53 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:02.639 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:02.640 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.975904932999999, 2023-01-02T18:17:02.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082, 2023-01-02T18:17:02.640 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.640 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.640 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:02.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:02.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:02.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:02.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3499999999999996e-06 2023-01-02T18:17:02.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509815+0000", 2023-01-02T18:17:02.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0020999999999999e-05 2023-01-02T18:17:02.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509825+0000", 2023-01-02T18:17:02.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1399999999999997e-06 2023-01-02T18:17:02.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509832+0000", 2023-01-02T18:17:02.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3279999999999999e-05 2023-01-02T18:17:02.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509875+0000", 2023-01-02T18:17:02.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0288e-05 2023-01-02T18:17:02.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509895+0000", 2023-01-02T18:17:02.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000905152 2023-01-02T18:17:02.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510800+0000", 2023-01-02T18:17:02.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1238000000000001e-05 2023-01-02T18:17:02.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510832+0000", 2023-01-02T18:17:02.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082 2023-01-02T18:17:02.650 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.650 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.650 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.651 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:17:02.651 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:02.651 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.973914392000001, 2023-01-02T18:17:02.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:17:02.651 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.652 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.652 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:02.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:02.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:17:02.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:17:02.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:17:02.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:17:02.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:17:02.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:17:02.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:17:02.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:17:02.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:17:02.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:17:02.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:17:02.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:17:02.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:17:02.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:17:02.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:17:02.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:17:02.661 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.661 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.662 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:66 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:02.662 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:02.663 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.962756235000001, 2023-01-02T18:17:02.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997, 2023-01-02T18:17:02.663 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.663 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.663 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:02.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:02.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522958+0000", 2023-01-02T18:17:02.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6449999999999994e-06 2023-01-02T18:17:02.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522967+0000", 2023-01-02T18:17:02.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3166000000000001e-05 2023-01-02T18:17:02.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522980+0000", 2023-01-02T18:17:02.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:17:02.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522987+0000", 2023-01-02T18:17:02.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4501000000000001e-05 2023-01-02T18:17:02.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523022+0000", 2023-01-02T18:17:02.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5023e-05 2023-01-02T18:17:02.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523037+0000", 2023-01-02T18:17:02.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057705099999999997 2023-01-02T18:17:02.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523614+0000", 2023-01-02T18:17:02.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1579999999999999e-05 2023-01-02T18:17:02.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523645+0000", 2023-01-02T18:17:02.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997 2023-01-02T18:17:02.673 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.673 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.673 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.674 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:26 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'6, mlcod=46'4)", 2023-01-02T18:17:02.674 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:02.674 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.947391628999998, 2023-01-02T18:17:02.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005, 2023-01-02T18:17:02.675 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.675 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.675 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:02.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:02.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538323+0000", 2023-01-02T18:17:02.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8736000000000002e-05 2023-01-02T18:17:02.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538342+0000", 2023-01-02T18:17:02.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6739999999999992e-06 2023-01-02T18:17:02.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538351+0000", 2023-01-02T18:17:02.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6460000000000001e-06 2023-01-02T18:17:02.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538356+0000", 2023-01-02T18:17:02.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.57e-05 2023-01-02T18:17:02.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538402+0000", 2023-01-02T18:17:02.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6050999999999998e-05 2023-01-02T18:17:02.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538428+0000", 2023-01-02T18:17:02.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055106199999999995 2023-01-02T18:17:02.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538979+0000", 2023-01-02T18:17:02.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7333000000000001e-05 2023-01-02T18:17:02.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539006+0000", 2023-01-02T18:17:02.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005 2023-01-02T18:17:02.685 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.685 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.685 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.686 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:27 3.f e46/43 3:f63788c7:::rbd_id.image5:head v 46'6, mlcod=46'4)", 2023-01-02T18:17:02.686 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:02.686 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.946071558, 2023-01-02T18:17:02.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001, 2023-01-02T18:17:02.686 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.686 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.687 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:02.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:02.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:02.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539643+0000", 2023-01-02T18:17:02.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0418999999999999e-05 2023-01-02T18:17:02.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539663+0000", 2023-01-02T18:17:02.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3852999999999999e-05 2023-01-02T18:17:02.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539677+0000", 2023-01-02T18:17:02.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5100000000000004e-06 2023-01-02T18:17:02.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539684+0000", 2023-01-02T18:17:02.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9595999999999998e-05 2023-01-02T18:17:02.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539723+0000", 2023-01-02T18:17:02.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7207999999999999e-05 2023-01-02T18:17:02.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539741+0000", 2023-01-02T18:17:02.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063475200000000004 2023-01-02T18:17:02.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540375+0000", 2023-01-02T18:17:02.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5425e-05 2023-01-02T18:17:02.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540411+0000", 2023-01-02T18:17:02.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001 2023-01-02T18:17:02.696 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.696 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.696 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.697 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:17:02.697 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:02.697 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.051958728999999, 2023-01-02T18:17:02.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:17:02.698 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.698 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.698 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:02.698 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:02.698 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.699 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:17:02.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.699 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:02.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:02.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:02.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:17:02.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:17:02.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:17:02.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:17:02.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:17:02.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:17:02.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:17:02.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:17:02.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:17:02.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:17:02.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:02.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:17:02.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:17:02.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:17:02.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:17:02.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:17:02.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:17:02.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:02.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:17:02.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:17:02.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:17:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:17:02.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:17:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:17:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:17:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:17:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:17:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:17:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.713 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:17:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:02.714 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.187177671000001, 2023-01-02T18:17:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:17:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:02.715 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:17:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:17:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:17:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:17:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:17:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:17:02.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:17:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:17:02.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:17:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:17:02.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:17:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:17:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:17:02.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:17:02.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:17:02.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:17:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:17:02.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:17:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:17:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:17:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:17:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:17:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:17:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:17:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:17:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:17:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:17:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.730 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:272 4.9 4:911e4614:::rbd_id.image18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:17:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.175549150999998, 2023-01-02T18:17:02.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999, 2023-01-02T18:17:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:02.732 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 272 2023-01-02T18:17:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:02.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:02.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310165+0000", 2023-01-02T18:17:02.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.628e-06 2023-01-02T18:17:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310174+0000", 2023-01-02T18:17:02.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2023-01-02T18:17:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310190+0000", 2023-01-02T18:17:02.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:17:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310198+0000", 2023-01-02T18:17:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6770000000000001e-05 2023-01-02T18:17:02.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310245+0000", 2023-01-02T18:17:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159517 2023-01-02T18:17:02.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310404+0000", 2023-01-02T18:17:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023075600000000001 2023-01-02T18:17:02.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310635+0000", 2023-01-02T18:17:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088889700000000004 2023-01-02T18:17:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311524+0000", 2023-01-02T18:17:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011021 2023-01-02T18:17:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311634+0000", 2023-01-02T18:17:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2626000000000002e-05 2023-01-02T18:17:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311667+0000", 2023-01-02T18:17:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9774000000000002e-05 2023-01-02T18:17:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:02.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311706+0000", 2023-01-02T18:17:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999 2023-01-02T18:17:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:02.746 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:02.746 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:02.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:02.748 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:02.748+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:02.777 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:02.847 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:02.848+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:02.913 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:02.913 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:02.914 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:02.914 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:02.918 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:02.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:02.935 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:02.948 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:02.948+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:02.952 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:02.969 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:02.987 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:03.022 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:03.039 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:03.041 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:03.041 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:03.041 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:03.041 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:03.042 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:03.042 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:03.042 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:03.042 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:03.048 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:03.048+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:03.089 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:03.090 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:03.100 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:03.150 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:03.149+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:03.226 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:03.226 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:03.236 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:03.250 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:03.250+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:03.352 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:03.352+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:03.402 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:03.402 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:03.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:03.455 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:03.456+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:03.537 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:03.537 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:03.546 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:03.554 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:03.554+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:03.586 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:17:03.655 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:03.654+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:03.717 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:03.718 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:03.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:03.770 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:03.771+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:03.853 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:03.853 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:03.856 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:03.857+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:03.862 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:03.957 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:03.957+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:04.027 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:04.027 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:04.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:04.057 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:04.057+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:04.158 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:04.159+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:04.162 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:04.162 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:04.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:04.259 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:04.259+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:04.316 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:04.316 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:04.327 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:04.360 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:04.360+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:04.461 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:04.461+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:04.493 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:04.493 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:04.503 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:04.588 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:04.588+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:04.663 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:04.664+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:04.671 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:04.671 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:04.681 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:04.765 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:04.765+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:04.847 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:04.848 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:04.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:04.865 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:04.866+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:04.966 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:04.966+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:05.022 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:05.023 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:05.032 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:05.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:05.076 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:05.076+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:05.160 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:05.160 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:05.167 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:05.166+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:05.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:05.217 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:05.237 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:05.255 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:05.267 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:05.267+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:05.273 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:05.291 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:05.310 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:05.334 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:05.344 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:05.345 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:05.345 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:05.354 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:05.355 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:05.356 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:05.356 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:05.356 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:05.356 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:05.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:05.400 INFO:tasks.workunit.client.0.smithi007.stdout:image: image28 2023-01-02T18:17:05.401 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image28 2023-01-02T18:17:05.401 INFO:tasks.workunit.client.0.smithi007.stdout:found image28 2023-01-02T18:17:05.401 INFO:tasks.workunit.client.0.smithi007.stdout:erased image28 2023-01-02T18:17:05.401 INFO:tasks.workunit.client.0.smithi007.stdout:image: image28 2023-01-02T18:17:05.401 INFO:tasks.workunit.client.0.smithi007.stdout:image: image29 2023-01-02T18:17:05.402 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image28 2023-01-02T18:17:05.402 INFO:tasks.workunit.client.0.smithi007.stdout:found image28 2023-01-02T18:17:05.402 INFO:tasks.workunit.client.0.smithi007.stdout:erased image28 2023-01-02T18:17:05.402 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image29 2023-01-02T18:17:05.402 INFO:tasks.workunit.client.0.smithi007.stdout:found image29 2023-01-02T18:17:05.403 INFO:tasks.workunit.client.0.smithi007.stdout:erased image29 2023-01-02T18:17:05.403 INFO:tasks.workunit.client.0.smithi007.stdout:100.00% done 2023-01-02T18:17:05.403 INFO:tasks.workunit.client.0.smithi007.stdout:image: image28 2023-01-02T18:17:05.403 INFO:tasks.workunit.client.0.smithi007.stdout:image: image29 2023-01-02T18:17:05.403 INFO:tasks.workunit.client.0.smithi007.stdout:image: image30 2023-01-02T18:17:05.404 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image28 2023-01-02T18:17:05.404 INFO:tasks.workunit.client.0.smithi007.stdout:found image28 2023-01-02T18:17:05.404 INFO:tasks.workunit.client.0.smithi007.stdout:erased image28 2023-01-02T18:17:05.404 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image29 2023-01-02T18:17:05.404 INFO:tasks.workunit.client.0.smithi007.stdout:found image29 2023-01-02T18:17:05.405 INFO:tasks.workunit.client.0.smithi007.stdout:erased image29 2023-01-02T18:17:05.405 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image30 2023-01-02T18:17:05.405 INFO:tasks.workunit.client.0.smithi007.stdout:found image30 2023-01-02T18:17:05.405 INFO:tasks.workunit.client.0.smithi007.stdout:erased image30 2023-01-02T18:17:05.405 INFO:tasks.workunit.client.0.smithi007.stdout:image: image28 2023-01-02T18:17:05.406 INFO:tasks.workunit.client.0.smithi007.stdout:image: image29 2023-01-02T18:17:05.406 INFO:tasks.workunit.client.0.smithi007.stdout:image: image30 2023-01-02T18:17:05.406 INFO:tasks.workunit.client.0.smithi007.stdout:image: image31 2023-01-02T18:17:05.406 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image28 2023-01-02T18:17:05.407 INFO:tasks.workunit.client.0.smithi007.stdout:found image28 2023-01-02T18:17:05.407 INFO:tasks.workunit.client.0.smithi007.stdout:erased image28 2023-01-02T18:17:05.407 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image29 2023-01-02T18:17:05.407 INFO:tasks.workunit.client.0.smithi007.stdout:found image29 2023-01-02T18:17:05.407 INFO:tasks.workunit.client.0.smithi007.stdout:erased image29 2023-01-02T18:17:05.408 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image30 2023-01-02T18:17:05.408 INFO:tasks.workunit.client.0.smithi007.stdout:found image30 2023-01-02T18:17:05.408 INFO:tasks.workunit.client.0.smithi007.stdout:erased image30 2023-01-02T18:17:05.408 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image31 2023-01-02T18:17:05.408 INFO:tasks.workunit.client.0.smithi007.stdout:found image31 2023-01-02T18:17:05.408 INFO:tasks.workunit.client.0.smithi007.stdout:erased image31 2023-01-02T18:17:05.409 INFO:tasks.workunit.client.0.smithi007.stdout:image: image28 2023-01-02T18:17:05.409 INFO:tasks.workunit.client.0.smithi007.stdout:image: image29 2023-01-02T18:17:05.409 INFO:tasks.workunit.client.0.smithi007.stdout:image: image30 2023-01-02T18:17:05.409 INFO:tasks.workunit.client.0.smithi007.stdout:image: image31 2023-01-02T18:17:05.409 INFO:tasks.workunit.client.0.smithi007.stdout:image: image32 2023-01-02T18:17:05.410 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image28 2023-01-02T18:17:05.410 INFO:tasks.workunit.client.0.smithi007.stdout:found image28 2023-01-02T18:17:05.410 INFO:tasks.workunit.client.0.smithi007.stdout:erased image28 2023-01-02T18:17:05.410 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image29 2023-01-02T18:17:05.410 INFO:tasks.workunit.client.0.smithi007.stdout:found image29 2023-01-02T18:17:05.411 INFO:tasks.workunit.client.0.smithi007.stdout:erased image29 2023-01-02T18:17:05.411 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image30 2023-01-02T18:17:05.411 INFO:tasks.workunit.client.0.smithi007.stdout:found image30 2023-01-02T18:17:05.411 INFO:tasks.workunit.client.0.smithi007.stdout:erased image30 2023-01-02T18:17:05.411 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image31 2023-01-02T18:17:05.412 INFO:tasks.workunit.client.0.smithi007.stdout:found image31 2023-01-02T18:17:05.412 INFO:tasks.workunit.client.0.smithi007.stdout:erased image31 2023-01-02T18:17:05.412 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image32 2023-01-02T18:17:05.412 INFO:tasks.workunit.client.0.smithi007.stdout:found image32 2023-01-02T18:17:05.412 INFO:tasks.workunit.client.0.smithi007.stdout:erased image32 2023-01-02T18:17:05.412 INFO:tasks.workunit.client.0.smithi007.stdout:100.00% done 2023-01-02T18:17:05.413 INFO:tasks.workunit.client.0.smithi007.stdout:image: image28 2023-01-02T18:17:05.413 INFO:tasks.workunit.client.0.smithi007.stdout:image: image29 2023-01-02T18:17:05.413 INFO:tasks.workunit.client.0.smithi007.stdout:image: image30 2023-01-02T18:17:05.413 INFO:tasks.workunit.client.0.smithi007.stdout:image: image31 2023-01-02T18:17:05.413 INFO:tasks.workunit.client.0.smithi007.stdout:image: image32 2023-01-02T18:17:05.414 INFO:tasks.workunit.client.0.smithi007.stdout:image: image33 2023-01-02T18:17:05.414 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image28 2023-01-02T18:17:05.414 INFO:tasks.workunit.client.0.smithi007.stdout:found image28 2023-01-02T18:17:05.414 INFO:tasks.workunit.client.0.smithi007.stdout:erased image28 2023-01-02T18:17:05.414 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image29 2023-01-02T18:17:05.414 INFO:tasks.workunit.client.0.smithi007.stdout:found image29 2023-01-02T18:17:05.415 INFO:tasks.workunit.client.0.smithi007.stdout:erased image29 2023-01-02T18:17:05.415 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image30 2023-01-02T18:17:05.415 INFO:tasks.workunit.client.0.smithi007.stdout:found image30 2023-01-02T18:17:05.415 INFO:tasks.workunit.client.0.smithi007.stdout:erased image30 2023-01-02T18:17:05.416 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image31 2023-01-02T18:17:05.416 INFO:tasks.workunit.client.0.smithi007.stdout:found image31 2023-01-02T18:17:05.416 INFO:tasks.workunit.client.0.smithi007.stdout:erased image31 2023-01-02T18:17:05.416 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image32 2023-01-02T18:17:05.416 INFO:tasks.workunit.client.0.smithi007.stdout:found image32 2023-01-02T18:17:05.417 INFO:tasks.workunit.client.0.smithi007.stdout:erased image32 2023-01-02T18:17:05.417 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image33 2023-01-02T18:17:05.417 INFO:tasks.workunit.client.0.smithi007.stdout:found image33 2023-01-02T18:17:05.417 INFO:tasks.workunit.client.0.smithi007.stdout:erased image33 2023-01-02T18:17:05.417 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestDeepCopy (7658 ms) 2023-01-02T18:17:05.418 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestDeepCopyPP 2023-01-02T18:17:05.418 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:05.400+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:05.469 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:05.469+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:05.486 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:05.487 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:05.487 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:05.487 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:05.487 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:05.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:05.570 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:05.571+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:05.600 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:17:05.667 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:05.667 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:05.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:05.668 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:05.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.668 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:05.668 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:05.669 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.182130367999999, 2023-01-02T18:17:05.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:05.669 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.669 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.669 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:05.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:05.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:05.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:05.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:05.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:05.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:05.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:05.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:05.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:05.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:05.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:05.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:05.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:05.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:05.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:05.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:05.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:05.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:05.679 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.679 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.679 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.680 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:05.680 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:05.680 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.318063838, 2023-01-02T18:17:05.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:05.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.681 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:05.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:05.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:05.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:05.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:05.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:05.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:05.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:05.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:05.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:05.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:05.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:05.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:05.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:05.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:05.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:05.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:05.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:05.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:05.691 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.691 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.691 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.316384225, 2023-01-02T18:17:05.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:05.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:05.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:05.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:05.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:05.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:05.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:05.702 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:05.703 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3495563409999995, 2023-01-02T18:17:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.704 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:05.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:05.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:05.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:05.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:05.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:05.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:05.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:05.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:05.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:05.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:05.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:05.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:05.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:05.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:05.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:05.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:05.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:05.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:05.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.714 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:05.715 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.0194187970000002, 2023-01-02T18:17:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:05.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:05.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:05.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:05.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:05.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:05.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:05.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:05.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:05.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:05.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:05.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:05.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:05.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:05.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:05.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:05.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:05.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:05.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.726 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.727 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:981 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'4, mlcod=64'2)", 2023-01-02T18:17:05.727 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:05.727 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.0070791000000003, 2023-01-02T18:17:05.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003, 2023-01-02T18:17:05.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.728 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:05.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658715+0000", 2023-01-02T18:17:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2509999999999997e-06 2023-01-02T18:17:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658723+0000", 2023-01-02T18:17:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6970000000000005e-06 2023-01-02T18:17:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658732+0000", 2023-01-02T18:17:05.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3159999999999998e-06 2023-01-02T18:17:05.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658737+0000", 2023-01-02T18:17:05.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2293000000000003e-05 2023-01-02T18:17:05.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658779+0000", 2023-01-02T18:17:05.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2996000000000001e-05 2023-01-02T18:17:05.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658802+0000", 2023-01-02T18:17:05.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066023399999999999 2023-01-02T18:17:05.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659462+0000", 2023-01-02T18:17:05.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4413000000000002e-05 2023-01-02T18:17:05.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659487+0000", 2023-01-02T18:17:05.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003 2023-01-02T18:17:05.738 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.738 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.739 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.739 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:05.739 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:05.739 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.3420660939999998, 2023-01-02T18:17:05.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:05.740 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.740 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.740 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:05.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:05.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:05.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:05.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:05.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:05.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:05.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:05.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:05.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:05.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:05.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:05.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:05.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:05.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:05.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:05.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:05.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:05.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:05.750 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.750 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.750 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.751 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:05.751 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:05.751 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.3402730089999997, 2023-01-02T18:17:05.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:05.752 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.752 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.752 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:05.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:05.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:05.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:05.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:05.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:05.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:05.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:05.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:05.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:05.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:05.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:05.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:05.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:05.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:05.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:05.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:05.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:05.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:05.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.762 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.763 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:05.763 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:05.763 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.3294352250000001, 2023-01-02T18:17:05.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:05.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.764 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:05.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:05.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:05.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:05.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:05.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:05.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:05.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:05.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:05.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:05.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:05.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:05.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:05.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:05.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:05.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:05.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:05.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.773 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.774 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1511 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'37, mlcod=68'35)", 2023-01-02T18:17:05.774 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:05.774 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2072389530000001, 2023-01-02T18:17:05.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005, 2023-01-02T18:17:05.775 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.775 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:05.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:05.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:05.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458554+0000", 2023-01-02T18:17:05.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4627000000000001e-05 2023-01-02T18:17:05.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458569+0000", 2023-01-02T18:17:05.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6376e-05 2023-01-02T18:17:05.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458595+0000", 2023-01-02T18:17:05.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2846e-05 2023-01-02T18:17:05.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458608+0000", 2023-01-02T18:17:05.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0798999999999997e-05 2023-01-02T18:17:05.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458689+0000", 2023-01-02T18:17:05.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1622999999999998e-05 2023-01-02T18:17:05.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458731+0000", 2023-01-02T18:17:05.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050369499999999997 2023-01-02T18:17:05.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459234+0000", 2023-01-02T18:17:05.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6656999999999998e-05 2023-01-02T18:17:05.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459271+0000", 2023-01-02T18:17:05.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005 2023-01-02T18:17:05.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.785 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.786 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1618 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'52, mlcod=68'50)", 2023-01-02T18:17:05.786 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:05.786 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.1610585310000001, 2023-01-02T18:17:05.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068253599999999997, 2023-01-02T18:17:05.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.787 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:05.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:05.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:05.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504736+0000", 2023-01-02T18:17:05.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3439999999999997e-06 2023-01-02T18:17:05.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504742+0000", 2023-01-02T18:17:05.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0339999999999999e-05 2023-01-02T18:17:05.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504753+0000", 2023-01-02T18:17:05.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000002e-06 2023-01-02T18:17:05.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504759+0000", 2023-01-02T18:17:05.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8566999999999998e-05 2023-01-02T18:17:05.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504808+0000", 2023-01-02T18:17:05.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3618e-05 2023-01-02T18:17:05.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504831+0000", 2023-01-02T18:17:05.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055935399999999997 2023-01-02T18:17:05.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.505391+0000", 2023-01-02T18:17:05.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8598999999999998e-05 2023-01-02T18:17:05.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.505419+0000", 2023-01-02T18:17:05.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068253599999999997 2023-01-02T18:17:05.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.797 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.797 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1642 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'55, mlcod=68'53)", 2023-01-02T18:17:05.798 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:05.798 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.1501084549999998, 2023-01-02T18:17:05.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068970200000000005, 2023-01-02T18:17:05.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.798 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:05.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:05.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:05.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515686+0000", 2023-01-02T18:17:05.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2879999999999998e-06 2023-01-02T18:17:05.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515692+0000", 2023-01-02T18:17:05.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0679000000000001e-05 2023-01-02T18:17:05.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515703+0000", 2023-01-02T18:17:05.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7849999999999999e-06 2023-01-02T18:17:05.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515708+0000", 2023-01-02T18:17:05.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4620000000000003e-05 2023-01-02T18:17:05.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515752+0000", 2023-01-02T18:17:05.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2283999999999999e-05 2023-01-02T18:17:05.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515775+0000", 2023-01-02T18:17:05.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057592299999999999 2023-01-02T18:17:05.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.516351+0000", 2023-01-02T18:17:05.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5884000000000002e-05 2023-01-02T18:17:05.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.516376+0000", 2023-01-02T18:17:05.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068970200000000005 2023-01-02T18:17:05.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.808 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.809 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.809 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1698 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'62, mlcod=68'60)", 2023-01-02T18:17:05.809 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:05.809 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.1247686410000002, 2023-01-02T18:17:05.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069486999999999999, 2023-01-02T18:17:05.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.810 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:05.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:05.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541026+0000", 2023-01-02T18:17:05.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1589999999999998e-06 2023-01-02T18:17:05.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541032+0000", 2023-01-02T18:17:05.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0879e-05 2023-01-02T18:17:05.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541043+0000", 2023-01-02T18:17:05.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5360000000000003e-06 2023-01-02T18:17:05.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541047+0000", 2023-01-02T18:17:05.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6459999999999999e-05 2023-01-02T18:17:05.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541094+0000", 2023-01-02T18:17:05.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323e-05 2023-01-02T18:17:05.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541117+0000", 2023-01-02T18:17:05.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057111 2023-01-02T18:17:05.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541688+0000", 2023-01-02T18:17:05.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3217999999999999e-05 2023-01-02T18:17:05.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541721+0000", 2023-01-02T18:17:05.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069486999999999999 2023-01-02T18:17:05.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.820 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.821 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1774 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'72, mlcod=68'70)", 2023-01-02T18:17:05.821 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:05.821 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.0901608630000004, 2023-01-02T18:17:05.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004, 2023-01-02T18:17:05.821 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.822 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:05.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:05.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:05.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575633+0000", 2023-01-02T18:17:05.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1912999999999999e-05 2023-01-02T18:17:05.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575645+0000", 2023-01-02T18:17:05.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5690000000000001e-05 2023-01-02T18:17:05.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575660+0000", 2023-01-02T18:17:05.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1430000000000001e-06 2023-01-02T18:17:05.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575668+0000", 2023-01-02T18:17:05.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9123000000000003e-05 2023-01-02T18:17:05.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575727+0000", 2023-01-02T18:17:05.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0632000000000001e-05 2023-01-02T18:17:05.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575757+0000", 2023-01-02T18:17:05.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057452100000000004 2023-01-02T18:17:05.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576332+0000", 2023-01-02T18:17:05.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8958999999999998e-05 2023-01-02T18:17:05.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576361+0000", 2023-01-02T18:17:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004 2023-01-02T18:17:05.831 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.832 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.832 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1783 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'73, mlcod=68'71)", 2023-01-02T18:17:05.832 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.579687+0000", 2023-01-02T18:17:05.833 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.0861081099999996, 2023-01-02T18:17:05.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067999399999999995, 2023-01-02T18:17:05.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.833 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579687+0000", 2023-01-02T18:17:05.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579687+0000", 2023-01-02T18:17:05.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:05.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579686+0000", 2023-01-02T18:17:05.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1459999999999996e-06 2023-01-02T18:17:05.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579694+0000", 2023-01-02T18:17:05.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4207e-05 2023-01-02T18:17:05.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579709+0000", 2023-01-02T18:17:05.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5180000000000001e-06 2023-01-02T18:17:05.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579715+0000", 2023-01-02T18:17:05.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5882e-05 2023-01-02T18:17:05.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579751+0000", 2023-01-02T18:17:05.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4052e-05 2023-01-02T18:17:05.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579765+0000", 2023-01-02T18:17:05.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057860500000000005 2023-01-02T18:17:05.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.580344+0000", 2023-01-02T18:17:05.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504999999999999e-05 2023-01-02T18:17:05.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.580367+0000", 2023-01-02T18:17:05.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067999399999999995 2023-01-02T18:17:05.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.843 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.844 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1819 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'77, mlcod=68'75)", 2023-01-02T18:17:05.844 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:05.844 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.0702343030000003, 2023-01-02T18:17:05.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068721400000000001, 2023-01-02T18:17:05.845 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.845 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.845 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:05.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:05.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:05.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595559+0000", 2023-01-02T18:17:05.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0942e-05 2023-01-02T18:17:05.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595570+0000", 2023-01-02T18:17:05.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8321999999999998e-05 2023-01-02T18:17:05.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595589+0000", 2023-01-02T18:17:05.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0069999999999997e-06 2023-01-02T18:17:05.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595597+0000", 2023-01-02T18:17:05.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7846999999999999e-05 2023-01-02T18:17:05.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595635+0000", 2023-01-02T18:17:05.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6322000000000001e-05 2023-01-02T18:17:05.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595651+0000", 2023-01-02T18:17:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056746499999999996 2023-01-02T18:17:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.596218+0000", 2023-01-02T18:17:05.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9777999999999998e-05 2023-01-02T18:17:05.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.596248+0000", 2023-01-02T18:17:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068721400000000001 2023-01-02T18:17:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1842 8.4 e68/65 8:24c831c0:::rbd_header.12a2b9663ff5:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.0528993340000001, 2023-01-02T18:17:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997, 2023-01-02T18:17:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.856 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:05.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:05.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612894+0000", 2023-01-02T18:17:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:05.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612908+0000", 2023-01-02T18:17:05.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6006000000000001e-05 2023-01-02T18:17:05.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612934+0000", 2023-01-02T18:17:05.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.509e-05 2023-01-02T18:17:05.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612949+0000", 2023-01-02T18:17:05.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7535999999999998e-05 2023-01-02T18:17:05.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613027+0000", 2023-01-02T18:17:05.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0413000000000001e-05 2023-01-02T18:17:05.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613067+0000", 2023-01-02T18:17:05.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056083499999999998 2023-01-02T18:17:05.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613628+0000", 2023-01-02T18:17:05.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0998000000000001e-05 2023-01-02T18:17:05.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613649+0000", 2023-01-02T18:17:05.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997 2023-01-02T18:17:05.866 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.866 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.866 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.867 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2136 8.16 e69/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:05.867 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:05.867 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.0448178609999998, 2023-01-02T18:17:05.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995, 2023-01-02T18:17:05.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.868 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.868 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:05.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:05.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:05.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:05.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8340000000000001e-06 2023-01-02T18:17:05.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620984+0000", 2023-01-02T18:17:05.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5201000000000001e-05 2023-01-02T18:17:05.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620999+0000", 2023-01-02T18:17:05.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9990000000000008e-06 2023-01-02T18:17:05.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621007+0000", 2023-01-02T18:17:05.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9780999999999997e-05 2023-01-02T18:17:05.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621047+0000", 2023-01-02T18:17:05.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2869e-05 2023-01-02T18:17:05.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621060+0000", 2023-01-02T18:17:05.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061950799999999995 2023-01-02T18:17:05.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621679+0000", 2023-01-02T18:17:05.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2191999999999999e-05 2023-01-02T18:17:05.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621711+0000", 2023-01-02T18:17:05.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995 2023-01-02T18:17:05.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.878 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2604 8.16 e72/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 72'4, mlcod=69'2)", 2023-01-02T18:17:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.27325651699999998, 2023-01-02T18:17:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068205399999999997, 2023-01-02T18:17:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:05.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:05.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392538+0000", 2023-01-02T18:17:05.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5759999999999999e-06 2023-01-02T18:17:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392543+0000", 2023-01-02T18:17:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1090999999999999e-05 2023-01-02T18:17:05.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392554+0000", 2023-01-02T18:17:05.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8440000000000003e-06 2023-01-02T18:17:05.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392560+0000", 2023-01-02T18:17:05.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5738000000000002e-05 2023-01-02T18:17:05.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392606+0000", 2023-01-02T18:17:05.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6169000000000001e-05 2023-01-02T18:17:05.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392622+0000", 2023-01-02T18:17:05.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056720399999999997 2023-01-02T18:17:05.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.393189+0000", 2023-01-02T18:17:05.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1707e-05 2023-01-02T18:17:05.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.393221+0000", 2023-01-02T18:17:05.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068205399999999997 2023-01-02T18:17:05.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.890 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.890 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2611 8.1b e72/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 72'85, mlcod=69'83)", 2023-01-02T18:17:05.891 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:05.891 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.26523212600000001, 2023-01-02T18:17:05.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999, 2023-01-02T18:17:05.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:05.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:05.891 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:05.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:05.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:05.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:05.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:05.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:05.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:05.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400562+0000", 2023-01-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1299999999999998e-06 2023-01-02T18:17:05.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:05.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400568+0000", 2023-01-02T18:17:05.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0643e-05 2023-01-02T18:17:05.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:05.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400579+0000", 2023-01-02T18:17:05.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4920000000000004e-06 2023-01-02T18:17:05.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:05.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400584+0000", 2023-01-02T18:17:05.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4360999999999998e-05 2023-01-02T18:17:05.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:05.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400618+0000", 2023-01-02T18:17:05.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4246999999999999e-05 2023-01-02T18:17:05.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:05.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400632+0000", 2023-01-02T18:17:05.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061679400000000004 2023-01-02T18:17:05.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:05.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401249+0000", 2023-01-02T18:17:05.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7705999999999999e-05 2023-01-02T18:17:05.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:05.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:05.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:05.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401277+0000", 2023-01-02T18:17:05.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999 2023-01-02T18:17:05.901 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.901 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.901 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.901 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:05.902 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:05.902 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:05.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:05.904 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:05.903+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:06.004 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:06.004+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:06.069 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:06.069 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:06.070 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:06.070 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:06.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:06.105 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:06.105+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:06.205 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:06.205+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:06.244 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:06.244 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:06.244 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:06.245 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:06.245 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:06.254 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:06.265 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7] out_osds: [5, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:17:06.266 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:17:06.266 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-01-02T18:17:06.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-01-02T18:17:06.329 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:17:06.331 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:06.331+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:06.407 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:06.408+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:06.443 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:06.444 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:06.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:06.444 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:06.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.444 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:06.445 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:06.445 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.006381984000001, 2023-01-02T18:17:06.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:06.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:06.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.447 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:06.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:06.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:06.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:06.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:06.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:06.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:06.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:06.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:06.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:06.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:06.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:06.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:06.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:06.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:06.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:06.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:06.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:06.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:06.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:06.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:06.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:06.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:06.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:06.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:06.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:06.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:06.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:06.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:06.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:06.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:06.461 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.462 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.462 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.462 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:06.463 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:06.463 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.956996991, 2023-01-02T18:17:06.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:17:06.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.463 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.464 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:06.464 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:06.464 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:17:06.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.464 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:06.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:06.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:06.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:17:06.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:17:06.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:17:06.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:17:06.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:17:06.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:17:06.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:17:06.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:17:06.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:17:06.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:17:06.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:17:06.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:17:06.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:06.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:17:06.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:17:06.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:17:06.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:17:06.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:17:06.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:17:06.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:17:06.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:17:06.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:17:06.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:17:06.477 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.477 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.477 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.478 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:8 3.18 3:1e96267a:::rbd_object_map.11d585d3810a:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:06.478 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:17:06.478 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.955187131999999, 2023-01-02T18:17:06.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087, 2023-01-02T18:17:06.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.479 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.479 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:06.479 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 8 2023-01-02T18:17:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:17:06.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487044+0000", 2023-01-02T18:17:06.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487043+0000", 2023-01-02T18:17:06.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6100000000000002e-06 2023-01-02T18:17:06.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487049+0000", 2023-01-02T18:17:06.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:06.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487064+0000", 2023-01-02T18:17:06.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3280000000000006e-06 2023-01-02T18:17:06.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487072+0000", 2023-01-02T18:17:06.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5221e-05 2023-01-02T18:17:06.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487117+0000", 2023-01-02T18:17:06.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7274000000000005e-05 2023-01-02T18:17:06.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487204+0000", 2023-01-02T18:17:06.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013400700000000001 2023-01-02T18:17:06.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2023-01-02T18:17:06.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.487338+0000", 2023-01-02T18:17:06.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083414299999999997 2023-01-02T18:17:06.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488173+0000", 2023-01-02T18:17:06.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020278700000000001 2023-01-02T18:17:06.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488375+0000", 2023-01-02T18:17:06.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6679999999999999e-05 2023-01-02T18:17:06.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488432+0000", 2023-01-02T18:17:06.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6842000000000003e-05 2023-01-02T18:17:06.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.488479+0000", 2023-01-02T18:17:06.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001435087 2023-01-02T18:17:06.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.493 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.494 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:52 3.8 3:105263f9:::rbd_id.image4:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:06.494 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:06.494 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.937299126999999, 2023-01-02T18:17:06.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001, 2023-01-02T18:17:06.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.495 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.495 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.495 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.495 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 52 2023-01-02T18:17:06.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.496 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:06.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:06.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504931+0000", 2023-01-02T18:17:06.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5480000000000004e-06 2023-01-02T18:17:06.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504938+0000", 2023-01-02T18:17:06.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2118e-05 2023-01-02T18:17:06.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504950+0000", 2023-01-02T18:17:06.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.259e-06 2023-01-02T18:17:06.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504956+0000", 2023-01-02T18:17:06.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1742999999999997e-05 2023-01-02T18:17:06.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504987+0000", 2023-01-02T18:17:06.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3327999999999999e-05 2023-01-02T18:17:06.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505071+0000", 2023-01-02T18:17:06.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012434100000000001 2023-01-02T18:17:06.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505195+0000", 2023-01-02T18:17:06.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083202299999999999 2023-01-02T18:17:06.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506027+0000", 2023-01-02T18:17:06.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031725600000000003 2023-01-02T18:17:06.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506344+0000", 2023-01-02T18:17:06.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9904e-05 2023-01-02T18:17:06.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506374+0000", 2023-01-02T18:17:06.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9748e-05 2023-01-02T18:17:06.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506414+0000", 2023-01-02T18:17:06.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001 2023-01-02T18:17:06.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.508 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.509 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.509 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:427 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.509 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:06.510 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.076278735000001, 2023-01-02T18:17:06.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001, 2023-01-02T18:17:06.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.510 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 427 2023-01-02T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:06.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365951+0000", 2023-01-02T18:17:06.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4900000000000002e-06 2023-01-02T18:17:06.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365956+0000", 2023-01-02T18:17:06.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5820000000000004e-06 2023-01-02T18:17:06.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365963+0000", 2023-01-02T18:17:06.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8339999999999998e-06 2023-01-02T18:17:06.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365968+0000", 2023-01-02T18:17:06.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000271091 2023-01-02T18:17:06.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366239+0000", 2023-01-02T18:17:06.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2132000000000006e-05 2023-01-02T18:17:06.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366321+0000", 2023-01-02T18:17:06.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000222733 2023-01-02T18:17:06.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366544+0000", 2023-01-02T18:17:06.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056500799999999998 2023-01-02T18:17:06.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367109+0000", 2023-01-02T18:17:06.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030673499999999998 2023-01-02T18:17:06.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367416+0000", 2023-01-02T18:17:06.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3107000000000003e-05 2023-01-02T18:17:06.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367489+0000", 2023-01-02T18:17:06.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3927000000000001e-05 2023-01-02T18:17:06.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367543+0000", 2023-01-02T18:17:06.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001 2023-01-02T18:17:06.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.524 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.524 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.524 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:444 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.525 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:06.525 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.066980758, 2023-01-02T18:17:06.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489, 2023-01-02T18:17:06.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.526 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.526 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.526 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.526 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 444 2023-01-02T18:17:06.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.527 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:06.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:06.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375249+0000", 2023-01-02T18:17:06.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9409999999999998e-06 2023-01-02T18:17:06.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375254+0000", 2023-01-02T18:17:06.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5210000000000008e-06 2023-01-02T18:17:06.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375264+0000", 2023-01-02T18:17:06.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9629999999999997e-06 2023-01-02T18:17:06.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375269+0000", 2023-01-02T18:17:06.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.333e-05 2023-01-02T18:17:06.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375312+0000", 2023-01-02T18:17:06.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6695999999999998e-05 2023-01-02T18:17:06.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375399+0000", 2023-01-02T18:17:06.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016210000000000001 2023-01-02T18:17:06.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375561+0000", 2023-01-02T18:17:06.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087961699999999996 2023-01-02T18:17:06.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376440+0000", 2023-01-02T18:17:06.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055437200000000002 2023-01-02T18:17:06.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376995+0000", 2023-01-02T18:17:06.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6236999999999997e-05 2023-01-02T18:17:06.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377051+0000", 2023-01-02T18:17:06.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0509e-05 2023-01-02T18:17:06.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377102+0000", 2023-01-02T18:17:06.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489 2023-01-02T18:17:06.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.539 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.540 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.540 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:06.540 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.056673517, 2023-01-02T18:17:06.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:17:06.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.542 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:17:06.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.542 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:06.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:06.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:17:06.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:17:06.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:17:06.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:17:06.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:17:06.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:17:06.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:17:06.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:17:06.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:17:06.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:17:06.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:17:06.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:17:06.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:17:06.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:17:06.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:17:06.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:17:06.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:17:06.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:17:06.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:17:06.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:17:06.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:17:06.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:17:06.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.555 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.556 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:556 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.556 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:17:06.556 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.002824419, 2023-01-02T18:17:06.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001475292, 2023-01-02T18:17:06.556 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.557 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.557 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.557 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 556 2023-01-02T18:17:06.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.558 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:17:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439406+0000", 2023-01-02T18:17:06.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439405+0000", 2023-01-02T18:17:06.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2149999999999998e-06 2023-01-02T18:17:06.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439412+0000", 2023-01-02T18:17:06.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2879e-05 2023-01-02T18:17:06.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439425+0000", 2023-01-02T18:17:06.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2339999999999999e-06 2023-01-02T18:17:06.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439431+0000", 2023-01-02T18:17:06.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1504e-05 2023-01-02T18:17:06.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439482+0000", 2023-01-02T18:17:06.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7194000000000006e-05 2023-01-02T18:17:06.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439569+0000", 2023-01-02T18:17:06.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000215632 2023-01-02T18:17:06.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439785+0000", 2023-01-02T18:17:06.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059054099999999998 2023-01-02T18:17:06.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440376+0000", 2023-01-02T18:17:06.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000404671 2023-01-02T18:17:06.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440780+0000", 2023-01-02T18:17:06.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5293000000000001e-05 2023-01-02T18:17:06.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440836+0000", 2023-01-02T18:17:06.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6108e-05 2023-01-02T18:17:06.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440882+0000", 2023-01-02T18:17:06.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001475292 2023-01-02T18:17:06.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.570 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.571 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:564 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.571 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:17:06.571 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.99770479, 2023-01-02T18:17:06.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001451564, 2023-01-02T18:17:06.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.572 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.572 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.572 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.573 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 564 2023-01-02T18:17:06.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.573 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:17:06.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444526+0000", 2023-01-02T18:17:06.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444525+0000", 2023-01-02T18:17:06.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1768e-05 2023-01-02T18:17:06.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444537+0000", 2023-01-02T18:17:06.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8800000000000003e-06 2023-01-02T18:17:06.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444547+0000", 2023-01-02T18:17:06.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2220000000000004e-06 2023-01-02T18:17:06.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444551+0000", 2023-01-02T18:17:06.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6570000000000003e-05 2023-01-02T18:17:06.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444598+0000", 2023-01-02T18:17:06.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9318000000000001e-05 2023-01-02T18:17:06.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444687+0000", 2023-01-02T18:17:06.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022138 2023-01-02T18:17:06.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.444908+0000", 2023-01-02T18:17:06.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061683899999999999 2023-01-02T18:17:06.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445525+0000", 2023-01-02T18:17:06.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035056600000000002 2023-01-02T18:17:06.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445876+0000", 2023-01-02T18:17:06.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6709000000000002e-05 2023-01-02T18:17:06.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445933+0000", 2023-01-02T18:17:06.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5068999999999998e-05 2023-01-02T18:17:06.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.445978+0000", 2023-01-02T18:17:06.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001451564 2023-01-02T18:17:06.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.590 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.591 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:572 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.591 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:17:06.591 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.992910910999999, 2023-01-02T18:17:06.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001474445, 2023-01-02T18:17:06.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 572 2023-01-02T18:17:06.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.593 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:17:06.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449320+0000", 2023-01-02T18:17:06.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:06.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449319+0000", 2023-01-02T18:17:06.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6760000000000001e-06 2023-01-02T18:17:06.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449325+0000", 2023-01-02T18:17:06.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3584000000000001e-05 2023-01-02T18:17:06.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449339+0000", 2023-01-02T18:17:06.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6309999999999997e-06 2023-01-02T18:17:06.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449346+0000", 2023-01-02T18:17:06.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6709000000000003e-05 2023-01-02T18:17:06.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449392+0000", 2023-01-02T18:17:06.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6323000000000006e-05 2023-01-02T18:17:06.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449489+0000", 2023-01-02T18:17:06.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000220089 2023-01-02T18:17:06.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449709+0000", 2023-01-02T18:17:06.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063770000000000005 2023-01-02T18:17:06.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450346+0000", 2023-01-02T18:17:06.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035778300000000003 2023-01-02T18:17:06.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450704+0000", 2023-01-02T18:17:06.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2308000000000001e-05 2023-01-02T18:17:06.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450757+0000", 2023-01-02T18:17:06.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7868999999999999e-05 2023-01-02T18:17:06.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450794+0000", 2023-01-02T18:17:06.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001474445 2023-01-02T18:17:06.605 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.605 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.606 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:629 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.606 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:06.607 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.960952557000001, 2023-01-02T18:17:06.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999, 2023-01-02T18:17:06.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.607 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.607 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.608 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.608 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 629 2023-01-02T18:17:06.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.608 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:06.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:06.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481277+0000", 2023-01-02T18:17:06.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.981e-06 2023-01-02T18:17:06.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481283+0000", 2023-01-02T18:17:06.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3018e-05 2023-01-02T18:17:06.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481296+0000", 2023-01-02T18:17:06.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0430000000000004e-06 2023-01-02T18:17:06.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481302+0000", 2023-01-02T18:17:06.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7145999999999999e-05 2023-01-02T18:17:06.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481349+0000", 2023-01-02T18:17:06.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6058999999999996e-05 2023-01-02T18:17:06.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481445+0000", 2023-01-02T18:17:06.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000219621 2023-01-02T18:17:06.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481665+0000", 2023-01-02T18:17:06.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076564299999999999 2023-01-02T18:17:06.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482431+0000", 2023-01-02T18:17:06.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027227600000000001 2023-01-02T18:17:06.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482703+0000", 2023-01-02T18:17:06.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5970000000000001e-05 2023-01-02T18:17:06.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482759+0000", 2023-01-02T18:17:06.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2224000000000001e-05 2023-01-02T18:17:06.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482801+0000", 2023-01-02T18:17:06.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999 2023-01-02T18:17:06.621 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.621 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.621 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.622 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:677 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.622 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:06.622 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.933261312999999, 2023-01-02T18:17:06.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911, 2023-01-02T18:17:06.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.623 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.623 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.623 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.623 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 677 2023-01-02T18:17:06.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.624 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:06.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:06.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508969+0000", 2023-01-02T18:17:06.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.268e-06 2023-01-02T18:17:06.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508975+0000", 2023-01-02T18:17:06.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4151000000000001e-05 2023-01-02T18:17:06.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508989+0000", 2023-01-02T18:17:06.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9569999999999996e-06 2023-01-02T18:17:06.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508996+0000", 2023-01-02T18:17:06.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6683e-05 2023-01-02T18:17:06.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509043+0000", 2023-01-02T18:17:06.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6942999999999997e-05 2023-01-02T18:17:06.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509130+0000", 2023-01-02T18:17:06.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020122099999999999 2023-01-02T18:17:06.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509331+0000", 2023-01-02T18:17:06.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063843400000000001 2023-01-02T18:17:06.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509969+0000", 2023-01-02T18:17:06.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062000599999999999 2023-01-02T18:17:06.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510589+0000", 2023-01-02T18:17:06.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8503000000000001e-05 2023-01-02T18:17:06.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510618+0000", 2023-01-02T18:17:06.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7784999999999998e-05 2023-01-02T18:17:06.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510655+0000", 2023-01-02T18:17:06.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911 2023-01-02T18:17:06.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.637 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.637 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:709 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:06.638 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:06.638 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.914238900000001, 2023-01-02T18:17:06.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999, 2023-01-02T18:17:06.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.639 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.639 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.639 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.639 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 709 2023-01-02T18:17:06.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.640 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:06.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:06.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527991+0000", 2023-01-02T18:17:06.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5170000000000001e-06 2023-01-02T18:17:06.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527996+0000", 2023-01-02T18:17:06.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2990000000000002e-06 2023-01-02T18:17:06.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528005+0000", 2023-01-02T18:17:06.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7049999999999996e-06 2023-01-02T18:17:06.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528011+0000", 2023-01-02T18:17:06.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3952999999999998e-05 2023-01-02T18:17:06.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528045+0000", 2023-01-02T18:17:06.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1950999999999998e-05 2023-01-02T18:17:06.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528097+0000", 2023-01-02T18:17:06.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000157078 2023-01-02T18:17:06.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528254+0000", 2023-01-02T18:17:06.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076010699999999999 2023-01-02T18:17:06.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529014+0000", 2023-01-02T18:17:06.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045062500000000002 2023-01-02T18:17:06.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529464+0000", 2023-01-02T18:17:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1790999999999999e-05 2023-01-02T18:17:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529516+0000", 2023-01-02T18:17:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1063999999999999e-05 2023-01-02T18:17:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529557+0000", 2023-01-02T18:17:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999 2023-01-02T18:17:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.653 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:06.653 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:06.653 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.1328418750000004, 2023-01-02T18:17:06.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:06.654 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.654 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.654 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.654 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:06.655 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:06.655 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:06.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.655 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:06.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:06.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:06.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:06.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:06.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:06.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:06.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:06.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:06.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:06.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:06.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:06.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:06.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:06.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:06.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:06.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:06.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:06.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:06.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:06.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:06.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:06.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:06.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:06.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:06.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:06.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:06.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:06.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:06.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:06.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.670 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.671 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:372 7.1 7:83feba0f:::rbd_object_map.11d56649889d:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:06.671 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:06.671 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.1229028119999995, 2023-01-02T18:17:06.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479, 2023-01-02T18:17:06.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.672 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.672 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:06.672 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:06.673 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 372 2023-01-02T18:17:06.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.673 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:06.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:06.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:06.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319326+0000", 2023-01-02T18:17:06.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1199999999999996e-06 2023-01-02T18:17:06.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319334+0000", 2023-01-02T18:17:06.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2170999999999999e-05 2023-01-02T18:17:06.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319346+0000", 2023-01-02T18:17:06.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7789999999999996e-06 2023-01-02T18:17:06.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319353+0000", 2023-01-02T18:17:06.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8445999999999997e-05 2023-01-02T18:17:06.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319392+0000", 2023-01-02T18:17:06.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010474700000000001 2023-01-02T18:17:06.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319497+0000", 2023-01-02T18:17:06.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138159 2023-01-02T18:17:06.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:06.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319635+0000", 2023-01-02T18:17:06.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071603699999999999 2023-01-02T18:17:06.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320351+0000", 2023-01-02T18:17:06.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063369800000000003 2023-01-02T18:17:06.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320985+0000", 2023-01-02T18:17:06.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5822000000000002e-05 2023-01-02T18:17:06.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321040+0000", 2023-01-02T18:17:06.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4125999999999997e-05 2023-01-02T18:17:06.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321085+0000", 2023-01-02T18:17:06.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479 2023-01-02T18:17:06.686 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.686 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.686 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.687 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:964 7.14 7:2d7624f7:::rbd_id.image26:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:06.687 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.645860+0000", 2023-01-02T18:17:06.687 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.7963707949999996, 2023-01-02T18:17:06.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014729560000000001, 2023-01-02T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:06.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 964 2023-01-02T18:17:06.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.689 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645860+0000", 2023-01-02T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645860+0000", 2023-01-02T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645859+0000", 2023-01-02T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2050000000000001e-06 2023-01-02T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645864+0000", 2023-01-02T18:17:06.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0960000000000007e-06 2023-01-02T18:17:06.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645873+0000", 2023-01-02T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3030000000000001e-06 2023-01-02T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645878+0000", 2023-01-02T18:17:06.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9790999999999999e-05 2023-01-02T18:17:06.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.645918+0000", 2023-01-02T18:17:06.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014038899999999999 2023-01-02T18:17:06.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646058+0000", 2023-01-02T18:17:06.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000203926 2023-01-02T18:17:06.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:06.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646262+0000", 2023-01-02T18:17:06.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077879399999999997 2023-01-02T18:17:06.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647041+0000", 2023-01-02T18:17:06.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024163599999999999 2023-01-02T18:17:06.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647282+0000", 2023-01-02T18:17:06.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9030000000000002e-05 2023-01-02T18:17:06.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647311+0000", 2023-01-02T18:17:06.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1744000000000001e-05 2023-01-02T18:17:06.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647333+0000", 2023-01-02T18:17:06.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014729560000000001 2023-01-02T18:17:06.701 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.702 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.702 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.702 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1953 8.8 8:1376a730:::rbd_id.image30:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:06.703 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:06.703 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.785818388, 2023-01-02T18:17:06.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939, 2023-01-02T18:17:06.703 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.703 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.704 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.704 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1953 2023-01-02T18:17:06.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.705 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:06.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:06.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:06.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656411+0000", 2023-01-02T18:17:06.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5109999999999992e-06 2023-01-02T18:17:06.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656421+0000", 2023-01-02T18:17:06.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3118000000000001e-05 2023-01-02T18:17:06.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656444+0000", 2023-01-02T18:17:06.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.841e-06 2023-01-02T18:17:06.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656452+0000", 2023-01-02T18:17:06.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8368000000000003e-05 2023-01-02T18:17:06.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656490+0000", 2023-01-02T18:17:06.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6940000000000004e-05 2023-01-02T18:17:06.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656587+0000", 2023-01-02T18:17:06.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013780300000000001 2023-01-02T18:17:06.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:06.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656725+0000", 2023-01-02T18:17:06.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000707375 2023-01-02T18:17:06.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.657432+0000", 2023-01-02T18:17:06.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062476800000000005 2023-01-02T18:17:06.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658057+0000", 2023-01-02T18:17:06.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4223000000000001e-05 2023-01-02T18:17:06.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658091+0000", 2023-01-02T18:17:06.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5299e-05 2023-01-02T18:17:06.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658116+0000", 2023-01-02T18:17:06.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939 2023-01-02T18:17:06.717 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.718 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.718 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.718 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:06.719 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:06.719 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8268819199999999, 2023-01-02T18:17:06.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:06.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.720 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.720 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.720 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:06.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.720 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:06.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:06.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:06.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:06.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:06.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:06.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:06.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:06.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:06.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:06.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:06.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:06.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:06.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:06.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:06.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:06.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:06.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:06.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:06.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:06.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:06.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:06.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:06.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:06.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:06.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:06.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:06.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:06.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:06.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:06.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:06.735 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.735 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.736 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.736 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2160 8.0 8:0415d193:::rbd_header.12a27aa439c7:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:06.736 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:06.737 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8075510119999998, 2023-01-02T18:17:06.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014998629999999999, 2023-01-02T18:17:06.737 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.737 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.737 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.737 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.738 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.738 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2160 2023-01-02T18:17:06.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.738 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:06.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:06.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:06.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634679+0000", 2023-01-02T18:17:06.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9569999999999999e-06 2023-01-02T18:17:06.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634685+0000", 2023-01-02T18:17:06.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1110999999999999e-05 2023-01-02T18:17:06.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634696+0000", 2023-01-02T18:17:06.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5769999999999999e-06 2023-01-02T18:17:06.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634702+0000", 2023-01-02T18:17:06.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2962000000000001e-05 2023-01-02T18:17:06.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634735+0000", 2023-01-02T18:17:06.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3204000000000001e-05 2023-01-02T18:17:06.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634789+0000", 2023-01-02T18:17:06.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036566000000000002 2023-01-02T18:17:06.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635154+0000", 2023-01-02T18:17:06.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074706800000000004 2023-01-02T18:17:06.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635901+0000", 2023-01-02T18:17:06.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000225295 2023-01-02T18:17:06.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636127+0000", 2023-01-02T18:17:06.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0684e-05 2023-01-02T18:17:06.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636157+0000", 2023-01-02T18:17:06.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2378000000000002e-05 2023-01-02T18:17:06.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636180+0000", 2023-01-02T18:17:06.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014998629999999999 2023-01-02T18:17:06.751 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.751 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.751 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.752 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:06.752 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:06.752 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.112410106, 2023-01-02T18:17:06.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:06.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:06.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:06.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:06.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:06.753 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:06.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:06.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.754 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:06.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:06.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:06.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:06.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:06.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:06.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:06.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:06.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:06.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:06.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:06.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:06.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:06.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:06.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:06.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:06.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:06.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:06.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:06.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:06.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:06.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:06.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:06.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:06.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:06.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:06.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:06.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:06.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:06.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:06.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:06.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:06.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:06.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:06.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:06.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:06.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:06.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:06.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:06.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:06.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:06.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:06.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:06.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:06.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:06.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.769 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.770 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.770 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:06.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:06.773 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:06.773 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:06.774 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 73, 2023-01-02T18:17:06.774 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "4e320929-c4bb-4ea9-9e1c-d8479b7e40b1", 2023-01-02T18:17:06.774 INFO:teuthology.orchestra.run.smithi007.stdout: "created": "2023-01-02T18:15:29.542145+0000", 2023-01-02T18:17:06.774 INFO:teuthology.orchestra.run.smithi007.stdout: "modified": "2023-01-02T18:17:06.313775+0000", 2023-01-02T18:17:06.774 INFO:teuthology.orchestra.run.smithi007.stdout: "last_up_change": "2023-01-02T18:15:38.537792+0000", 2023-01-02T18:17:06.775 INFO:teuthology.orchestra.run.smithi007.stdout: "last_in_change": "2023-01-02T18:16:47.302822+0000", 2023-01-02T18:17:06.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-01-02T18:17:06.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_num": 5806080, 2023-01-02T18:17:06.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_set": [ 2023-01-02T18:17:06.776 INFO:teuthology.orchestra.run.smithi007.stdout: "nodeep-scrub", 2023-01-02T18:17:06.776 INFO:teuthology.orchestra.run.smithi007.stdout: "noscrub", 2023-01-02T18:17:06.776 INFO:teuthology.orchestra.run.smithi007.stdout: "pglog_hardlimit", 2023-01-02T18:17:06.776 INFO:teuthology.orchestra.run.smithi007.stdout: "purged_snapdirs", 2023-01-02T18:17:06.776 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_deletes", 2023-01-02T18:17:06.777 INFO:teuthology.orchestra.run.smithi007.stdout: "sortbitwise" 2023-01-02T18:17:06.777 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:06.777 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_version": 4, 2023-01-02T18:17:06.777 INFO:teuthology.orchestra.run.smithi007.stdout: "full_ratio": 0.94999998807907104, 2023-01-02T18:17:06.777 INFO:teuthology.orchestra.run.smithi007.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-01-02T18:17:06.778 INFO:teuthology.orchestra.run.smithi007.stdout: "nearfull_ratio": 0.85000002384185791, 2023-01-02T18:17:06.778 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_snapshot": "", 2023-01-02T18:17:06.778 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_max": 9, 2023-01-02T18:17:06.778 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd": 8, 2023-01-02T18:17:06.778 INFO:teuthology.orchestra.run.smithi007.stdout: "require_min_compat_client": "luminous", 2023-01-02T18:17:06.779 INFO:teuthology.orchestra.run.smithi007.stdout: "min_compat_client": "luminous", 2023-01-02T18:17:06.779 INFO:teuthology.orchestra.run.smithi007.stdout: "require_osd_release": "pacific", 2023-01-02T18:17:06.779 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": [ 2023-01-02T18:17:06.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.779 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 1, 2023-01-02T18:17:06.780 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "device_health_metrics", 2023-01-02T18:17:06.780 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:38.598445+0000", 2023-01-02T18:17:06.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:17:06.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:17:06.780 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.781 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.781 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.781 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.781 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.781 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.782 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.782 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.782 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.782 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.782 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 1, 2023-01-02T18:17:06.782 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 1, 2023-01-02T18:17:06.783 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 1, 2023-01-02T18:17:06.783 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 1, 2023-01-02T18:17:06.783 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 1, 2023-01-02T18:17:06.783 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.783 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.784 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.784 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.784 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.784 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.784 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.785 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "16", 2023-01-02T18:17:06.785 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.785 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.785 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.786 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.786 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.786 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:17:06.786 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:17:06.786 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.787 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.787 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.787 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.788 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.788 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.788 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.788 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.788 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.790 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.790 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.790 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.791 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.791 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.791 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.791 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.792 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.792 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.792 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.792 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.792 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-01-02T18:17:06.793 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_max": 32, 2023-01-02T18:17:06.793 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 1 2023-01-02T18:17:06.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.793 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:06.793 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_devicehealth": {} 2023-01-02T18:17:06.794 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.794 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 2, 2023-01-02T18:17:06.794 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "rbd", 2023-01-02T18:17:06.795 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:40.853543+0000", 2023-01-02T18:17:06.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:17:06.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:17:06.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.795 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.795 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.796 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.796 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.796 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.796 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.796 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.797 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 8, 2023-01-02T18:17:06.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 8, 2023-01-02T18:17:06.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 8, 2023-01-02T18:17:06.798 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 8, 2023-01-02T18:17:06.798 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 8, 2023-01-02T18:17:06.798 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.798 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.798 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.799 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.799 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.799 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.799 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.800 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "18", 2023-01-02T18:17:06.800 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.800 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.801 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.801 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.801 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.801 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:17:06.801 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:17:06.802 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.802 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.802 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.802 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.803 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.803 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.803 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.803 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.804 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.804 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.804 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.804 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.804 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.805 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.805 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.805 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.806 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.806 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.806 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.806 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.807 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.807 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.807 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.807 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.807 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.807 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.808 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:06.808 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:06.808 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd": {} 2023-01-02T18:17:06.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.809 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-01-02T18:17:06.809 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-1", 2023-01-02T18:17:06.809 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:36.229953+0000", 2023-01-02T18:17:06.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:06.810 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:06.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.810 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.810 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.811 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.811 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.811 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.811 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.811 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.812 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.812 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.812 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:06.812 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:06.812 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:06.812 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:06.813 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:06.813 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.813 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.813 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.813 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.814 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.814 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.814 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.814 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "46", 2023-01-02T18:17:06.815 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.815 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.815 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.815 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.815 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.816 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:06.816 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 46, 2023-01-02T18:17:06.816 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.816 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.816 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.816 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.817 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.817 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.817 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.818 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.818 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.818 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.818 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.818 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.819 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.819 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.819 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.819 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.820 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.820 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.820 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.821 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.821 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.821 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.822 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.822 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.822 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.822 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.822 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:06.823 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:06.823 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:06.823 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.823 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 4, 2023-01-02T18:17:06.824 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-2", 2023-01-02T18:17:06.824 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:39.906131+0000", 2023-01-02T18:17:06.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:06.824 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:06.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.825 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.825 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.825 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.825 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.825 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.826 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.826 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.826 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.826 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.826 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:06.827 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:06.827 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:06.827 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:06.827 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:06.827 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.828 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.828 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.828 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.828 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.828 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.829 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.829 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "51", 2023-01-02T18:17:06.830 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.830 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.830 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.830 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.830 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.831 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:06.831 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 51, 2023-01-02T18:17:06.831 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.831 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.831 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.832 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.832 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.832 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.832 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.832 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.833 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.833 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.833 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.833 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.833 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.834 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.834 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.834 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.834 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.834 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.835 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.835 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.835 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.836 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.836 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.836 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.836 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.836 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.837 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.837 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.837 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:06.837 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:06.838 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:06.838 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.838 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 5, 2023-01-02T18:17:06.838 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-3", 2023-01-02T18:17:06.839 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:44.455124+0000", 2023-01-02T18:17:06.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:06.839 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:06.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.839 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.840 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.840 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.840 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.840 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.840 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.840 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.841 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.841 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.841 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:06.841 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:06.841 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:06.842 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:06.842 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:06.842 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.842 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.842 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.843 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.843 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.843 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.843 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.843 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "56", 2023-01-02T18:17:06.844 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.844 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.844 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.844 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.844 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.844 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:06.845 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 56, 2023-01-02T18:17:06.845 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.845 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.845 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.845 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.846 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.846 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.846 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.846 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.847 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.847 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.847 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.847 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.847 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.847 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.848 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.848 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.848 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.848 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.849 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.849 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.849 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.849 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.849 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.850 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.850 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.850 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.850 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.850 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.851 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:06.851 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:06.851 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:06.851 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.852 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 6, 2023-01-02T18:17:06.852 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-4", 2023-01-02T18:17:06.852 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:49.454047+0000", 2023-01-02T18:17:06.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:06.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:06.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.853 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.853 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.853 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.853 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.854 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.854 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.854 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.854 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.854 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.854 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:06.855 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.856 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.856 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.856 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.856 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.856 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.857 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.857 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "60", 2023-01-02T18:17:06.857 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.857 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.858 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.858 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.858 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.858 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:06.858 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 60, 2023-01-02T18:17:06.858 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.859 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.859 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.859 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.860 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.860 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.860 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.860 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.860 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.860 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.861 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.861 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.861 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.861 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.861 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.861 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.862 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.862 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.862 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.863 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.863 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.863 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.863 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.864 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.864 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.864 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.864 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:06.864 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:06.864 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:06.865 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.865 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 7, 2023-01-02T18:17:06.865 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-5", 2023-01-02T18:17:06.866 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:53.843144+0000", 2023-01-02T18:17:06.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:06.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:06.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.866 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.866 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.867 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.867 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.867 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.867 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.867 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.868 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.868 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.868 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:06.868 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:06.868 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:06.869 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:06.869 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:06.869 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.869 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.869 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.869 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.870 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.870 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.870 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.870 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "64", 2023-01-02T18:17:06.871 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.871 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.871 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.871 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.871 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.871 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:06.872 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 64, 2023-01-02T18:17:06.872 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.872 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.872 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.872 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.873 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.873 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.873 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.873 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.874 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.874 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.874 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.874 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.874 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.875 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.875 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.875 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.875 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.876 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.876 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.876 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.876 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.877 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.877 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.877 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.877 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.877 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.878 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:06.878 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:06.878 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:06.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 8, 2023-01-02T18:17:06.879 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-6", 2023-01-02T18:17:06.879 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:57.794651+0000", 2023-01-02T18:17:06.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:06.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:06.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.880 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.880 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.880 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.880 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.880 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.881 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.881 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.881 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.881 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.881 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:06.882 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:06.882 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:06.882 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:06.882 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:06.882 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.882 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.883 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.883 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.883 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.883 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.883 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.884 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "72", 2023-01-02T18:17:06.884 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.884 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.884 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.884 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.885 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.885 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 7, 2023-01-02T18:17:06.885 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 72, 2023-01-02T18:17:06.885 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.885 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.886 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.886 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.886 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.886 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.887 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.887 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.887 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.887 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.887 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.887 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.888 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.888 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.888 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.888 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.888 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.889 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.889 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.889 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.889 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.890 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.890 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.890 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.890 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.890 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.891 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.891 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:06.891 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:06.891 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:06.891 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.892 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 9, 2023-01-02T18:17:06.892 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-7", 2023-01-02T18:17:06.892 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:05.454247+0000", 2023-01-02T18:17:06.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 32769, 2023-01-02T18:17:06.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,creating", 2023-01-02T18:17:06.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:06.893 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:06.893 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:06.893 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:06.893 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:06.894 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:06.894 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:06.894 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:06.894 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:06.894 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:06.894 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:06.895 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:06.895 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:06.895 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:06.895 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:06.895 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:06.896 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:06.896 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:06.896 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:06.896 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:06.896 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:06.896 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:06.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.897 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "73", 2023-01-02T18:17:06.897 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:06.897 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:06.897 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:06.898 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:06.898 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:06.898 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:17:06.898 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:17:06.898 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:06.899 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:06.899 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:06.899 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:06.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:06.899 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:06.899 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:06.900 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:06.900 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:06.900 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:06.900 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:06.900 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:06.901 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:06.901 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:06.901 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:06.901 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:06.901 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:06.901 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:06.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:06.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.902 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:06.902 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:06.902 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:06.902 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:06.903 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:06.903 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:06.903 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:06.903 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:06.903 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:06.904 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:06.904 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:06.904 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:06.904 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": {} 2023-01-02T18:17:06.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.904 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:06.905 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:17:06.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.905 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:17:06.905 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "69e18813-bd8e-4b22-9c40-d702ff3a5efd", 2023-01-02T18:17:06.905 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:06.906 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:06.906 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:06.906 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.6576995849609375, 2023-01-02T18:17:06.906 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:06.906 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 65, 2023-01-02T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:06.907 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.908 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6808", 2023-01-02T18:17:06.908 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:06.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.909 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6809", 2023-01-02T18:17:06.909 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:06.909 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.909 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.910 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:06.910 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.911 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6810", 2023-01-02T18:17:06.911 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:06.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.912 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6811", 2023-01-02T18:17:06.912 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:06.912 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.912 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.912 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:06.913 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.913 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6814", 2023-01-02T18:17:06.913 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:06.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.914 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6815", 2023-01-02T18:17:06.914 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:06.914 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.915 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.915 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:06.915 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.916 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6812", 2023-01-02T18:17:06.916 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:06.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.917 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6813", 2023-01-02T18:17:06.917 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:06.917 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.917 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.918 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6809/107063", 2023-01-02T18:17:06.918 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6811/107063", 2023-01-02T18:17:06.918 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6815/107063", 2023-01-02T18:17:06.918 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6813/107063", 2023-01-02T18:17:06.918 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:06.919 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:06.919 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:06.919 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.919 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:17:06.920 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "aa04dec6-4607-4f2a-85a3-a6278832fef3", 2023-01-02T18:17:06.920 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:06.920 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:06.920 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:06.920 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.3902130126953125, 2023-01-02T18:17:06.920 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:06.921 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:06.921 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:06.921 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 65, 2023-01-02T18:17:06.921 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:06.921 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:06.922 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:06.922 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.922 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.922 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6824", 2023-01-02T18:17:06.922 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:06.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.923 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.923 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6825", 2023-01-02T18:17:06.923 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:06.924 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.924 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.924 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:06.924 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.925 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6826", 2023-01-02T18:17:06.925 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:06.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.926 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6827", 2023-01-02T18:17:06.926 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:06.926 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.926 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.927 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:06.927 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.927 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6830", 2023-01-02T18:17:06.928 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:06.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.928 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6831", 2023-01-02T18:17:06.929 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:06.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.929 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.929 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:06.930 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.930 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6828", 2023-01-02T18:17:06.930 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:06.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.931 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6829", 2023-01-02T18:17:06.931 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:06.931 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.931 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.932 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6825/107066", 2023-01-02T18:17:06.932 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6827/107066", 2023-01-02T18:17:06.932 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6831/107066", 2023-01-02T18:17:06.932 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6829/107066", 2023-01-02T18:17:06.933 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:06.933 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:06.933 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:06.933 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.934 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:17:06.934 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "c98a28fb-d910-4601-a229-d4318259ab9b", 2023-01-02T18:17:06.934 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:06.934 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:06.934 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:06.935 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.14453125, 2023-01-02T18:17:06.935 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:06.935 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:06.935 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:06.935 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 61, 2023-01-02T18:17:06.936 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:06.936 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:06.936 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:06.936 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.936 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.937 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6816", 2023-01-02T18:17:06.937 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:06.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.937 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.938 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6817", 2023-01-02T18:17:06.938 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:06.938 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.938 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.938 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:06.939 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.939 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6818", 2023-01-02T18:17:06.939 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:06.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.940 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6819", 2023-01-02T18:17:06.940 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:06.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.941 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.941 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:06.941 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.942 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6822", 2023-01-02T18:17:06.942 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:06.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.943 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6823", 2023-01-02T18:17:06.943 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:06.943 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.943 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.944 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:06.944 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.944 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6820", 2023-01-02T18:17:06.944 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:06.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.945 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6821", 2023-01-02T18:17:06.945 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6817/107065", 2023-01-02T18:17:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6819/107065", 2023-01-02T18:17:06.946 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6823/107065", 2023-01-02T18:17:06.947 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6821/107065", 2023-01-02T18:17:06.947 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:06.947 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:06.947 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:06.947 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.948 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:17:06.948 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "3c5d48f4-5384-4563-8acb-11d866b85ef4", 2023-01-02T18:17:06.948 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:06.948 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:06.948 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:06.949 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:06.949 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:06.949 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:06.949 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:06.949 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 65, 2023-01-02T18:17:06.949 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:06.950 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:06.950 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:06.950 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.951 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2023-01-02T18:17:06.951 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:06.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.951 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2023-01-02T18:17:06.952 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:06.952 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.952 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.952 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:06.953 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.953 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6802", 2023-01-02T18:17:06.953 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:06.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.954 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6803", 2023-01-02T18:17:06.954 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:06.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.955 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.955 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:06.955 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6806", 2023-01-02T18:17:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6807", 2023-01-02T18:17:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.957 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.958 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6804", 2023-01-02T18:17:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6805", 2023-01-02T18:17:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6801/107064", 2023-01-02T18:17:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6803/107064", 2023-01-02T18:17:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6807/107064", 2023-01-02T18:17:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6805/107064", 2023-01-02T18:17:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:06.961 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:17:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "2476d495-4979-4679-a7e9-12652c270092", 2023-01-02T18:17:06.962 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 0, 2023-01-02T18:17:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 0, 2023-01-02T18:17:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:06.963 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:06.964 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 52, 2023-01-02T18:17:06.964 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:06.964 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:06.964 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:06.964 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.965 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.965 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6800", 2023-01-02T18:17:06.965 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:06.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.966 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.966 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6801", 2023-01-02T18:17:06.966 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:06.966 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.966 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.967 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:06.967 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.968 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6802", 2023-01-02T18:17:06.968 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:06.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.968 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.968 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6803", 2023-01-02T18:17:06.969 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:06.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.969 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.969 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:06.970 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.970 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6806", 2023-01-02T18:17:06.970 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:06.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.971 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6807", 2023-01-02T18:17:06.971 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:06.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.972 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.972 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:06.972 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.973 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6804", 2023-01-02T18:17:06.973 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:06.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.973 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.974 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6805", 2023-01-02T18:17:06.974 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:06.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.974 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.974 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6801/106900", 2023-01-02T18:17:06.975 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6803/106900", 2023-01-02T18:17:06.975 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6807/106900", 2023-01-02T18:17:06.975 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6805/106900", 2023-01-02T18:17:06.975 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:06.975 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:06.976 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:06.976 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.976 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:17:06.977 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "38d57e5e-b6c1-445f-b181-23fb518698f9", 2023-01-02T18:17:06.977 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:06.977 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 0, 2023-01-02T18:17:06.977 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 0, 2023-01-02T18:17:06.977 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:06.977 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:06.978 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:06.978 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:06.978 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 47, 2023-01-02T18:17:06.978 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:06.978 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:06.979 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:06.979 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.979 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.979 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6816", 2023-01-02T18:17:06.980 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:06.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.980 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6817", 2023-01-02T18:17:06.980 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:06.981 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.981 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.981 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:06.981 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.982 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.982 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6818", 2023-01-02T18:17:06.982 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:06.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.983 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6819", 2023-01-02T18:17:06.983 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:06.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.983 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.984 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:06.984 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.984 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.984 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6822", 2023-01-02T18:17:06.985 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:06.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.985 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6823", 2023-01-02T18:17:06.986 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:06.986 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.986 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.986 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:06.986 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.987 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.987 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6820", 2023-01-02T18:17:06.987 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:06.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.988 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6821", 2023-01-02T18:17:06.988 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:06.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.988 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.989 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6817/106930", 2023-01-02T18:17:06.989 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6819/106930", 2023-01-02T18:17:06.989 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6823/106930", 2023-01-02T18:17:06.989 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6821/106930", 2023-01-02T18:17:06.990 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:06.990 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:06.990 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:06.990 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.991 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:17:06.991 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "6c78f25a-2a65-47fe-b101-e47c00a5b2f6", 2023-01-02T18:17:06.991 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:06.991 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:06.991 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:06.991 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:06.992 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:06.992 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:06.992 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:06.992 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 65, 2023-01-02T18:17:06.992 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:06.993 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:06.993 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:06.993 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.993 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6808", 2023-01-02T18:17:06.994 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:06.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.994 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6809", 2023-01-02T18:17:06.995 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:06.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.995 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.995 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:06.996 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.996 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.996 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6810", 2023-01-02T18:17:06.996 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:06.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:06.997 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6811", 2023-01-02T18:17:06.997 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:06.997 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:06.998 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:06.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.998 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:06.998 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:06.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:06.999 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6814", 2023-01-02T18:17:06.999 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:06.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:06.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:06.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:07.000 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6815", 2023-01-02T18:17:07.000 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:07.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.000 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.001 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:07.001 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:07.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:07.001 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6812", 2023-01-02T18:17:07.001 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:07.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.002 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:07.002 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6813", 2023-01-02T18:17:07.002 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:07.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.003 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.003 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6809/106901", 2023-01-02T18:17:07.003 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6811/106901", 2023-01-02T18:17:07.003 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6815/106901", 2023-01-02T18:17:07.004 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6813/106901", 2023-01-02T18:17:07.004 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:07.004 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:07.004 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:07.004 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.005 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:17:07.005 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "b094706d-7145-4865-ae95-e5cd7e40d23b", 2023-01-02T18:17:07.005 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:07.005 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:07.006 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:07.006 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:07.006 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:07.006 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:07.006 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:07.007 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 65, 2023-01-02T18:17:07.007 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:07.007 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:07.007 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:07.007 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:07.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.008 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:07.008 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6824", 2023-01-02T18:17:07.008 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:07.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:07.009 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6825", 2023-01-02T18:17:07.009 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:07.009 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.009 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.010 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:07.010 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:07.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:07.011 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6826", 2023-01-02T18:17:07.011 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:07.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.011 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:07.011 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6827", 2023-01-02T18:17:07.012 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:07.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.012 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.012 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:07.012 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:07.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:07.013 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6830", 2023-01-02T18:17:07.013 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:07.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:07.014 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6831", 2023-01-02T18:17:07.014 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:07.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.015 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.015 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:07.015 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:07.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:07.016 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6828", 2023-01-02T18:17:07.016 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:07.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:07.016 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6829", 2023-01-02T18:17:07.017 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:07.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.017 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.017 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6825/106931", 2023-01-02T18:17:07.018 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6827/106931", 2023-01-02T18:17:07.018 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6831/106931", 2023-01-02T18:17:07.018 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6829/106931", 2023-01-02T18:17:07.018 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:07.018 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:07.019 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:07.019 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.019 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.019 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:07.019 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_xinfo": [ 2023-01-02T18:17:07.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.020 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:17:07.020 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:07.020 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:07.020 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:07.020 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:07.020 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:07.021 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.290083+0000", 2023-01-02T18:17:07.021 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:07.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.021 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:17:07.022 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:07.022 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:07.022 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:07.022 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:07.022 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:07.022 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.303022+0000", 2023-01-02T18:17:07.023 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:07.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.023 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:17:07.023 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:07.024 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:07.024 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:07.024 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:07.024 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:07.024 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.292245+0000", 2023-01-02T18:17:07.024 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:07.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.025 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:17:07.025 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:07.025 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:07.026 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:07.026 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:07.026 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:07.026 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.210530+0000", 2023-01-02T18:17:07.026 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:07.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.027 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:17:07.027 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:07.027 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:07.027 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:07.028 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:07.028 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 65536, 2023-01-02T18:17:07.028 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.282212+0000", 2023-01-02T18:17:07.028 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:07.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.029 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:17:07.029 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:07.029 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:07.029 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:07.030 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:07.030 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 65536, 2023-01-02T18:17:07.030 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.237376+0000", 2023-01-02T18:17:07.030 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:07.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.031 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:17:07.031 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:07.031 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:07.031 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:07.031 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:07.031 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:07.032 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.239974+0000", 2023-01-02T18:17:07.032 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:07.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.032 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:17:07.033 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:07.033 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:07.033 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:07.033 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:07.033 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:07.034 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.276340+0000", 2023-01-02T18:17:07.034 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:07.034 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.034 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:07.034 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap": [ 2023-01-02T18:17:07.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.035 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "2.0", 2023-01-02T18:17:07.035 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:17:07.035 INFO:teuthology.orchestra.run.smithi007.stdout: 2, 2023-01-02T18:17:07.035 INFO:teuthology.orchestra.run.smithi007.stdout: 3 2023-01-02T18:17:07.035 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.036 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:07.036 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_items": [], 2023-01-02T18:17:07.036 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_temp": [], 2023-01-02T18:17:07.036 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_temp": [], 2023-01-02T18:17:07.036 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklist": {}, 2023-01-02T18:17:07.037 INFO:teuthology.orchestra.run.smithi007.stdout: "range_blocklist": {}, 2023-01-02T18:17:07.037 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profiles": { 2023-01-02T18:17:07.037 INFO:teuthology.orchestra.run.smithi007.stdout: "default": { 2023-01-02T18:17:07.037 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-failure-domain": "osd", 2023-01-02T18:17:07.037 INFO:teuthology.orchestra.run.smithi007.stdout: "k": "2", 2023-01-02T18:17:07.038 INFO:teuthology.orchestra.run.smithi007.stdout: "m": "1", 2023-01-02T18:17:07.038 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin": "jerasure", 2023-01-02T18:17:07.038 INFO:teuthology.orchestra.run.smithi007.stdout: "ruleset-failure-domain": "osd", 2023-01-02T18:17:07.038 INFO:teuthology.orchestra.run.smithi007.stdout: "technique": "reed_sol_van" 2023-01-02T18:17:07.038 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:07.039 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps_queue": [ 2023-01-02T18:17:07.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.039 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 8, 2023-01-02T18:17:07.039 INFO:teuthology.orchestra.run.smithi007.stdout: "snaps": [ 2023-01-02T18:17:07.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:07.040 INFO:teuthology.orchestra.run.smithi007.stdout: "begin": 2, 2023-01-02T18:17:07.040 INFO:teuthology.orchestra.run.smithi007.stdout: "length": 1 2023-01-02T18:17:07.040 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.040 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:07.040 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.040 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:07.041 INFO:teuthology.orchestra.run.smithi007.stdout: "new_removed_snaps": [], 2023-01-02T18:17:07.041 INFO:teuthology.orchestra.run.smithi007.stdout: "new_purged_snaps": [], 2023-01-02T18:17:07.041 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_node_flags": {}, 2023-01-02T18:17:07.041 INFO:teuthology.orchestra.run.smithi007.stdout: "device_class_flags": {}, 2023-01-02T18:17:07.041 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode": { 2023-01-02T18:17:07.042 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_enabled": false, 2023-01-02T18:17:07.042 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_bucket_count": 0, 2023-01-02T18:17:07.042 INFO:teuthology.orchestra.run.smithi007.stdout: "degraded_stretch_mode": 0, 2023-01-02T18:17:07.042 INFO:teuthology.orchestra.run.smithi007.stdout: "recovering_stretch_mode": 0, 2023-01-02T18:17:07.042 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_bucket": 0 2023-01-02T18:17:07.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:07.043 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:07.044 INFO:tasks.thrashosds.thrasher:j is {'epoch': 73, 'fsid': '4e320929-c4bb-4ea9-9e1c-d8479b7e40b1', 'created': '2023-01-02T18:15:29.542145+0000', 'modified': '2023-01-02T18:17:06.313775+0000', 'last_up_change': '2023-01-02T18:15:38.537792+0000', 'last_in_change': '2023-01-02T18:16:47.302822+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 9, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-02T18:15:38.598445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-01-02T18:15:40.853543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'test-librbd-smithi007-118686-1', 'create_time': '2023-01-02T18:16:36.229953+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 46, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'test-librbd-smithi007-118686-2', 'create_time': '2023-01-02T18:16:39.906131+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 5, 'pool_name': 'test-librbd-smithi007-118686-3', 'create_time': '2023-01-02T18:16:44.455124+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 56, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 6, 'pool_name': 'test-librbd-smithi007-118686-4', 'create_time': '2023-01-02T18:16:49.454047+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 60, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 7, 'pool_name': 'test-librbd-smithi007-118686-5', 'create_time': '2023-01-02T18:16:53.843144+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 64, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 8, 'pool_name': 'test-librbd-smithi007-118686-6', 'create_time': '2023-01-02T18:16:57.794651+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 9, 'pool_name': 'test-librbd-smithi007-118686-7', 'create_time': '2023-01-02T18:17:05.454247+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '73', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {}}], 'osds': [{'osd': 0, 'uuid': '69e18813-bd8e-4b22-9c40-d702ff3a5efd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6576995849609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6808', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6809', 'nonce': 107063}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6810', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6811', 'nonce': 107063}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6814', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6815', 'nonce': 107063}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6812', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6813', 'nonce': 107063}]}, 'public_addr': '172.21.15.7:6809/107063', 'cluster_addr': '172.21.15.7:6811/107063', 'heartbeat_back_addr': '172.21.15.7:6815/107063', 'heartbeat_front_addr': '172.21.15.7:6813/107063', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa04dec6-4607-4f2a-85a3-a6278832fef3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3902130126953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6824', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6825', 'nonce': 107066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6826', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6827', 'nonce': 107066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6830', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6831', 'nonce': 107066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6828', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6829', 'nonce': 107066}]}, 'public_addr': '172.21.15.7:6825/107066', 'cluster_addr': '172.21.15.7:6827/107066', 'heartbeat_back_addr': '172.21.15.7:6831/107066', 'heartbeat_front_addr': '172.21.15.7:6829/107066', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'c98a28fb-d910-4601-a229-d4318259ab9b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.14453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 61, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6816', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6817', 'nonce': 107065}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6818', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6819', 'nonce': 107065}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6822', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6823', 'nonce': 107065}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6820', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6821', 'nonce': 107065}]}, 'public_addr': '172.21.15.7:6817/107065', 'cluster_addr': '172.21.15.7:6819/107065', 'heartbeat_back_addr': '172.21.15.7:6823/107065', 'heartbeat_front_addr': '172.21.15.7:6821/107065', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3c5d48f4-5384-4563-8acb-11d866b85ef4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6800', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6801', 'nonce': 107064}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6802', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6803', 'nonce': 107064}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6806', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6807', 'nonce': 107064}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6804', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6805', 'nonce': 107064}]}, 'public_addr': '172.21.15.7:6801/107064', 'cluster_addr': '172.21.15.7:6803/107064', 'heartbeat_back_addr': '172.21.15.7:6807/107064', 'heartbeat_front_addr': '172.21.15.7:6805/107064', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '2476d495-4979-4679-a7e9-12652c270092', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 106900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 106900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 106900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 106900}]}, 'public_addr': '172.21.15.57:6801/106900', 'cluster_addr': '172.21.15.57:6803/106900', 'heartbeat_back_addr': '172.21.15.57:6807/106900', 'heartbeat_front_addr': '172.21.15.57:6805/106900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '38d57e5e-b6c1-445f-b181-23fb518698f9', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6816', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6817', 'nonce': 106930}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6818', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 106930}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6822', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6823', 'nonce': 106930}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6820', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6821', 'nonce': 106930}]}, 'public_addr': '172.21.15.57:6817/106930', 'cluster_addr': '172.21.15.57:6819/106930', 'heartbeat_back_addr': '172.21.15.57:6823/106930', 'heartbeat_front_addr': '172.21.15.57:6821/106930', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6c78f25a-2a65-47fe-b101-e47c00a5b2f6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6808', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6809', 'nonce': 106901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6810', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6811', 'nonce': 106901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6814', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6815', 'nonce': 106901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6812', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6813', 'nonce': 106901}]}, 'public_addr': '172.21.15.57:6809/106901', 'cluster_addr': '172.21.15.57:6811/106901', 'heartbeat_back_addr': '172.21.15.57:6815/106901', 'heartbeat_front_addr': '172.21.15.57:6813/106901', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'b094706d-7145-4865-ae95-e5cd7e40d23b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 65, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6824', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6825', 'nonce': 106931}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6826', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6827', 'nonce': 106931}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6830', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6831', 'nonce': 106931}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6828', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6829', 'nonce': 106931}]}, 'public_addr': '172.21.15.57:6825/106931', 'cluster_addr': '172.21.15.57:6827/106931', 'heartbeat_back_addr': '172.21.15.57:6831/106931', 'heartbeat_front_addr': '172.21.15.57:6829/106931', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.290083+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.303022+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.292245+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.210530+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.282212+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.237376+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.239974+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.276340+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [2, 3]}], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 8, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-01-02T18:17:07.044 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:17:07.045 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:06.771+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:07.046 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:07.046+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:07.147 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:07.147+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:07.185 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:07.185 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:07.186 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:07.186 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:07.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:07.248 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:07.248+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:07.321 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:17:07.322 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:17:07.322 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:07.332 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:07.337 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:07.369 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:07.377 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:07.378+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:07.385 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:07.390 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:17:07.395 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2023-01-02T18:17:07.333018+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1667,"num_objects":105,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":105,"num_whiteouts":0,"num_read":6397,"num_read_kb":5648,"num_write":476,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":492,"num_keys_recovered":102,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":585,"ondisk_log_size":585,"up":402,"acting":402,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":402,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":40916,"kb_used_data":5348,"kb_used_omap":0,"kb_used_meta":35520,"kb_avail":566190124,"statfs":{"total":579820584960,"available":579778686976,"internally_reserved":0,"allocated":5476352,"data_stored":2395548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36372480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":430,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2297,"num_read_kb":2044,"num_write":138,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.752089"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614129+0000","last_change":"2023-01-02T18:17:01.320137+0000","last_active":"2023-01-02T18:17:03.614129+0000","last_peered":"2023-01-02T18:17:03.614129+0000","last_clean":"2023-01-02T18:17:03.614129+0000","last_became_active":"2023-01-02T18:16:59.324809+0000","last_became_peered":"2023-01-02T18:16:59.324809+0000","last_unstale":"2023-01-02T18:17:03.614129+0000","last_undegraded":"2023-01-02T18:17:03.614129+0000","last_fullsized":"2023-01-02T18:17:03.614129+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.597582+0000","last_change":"2023-01-02T18:16:48.330409+0000","last_active":"2023-01-02T18:17:03.597582+0000","last_peered":"2023-01-02T18:17:03.597582+0000","last_clean":"2023-01-02T18:17:03.597582+0000","last_became_active":"2023-01-02T18:16:48.329903+0000","last_became_peered":"2023-01-02T18:16:48.329903+0000","last_unstale":"2023-01-02T18:17:03.597582+0000","last_undegraded":"2023-01-02T18:17:03.597582+0000","last_fullsized":"2023-01-02T18:17:03.597582+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.615151+0000","last_change":"2023-01-02T18:16:42.460802+0000","last_active":"2023-01-02T18:17:03.615151+0000","last_peered":"2023-01-02T18:17:03.615151+0000","last_clean":"2023-01-02T18:17:03.615151+0000","last_became_active":"2023-01-02T18:16:42.460433+0000","last_became_peered":"2023-01-02T18:16:42.460433+0000","last_unstale":"2023-01-02T18:17:03.615151+0000","last_undegraded":"2023-01-02T18:17:03.615151+0000","last_fullsized":"2023-01-02T18:17:03.615151+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603213+0000","last_change":"2023-01-02T18:16:49.304700+0000","last_active":"2023-01-02T18:17:03.603213+0000","last_peered":"2023-01-02T18:17:03.603213+0000","last_clean":"2023-01-02T18:17:03.603213+0000","last_became_active":"2023-01-02T18:16:46.314227+0000","last_became_peered":"2023-01-02T18:16:46.314227+0000","last_unstale":"2023-01-02T18:17:03.603213+0000","last_undegraded":"2023-01-02T18:17:03.603213+0000","last_fullsized":"2023-01-02T18:17:03.603213+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":112,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603201+0000","last_change":"2023-01-02T18:16:53.346444+0000","last_active":"2023-01-02T18:17:03.603201+0000","last_peered":"2023-01-02T18:17:03.603201+0000","last_clean":"2023-01-02T18:17:03.603201+0000","last_became_active":"2023-01-02T18:16:51.340482+0000","last_became_peered":"2023-01-02T18:16:51.340482+0000","last_unstale":"2023-01-02T18:17:03.603201+0000","last_undegraded":"2023-01-02T18:17:03.603201+0000","last_fullsized":"2023-01-02T18:17:03.603201+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":80,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":120,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.319510+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:17:04.319510+0000","last_peered":"2023-01-02T18:17:04.319510+0000","last_clean":"2023-01-02T18:17:04.319510+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:17:04.319510+0000","last_undegraded":"2023-01-02T18:17:04.319510+0000","last_fullsized":"2023-01-02T18:17:04.319510+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"71'15","reported_seq":146,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.418227+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:17:04.418227+0000","last_peered":"2023-01-02T18:17:04.418227+0000","last_clean":"2023-01-02T18:17:04.418227+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:17:04.418227+0000","last_undegraded":"2023-01-02T18:17:04.418227+0000","last_fullsized":"2023-01-02T18:17:04.418227+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":181,"num_read_kb":167,"num_write":9,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.19","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585866+0000","last_change":"2023-01-02T18:16:44.306676+0000","last_active":"2023-01-02T18:17:03.585866+0000","last_peered":"2023-01-02T18:17:03.585866+0000","last_clean":"2023-01-02T18:17:03.585866+0000","last_became_active":"2023-01-02T18:16:41.446794+0000","last_became_peered":"2023-01-02T18:16:41.446794+0000","last_unstale":"2023-01-02T18:17:03.585866+0000","last_undegraded":"2023-01-02T18:17:03.585866+0000","last_fullsized":"2023-01-02T18:17:03.585866+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"46'10","reported_seq":59,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586448+0000","last_change":"2023-01-02T18:16:39.438979+0000","last_active":"2023-01-02T18:17:03.586448+0000","last_peered":"2023-01-02T18:17:03.586448+0000","last_clean":"2023-01-02T18:17:03.586448+0000","last_became_active":"2023-01-02T18:16:37.427175+0000","last_became_peered":"2023-01-02T18:16:37.427175+0000","last_unstale":"2023-01-02T18:17:03.586448+0000","last_undegraded":"2023-01-02T18:17:03.586448+0000","last_fullsized":"2023-01-02T18:17:03.586448+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.597783+0000","last_change":"2023-01-02T18:16:49.318455+0000","last_active":"2023-01-02T18:17:03.597783+0000","last_peered":"2023-01-02T18:17:03.597783+0000","last_clean":"2023-01-02T18:17:03.597783+0000","last_became_active":"2023-01-02T18:16:48.329597+0000","last_became_peered":"2023-01-02T18:16:48.329597+0000","last_unstale":"2023-01-02T18:17:03.597783+0000","last_undegraded":"2023-01-02T18:17:03.597783+0000","last_fullsized":"2023-01-02T18:17:03.597783+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586999+0000","last_change":"2023-01-02T18:16:53.344973+0000","last_active":"2023-01-02T18:17:03.586999+0000","last_peered":"2023-01-02T18:17:03.586999+0000","last_clean":"2023-01-02T18:17:03.586999+0000","last_became_active":"2023-01-02T18:16:51.341196+0000","last_became_peered":"2023-01-02T18:16:51.341196+0000","last_unstale":"2023-01-02T18:17:03.586999+0000","last_undegraded":"2023-01-02T18:17:03.586999+0000","last_fullsized":"2023-01-02T18:17:03.586999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":102,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.310501+0000","last_change":"2023-01-02T18:16:57.306888+0000","last_active":"2023-01-02T18:17:04.310501+0000","last_peered":"2023-01-02T18:17:04.310501+0000","last_clean":"2023-01-02T18:17:04.310501+0000","last_became_active":"2023-01-02T18:16:55.307841+0000","last_became_peered":"2023-01-02T18:16:55.307841+0000","last_unstale":"2023-01-02T18:17:04.310501+0000","last_undegraded":"2023-01-02T18:17:04.310501+0000","last_fullsized":"2023-01-02T18:17:04.310501+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"70'3","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.315576+0000","last_change":"2023-01-02T18:17:01.311706+0000","last_active":"2023-01-02T18:17:04.315576+0000","last_peered":"2023-01-02T18:17:04.315576+0000","last_clean":"2023-01-02T18:17:04.315576+0000","last_became_active":"2023-01-02T18:16:59.313908+0000","last_became_peered":"2023-01-02T18:16:59.313908+0000","last_unstale":"2023-01-02T18:17:04.315576+0000","last_undegraded":"2023-01-02T18:17:04.315576+0000","last_fullsized":"2023-01-02T18:17:04.315576+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1a","version":"51'2","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.587481+0000","last_change":"2023-01-02T18:16:48.343757+0000","last_active":"2023-01-02T18:17:03.587481+0000","last_peered":"2023-01-02T18:17:03.587481+0000","last_clean":"2023-01-02T18:17:03.587481+0000","last_became_active":"2023-01-02T18:16:48.326121+0000","last_became_peered":"2023-01-02T18:16:48.326121+0000","last_unstale":"2023-01-02T18:17:03.587481+0000","last_undegraded":"2023-01-02T18:17:03.587481+0000","last_fullsized":"2023-01-02T18:17:03.587481+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"46'1","reported_seq":47,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598448+0000","last_change":"2023-01-02T18:16:48.354695+0000","last_active":"2023-01-02T18:17:03.598448+0000","last_peered":"2023-01-02T18:17:03.598448+0000","last_clean":"2023-01-02T18:17:03.598448+0000","last_became_active":"2023-01-02T18:16:48.329613+0000","last_became_peered":"2023-01-02T18:16:48.329613+0000","last_unstale":"2023-01-02T18:17:03.598448+0000","last_undegraded":"2023-01-02T18:17:03.598448+0000","last_fullsized":"2023-01-02T18:17:03.598448+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1b","version":"56'1","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614568+0000","last_change":"2023-01-02T18:16:49.324862+0000","last_active":"2023-01-02T18:17:03.614568+0000","last_peered":"2023-01-02T18:17:03.614568+0000","last_clean":"2023-01-02T18:17:03.614568+0000","last_became_active":"2023-01-02T18:16:46.315844+0000","last_became_peered":"2023-01-02T18:16:46.315844+0000","last_unstale":"2023-01-02T18:17:03.614568+0000","last_undegraded":"2023-01-02T18:17:03.614568+0000","last_fullsized":"2023-01-02T18:17:03.614568+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.613396+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:17:03.613396+0000","last_peered":"2023-01-02T18:17:03.613396+0000","last_clean":"2023-01-02T18:17:03.613396+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:17:03.613396+0000","last_undegraded":"2023-01-02T18:17:03.613396+0000","last_fullsized":"2023-01-02T18:17:03.613396+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.310829+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:17:04.310829+0000","last_peered":"2023-01-02T18:17:04.310829+0000","last_clean":"2023-01-02T18:17:04.310829+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:17:04.310829+0000","last_undegraded":"2023-01-02T18:17:04.310829+0000","last_fullsized":"2023-01-02T18:17:04.310829+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.604183+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:17:03.604183+0000","last_peered":"2023-01-02T18:17:03.604183+0000","last_clean":"2023-01-02T18:17:03.604183+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:17:03.604183+0000","last_undegraded":"2023-01-02T18:17:03.604183+0000","last_fullsized":"2023-01-02T18:17:03.604183+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1b","version":"51'1","reported_seq":28,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586792+0000","last_change":"2023-01-02T18:16:48.330072+0000","last_active":"2023-01-02T18:17:03.586792+0000","last_peered":"2023-01-02T18:17:03.586792+0000","last_clean":"2023-01-02T18:17:03.586792+0000","last_became_active":"2023-01-02T18:16:48.329697+0000","last_became_peered":"2023-01-02T18:16:48.329697+0000","last_unstale":"2023-01-02T18:17:03.586792+0000","last_undegraded":"2023-01-02T18:17:03.586792+0000","last_fullsized":"2023-01-02T18:17:03.586792+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"46'21","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598469+0000","last_change":"2023-01-02T18:16:48.340958+0000","last_active":"2023-01-02T18:17:03.598469+0000","last_peered":"2023-01-02T18:17:03.598469+0000","last_clean":"2023-01-02T18:17:03.598469+0000","last_became_active":"2023-01-02T18:16:48.325842+0000","last_became_peered":"2023-01-02T18:16:48.325842+0000","last_unstale":"2023-01-02T18:17:03.598469+0000","last_undegraded":"2023-01-02T18:17:03.598469+0000","last_fullsized":"2023-01-02T18:17:03.598469+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":39,"num_write":21,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":51,"num_keys_recovered":30,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1a","version":"56'2","reported_seq":47,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603522+0000","last_change":"2023-01-02T18:16:49.305216+0000","last_active":"2023-01-02T18:17:03.603522+0000","last_peered":"2023-01-02T18:17:03.603522+0000","last_clean":"2023-01-02T18:17:03.603522+0000","last_became_active":"2023-01-02T18:16:48.327069+0000","last_became_peered":"2023-01-02T18:16:48.327069+0000","last_unstale":"2023-01-02T18:17:03.603522+0000","last_undegraded":"2023-01-02T18:17:03.603522+0000","last_fullsized":"2023-01-02T18:17:03.603522+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.582042+0000","last_change":"2023-01-02T18:16:53.344282+0000","last_active":"2023-01-02T18:17:03.582042+0000","last_peered":"2023-01-02T18:17:03.582042+0000","last_clean":"2023-01-02T18:17:03.582042+0000","last_became_active":"2023-01-02T18:16:51.342864+0000","last_became_peered":"2023-01-02T18:16:51.342864+0000","last_unstale":"2023-01-02T18:17:03.582042+0000","last_undegraded":"2023-01-02T18:17:03.582042+0000","last_fullsized":"2023-01-02T18:17:03.582042+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":540,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.310148+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:17:04.310148+0000","last_peered":"2023-01-02T18:17:04.310148+0000","last_clean":"2023-01-02T18:17:04.310148+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:17:04.310148+0000","last_undegraded":"2023-01-02T18:17:04.310148+0000","last_fullsized":"2023-01-02T18:17:04.310148+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"71'16","reported_seq":141,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.364797+0000","last_change":"2023-01-02T18:17:01.321350+0000","last_active":"2023-01-02T18:17:04.364797+0000","last_peered":"2023-01-02T18:17:04.364797+0000","last_clean":"2023-01-02T18:17:04.364797+0000","last_became_active":"2023-01-02T18:16:59.310618+0000","last_became_peered":"2023-01-02T18:16:59.310618+0000","last_unstale":"2023-01-02T18:17:04.364797+0000","last_undegraded":"2023-01-02T18:17:04.364797+0000","last_fullsized":"2023-01-02T18:17:04.364797+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"7.1f","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.311704+0000","last_change":"2023-01-02T18:16:57.307585+0000","last_active":"2023-01-02T18:17:04.311704+0000","last_peered":"2023-01-02T18:17:04.311704+0000","last_clean":"2023-01-02T18:17:04.311704+0000","last_became_active":"2023-01-02T18:16:55.315726+0000","last_became_peered":"2023-01-02T18:16:55.315726+0000","last_unstale":"2023-01-02T18:17:04.311704+0000","last_undegraded":"2023-01-02T18:17:04.311704+0000","last_fullsized":"2023-01-02T18:17:04.311704+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":50,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.581398+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:17:03.581398+0000","last_peered":"2023-01-02T18:17:03.581398+0000","last_clean":"2023-01-02T18:17:03.581398+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:17:03.581398+0000","last_undegraded":"2023-01-02T18:17:03.581398+0000","last_fullsized":"2023-01-02T18:17:03.581398+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":55,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614394+0000","last_change":"2023-01-02T18:16:48.349016+0000","last_active":"2023-01-02T18:17:03.614394+0000","last_peered":"2023-01-02T18:17:03.614394+0000","last_clean":"2023-01-02T18:17:03.614394+0000","last_became_active":"2023-01-02T18:16:48.331845+0000","last_became_peered":"2023-01-02T18:16:48.331845+0000","last_unstale":"2023-01-02T18:17:03.614394+0000","last_undegraded":"2023-01-02T18:17:03.614394+0000","last_fullsized":"2023-01-02T18:17:03.614394+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614333+0000","last_change":"2023-01-02T18:16:49.324534+0000","last_active":"2023-01-02T18:17:03.614333+0000","last_peered":"2023-01-02T18:17:03.614333+0000","last_clean":"2023-01-02T18:17:03.614333+0000","last_became_active":"2023-01-02T18:16:48.327014+0000","last_became_peered":"2023-01-02T18:16:48.327014+0000","last_unstale":"2023-01-02T18:17:03.614333+0000","last_undegraded":"2023-01-02T18:17:03.614333+0000","last_fullsized":"2023-01-02T18:17:03.614333+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598066+0000","last_change":"2023-01-02T18:16:53.604464+0000","last_active":"2023-01-02T18:17:03.598066+0000","last_peered":"2023-01-02T18:17:03.598066+0000","last_clean":"2023-01-02T18:17:03.598066+0000","last_became_active":"2023-01-02T18:16:51.343193+0000","last_became_peered":"2023-01-02T18:16:51.343193+0000","last_unstale":"2023-01-02T18:17:03.598066+0000","last_undegraded":"2023-01-02T18:17:03.598066+0000","last_fullsized":"2023-01-02T18:17:03.598066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603847+0000","last_change":"2023-01-02T18:17:01.322905+0000","last_active":"2023-01-02T18:17:03.603847+0000","last_peered":"2023-01-02T18:17:03.603847+0000","last_clean":"2023-01-02T18:17:03.603847+0000","last_became_active":"2023-01-02T18:16:59.312747+0000","last_became_peered":"2023-01-02T18:16:59.312747+0000","last_unstale":"2023-01-02T18:17:03.603847+0000","last_undegraded":"2023-01-02T18:17:03.603847+0000","last_fullsized":"2023-01-02T18:17:03.603847+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.0","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586085+0000","last_change":"2023-01-02T18:16:49.309259+0000","last_active":"2023-01-02T18:17:03.586085+0000","last_peered":"2023-01-02T18:17:03.586085+0000","last_clean":"2023-01-02T18:17:03.586085+0000","last_became_active":"2023-01-02T18:16:46.313760+0000","last_became_peered":"2023-01-02T18:16:46.313760+0000","last_unstale":"2023-01-02T18:17:03.586085+0000","last_undegraded":"2023-01-02T18:17:03.586085+0000","last_fullsized":"2023-01-02T18:17:03.586085+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":47,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.597862+0000","last_change":"2023-01-02T18:16:48.358986+0000","last_active":"2023-01-02T18:17:03.597862+0000","last_peered":"2023-01-02T18:17:03.597862+0000","last_clean":"2023-01-02T18:17:03.597862+0000","last_became_active":"2023-01-02T18:16:48.336041+0000","last_became_peered":"2023-01-02T18:16:48.336041+0000","last_unstale":"2023-01-02T18:17:03.597862+0000","last_undegraded":"2023-01-02T18:17:03.597862+0000","last_fullsized":"2023-01-02T18:17:03.597862+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":40,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614701+0000","last_change":"2023-01-02T18:16:39.420853+0000","last_active":"2023-01-02T18:17:03.614701+0000","last_peered":"2023-01-02T18:17:03.614701+0000","last_clean":"2023-01-02T18:17:03.614701+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:17:03.614701+0000","last_undegraded":"2023-01-02T18:17:03.614701+0000","last_fullsized":"2023-01-02T18:17:03.614701+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598154+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:17:03.598154+0000","last_peered":"2023-01-02T18:17:03.598154+0000","last_clean":"2023-01-02T18:17:03.598154+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:17:03.598154+0000","last_undegraded":"2023-01-02T18:17:03.598154+0000","last_fullsized":"2023-01-02T18:17:03.598154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603218+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:17:03.603218+0000","last_peered":"2023-01-02T18:17:03.603218+0000","last_clean":"2023-01-02T18:17:03.603218+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:17:03.603218+0000","last_undegraded":"2023-01-02T18:17:03.603218+0000","last_fullsized":"2023-01-02T18:17:03.603218+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.314785+0000","last_change":"2023-01-02T18:16:57.312949+0000","last_active":"2023-01-02T18:17:04.314785+0000","last_peered":"2023-01-02T18:17:04.314785+0000","last_clean":"2023-01-02T18:17:04.314785+0000","last_became_active":"2023-01-02T18:16:55.315334+0000","last_became_peered":"2023-01-02T18:16:55.315334+0000","last_unstale":"2023-01-02T18:17:04.314785+0000","last_undegraded":"2023-01-02T18:17:04.314785+0000","last_fullsized":"2023-01-02T18:17:04.314785+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614125+0000","last_change":"2023-01-02T18:17:01.319510+0000","last_active":"2023-01-02T18:17:03.614125+0000","last_peered":"2023-01-02T18:17:03.614125+0000","last_clean":"2023-01-02T18:17:03.614125+0000","last_became_active":"2023-01-02T18:16:59.327716+0000","last_became_peered":"2023-01-02T18:16:59.327716+0000","last_unstale":"2023-01-02T18:17:03.614125+0000","last_undegraded":"2023-01-02T18:17:03.614125+0000","last_fullsized":"2023-01-02T18:17:03.614125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.1","version":"0'0","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586046+0000","last_change":"2023-01-02T18:16:49.310704+0000","last_active":"2023-01-02T18:17:03.586046+0000","last_peered":"2023-01-02T18:17:03.586046+0000","last_clean":"2023-01-02T18:17:03.586046+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:03.586046+0000","last_undegraded":"2023-01-02T18:17:03.586046+0000","last_fullsized":"2023-01-02T18:17:03.586046+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585662+0000","last_change":"2023-01-02T18:16:44.307480+0000","last_active":"2023-01-02T18:17:03.585662+0000","last_peered":"2023-01-02T18:17:03.585662+0000","last_clean":"2023-01-02T18:17:03.585662+0000","last_became_active":"2023-01-02T18:16:41.447912+0000","last_became_peered":"2023-01-02T18:16:41.447912+0000","last_unstale":"2023-01-02T18:17:03.585662+0000","last_undegraded":"2023-01-02T18:17:03.585662+0000","last_fullsized":"2023-01-02T18:17:03.585662+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.583598+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:17:03.583598+0000","last_peered":"2023-01-02T18:17:03.583598+0000","last_clean":"2023-01-02T18:17:03.583598+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:17:03.583598+0000","last_undegraded":"2023-01-02T18:17:03.583598+0000","last_fullsized":"2023-01-02T18:17:03.583598+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"46'3","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586730+0000","last_change":"2023-01-02T18:16:39.438228+0000","last_active":"2023-01-02T18:17:03.586730+0000","last_peered":"2023-01-02T18:17:03.586730+0000","last_clean":"2023-01-02T18:17:03.586730+0000","last_became_active":"2023-01-02T18:16:37.431863+0000","last_became_peered":"2023-01-02T18:16:37.431863+0000","last_unstale":"2023-01-02T18:17:03.586730+0000","last_undegraded":"2023-01-02T18:17:03.586730+0000","last_fullsized":"2023-01-02T18:17:03.586730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586828+0000","last_change":"2023-01-02T18:16:53.344851+0000","last_active":"2023-01-02T18:17:03.586828+0000","last_peered":"2023-01-02T18:17:03.586828+0000","last_clean":"2023-01-02T18:17:03.586828+0000","last_became_active":"2023-01-02T18:16:51.341804+0000","last_became_peered":"2023-01-02T18:16:51.341804+0000","last_unstale":"2023-01-02T18:17:03.586828+0000","last_undegraded":"2023-01-02T18:17:03.586828+0000","last_fullsized":"2023-01-02T18:17:03.586828+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.315464+0000","last_change":"2023-01-02T18:16:57.313134+0000","last_active":"2023-01-02T18:17:04.315464+0000","last_peered":"2023-01-02T18:17:04.315464+0000","last_clean":"2023-01-02T18:17:04.315464+0000","last_became_active":"2023-01-02T18:16:55.311645+0000","last_became_peered":"2023-01-02T18:16:55.311645+0000","last_unstale":"2023-01-02T18:17:04.315464+0000","last_undegraded":"2023-01-02T18:17:04.315464+0000","last_fullsized":"2023-01-02T18:17:04.315464+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.316125+0000","last_change":"2023-01-02T18:17:01.310492+0000","last_active":"2023-01-02T18:17:04.316125+0000","last_peered":"2023-01-02T18:17:04.316125+0000","last_clean":"2023-01-02T18:17:04.316125+0000","last_became_active":"2023-01-02T18:16:59.313793+0000","last_became_peered":"2023-01-02T18:16:59.313793+0000","last_unstale":"2023-01-02T18:17:04.316125+0000","last_undegraded":"2023-01-02T18:17:04.316125+0000","last_fullsized":"2023-01-02T18:17:04.316125+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.2","version":"56'1","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598524+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:17:03.598524+0000","last_peered":"2023-01-02T18:17:03.598524+0000","last_clean":"2023-01-02T18:17:03.598524+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:17:03.598524+0000","last_undegraded":"2023-01-02T18:17:03.598524+0000","last_fullsized":"2023-01-02T18:17:03.598524+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":103,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603681+0000","last_change":"2023-01-02T18:16:44.300067+0000","last_active":"2023-01-02T18:17:03.603681+0000","last_peered":"2023-01-02T18:17:03.603681+0000","last_clean":"2023-01-02T18:17:03.603681+0000","last_became_active":"2023-01-02T18:16:42.450970+0000","last_became_peered":"2023-01-02T18:16:42.450970+0000","last_unstale":"2023-01-02T18:17:03.603681+0000","last_undegraded":"2023-01-02T18:17:03.603681+0000","last_fullsized":"2023-01-02T18:17:03.603681+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":83,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"46'2","reported_seq":46,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.582802+0000","last_change":"2023-01-02T18:16:39.426089+0000","last_active":"2023-01-02T18:17:03.582802+0000","last_peered":"2023-01-02T18:17:03.582802+0000","last_clean":"2023-01-02T18:17:03.582802+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:17:03.582802+0000","last_undegraded":"2023-01-02T18:17:03.582802+0000","last_fullsized":"2023-01-02T18:17:03.582802+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603734+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:17:03.603734+0000","last_peered":"2023-01-02T18:17:03.603734+0000","last_clean":"2023-01-02T18:17:03.603734+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:17:03.603734+0000","last_undegraded":"2023-01-02T18:17:03.603734+0000","last_fullsized":"2023-01-02T18:17:03.603734+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598166+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:17:03.598166+0000","last_peered":"2023-01-02T18:17:03.598166+0000","last_clean":"2023-01-02T18:17:03.598166+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:17:03.598166+0000","last_undegraded":"2023-01-02T18:17:03.598166+0000","last_fullsized":"2023-01-02T18:17:03.598166+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.314391+0000","last_change":"2023-01-02T18:16:57.312360+0000","last_active":"2023-01-02T18:17:04.314391+0000","last_peered":"2023-01-02T18:17:04.314391+0000","last_clean":"2023-01-02T18:17:04.314391+0000","last_became_active":"2023-01-02T18:16:55.317478+0000","last_became_peered":"2023-01-02T18:16:55.317478+0000","last_unstale":"2023-01-02T18:17:04.314391+0000","last_undegraded":"2023-01-02T18:17:04.314391+0000","last_fullsized":"2023-01-02T18:17:04.314391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"71'3","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.303683+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:17:04.303683+0000","last_peered":"2023-01-02T18:17:04.303683+0000","last_clean":"2023-01-02T18:17:04.303683+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:17:04.303683+0000","last_undegraded":"2023-01-02T18:17:04.303683+0000","last_fullsized":"2023-01-02T18:17:04.303683+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.6","version":"51'2","reported_seq":38,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614630+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:17:03.614630+0000","last_peered":"2023-01-02T18:17:03.614630+0000","last_clean":"2023-01-02T18:17:03.614630+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:17:03.614630+0000","last_undegraded":"2023-01-02T18:17:03.614630+0000","last_fullsized":"2023-01-02T18:17:03.614630+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"46'13","reported_seq":110,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.613761+0000","last_change":"2023-01-02T18:16:48.342853+0000","last_active":"2023-01-02T18:17:03.613761+0000","last_peered":"2023-01-02T18:17:03.613761+0000","last_clean":"2023-01-02T18:17:03.613761+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:03.613761+0000","last_undegraded":"2023-01-02T18:17:03.613761+0000","last_fullsized":"2023-01-02T18:17:03.613761+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":92,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585671+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:17:03.585671+0000","last_peered":"2023-01-02T18:17:03.585671+0000","last_clean":"2023-01-02T18:17:03.585671+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:17:03.585671+0000","last_undegraded":"2023-01-02T18:17:03.585671+0000","last_fullsized":"2023-01-02T18:17:03.585671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.583906+0000","last_change":"2023-01-02T18:16:49.298888+0000","last_active":"2023-01-02T18:17:03.583906+0000","last_peered":"2023-01-02T18:17:03.583906+0000","last_clean":"2023-01-02T18:17:03.583906+0000","last_became_active":"2023-01-02T18:16:46.314689+0000","last_became_peered":"2023-01-02T18:16:46.314689+0000","last_unstale":"2023-01-02T18:17:03.583906+0000","last_undegraded":"2023-01-02T18:17:03.583906+0000","last_fullsized":"2023-01-02T18:17:03.583906+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.582526+0000","last_change":"2023-01-02T18:16:53.344265+0000","last_active":"2023-01-02T18:17:03.582526+0000","last_peered":"2023-01-02T18:17:03.582526+0000","last_clean":"2023-01-02T18:17:03.582526+0000","last_became_active":"2023-01-02T18:16:51.342951+0000","last_became_peered":"2023-01-02T18:16:51.342951+0000","last_unstale":"2023-01-02T18:17:03.582526+0000","last_undegraded":"2023-01-02T18:17:03.582526+0000","last_fullsized":"2023-01-02T18:17:03.582526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.307384+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:17:04.307384+0000","last_peered":"2023-01-02T18:17:04.307384+0000","last_clean":"2023-01-02T18:17:04.307384+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:17:04.307384+0000","last_undegraded":"2023-01-02T18:17:04.307384+0000","last_fullsized":"2023-01-02T18:17:04.307384+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.597992+0000","last_change":"2023-01-02T18:17:01.316849+0000","last_active":"2023-01-02T18:17:03.597992+0000","last_peered":"2023-01-02T18:17:03.597992+0000","last_clean":"2023-01-02T18:17:03.597992+0000","last_became_active":"2023-01-02T18:16:59.320366+0000","last_became_peered":"2023-01-02T18:16:59.320366+0000","last_unstale":"2023-01-02T18:17:03.597992+0000","last_undegraded":"2023-01-02T18:17:03.597992+0000","last_fullsized":"2023-01-02T18:17:03.597992+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.4","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603766+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:17:03.603766+0000","last_peered":"2023-01-02T18:17:03.603766+0000","last_clean":"2023-01-02T18:17:03.603766+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:17:03.603766+0000","last_undegraded":"2023-01-02T18:17:03.603766+0000","last_fullsized":"2023-01-02T18:17:03.603766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":49,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598355+0000","last_change":"2023-01-02T18:16:48.345373+0000","last_active":"2023-01-02T18:17:03.598355+0000","last_peered":"2023-01-02T18:17:03.598355+0000","last_clean":"2023-01-02T18:17:03.598355+0000","last_became_active":"2023-01-02T18:16:48.328041+0000","last_became_peered":"2023-01-02T18:16:48.328041+0000","last_unstale":"2023-01-02T18:17:03.598355+0000","last_undegraded":"2023-01-02T18:17:03.598355+0000","last_fullsized":"2023-01-02T18:17:03.598355+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"46'5","reported_seq":73,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586628+0000","last_change":"2023-01-02T18:16:42.455990+0000","last_active":"2023-01-02T18:17:03.586628+0000","last_peered":"2023-01-02T18:17:03.586628+0000","last_clean":"2023-01-02T18:17:03.586628+0000","last_became_active":"2023-01-02T18:16:42.441589+0000","last_became_peered":"2023-01-02T18:16:42.441589+0000","last_unstale":"2023-01-02T18:17:03.586628+0000","last_undegraded":"2023-01-02T18:17:03.586628+0000","last_fullsized":"2023-01-02T18:17:03.586628+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603141+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:17:03.603141+0000","last_peered":"2023-01-02T18:17:03.603141+0000","last_clean":"2023-01-02T18:17:03.603141+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:17:03.603141+0000","last_undegraded":"2023-01-02T18:17:03.603141+0000","last_fullsized":"2023-01-02T18:17:03.603141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603590+0000","last_change":"2023-01-02T18:16:42.460481+0000","last_active":"2023-01-02T18:17:03.603590+0000","last_peered":"2023-01-02T18:17:03.603590+0000","last_clean":"2023-01-02T18:17:03.603590+0000","last_became_active":"2023-01-02T18:16:42.460130+0000","last_became_peered":"2023-01-02T18:16:42.460130+0000","last_unstale":"2023-01-02T18:17:03.603590+0000","last_undegraded":"2023-01-02T18:17:03.603590+0000","last_fullsized":"2023-01-02T18:17:03.603590+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":542,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586939+0000","last_change":"2023-01-02T18:16:53.345442+0000","last_active":"2023-01-02T18:17:03.586939+0000","last_peered":"2023-01-02T18:17:03.586939+0000","last_clean":"2023-01-02T18:17:03.586939+0000","last_became_active":"2023-01-02T18:16:51.341121+0000","last_became_peered":"2023-01-02T18:16:51.341121+0000","last_unstale":"2023-01-02T18:17:03.586939+0000","last_undegraded":"2023-01-02T18:17:03.586939+0000","last_fullsized":"2023-01-02T18:17:03.586939+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.320842+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:17:04.320842+0000","last_peered":"2023-01-02T18:17:04.320842+0000","last_clean":"2023-01-02T18:17:04.320842+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:17:04.320842+0000","last_undegraded":"2023-01-02T18:17:04.320842+0000","last_fullsized":"2023-01-02T18:17:04.320842+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586697+0000","last_change":"2023-01-02T18:17:01.311985+0000","last_active":"2023-01-02T18:17:03.586697+0000","last_peered":"2023-01-02T18:17:03.586697+0000","last_clean":"2023-01-02T18:17:03.586697+0000","last_became_active":"2023-01-02T18:16:59.316880+0000","last_became_peered":"2023-01-02T18:16:59.316880+0000","last_unstale":"2023-01-02T18:17:03.586697+0000","last_undegraded":"2023-01-02T18:17:03.586697+0000","last_fullsized":"2023-01-02T18:17:03.586697+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.583830+0000","last_change":"2023-01-02T18:16:44.298099+0000","last_active":"2023-01-02T18:17:03.583830+0000","last_peered":"2023-01-02T18:17:03.583830+0000","last_clean":"2023-01-02T18:17:03.583830+0000","last_became_active":"2023-01-02T18:16:42.439207+0000","last_became_peered":"2023-01-02T18:16:42.439207+0000","last_unstale":"2023-01-02T18:17:03.583830+0000","last_undegraded":"2023-01-02T18:17:03.583830+0000","last_fullsized":"2023-01-02T18:17:03.583830+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"46'7","reported_seq":80,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.581590+0000","last_change":"2023-01-02T18:16:39.426307+0000","last_active":"2023-01-02T18:17:03.581590+0000","last_peered":"2023-01-02T18:17:03.581590+0000","last_clean":"2023-01-02T18:17:03.581590+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:17:03.581590+0000","last_undegraded":"2023-01-02T18:17:03.581590+0000","last_fullsized":"2023-01-02T18:17:03.581590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":82,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":60,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585769+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:17:03.585769+0000","last_peered":"2023-01-02T18:17:03.585769+0000","last_clean":"2023-01-02T18:17:03.585769+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:17:03.585769+0000","last_undegraded":"2023-01-02T18:17:03.585769+0000","last_fullsized":"2023-01-02T18:17:03.585769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.580953+0000","last_change":"2023-01-02T18:16:49.298954+0000","last_active":"2023-01-02T18:17:03.580953+0000","last_peered":"2023-01-02T18:17:03.580953+0000","last_clean":"2023-01-02T18:17:03.580953+0000","last_became_active":"2023-01-02T18:16:46.316378+0000","last_became_peered":"2023-01-02T18:16:46.316378+0000","last_unstale":"2023-01-02T18:17:03.580953+0000","last_undegraded":"2023-01-02T18:17:03.580953+0000","last_fullsized":"2023-01-02T18:17:03.580953+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603633+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:17:03.603633+0000","last_peered":"2023-01-02T18:17:03.603633+0000","last_clean":"2023-01-02T18:17:03.603633+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:17:03.603633+0000","last_undegraded":"2023-01-02T18:17:03.603633+0000","last_fullsized":"2023-01-02T18:17:03.603633+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.319813+0000","last_change":"2023-01-02T18:16:57.306312+0000","last_active":"2023-01-02T18:17:04.319813+0000","last_peered":"2023-01-02T18:17:04.319813+0000","last_clean":"2023-01-02T18:17:04.319813+0000","last_became_active":"2023-01-02T18:16:55.314537+0000","last_became_peered":"2023-01-02T18:16:55.314537+0000","last_unstale":"2023-01-02T18:17:04.319813+0000","last_undegraded":"2023-01-02T18:17:04.319813+0000","last_fullsized":"2023-01-02T18:17:04.319813+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585332+0000","last_change":"2023-01-02T18:17:01.311731+0000","last_active":"2023-01-02T18:17:03.585332+0000","last_peered":"2023-01-02T18:17:03.585332+0000","last_clean":"2023-01-02T18:17:03.585332+0000","last_became_active":"2023-01-02T18:16:59.312608+0000","last_became_peered":"2023-01-02T18:16:59.312608+0000","last_unstale":"2023-01-02T18:17:03.585332+0000","last_undegraded":"2023-01-02T18:17:03.585332+0000","last_fullsized":"2023-01-02T18:17:03.585332+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.4","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.582708+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:17:03.582708+0000","last_peered":"2023-01-02T18:17:03.582708+0000","last_clean":"2023-01-02T18:17:03.582708+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:17:03.582708+0000","last_undegraded":"2023-01-02T18:17:03.582708+0000","last_fullsized":"2023-01-02T18:17:03.582708+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"46'1","reported_seq":29,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598392+0000","last_change":"2023-01-02T18:16:48.356953+0000","last_active":"2023-01-02T18:17:03.598392+0000","last_peered":"2023-01-02T18:17:03.598392+0000","last_clean":"2023-01-02T18:17:03.598392+0000","last_became_active":"2023-01-02T18:16:48.335418+0000","last_became_peered":"2023-01-02T18:16:48.335418+0000","last_unstale":"2023-01-02T18:17:03.598392+0000","last_undegraded":"2023-01-02T18:17:03.598392+0000","last_fullsized":"2023-01-02T18:17:03.598392+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.580989+0000","last_change":"2023-01-02T18:16:42.442424+0000","last_active":"2023-01-02T18:17:03.580989+0000","last_peered":"2023-01-02T18:17:03.580989+0000","last_clean":"2023-01-02T18:17:03.580989+0000","last_became_active":"2023-01-02T18:16:42.442110+0000","last_became_peered":"2023-01-02T18:16:42.442110+0000","last_unstale":"2023-01-02T18:17:03.580989+0000","last_undegraded":"2023-01-02T18:17:03.580989+0000","last_fullsized":"2023-01-02T18:17:03.580989+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614544+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:17:03.614544+0000","last_peered":"2023-01-02T18:17:03.614544+0000","last_clean":"2023-01-02T18:17:03.614544+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:17:03.614544+0000","last_undegraded":"2023-01-02T18:17:03.614544+0000","last_fullsized":"2023-01-02T18:17:03.614544+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586627+0000","last_change":"2023-01-02T18:16:53.345663+0000","last_active":"2023-01-02T18:17:03.586627+0000","last_peered":"2023-01-02T18:17:03.586627+0000","last_clean":"2023-01-02T18:17:03.586627+0000","last_became_active":"2023-01-02T18:16:51.341075+0000","last_became_peered":"2023-01-02T18:16:51.341075+0000","last_unstale":"2023-01-02T18:17:03.586627+0000","last_undegraded":"2023-01-02T18:17:03.586627+0000","last_fullsized":"2023-01-02T18:17:03.586627+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.312010+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:17:04.312010+0000","last_peered":"2023-01-02T18:17:04.312010+0000","last_clean":"2023-01-02T18:17:04.312010+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:17:04.312010+0000","last_undegraded":"2023-01-02T18:17:04.312010+0000","last_fullsized":"2023-01-02T18:17:04.312010+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614273+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:17:03.614273+0000","last_peered":"2023-01-02T18:17:03.614273+0000","last_clean":"2023-01-02T18:17:03.614273+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:17:03.614273+0000","last_undegraded":"2023-01-02T18:17:03.614273+0000","last_fullsized":"2023-01-02T18:17:03.614273+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"5.3","version":"56'4","reported_seq":40,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598053+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:17:03.598053+0000","last_peered":"2023-01-02T18:17:03.598053+0000","last_clean":"2023-01-02T18:17:03.598053+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:03.598053+0000","last_undegraded":"2023-01-02T18:17:03.598053+0000","last_fullsized":"2023-01-02T18:17:03.598053+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":45,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.581313+0000","last_change":"2023-01-02T18:16:48.336174+0000","last_active":"2023-01-02T18:17:03.581313+0000","last_peered":"2023-01-02T18:17:03.581313+0000","last_clean":"2023-01-02T18:17:03.581313+0000","last_became_active":"2023-01-02T18:16:48.335738+0000","last_became_peered":"2023-01-02T18:16:48.335738+0000","last_unstale":"2023-01-02T18:17:03.581313+0000","last_undegraded":"2023-01-02T18:17:03.581313+0000","last_fullsized":"2023-01-02T18:17:03.581313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"46'1","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586120+0000","last_change":"2023-01-02T18:16:42.463393+0000","last_active":"2023-01-02T18:17:03.586120+0000","last_peered":"2023-01-02T18:17:03.586120+0000","last_clean":"2023-01-02T18:17:03.586120+0000","last_became_active":"2023-01-02T18:16:42.461031+0000","last_became_peered":"2023-01-02T18:16:42.461031+0000","last_unstale":"2023-01-02T18:17:03.586120+0000","last_undegraded":"2023-01-02T18:17:03.586120+0000","last_fullsized":"2023-01-02T18:17:03.586120+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.582757+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:17:03.582757+0000","last_peered":"2023-01-02T18:17:03.582757+0000","last_clean":"2023-01-02T18:17:03.582757+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:17:03.582757+0000","last_undegraded":"2023-01-02T18:17:03.582757+0000","last_fullsized":"2023-01-02T18:17:03.582757+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.613503+0000","last_change":"2023-01-02T18:16:53.685845+0000","last_active":"2023-01-02T18:17:03.613503+0000","last_peered":"2023-01-02T18:17:03.613503+0000","last_clean":"2023-01-02T18:17:03.613503+0000","last_became_active":"2023-01-02T18:16:51.345111+0000","last_became_peered":"2023-01-02T18:16:51.345111+0000","last_unstale":"2023-01-02T18:17:03.613503+0000","last_undegraded":"2023-01-02T18:17:03.613503+0000","last_fullsized":"2023-01-02T18:17:03.613503+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":26,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.314445+0000","last_change":"2023-01-02T18:16:57.312915+0000","last_active":"2023-01-02T18:17:04.314445+0000","last_peered":"2023-01-02T18:17:04.314445+0000","last_clean":"2023-01-02T18:17:04.314445+0000","last_became_active":"2023-01-02T18:16:55.310046+0000","last_became_peered":"2023-01-02T18:16:55.310046+0000","last_unstale":"2023-01-02T18:17:04.314445+0000","last_undegraded":"2023-01-02T18:17:04.314445+0000","last_fullsized":"2023-01-02T18:17:04.314445+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"69'1","reported_seq":28,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.374357+0000","last_change":"2023-01-02T18:17:01.317345+0000","last_active":"2023-01-02T18:17:04.374357+0000","last_peered":"2023-01-02T18:17:04.374357+0000","last_clean":"2023-01-02T18:17:04.374357+0000","last_became_active":"2023-01-02T18:16:59.309565+0000","last_became_peered":"2023-01-02T18:16:59.309565+0000","last_unstale":"2023-01-02T18:17:04.374357+0000","last_undegraded":"2023-01-02T18:17:04.374357+0000","last_fullsized":"2023-01-02T18:17:04.374357+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":20,"num_read_kb":10,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.f","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.583793+0000","last_change":"2023-01-02T18:16:44.298243+0000","last_active":"2023-01-02T18:17:03.583793+0000","last_peered":"2023-01-02T18:17:03.583793+0000","last_clean":"2023-01-02T18:17:03.583793+0000","last_became_active":"2023-01-02T18:16:41.448643+0000","last_became_peered":"2023-01-02T18:16:41.448643+0000","last_unstale":"2023-01-02T18:17:03.583793+0000","last_undegraded":"2023-01-02T18:17:03.583793+0000","last_fullsized":"2023-01-02T18:17:03.583793+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"46'7","reported_seq":50,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585591+0000","last_change":"2023-01-02T18:16:39.438368+0000","last_active":"2023-01-02T18:17:03.585591+0000","last_peered":"2023-01-02T18:17:03.585591+0000","last_clean":"2023-01-02T18:17:03.585591+0000","last_became_active":"2023-01-02T18:16:37.414106+0000","last_became_peered":"2023-01-02T18:16:37.414106+0000","last_unstale":"2023-01-02T18:17:03.585591+0000","last_undegraded":"2023-01-02T18:17:03.585591+0000","last_fullsized":"2023-01-02T18:17:03.585591+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":9,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614896+0000","last_change":"2023-01-02T18:16:49.324748+0000","last_active":"2023-01-02T18:17:03.614896+0000","last_peered":"2023-01-02T18:17:03.614896+0000","last_clean":"2023-01-02T18:17:03.614896+0000","last_became_active":"2023-01-02T18:16:48.317958+0000","last_became_peered":"2023-01-02T18:16:48.317958+0000","last_unstale":"2023-01-02T18:17:03.614896+0000","last_undegraded":"2023-01-02T18:17:03.614896+0000","last_fullsized":"2023-01-02T18:17:03.614896+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614250+0000","last_change":"2023-01-02T18:16:53.686661+0000","last_active":"2023-01-02T18:17:03.614250+0000","last_peered":"2023-01-02T18:17:03.614250+0000","last_clean":"2023-01-02T18:17:03.614250+0000","last_became_active":"2023-01-02T18:16:51.345330+0000","last_became_peered":"2023-01-02T18:16:51.345330+0000","last_unstale":"2023-01-02T18:17:03.614250+0000","last_undegraded":"2023-01-02T18:17:03.614250+0000","last_fullsized":"2023-01-02T18:17:03.614250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.311391+0000","last_change":"2023-01-02T18:16:57.307540+0000","last_active":"2023-01-02T18:17:04.311391+0000","last_peered":"2023-01-02T18:17:04.311391+0000","last_clean":"2023-01-02T18:17:04.311391+0000","last_became_active":"2023-01-02T18:16:55.319082+0000","last_became_peered":"2023-01-02T18:16:55.319082+0000","last_unstale":"2023-01-02T18:17:04.311391+0000","last_undegraded":"2023-01-02T18:17:04.311391+0000","last_fullsized":"2023-01-02T18:17:04.311391+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.613844+0000","last_change":"2023-01-02T18:17:01.318897+0000","last_active":"2023-01-02T18:17:03.613844+0000","last_peered":"2023-01-02T18:17:03.613844+0000","last_clean":"2023-01-02T18:17:03.613844+0000","last_became_active":"2023-01-02T18:16:59.321009+0000","last_became_peered":"2023-01-02T18:16:59.321009+0000","last_unstale":"2023-01-02T18:17:03.613844+0000","last_undegraded":"2023-01-02T18:17:03.613844+0000","last_fullsized":"2023-01-02T18:17:03.613844+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.e","version":"51'1","reported_seq":46,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598313+0000","last_change":"2023-01-02T18:16:48.352507+0000","last_active":"2023-01-02T18:17:03.598313+0000","last_peered":"2023-01-02T18:17:03.598313+0000","last_clean":"2023-01-02T18:17:03.598313+0000","last_became_active":"2023-01-02T18:16:48.330483+0000","last_became_peered":"2023-01-02T18:16:48.330483+0000","last_unstale":"2023-01-02T18:17:03.598313+0000","last_undegraded":"2023-01-02T18:17:03.598313+0000","last_fullsized":"2023-01-02T18:17:03.598313+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.604147+0000","last_change":"2023-01-02T18:16:48.323820+0000","last_active":"2023-01-02T18:17:03.604147+0000","last_peered":"2023-01-02T18:17:03.604147+0000","last_clean":"2023-01-02T18:17:03.604147+0000","last_became_active":"2023-01-02T18:16:48.322710+0000","last_became_peered":"2023-01-02T18:16:48.322710+0000","last_unstale":"2023-01-02T18:17:03.604147+0000","last_undegraded":"2023-01-02T18:17:03.604147+0000","last_fullsized":"2023-01-02T18:17:03.604147+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":32,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598342+0000","last_change":"2023-01-02T18:16:49.319064+0000","last_active":"2023-01-02T18:17:03.598342+0000","last_peered":"2023-01-02T18:17:03.598342+0000","last_clean":"2023-01-02T18:17:03.598342+0000","last_became_active":"2023-01-02T18:16:48.324476+0000","last_became_peered":"2023-01-02T18:16:48.324476+0000","last_unstale":"2023-01-02T18:17:03.598342+0000","last_undegraded":"2023-01-02T18:17:03.598342+0000","last_fullsized":"2023-01-02T18:17:03.598342+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.587375+0000","last_change":"2023-01-02T18:16:53.345390+0000","last_active":"2023-01-02T18:17:03.587375+0000","last_peered":"2023-01-02T18:17:03.587375+0000","last_clean":"2023-01-02T18:17:03.587375+0000","last_became_active":"2023-01-02T18:16:51.339020+0000","last_became_peered":"2023-01-02T18:16:51.339020+0000","last_unstale":"2023-01-02T18:17:03.587375+0000","last_undegraded":"2023-01-02T18:17:03.587375+0000","last_fullsized":"2023-01-02T18:17:03.587375+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.311740+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:17:04.311740+0000","last_peered":"2023-01-02T18:17:04.311740+0000","last_clean":"2023-01-02T18:17:04.311740+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:17:04.311740+0000","last_undegraded":"2023-01-02T18:17:04.311740+0000","last_fullsized":"2023-01-02T18:17:04.311740+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.581861+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:17:03.581861+0000","last_peered":"2023-01-02T18:17:03.581861+0000","last_clean":"2023-01-02T18:17:03.581861+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:17:03.581861+0000","last_undegraded":"2023-01-02T18:17:03.581861+0000","last_fullsized":"2023-01-02T18:17:03.581861+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.583325+0000","last_change":"2023-01-02T18:16:48.329052+0000","last_active":"2023-01-02T18:17:03.583325+0000","last_peered":"2023-01-02T18:17:03.583325+0000","last_clean":"2023-01-02T18:17:03.583325+0000","last_became_active":"2023-01-02T18:16:48.327662+0000","last_became_peered":"2023-01-02T18:16:48.327662+0000","last_unstale":"2023-01-02T18:17:03.583325+0000","last_undegraded":"2023-01-02T18:17:03.583325+0000","last_fullsized":"2023-01-02T18:17:03.583325+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'4","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598576+0000","last_change":"2023-01-02T18:16:48.350389+0000","last_active":"2023-01-02T18:17:03.598576+0000","last_peered":"2023-01-02T18:17:03.598576+0000","last_clean":"2023-01-02T18:17:03.598576+0000","last_became_active":"2023-01-02T18:16:48.329461+0000","last_became_peered":"2023-01-02T18:16:48.329461+0000","last_unstale":"2023-01-02T18:17:03.598576+0000","last_undegraded":"2023-01-02T18:17:03.598576+0000","last_fullsized":"2023-01-02T18:17:03.598576+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614575+0000","last_change":"2023-01-02T18:16:49.323150+0000","last_active":"2023-01-02T18:17:03.614575+0000","last_peered":"2023-01-02T18:17:03.614575+0000","last_clean":"2023-01-02T18:17:03.614575+0000","last_became_active":"2023-01-02T18:16:48.326635+0000","last_became_peered":"2023-01-02T18:16:48.326635+0000","last_unstale":"2023-01-02T18:17:03.614575+0000","last_undegraded":"2023-01-02T18:17:03.614575+0000","last_fullsized":"2023-01-02T18:17:03.614575+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586573+0000","last_change":"2023-01-02T18:16:53.345223+0000","last_active":"2023-01-02T18:17:03.586573+0000","last_peered":"2023-01-02T18:17:03.586573+0000","last_clean":"2023-01-02T18:17:03.586573+0000","last_became_active":"2023-01-02T18:16:51.341580+0000","last_became_peered":"2023-01-02T18:16:51.341580+0000","last_unstale":"2023-01-02T18:17:03.586573+0000","last_undegraded":"2023-01-02T18:17:03.586573+0000","last_fullsized":"2023-01-02T18:17:03.586573+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.303196+0000","last_change":"2023-01-02T18:16:57.305459+0000","last_active":"2023-01-02T18:17:04.303196+0000","last_peered":"2023-01-02T18:17:04.303196+0000","last_clean":"2023-01-02T18:17:04.303196+0000","last_became_active":"2023-01-02T18:16:55.315865+0000","last_became_peered":"2023-01-02T18:16:55.315865+0000","last_unstale":"2023-01-02T18:17:04.303196+0000","last_undegraded":"2023-01-02T18:17:04.303196+0000","last_fullsized":"2023-01-02T18:17:04.303196+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"70'9","reported_seq":60,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.332621+0000","last_change":"2023-01-02T18:17:01.311899+0000","last_active":"2023-01-02T18:17:04.332621+0000","last_peered":"2023-01-02T18:17:04.332621+0000","last_clean":"2023-01-02T18:17:04.332621+0000","last_became_active":"2023-01-02T18:16:59.309612+0000","last_became_peered":"2023-01-02T18:16:59.309612+0000","last_unstale":"2023-01-02T18:17:04.332621+0000","last_undegraded":"2023-01-02T18:17:04.332621+0000","last_fullsized":"2023-01-02T18:17:04.332621+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":75,"num_read_kb":60,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.587415+0000","last_change":"2023-01-02T18:16:48.328829+0000","last_active":"2023-01-02T18:17:03.587415+0000","last_peered":"2023-01-02T18:17:03.587415+0000","last_clean":"2023-01-02T18:17:03.587415+0000","last_became_active":"2023-01-02T18:16:48.328372+0000","last_became_peered":"2023-01-02T18:16:48.328372+0000","last_unstale":"2023-01-02T18:17:03.587415+0000","last_undegraded":"2023-01-02T18:17:03.587415+0000","last_fullsized":"2023-01-02T18:17:03.587415+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586881+0000","last_change":"2023-01-02T18:16:39.438088+0000","last_active":"2023-01-02T18:17:03.586881+0000","last_peered":"2023-01-02T18:17:03.586881+0000","last_clean":"2023-01-02T18:17:03.586881+0000","last_became_active":"2023-01-02T18:16:37.415896+0000","last_became_peered":"2023-01-02T18:16:37.415896+0000","last_unstale":"2023-01-02T18:17:03.586881+0000","last_undegraded":"2023-01-02T18:17:03.586881+0000","last_fullsized":"2023-01-02T18:17:03.586881+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'3","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603939+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:17:03.603939+0000","last_peered":"2023-01-02T18:17:03.603939+0000","last_clean":"2023-01-02T18:17:03.603939+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:17:03.603939+0000","last_undegraded":"2023-01-02T18:17:03.603939+0000","last_fullsized":"2023-01-02T18:17:03.603939+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.583318+0000","last_change":"2023-01-02T18:16:53.344544+0000","last_active":"2023-01-02T18:17:03.583318+0000","last_peered":"2023-01-02T18:17:03.583318+0000","last_clean":"2023-01-02T18:17:03.583318+0000","last_became_active":"2023-01-02T18:16:51.339073+0000","last_became_peered":"2023-01-02T18:16:51.339073+0000","last_unstale":"2023-01-02T18:17:03.583318+0000","last_undegraded":"2023-01-02T18:17:03.583318+0000","last_fullsized":"2023-01-02T18:17:03.583318+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":117,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.320811+0000","last_change":"2023-01-02T18:16:57.307483+0000","last_active":"2023-01-02T18:17:04.320811+0000","last_peered":"2023-01-02T18:17:04.320811+0000","last_clean":"2023-01-02T18:17:04.320811+0000","last_became_active":"2023-01-02T18:16:55.316680+0000","last_became_peered":"2023-01-02T18:16:55.316680+0000","last_unstale":"2023-01-02T18:17:04.320811+0000","last_undegraded":"2023-01-02T18:17:04.320811+0000","last_fullsized":"2023-01-02T18:17:04.320811+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586231+0000","last_change":"2023-01-02T18:17:01.310439+0000","last_active":"2023-01-02T18:17:03.586231+0000","last_peered":"2023-01-02T18:17:03.586231+0000","last_clean":"2023-01-02T18:17:03.586231+0000","last_became_active":"2023-01-02T18:16:59.315925+0000","last_became_peered":"2023-01-02T18:16:59.315925+0000","last_unstale":"2023-01-02T18:17:03.586231+0000","last_undegraded":"2023-01-02T18:17:03.586231+0000","last_fullsized":"2023-01-02T18:17:03.586231+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614289+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:17:03.614289+0000","last_peered":"2023-01-02T18:17:03.614289+0000","last_clean":"2023-01-02T18:17:03.614289+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:17:03.614289+0000","last_undegraded":"2023-01-02T18:17:03.614289+0000","last_fullsized":"2023-01-02T18:17:03.614289+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'5","reported_seq":56,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.587184+0000","last_change":"2023-01-02T18:16:42.448542+0000","last_active":"2023-01-02T18:17:03.587184+0000","last_peered":"2023-01-02T18:17:03.587184+0000","last_clean":"2023-01-02T18:17:03.587184+0000","last_became_active":"2023-01-02T18:16:42.441102+0000","last_became_peered":"2023-01-02T18:16:42.441102+0000","last_unstale":"2023-01-02T18:17:03.587184+0000","last_undegraded":"2023-01-02T18:17:03.587184+0000","last_fullsized":"2023-01-02T18:17:03.587184+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586726+0000","last_change":"2023-01-02T18:16:49.309370+0000","last_active":"2023-01-02T18:17:03.586726+0000","last_peered":"2023-01-02T18:17:03.586726+0000","last_clean":"2023-01-02T18:17:03.586726+0000","last_became_active":"2023-01-02T18:16:48.323683+0000","last_became_peered":"2023-01-02T18:16:48.323683+0000","last_unstale":"2023-01-02T18:17:03.586726+0000","last_undegraded":"2023-01-02T18:17:03.586726+0000","last_fullsized":"2023-01-02T18:17:03.586726+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603084+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:17:03.603084+0000","last_peered":"2023-01-02T18:17:03.603084+0000","last_clean":"2023-01-02T18:17:03.603084+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:17:03.603084+0000","last_undegraded":"2023-01-02T18:17:03.603084+0000","last_fullsized":"2023-01-02T18:17:03.603084+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.307028+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:17:04.307028+0000","last_peered":"2023-01-02T18:17:04.307028+0000","last_clean":"2023-01-02T18:17:04.307028+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:17:04.307028+0000","last_undegraded":"2023-01-02T18:17:04.307028+0000","last_fullsized":"2023-01-02T18:17:04.307028+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614433+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:17:03.614433+0000","last_peered":"2023-01-02T18:17:03.614433+0000","last_clean":"2023-01-02T18:17:03.614433+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:17:03.614433+0000","last_undegraded":"2023-01-02T18:17:03.614433+0000","last_fullsized":"2023-01-02T18:17:03.614433+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.a","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598250+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:17:03.598250+0000","last_peered":"2023-01-02T18:17:03.598250+0000","last_clean":"2023-01-02T18:17:03.598250+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:17:03.598250+0000","last_undegraded":"2023-01-02T18:17:03.598250+0000","last_fullsized":"2023-01-02T18:17:03.598250+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"46'4","reported_seq":66,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603732+0000","last_change":"2023-01-02T18:16:42.453646+0000","last_active":"2023-01-02T18:17:03.603732+0000","last_peered":"2023-01-02T18:17:03.603732+0000","last_clean":"2023-01-02T18:17:03.603732+0000","last_became_active":"2023-01-02T18:16:42.445252+0000","last_became_peered":"2023-01-02T18:16:42.445252+0000","last_unstale":"2023-01-02T18:17:03.603732+0000","last_undegraded":"2023-01-02T18:17:03.603732+0000","last_fullsized":"2023-01-02T18:17:03.603732+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":30,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"56'8","reported_seq":42,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.581663+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:17:03.581663+0000","last_peered":"2023-01-02T18:17:03.581663+0000","last_clean":"2023-01-02T18:17:03.581663+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:17:03.581663+0000","last_undegraded":"2023-01-02T18:17:03.581663+0000","last_fullsized":"2023-01-02T18:17:03.581663+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603866+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:17:03.603866+0000","last_peered":"2023-01-02T18:17:03.603866+0000","last_clean":"2023-01-02T18:17:03.603866+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:17:03.603866+0000","last_undegraded":"2023-01-02T18:17:03.603866+0000","last_fullsized":"2023-01-02T18:17:03.603866+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.319411+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:17:04.319411+0000","last_peered":"2023-01-02T18:17:04.319411+0000","last_clean":"2023-01-02T18:17:04.319411+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:17:04.319411+0000","last_undegraded":"2023-01-02T18:17:04.319411+0000","last_fullsized":"2023-01-02T18:17:04.319411+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"71'2","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.401690+0000","last_change":"2023-01-02T18:17:01.317443+0000","last_active":"2023-01-02T18:17:04.401690+0000","last_peered":"2023-01-02T18:17:04.401690+0000","last_clean":"2023-01-02T18:17:04.401690+0000","last_became_active":"2023-01-02T18:16:59.311550+0000","last_became_peered":"2023-01-02T18:16:59.311550+0000","last_unstale":"2023-01-02T18:17:04.401690+0000","last_undegraded":"2023-01-02T18:17:04.401690+0000","last_fullsized":"2023-01-02T18:17:04.401690+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.9","version":"51'3","reported_seq":30,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585577+0000","last_change":"2023-01-02T18:16:48.345208+0000","last_active":"2023-01-02T18:17:03.585577+0000","last_peered":"2023-01-02T18:17:03.585577+0000","last_clean":"2023-01-02T18:17:03.585577+0000","last_became_active":"2023-01-02T18:16:48.327080+0000","last_became_peered":"2023-01-02T18:16:48.327080+0000","last_unstale":"2023-01-02T18:17:03.585577+0000","last_undegraded":"2023-01-02T18:17:03.585577+0000","last_fullsized":"2023-01-02T18:17:03.585577+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":84,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603990+0000","last_change":"2023-01-02T18:16:48.347211+0000","last_active":"2023-01-02T18:17:03.603990+0000","last_peered":"2023-01-02T18:17:03.603990+0000","last_clean":"2023-01-02T18:17:03.603990+0000","last_became_active":"2023-01-02T18:16:48.327374+0000","last_became_peered":"2023-01-02T18:16:48.327374+0000","last_unstale":"2023-01-02T18:17:03.603990+0000","last_undegraded":"2023-01-02T18:17:03.603990+0000","last_fullsized":"2023-01-02T18:17:03.603990+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.613483+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:17:03.613483+0000","last_peered":"2023-01-02T18:17:03.613483+0000","last_clean":"2023-01-02T18:17:03.613483+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:17:03.613483+0000","last_undegraded":"2023-01-02T18:17:03.613483+0000","last_fullsized":"2023-01-02T18:17:03.613483+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.587040+0000","last_change":"2023-01-02T18:16:53.342610+0000","last_active":"2023-01-02T18:17:03.587040+0000","last_peered":"2023-01-02T18:17:03.587040+0000","last_clean":"2023-01-02T18:17:03.587040+0000","last_became_active":"2023-01-02T18:16:51.341683+0000","last_became_peered":"2023-01-02T18:16:51.341683+0000","last_unstale":"2023-01-02T18:17:03.587040+0000","last_undegraded":"2023-01-02T18:17:03.587040+0000","last_fullsized":"2023-01-02T18:17:03.587040+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.314469+0000","last_change":"2023-01-02T18:16:57.312289+0000","last_active":"2023-01-02T18:17:04.314469+0000","last_peered":"2023-01-02T18:17:04.314469+0000","last_clean":"2023-01-02T18:17:04.314469+0000","last_became_active":"2023-01-02T18:16:55.317023+0000","last_became_peered":"2023-01-02T18:16:55.317023+0000","last_unstale":"2023-01-02T18:17:04.314469+0000","last_undegraded":"2023-01-02T18:17:04.314469+0000","last_fullsized":"2023-01-02T18:17:04.314469+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"70'9","reported_seq":120,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.632528+0000","last_change":"2023-01-02T18:17:01.317071+0000","last_active":"2023-01-02T18:17:03.632528+0000","last_peered":"2023-01-02T18:17:03.632528+0000","last_clean":"2023-01-02T18:17:03.632528+0000","last_became_active":"2023-01-02T18:16:59.310165+0000","last_became_peered":"2023-01-02T18:16:59.310165+0000","last_unstale":"2023-01-02T18:17:03.632528+0000","last_undegraded":"2023-01-02T18:17:03.632528+0000","last_fullsized":"2023-01-02T18:17:03.632528+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.8","version":"51'1","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603042+0000","last_change":"2023-01-02T18:16:44.299209+0000","last_active":"2023-01-02T18:17:03.603042+0000","last_peered":"2023-01-02T18:17:03.603042+0000","last_clean":"2023-01-02T18:17:03.603042+0000","last_became_active":"2023-01-02T18:16:42.441304+0000","last_became_peered":"2023-01-02T18:16:42.441304+0000","last_unstale":"2023-01-02T18:17:03.603042+0000","last_undegraded":"2023-01-02T18:17:03.603042+0000","last_fullsized":"2023-01-02T18:17:03.603042+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"46'7","reported_seq":81,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.604213+0000","last_change":"2023-01-02T18:16:48.341709+0000","last_active":"2023-01-02T18:17:03.604213+0000","last_peered":"2023-01-02T18:17:03.604213+0000","last_clean":"2023-01-02T18:17:03.604213+0000","last_became_active":"2023-01-02T18:16:48.324242+0000","last_became_peered":"2023-01-02T18:16:48.324242+0000","last_unstale":"2023-01-02T18:17:03.604213+0000","last_undegraded":"2023-01-02T18:17:03.604213+0000","last_fullsized":"2023-01-02T18:17:03.604213+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":46,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.604200+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:17:03.604200+0000","last_peered":"2023-01-02T18:17:03.604200+0000","last_clean":"2023-01-02T18:17:03.604200+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:03.604200+0000","last_undegraded":"2023-01-02T18:17:03.604200+0000","last_fullsized":"2023-01-02T18:17:03.604200+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598159+0000","last_change":"2023-01-02T18:16:53.604245+0000","last_active":"2023-01-02T18:17:03.598159+0000","last_peered":"2023-01-02T18:17:03.598159+0000","last_clean":"2023-01-02T18:17:03.598159+0000","last_became_active":"2023-01-02T18:16:51.338292+0000","last_became_peered":"2023-01-02T18:16:51.338292+0000","last_unstale":"2023-01-02T18:17:03.598159+0000","last_undegraded":"2023-01-02T18:17:03.598159+0000","last_fullsized":"2023-01-02T18:17:03.598159+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.303665+0000","last_change":"2023-01-02T18:16:57.317106+0000","last_active":"2023-01-02T18:17:04.303665+0000","last_peered":"2023-01-02T18:17:04.303665+0000","last_clean":"2023-01-02T18:17:04.303665+0000","last_became_active":"2023-01-02T18:16:55.308873+0000","last_became_peered":"2023-01-02T18:16:55.308873+0000","last_unstale":"2023-01-02T18:17:04.303665+0000","last_undegraded":"2023-01-02T18:17:04.303665+0000","last_fullsized":"2023-01-02T18:17:04.303665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"70'84","reported_seq":665,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.412420+0000","last_change":"2023-01-02T18:17:01.316472+0000","last_active":"2023-01-02T18:17:04.412420+0000","last_peered":"2023-01-02T18:17:04.412420+0000","last_clean":"2023-01-02T18:17:04.412420+0000","last_became_active":"2023-01-02T18:16:59.310142+0000","last_became_peered":"2023-01-02T18:16:59.310142+0000","last_unstale":"2023-01-02T18:17:04.412420+0000","last_undegraded":"2023-01-02T18:17:04.412420+0000","last_fullsized":"2023-01-02T18:17:04.412420+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":84,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1512,"num_read_kb":1369,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.17","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586643+0000","last_change":"2023-01-02T18:16:44.308280+0000","last_active":"2023-01-02T18:17:03.586643+0000","last_peered":"2023-01-02T18:17:03.586643+0000","last_clean":"2023-01-02T18:17:03.586643+0000","last_became_active":"2023-01-02T18:16:41.446391+0000","last_became_peered":"2023-01-02T18:16:41.446391+0000","last_unstale":"2023-01-02T18:17:03.586643+0000","last_undegraded":"2023-01-02T18:17:03.586643+0000","last_fullsized":"2023-01-02T18:17:03.586643+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"46'2","reported_seq":46,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.597687+0000","last_change":"2023-01-02T18:16:39.440808+0000","last_active":"2023-01-02T18:17:03.597687+0000","last_peered":"2023-01-02T18:17:03.597687+0000","last_clean":"2023-01-02T18:17:03.597687+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:17:03.597687+0000","last_undegraded":"2023-01-02T18:17:03.597687+0000","last_fullsized":"2023-01-02T18:17:03.597687+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586537+0000","last_change":"2023-01-02T18:16:49.310953+0000","last_active":"2023-01-02T18:17:03.586537+0000","last_peered":"2023-01-02T18:17:03.586537+0000","last_clean":"2023-01-02T18:17:03.586537+0000","last_became_active":"2023-01-02T18:16:46.312067+0000","last_became_peered":"2023-01-02T18:16:46.312067+0000","last_unstale":"2023-01-02T18:17:03.586537+0000","last_undegraded":"2023-01-02T18:17:03.586537+0000","last_fullsized":"2023-01-02T18:17:03.586537+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603630+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:17:03.603630+0000","last_peered":"2023-01-02T18:17:03.603630+0000","last_clean":"2023-01-02T18:17:03.603630+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:17:03.603630+0000","last_undegraded":"2023-01-02T18:17:03.603630+0000","last_fullsized":"2023-01-02T18:17:03.603630+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.314711+0000","last_change":"2023-01-02T18:16:57.313875+0000","last_active":"2023-01-02T18:17:04.314711+0000","last_peered":"2023-01-02T18:17:04.314711+0000","last_clean":"2023-01-02T18:17:04.314711+0000","last_became_active":"2023-01-02T18:16:55.318719+0000","last_became_peered":"2023-01-02T18:16:55.318719+0000","last_unstale":"2023-01-02T18:17:04.314711+0000","last_undegraded":"2023-01-02T18:17:04.314711+0000","last_fullsized":"2023-01-02T18:17:04.314711+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"68'2","reported_seq":122,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.405729+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:17:04.405729+0000","last_peered":"2023-01-02T18:17:04.405729+0000","last_clean":"2023-01-02T18:17:04.405729+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:17:04.405729+0000","last_undegraded":"2023-01-02T18:17:04.405729+0000","last_fullsized":"2023-01-02T18:17:04.405729+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586277+0000","last_change":"2023-01-02T18:16:44.307606+0000","last_active":"2023-01-02T18:17:03.586277+0000","last_peered":"2023-01-02T18:17:03.586277+0000","last_clean":"2023-01-02T18:17:03.586277+0000","last_became_active":"2023-01-02T18:16:41.449266+0000","last_became_peered":"2023-01-02T18:16:41.449266+0000","last_unstale":"2023-01-02T18:17:03.586277+0000","last_undegraded":"2023-01-02T18:17:03.586277+0000","last_fullsized":"2023-01-02T18:17:03.586277+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603257+0000","last_change":"2023-01-02T18:16:48.349656+0000","last_active":"2023-01-02T18:17:03.603257+0000","last_peered":"2023-01-02T18:17:03.603257+0000","last_clean":"2023-01-02T18:17:03.603257+0000","last_became_active":"2023-01-02T18:16:48.329249+0000","last_became_peered":"2023-01-02T18:16:48.329249+0000","last_unstale":"2023-01-02T18:17:03.603257+0000","last_undegraded":"2023-01-02T18:17:03.603257+0000","last_fullsized":"2023-01-02T18:17:03.603257+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586874+0000","last_change":"2023-01-02T18:16:49.311129+0000","last_active":"2023-01-02T18:17:03.586874+0000","last_peered":"2023-01-02T18:17:03.586874+0000","last_clean":"2023-01-02T18:17:03.586874+0000","last_became_active":"2023-01-02T18:16:46.312301+0000","last_became_peered":"2023-01-02T18:16:46.312301+0000","last_unstale":"2023-01-02T18:17:03.586874+0000","last_undegraded":"2023-01-02T18:17:03.586874+0000","last_fullsized":"2023-01-02T18:17:03.586874+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.581456+0000","last_change":"2023-01-02T18:16:53.350359+0000","last_active":"2023-01-02T18:17:03.581456+0000","last_peered":"2023-01-02T18:17:03.581456+0000","last_clean":"2023-01-02T18:17:03.581456+0000","last_became_active":"2023-01-02T18:16:51.338043+0000","last_became_peered":"2023-01-02T18:16:51.338043+0000","last_unstale":"2023-01-02T18:17:03.581456+0000","last_undegraded":"2023-01-02T18:17:03.581456+0000","last_fullsized":"2023-01-02T18:17:03.581456+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":27,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.307826+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:17:04.307826+0000","last_peered":"2023-01-02T18:17:04.307826+0000","last_clean":"2023-01-02T18:17:04.307826+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:17:04.307826+0000","last_undegraded":"2023-01-02T18:17:04.307826+0000","last_fullsized":"2023-01-02T18:17:04.307826+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"68'4","reported_seq":23,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.597672+0000","last_change":"2023-01-02T18:17:01.316528+0000","last_active":"2023-01-02T18:17:03.597672+0000","last_peered":"2023-01-02T18:17:03.597672+0000","last_clean":"2023-01-02T18:17:03.597672+0000","last_became_active":"2023-01-02T18:16:59.324956+0000","last_became_peered":"2023-01-02T18:16:59.324956+0000","last_unstale":"2023-01-02T18:17:03.597672+0000","last_undegraded":"2023-01-02T18:17:03.597672+0000","last_fullsized":"2023-01-02T18:17:03.597672+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.15","version":"0'0","reported_seq":35,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.604103+0000","last_change":"2023-01-02T18:16:44.299509+0000","last_active":"2023-01-02T18:17:03.604103+0000","last_peered":"2023-01-02T18:17:03.604103+0000","last_clean":"2023-01-02T18:17:03.604103+0000","last_became_active":"2023-01-02T18:16:42.439600+0000","last_became_peered":"2023-01-02T18:16:42.439600+0000","last_unstale":"2023-01-02T18:17:03.604103+0000","last_undegraded":"2023-01-02T18:17:03.604103+0000","last_fullsized":"2023-01-02T18:17:03.604103+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":43,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603597+0000","last_change":"2023-01-02T18:16:39.509367+0000","last_active":"2023-01-02T18:17:03.603597+0000","last_peered":"2023-01-02T18:17:03.603597+0000","last_clean":"2023-01-02T18:17:03.603597+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:17:03.603597+0000","last_undegraded":"2023-01-02T18:17:03.603597+0000","last_fullsized":"2023-01-02T18:17:03.603597+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.587244+0000","last_change":"2023-01-02T18:16:49.310391+0000","last_active":"2023-01-02T18:17:03.587244+0000","last_peered":"2023-01-02T18:17:03.587244+0000","last_clean":"2023-01-02T18:17:03.587244+0000","last_became_active":"2023-01-02T18:16:46.316328+0000","last_became_peered":"2023-01-02T18:16:46.316328+0000","last_unstale":"2023-01-02T18:17:03.587244+0000","last_undegraded":"2023-01-02T18:17:03.587244+0000","last_fullsized":"2023-01-02T18:17:03.587244+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.615250+0000","last_change":"2023-01-02T18:16:53.686538+0000","last_active":"2023-01-02T18:17:03.615250+0000","last_peered":"2023-01-02T18:17:03.615250+0000","last_clean":"2023-01-02T18:17:03.615250+0000","last_became_active":"2023-01-02T18:16:51.336975+0000","last_became_peered":"2023-01-02T18:16:51.336975+0000","last_unstale":"2023-01-02T18:17:03.615250+0000","last_undegraded":"2023-01-02T18:17:03.615250+0000","last_fullsized":"2023-01-02T18:17:03.615250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.320590+0000","last_change":"2023-01-02T18:16:57.306845+0000","last_active":"2023-01-02T18:17:04.320590+0000","last_peered":"2023-01-02T18:17:04.320590+0000","last_clean":"2023-01-02T18:17:04.320590+0000","last_became_active":"2023-01-02T18:16:55.318612+0000","last_became_peered":"2023-01-02T18:16:55.318612+0000","last_unstale":"2023-01-02T18:17:04.320590+0000","last_undegraded":"2023-01-02T18:17:04.320590+0000","last_fullsized":"2023-01-02T18:17:04.320590+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"69'1","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585230+0000","last_change":"2023-01-02T18:17:01.307624+0000","last_active":"2023-01-02T18:17:03.585230+0000","last_peered":"2023-01-02T18:17:03.585230+0000","last_clean":"2023-01-02T18:17:03.585230+0000","last_became_active":"2023-01-02T18:16:59.311706+0000","last_became_peered":"2023-01-02T18:16:59.311706+0000","last_unstale":"2023-01-02T18:17:03.585230+0000","last_undegraded":"2023-01-02T18:17:03.585230+0000","last_fullsized":"2023-01-02T18:17:03.585230+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.14","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586481+0000","last_change":"2023-01-02T18:16:44.307239+0000","last_active":"2023-01-02T18:17:03.586481+0000","last_peered":"2023-01-02T18:17:03.586481+0000","last_clean":"2023-01-02T18:17:03.586481+0000","last_became_active":"2023-01-02T18:16:41.447671+0000","last_became_peered":"2023-01-02T18:16:41.447671+0000","last_unstale":"2023-01-02T18:17:03.586481+0000","last_undegraded":"2023-01-02T18:17:03.586481+0000","last_fullsized":"2023-01-02T18:17:03.586481+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":48,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603315+0000","last_change":"2023-01-02T18:16:48.325246+0000","last_active":"2023-01-02T18:17:03.603315+0000","last_peered":"2023-01-02T18:17:03.603315+0000","last_clean":"2023-01-02T18:17:03.603315+0000","last_became_active":"2023-01-02T18:16:48.322940+0000","last_became_peered":"2023-01-02T18:16:48.322940+0000","last_unstale":"2023-01-02T18:17:03.603315+0000","last_undegraded":"2023-01-02T18:17:03.603315+0000","last_fullsized":"2023-01-02T18:17:03.603315+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.583233+0000","last_change":"2023-01-02T18:16:49.300038+0000","last_active":"2023-01-02T18:17:03.583233+0000","last_peered":"2023-01-02T18:17:03.583233+0000","last_clean":"2023-01-02T18:17:03.583233+0000","last_became_active":"2023-01-02T18:16:46.315569+0000","last_became_peered":"2023-01-02T18:16:46.315569+0000","last_unstale":"2023-01-02T18:17:03.583233+0000","last_undegraded":"2023-01-02T18:17:03.583233+0000","last_fullsized":"2023-01-02T18:17:03.583233+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603862+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:17:03.603862+0000","last_peered":"2023-01-02T18:17:03.603862+0000","last_clean":"2023-01-02T18:17:03.603862+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:17:03.603862+0000","last_undegraded":"2023-01-02T18:17:03.603862+0000","last_fullsized":"2023-01-02T18:17:03.603862+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.308428+0000","last_change":"2023-01-02T18:16:57.312176+0000","last_active":"2023-01-02T18:17:04.308428+0000","last_peered":"2023-01-02T18:17:04.308428+0000","last_clean":"2023-01-02T18:17:04.308428+0000","last_became_active":"2023-01-02T18:16:55.311934+0000","last_became_peered":"2023-01-02T18:16:55.311934+0000","last_unstale":"2023-01-02T18:17:04.308428+0000","last_undegraded":"2023-01-02T18:17:04.308428+0000","last_fullsized":"2023-01-02T18:17:04.308428+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":25,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.615088+0000","last_change":"2023-01-02T18:17:01.320344+0000","last_active":"2023-01-02T18:17:03.615088+0000","last_peered":"2023-01-02T18:17:03.615088+0000","last_clean":"2023-01-02T18:17:03.615088+0000","last_became_active":"2023-01-02T18:16:59.324530+0000","last_became_peered":"2023-01-02T18:16:59.324530+0000","last_unstale":"2023-01-02T18:17:03.615088+0000","last_undegraded":"2023-01-02T18:17:03.615088+0000","last_fullsized":"2023-01-02T18:17:03.615088+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598078+0000","last_change":"2023-01-02T18:16:48.329830+0000","last_active":"2023-01-02T18:17:03.598078+0000","last_peered":"2023-01-02T18:17:03.598078+0000","last_clean":"2023-01-02T18:17:03.598078+0000","last_became_active":"2023-01-02T18:16:48.329469+0000","last_became_peered":"2023-01-02T18:16:48.329469+0000","last_unstale":"2023-01-02T18:17:03.598078+0000","last_undegraded":"2023-01-02T18:17:03.598078+0000","last_fullsized":"2023-01-02T18:17:03.598078+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603678+0000","last_change":"2023-01-02T18:16:48.343876+0000","last_active":"2023-01-02T18:17:03.603678+0000","last_peered":"2023-01-02T18:17:03.603678+0000","last_clean":"2023-01-02T18:17:03.603678+0000","last_became_active":"2023-01-02T18:16:48.326351+0000","last_became_peered":"2023-01-02T18:16:48.326351+0000","last_unstale":"2023-01-02T18:17:03.603678+0000","last_undegraded":"2023-01-02T18:17:03.603678+0000","last_fullsized":"2023-01-02T18:17:03.603678+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586538+0000","last_change":"2023-01-02T18:16:49.310459+0000","last_active":"2023-01-02T18:17:03.586538+0000","last_peered":"2023-01-02T18:17:03.586538+0000","last_clean":"2023-01-02T18:17:03.586538+0000","last_became_active":"2023-01-02T18:16:46.312215+0000","last_became_peered":"2023-01-02T18:16:46.312215+0000","last_unstale":"2023-01-02T18:17:03.586538+0000","last_undegraded":"2023-01-02T18:17:03.586538+0000","last_fullsized":"2023-01-02T18:17:03.586538+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585475+0000","last_change":"2023-01-02T18:16:53.342357+0000","last_active":"2023-01-02T18:17:03.585475+0000","last_peered":"2023-01-02T18:17:03.585475+0000","last_clean":"2023-01-02T18:17:03.585475+0000","last_became_active":"2023-01-02T18:16:51.341254+0000","last_became_peered":"2023-01-02T18:16:51.341254+0000","last_unstale":"2023-01-02T18:17:03.585475+0000","last_undegraded":"2023-01-02T18:17:03.585475+0000","last_fullsized":"2023-01-02T18:17:03.585475+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.314498+0000","last_change":"2023-01-02T18:16:57.312710+0000","last_active":"2023-01-02T18:17:04.314498+0000","last_peered":"2023-01-02T18:17:04.314498+0000","last_clean":"2023-01-02T18:17:04.314498+0000","last_became_active":"2023-01-02T18:16:55.317525+0000","last_became_peered":"2023-01-02T18:16:55.317525+0000","last_unstale":"2023-01-02T18:17:04.314498+0000","last_undegraded":"2023-01-02T18:17:04.314498+0000","last_fullsized":"2023-01-02T18:17:04.314498+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586067+0000","last_change":"2023-01-02T18:17:01.311474+0000","last_active":"2023-01-02T18:17:03.586067+0000","last_peered":"2023-01-02T18:17:03.586067+0000","last_clean":"2023-01-02T18:17:03.586067+0000","last_became_active":"2023-01-02T18:16:59.314245+0000","last_became_peered":"2023-01-02T18:16:59.314245+0000","last_unstale":"2023-01-02T18:17:03.586067+0000","last_undegraded":"2023-01-02T18:17:03.586067+0000","last_fullsized":"2023-01-02T18:17:03.586067+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.12","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598624+0000","last_change":"2023-01-02T18:16:44.320516+0000","last_active":"2023-01-02T18:17:03.598624+0000","last_peered":"2023-01-02T18:17:03.598624+0000","last_clean":"2023-01-02T18:17:03.598624+0000","last_became_active":"2023-01-02T18:16:41.444704+0000","last_became_peered":"2023-01-02T18:16:41.444704+0000","last_unstale":"2023-01-02T18:17:03.598624+0000","last_undegraded":"2023-01-02T18:17:03.598624+0000","last_fullsized":"2023-01-02T18:17:03.598624+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"46'5","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603850+0000","last_change":"2023-01-02T18:16:39.509436+0000","last_active":"2023-01-02T18:17:03.603850+0000","last_peered":"2023-01-02T18:17:03.603850+0000","last_clean":"2023-01-02T18:17:03.603850+0000","last_became_active":"2023-01-02T18:16:37.436152+0000","last_became_peered":"2023-01-02T18:16:37.436152+0000","last_unstale":"2023-01-02T18:17:03.603850+0000","last_undegraded":"2023-01-02T18:17:03.603850+0000","last_fullsized":"2023-01-02T18:17:03.603850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586951+0000","last_change":"2023-01-02T18:16:49.309763+0000","last_active":"2023-01-02T18:17:03.586951+0000","last_peered":"2023-01-02T18:17:03.586951+0000","last_clean":"2023-01-02T18:17:03.586951+0000","last_became_active":"2023-01-02T18:16:46.308336+0000","last_became_peered":"2023-01-02T18:16:46.308336+0000","last_unstale":"2023-01-02T18:17:03.586951+0000","last_undegraded":"2023-01-02T18:17:03.586951+0000","last_fullsized":"2023-01-02T18:17:03.586951+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.613587+0000","last_change":"2023-01-02T18:16:53.686000+0000","last_active":"2023-01-02T18:17:03.613587+0000","last_peered":"2023-01-02T18:17:03.613587+0000","last_clean":"2023-01-02T18:17:03.613587+0000","last_became_active":"2023-01-02T18:16:51.345471+0000","last_became_peered":"2023-01-02T18:16:51.345471+0000","last_unstale":"2023-01-02T18:17:03.613587+0000","last_undegraded":"2023-01-02T18:17:03.613587+0000","last_fullsized":"2023-01-02T18:17:03.613587+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.306829+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:17:04.306829+0000","last_peered":"2023-01-02T18:17:04.306829+0000","last_clean":"2023-01-02T18:17:04.306829+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:17:04.306829+0000","last_undegraded":"2023-01-02T18:17:04.306829+0000","last_fullsized":"2023-01-02T18:17:04.306829+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.322242+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:17:04.322242+0000","last_peered":"2023-01-02T18:17:04.322242+0000","last_clean":"2023-01-02T18:17:04.322242+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:17:04.322242+0000","last_undegraded":"2023-01-02T18:17:04.322242+0000","last_fullsized":"2023-01-02T18:17:04.322242+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.11","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585955+0000","last_change":"2023-01-02T18:16:44.306989+0000","last_active":"2023-01-02T18:17:03.585955+0000","last_peered":"2023-01-02T18:17:03.585955+0000","last_clean":"2023-01-02T18:17:03.585955+0000","last_became_active":"2023-01-02T18:16:41.448619+0000","last_became_peered":"2023-01-02T18:16:41.448619+0000","last_unstale":"2023-01-02T18:17:03.585955+0000","last_undegraded":"2023-01-02T18:17:03.585955+0000","last_fullsized":"2023-01-02T18:17:03.585955+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"46'1","reported_seq":51,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603873+0000","last_change":"2023-01-02T18:16:42.446044+0000","last_active":"2023-01-02T18:17:03.603873+0000","last_peered":"2023-01-02T18:17:03.603873+0000","last_clean":"2023-01-02T18:17:03.603873+0000","last_became_active":"2023-01-02T18:16:42.440314+0000","last_became_peered":"2023-01-02T18:16:42.440314+0000","last_unstale":"2023-01-02T18:17:03.603873+0000","last_undegraded":"2023-01-02T18:17:03.603873+0000","last_fullsized":"2023-01-02T18:17:03.603873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603418+0000","last_change":"2023-01-02T18:16:49.304745+0000","last_active":"2023-01-02T18:17:03.603418+0000","last_peered":"2023-01-02T18:17:03.603418+0000","last_clean":"2023-01-02T18:17:03.603418+0000","last_became_active":"2023-01-02T18:16:48.325920+0000","last_became_peered":"2023-01-02T18:16:48.325920+0000","last_unstale":"2023-01-02T18:17:03.603418+0000","last_undegraded":"2023-01-02T18:17:03.603418+0000","last_fullsized":"2023-01-02T18:17:03.603418+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":27,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.587128+0000","last_change":"2023-01-02T18:16:53.342417+0000","last_active":"2023-01-02T18:17:03.587128+0000","last_peered":"2023-01-02T18:17:03.587128+0000","last_clean":"2023-01-02T18:17:03.587128+0000","last_became_active":"2023-01-02T18:16:51.341971+0000","last_became_peered":"2023-01-02T18:16:51.341971+0000","last_unstale":"2023-01-02T18:17:03.587128+0000","last_undegraded":"2023-01-02T18:17:03.587128+0000","last_fullsized":"2023-01-02T18:17:03.587128+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.310467+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:17:04.310467+0000","last_peered":"2023-01-02T18:17:04.310467+0000","last_clean":"2023-01-02T18:17:04.310467+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:17:04.310467+0000","last_undegraded":"2023-01-02T18:17:04.310467+0000","last_fullsized":"2023-01-02T18:17:04.310467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"71'6","reported_seq":41,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.376500+0000","last_change":"2023-01-02T18:17:01.322371+0000","last_active":"2023-01-02T18:17:04.376500+0000","last_peered":"2023-01-02T18:17:04.376500+0000","last_clean":"2023-01-02T18:17:04.376500+0000","last_became_active":"2023-01-02T18:16:59.324902+0000","last_became_peered":"2023-01-02T18:16:59.324902+0000","last_unstale":"2023-01-02T18:17:04.376500+0000","last_undegraded":"2023-01-02T18:17:04.376500+0000","last_fullsized":"2023-01-02T18:17:04.376500+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":25,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.10","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585770+0000","last_change":"2023-01-02T18:16:44.306689+0000","last_active":"2023-01-02T18:17:03.585770+0000","last_peered":"2023-01-02T18:17:03.585770+0000","last_clean":"2023-01-02T18:17:03.585770+0000","last_became_active":"2023-01-02T18:16:41.448162+0000","last_became_peered":"2023-01-02T18:16:41.448162+0000","last_unstale":"2023-01-02T18:17:03.585770+0000","last_undegraded":"2023-01-02T18:17:03.585770+0000","last_fullsized":"2023-01-02T18:17:03.585770+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586834+0000","last_change":"2023-01-02T18:16:42.440271+0000","last_active":"2023-01-02T18:17:03.586834+0000","last_peered":"2023-01-02T18:17:03.586834+0000","last_clean":"2023-01-02T18:17:03.586834+0000","last_became_active":"2023-01-02T18:16:42.435382+0000","last_became_peered":"2023-01-02T18:16:42.435382+0000","last_unstale":"2023-01-02T18:17:03.586834+0000","last_undegraded":"2023-01-02T18:17:03.586834+0000","last_fullsized":"2023-01-02T18:17:03.586834+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.597771+0000","last_change":"2023-01-02T18:16:49.318037+0000","last_active":"2023-01-02T18:17:03.597771+0000","last_peered":"2023-01-02T18:17:03.597771+0000","last_clean":"2023-01-02T18:17:03.597771+0000","last_became_active":"2023-01-02T18:16:48.330758+0000","last_became_peered":"2023-01-02T18:16:48.330758+0000","last_unstale":"2023-01-02T18:17:03.597771+0000","last_undegraded":"2023-01-02T18:17:03.597771+0000","last_fullsized":"2023-01-02T18:17:03.597771+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":124,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603306+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:17:03.603306+0000","last_peered":"2023-01-02T18:17:03.603306+0000","last_clean":"2023-01-02T18:17:03.603306+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:17:03.603306+0000","last_undegraded":"2023-01-02T18:17:03.603306+0000","last_fullsized":"2023-01-02T18:17:03.603306+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.319684+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:17:04.319684+0000","last_peered":"2023-01-02T18:17:04.319684+0000","last_clean":"2023-01-02T18:17:04.319684+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:17:04.319684+0000","last_undegraded":"2023-01-02T18:17:04.319684+0000","last_fullsized":"2023-01-02T18:17:04.319684+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586592+0000","last_change":"2023-01-02T18:17:01.311515+0000","last_active":"2023-01-02T18:17:03.586592+0000","last_peered":"2023-01-02T18:17:03.586592+0000","last_clean":"2023-01-02T18:17:03.586592+0000","last_became_active":"2023-01-02T18:16:59.322412+0000","last_became_peered":"2023-01-02T18:16:59.322412+0000","last_unstale":"2023-01-02T18:17:03.586592+0000","last_undegraded":"2023-01-02T18:17:03.586592+0000","last_fullsized":"2023-01-02T18:17:03.586592+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"4.1f","version":"0'0","reported_seq":37,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598251+0000","last_change":"2023-01-02T18:16:44.320520+0000","last_active":"2023-01-02T18:17:03.598251+0000","last_peered":"2023-01-02T18:17:03.598251+0000","last_clean":"2023-01-02T18:17:03.598251+0000","last_became_active":"2023-01-02T18:16:42.441192+0000","last_became_peered":"2023-01-02T18:16:42.441192+0000","last_unstale":"2023-01-02T18:17:03.598251+0000","last_undegraded":"2023-01-02T18:17:03.598251+0000","last_fullsized":"2023-01-02T18:17:03.598251+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":82,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.585768+0000","last_change":"2023-01-02T18:16:39.437971+0000","last_active":"2023-01-02T18:17:03.585768+0000","last_peered":"2023-01-02T18:17:03.585768+0000","last_clean":"2023-01-02T18:17:03.585768+0000","last_became_active":"2023-01-02T18:16:37.415177+0000","last_became_peered":"2023-01-02T18:16:37.415177+0000","last_unstale":"2023-01-02T18:17:03.585768+0000","last_undegraded":"2023-01-02T18:17:03.585768+0000","last_fullsized":"2023-01-02T18:17:03.585768+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":31,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614937+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:17:03.614937+0000","last_peered":"2023-01-02T18:17:03.614937+0000","last_clean":"2023-01-02T18:17:03.614937+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:17:03.614937+0000","last_undegraded":"2023-01-02T18:17:03.614937+0000","last_fullsized":"2023-01-02T18:17:03.614937+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.583186+0000","last_change":"2023-01-02T18:16:53.344508+0000","last_active":"2023-01-02T18:17:03.583186+0000","last_peered":"2023-01-02T18:17:03.583186+0000","last_clean":"2023-01-02T18:17:03.583186+0000","last_became_active":"2023-01-02T18:16:51.339305+0000","last_became_peered":"2023-01-02T18:16:51.339305+0000","last_unstale":"2023-01-02T18:17:03.583186+0000","last_undegraded":"2023-01-02T18:17:03.583186+0000","last_fullsized":"2023-01-02T18:17:03.583186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":31,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.315383+0000","last_change":"2023-01-02T18:16:57.314050+0000","last_active":"2023-01-02T18:17:04.315383+0000","last_peered":"2023-01-02T18:17:04.315383+0000","last_clean":"2023-01-02T18:17:04.315383+0000","last_became_active":"2023-01-02T18:16:55.315221+0000","last_became_peered":"2023-01-02T18:16:55.315221+0000","last_unstale":"2023-01-02T18:17:04.315383+0000","last_undegraded":"2023-01-02T18:17:04.315383+0000","last_fullsized":"2023-01-02T18:17:04.315383+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598609+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:17:03.598609+0000","last_peered":"2023-01-02T18:17:03.598609+0000","last_clean":"2023-01-02T18:17:03.598609+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:17:03.598609+0000","last_undegraded":"2023-01-02T18:17:03.598609+0000","last_fullsized":"2023-01-02T18:17:03.598609+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.304380+0000","last_change":"2023-01-02T18:16:57.317052+0000","last_active":"2023-01-02T18:17:04.304380+0000","last_peered":"2023-01-02T18:17:04.304380+0000","last_clean":"2023-01-02T18:17:04.304380+0000","last_became_active":"2023-01-02T18:16:55.310981+0000","last_became_peered":"2023-01-02T18:16:55.310981+0000","last_unstale":"2023-01-02T18:17:04.304380+0000","last_undegraded":"2023-01-02T18:17:04.304380+0000","last_fullsized":"2023-01-02T18:17:04.304380+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":36,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.614785+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:17:03.614785+0000","last_peered":"2023-01-02T18:17:03.614785+0000","last_clean":"2023-01-02T18:17:03.614785+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:17:03.614785+0000","last_undegraded":"2023-01-02T18:17:03.614785+0000","last_fullsized":"2023-01-02T18:17:03.614785+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.581908+0000","last_change":"2023-01-02T18:16:39.426086+0000","last_active":"2023-01-02T18:17:03.581908+0000","last_peered":"2023-01-02T18:17:03.581908+0000","last_clean":"2023-01-02T18:17:03.581908+0000","last_became_active":"2023-01-02T18:16:37.416142+0000","last_became_peered":"2023-01-02T18:16:37.416142+0000","last_unstale":"2023-01-02T18:17:03.581908+0000","last_undegraded":"2023-01-02T18:17:03.581908+0000","last_fullsized":"2023-01-02T18:17:03.581908+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"56'15","reported_seq":97,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.598344+0000","last_change":"2023-01-02T18:16:49.319188+0000","last_active":"2023-01-02T18:17:03.598344+0000","last_peered":"2023-01-02T18:17:03.598344+0000","last_clean":"2023-01-02T18:17:03.598344+0000","last_became_active":"2023-01-02T18:16:48.329016+0000","last_became_peered":"2023-01-02T18:16:48.329016+0000","last_unstale":"2023-01-02T18:17:03.598344+0000","last_undegraded":"2023-01-02T18:17:03.598344+0000","last_fullsized":"2023-01-02T18:17:03.598344+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":130,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.603524+0000","last_change":"2023-01-02T18:16:53.346722+0000","last_active":"2023-01-02T18:17:03.603524+0000","last_peered":"2023-01-02T18:17:03.603524+0000","last_clean":"2023-01-02T18:17:03.603524+0000","last_became_active":"2023-01-02T18:16:51.339164+0000","last_became_peered":"2023-01-02T18:16:51.339164+0000","last_unstale":"2023-01-02T18:17:03.603524+0000","last_undegraded":"2023-01-02T18:17:03.603524+0000","last_fullsized":"2023-01-02T18:17:03.603524+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-01-02T18:17:06.313775+0000","last_change":"2023-01-02T18:17:06.313775+0000","last_active":"2023-01-02T18:17:06.313775+0000","last_peered":"2023-01-02T18:17:06.313775+0000","last_clean":"2023-01-02T18:17:06.313775+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-01-02T18:17:06.313775+0000","last_undegraded":"2023-01-02T18:17:06.313775+0000","last_fullsized":"2023-01-02T18:17:06.313775+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"71'2","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.417363+0000","last_change":"2023-01-02T18:17:01.321057+0000","last_active":"2023-01-02T18:17:04.417363+0000","last_peered":"2023-01-02T18:17:04.417363+0000","last_clean":"2023-01-02T18:17:04.417363+0000","last_became_active":"2023-01-02T18:16:59.310738+0000","last_became_peered":"2023-01-02T18:16:59.310738+0000","last_unstale":"2023-01-02T18:17:04.417363+0000","last_undegraded":"2023-01-02T18:17:04.417363+0000","last_fullsized":"2023-01-02T18:17:04.417363+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"7.1e","version":"64'1","reported_seq":23,"reported_epoch":71,"state":"active+clean","last_fresh":"2023-01-02T18:17:04.303266+0000","last_change":"2023-01-02T18:16:57.317294+0000","last_active":"2023-01-02T18:17:04.303266+0000","last_peered":"2023-01-02T18:17:04.303266+0000","last_clean":"2023-01-02T18:17:04.303266+0000","last_became_active":"2023-01-02T18:16:55.316682+0000","last_became_peered":"2023-01-02T18:16:55.316682+0000","last_unstale":"2023-01-02T18:17:04.303266+0000","last_undegraded":"2023-01-02T18:17:04.303266+0000","last_fullsized":"2023-01-02T18:17:04.303266+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":47,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586014+0000","last_change":"2023-01-02T18:16:44.308144+0000","last_active":"2023-01-02T18:17:03.586014+0000","last_peered":"2023-01-02T18:17:03.586014+0000","last_clean":"2023-01-02T18:17:03.586014+0000","last_became_active":"2023-01-02T18:16:41.446839+0000","last_became_peered":"2023-01-02T18:16:41.446839+0000","last_unstale":"2023-01-02T18:17:03.586014+0000","last_undegraded":"2023-01-02T18:17:03.586014+0000","last_fullsized":"2023-01-02T18:17:03.586014+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"46'3","reported_seq":65,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.580897+0000","last_change":"2023-01-02T18:16:48.334513+0000","last_active":"2023-01-02T18:17:03.580897+0000","last_peered":"2023-01-02T18:17:03.580897+0000","last_clean":"2023-01-02T18:17:03.580897+0000","last_became_active":"2023-01-02T18:16:48.329379+0000","last_became_peered":"2023-01-02T18:16:48.329379+0000","last_unstale":"2023-01-02T18:17:03.580897+0000","last_undegraded":"2023-01-02T18:17:03.580897+0000","last_fullsized":"2023-01-02T18:17:03.580897+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.587484+0000","last_change":"2023-01-02T18:16:49.310230+0000","last_active":"2023-01-02T18:17:03.587484+0000","last_peered":"2023-01-02T18:17:03.587484+0000","last_clean":"2023-01-02T18:17:03.587484+0000","last_became_active":"2023-01-02T18:16:48.324944+0000","last_became_peered":"2023-01-02T18:16:48.324944+0000","last_unstale":"2023-01-02T18:17:03.587484+0000","last_undegraded":"2023-01-02T18:17:03.587484+0000","last_fullsized":"2023-01-02T18:17:03.587484+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":26,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-01-02T18:17:03.586518+0000","last_change":"2023-01-02T18:16:53.345118+0000","last_active":"2023-01-02T18:17:03.586518+0000","last_peered":"2023-01-02T18:17:03.586518+0000","last_clean":"2023-01-02T18:17:03.586518+0000","last_became_active":"2023-01-02T18:16:51.341889+0000","last_became_peered":"2023-01-02T18:16:51.341889+0000","last_unstale":"2023-01-02T18:17:03.586518+0000","last_undegraded":"2023-01-02T18:17:03.586518+0000","last_fullsized":"2023-01-02T18:17:03.586518+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":430,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":2297,"num_read_kb":2044,"num_write":138,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":167,"ondisk_log_size":167,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":1365,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":753,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":831,"num_read_kb":661,"num_write":96,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":422,"num_keys_recovered":94,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":1848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":104,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":70,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":109,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":1365,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6776,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":94365064,"statfs":{"total":96636764160,"available":96629825536,"internally_reserved":0,"allocated":901120,"data_stored":388255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.61199999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.55500000000000005}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.58599999999999997}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.34000000000000002}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.39100000000000001}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.47099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6936,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":6016,"kb_avail":94364904,"statfs":{"total":96636764160,"available":96629661696,"internally_reserved":0,"allocated":933888,"data_stored":404871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6160384},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.437},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.61299999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.55800000000000005}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.52800000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.33200000000000002}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.498},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.39500000000000002}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.378},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6864,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5952,"kb_avail":94364976,"statfs":{"total":96636764160,"available":96629735424,"internally_reserved":0,"allocated":925696,"data_stored":404765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6094848},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.28799999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.35699999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.498},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56399999999999995}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.55100000000000005}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.57899999999999996}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.64900000000000002}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.72599999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6788,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":94365052,"statfs":{"total":96636764160,"available":96629813248,"internally_reserved":0,"allocated":913408,"data_stored":396548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.29099999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.24099999999999999}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.373}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.68700000000000006}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.73299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6616,"kb_used_data":848,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":94365224,"statfs":{"total":96636764160,"available":96629989376,"internally_reserved":0,"allocated":868352,"data_stored":396218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.26500000000000001}]},{"osd":1,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.318}]},{"osd":3,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.54700000000000004}]},{"osd":7,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.49199999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6936,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":6016,"kb_avail":94364904,"statfs":{"total":96636764160,"available":96629661696,"internally_reserved":0,"allocated":933888,"data_stored":404891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6160384},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.32700000000000001}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.312}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.443}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.48999999999999999}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.64900000000000002}]}]},{"osd":4,"up_from":0,"seq":55834574868,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":0,"seq":55834574867,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":83,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:17:07.407 INFO:tasks.thrashosds.thrasher:Setting 5.6 to [4, 6, 0, 5] 2023-01-02T18:17:07.407 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '5.6', '4', '6', '0', '5'] 2023-01-02T18:17:07.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 5.6 4 6 0 5 2023-01-02T18:17:07.465 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:07.465 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:17:07.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:17:07.466 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:17:07.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.466 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1 3.1a 3:5bdd5772:::image1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:17:07.466 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:07.466 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.050796885, 2023-01-02T18:17:07.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839, 2023-01-02T18:17:07.467 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.467 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:17:07.467 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:07.467 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1 2023-01-02T18:17:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:07.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413949+0000", 2023-01-02T18:17:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8359999999999999e-06 2023-01-02T18:17:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413954+0000", 2023-01-02T18:17:07.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2023-01-02T18:17:07.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413961+0000", 2023-01-02T18:17:07.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7519999999999999e-06 2023-01-02T18:17:07.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413968+0000", 2023-01-02T18:17:07.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0071999999999999e-05 2023-01-02T18:17:07.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414008+0000", 2023-01-02T18:17:07.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1890000000000001e-06 2023-01-02T18:17:07.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:17:07.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414015+0000", 2023-01-02T18:17:07.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013744829999999999 2023-01-02T18:17:07.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415389+0000", 2023-01-02T18:17:07.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1655000000000003e-05 2023-01-02T18:17:07.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415471+0000", 2023-01-02T18:17:07.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839 2023-01-02T18:17:07.478 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.478 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.478 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.478 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:17:07.479 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:07.479 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.049847098000001, 2023-01-02T18:17:07.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:17:07.479 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.479 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.480 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:07.480 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:07.480 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:07.480 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:17:07.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.481 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:07.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:07.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:07.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:17:07.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:17:07.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:17:07.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:17:07.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:17:07.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:17:07.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:17:07.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:17:07.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:17:07.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:17:07.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:07.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:17:07.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:17:07.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:17:07.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:17:07.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:17:07.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:17:07.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:17:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:17:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:07.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:17:07.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:17:07.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:07.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:17:07.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:17:07.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:17:07.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:17:07.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:17:07.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:17:07.495 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.495 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.495 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.496 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:07.496 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:07.496 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.044178836, 2023-01-02T18:17:07.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:17:07.496 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.497 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.497 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:07.497 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:07.497 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:07.497 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:17:07.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.498 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:07.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:07.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:07.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:17:07.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:17:07.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:17:07.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:17:07.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:17:07.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:17:07.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:17:07.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:17:07.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:17:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:17:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:07.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:17:07.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:17:07.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:17:07.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:17:07.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:17:07.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:17:07.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:07.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:17:07.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:17:07.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:07.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:17:07.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:17:07.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:07.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:17:07.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:17:07.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:17:07.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:17:07.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:17:07.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:17:07.511 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.511 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.512 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:07.512 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:07.512 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.038645173999999, 2023-01-02T18:17:07.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:17:07.513 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.513 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.513 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:07.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:07.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:07.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:17:07.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:17:07.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:17:07.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:17:07.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:17:07.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:17:07.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:17:07.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:17:07.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:17:07.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:17:07.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:17:07.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:17:07.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:17:07.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:17:07.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:17:07.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:17:07.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.523 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.524 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:11 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:07.524 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:07.524 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.030942174, 2023-01-02T18:17:07.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152, 2023-01-02T18:17:07.524 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.524 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.525 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:07.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:07.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:07.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:07.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:17:07.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433810+0000", 2023-01-02T18:17:07.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1821000000000001e-05 2023-01-02T18:17:07.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433822+0000", 2023-01-02T18:17:07.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4549999999999998e-06 2023-01-02T18:17:07.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433829+0000", 2023-01-02T18:17:07.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6005000000000003e-05 2023-01-02T18:17:07.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433885+0000", 2023-01-02T18:17:07.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.16e-05 2023-01-02T18:17:07.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433907+0000", 2023-01-02T18:17:07.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011094480000000001 2023-01-02T18:17:07.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435016+0000", 2023-01-02T18:17:07.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8626999999999999e-05 2023-01-02T18:17:07.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435045+0000", 2023-01-02T18:17:07.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152 2023-01-02T18:17:07.534 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.534 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.534 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.535 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:24 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:07.535 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:07.535 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.015313670000001, 2023-01-02T18:17:07.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997, 2023-01-02T18:17:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449431+0000", 2023-01-02T18:17:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7706e-05 2023-01-02T18:17:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449449+0000", 2023-01-02T18:17:07.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0883999999999998e-05 2023-01-02T18:17:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449480+0000", 2023-01-02T18:17:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4416000000000001e-05 2023-01-02T18:17:07.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449494+0000", 2023-01-02T18:17:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6549000000000001e-05 2023-01-02T18:17:07.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449581+0000", 2023-01-02T18:17:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9669000000000003e-05 2023-01-02T18:17:07.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449620+0000", 2023-01-02T18:17:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0006958 2023-01-02T18:17:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450316+0000", 2023-01-02T18:17:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0188e-05 2023-01-02T18:17:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450346+0000", 2023-01-02T18:17:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997 2023-01-02T18:17:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:30 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.007911163999999, 2023-01-02T18:17:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003, 2023-01-02T18:17:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456835+0000", 2023-01-02T18:17:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7504999999999999e-05 2023-01-02T18:17:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456852+0000", 2023-01-02T18:17:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2356e-05 2023-01-02T18:17:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456865+0000", 2023-01-02T18:17:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.421e-06 2023-01-02T18:17:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456871+0000", 2023-01-02T18:17:07.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8040999999999997e-05 2023-01-02T18:17:07.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456909+0000", 2023-01-02T18:17:07.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5384e-05 2023-01-02T18:17:07.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456925+0000", 2023-01-02T18:17:07.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074633700000000002 2023-01-02T18:17:07.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457671+0000", 2023-01-02T18:17:07.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7826000000000001e-05 2023-01-02T18:17:07.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457699+0000", 2023-01-02T18:17:07.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003 2023-01-02T18:17:07.556 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.557 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.557 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.557 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:31 3.1c e46/43 3:3d3f3250:::rbd_id.image2:head v 46'3, mlcod=46'1)", 2023-01-02T18:17:07.558 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:07.558 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.006282680999998, 2023-01-02T18:17:07.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999, 2023-01-02T18:17:07.558 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.558 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.559 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:07.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:07.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458463+0000", 2023-01-02T18:17:07.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3389999999999998e-06 2023-01-02T18:17:07.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458470+0000", 2023-01-02T18:17:07.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.205e-05 2023-01-02T18:17:07.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458482+0000", 2023-01-02T18:17:07.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5809999999999996e-06 2023-01-02T18:17:07.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458487+0000", 2023-01-02T18:17:07.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8702000000000001e-05 2023-01-02T18:17:07.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458546+0000", 2023-01-02T18:17:07.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2495e-05 2023-01-02T18:17:07.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458559+0000", 2023-01-02T18:17:07.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001846735 2023-01-02T18:17:07.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460405+0000", 2023-01-02T18:17:07.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9183000000000002e-05 2023-01-02T18:17:07.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460435+0000", 2023-01-02T18:17:07.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999 2023-01-02T18:17:07.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.568 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.568 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.569 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:32 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:07.569 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:07.569 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.002932972, 2023-01-02T18:17:07.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997, 2023-01-02T18:17:07.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.570 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.570 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:07.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:07.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:07.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:07.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3030000000000001e-06 2023-01-02T18:17:07.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461818+0000", 2023-01-02T18:17:07.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0964999999999999e-05 2023-01-02T18:17:07.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461829+0000", 2023-01-02T18:17:07.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8039999999999998e-06 2023-01-02T18:17:07.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461835+0000", 2023-01-02T18:17:07.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8708999999999997e-05 2023-01-02T18:17:07.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461884+0000", 2023-01-02T18:17:07.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5057e-05 2023-01-02T18:17:07.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461899+0000", 2023-01-02T18:17:07.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061687999999999999 2023-01-02T18:17:07.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462515+0000", 2023-01-02T18:17:07.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1633e-05 2023-01-02T18:17:07.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462547+0000", 2023-01-02T18:17:07.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997 2023-01-02T18:17:07.579 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.579 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.580 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:33 3.3 3:c76fae31:::rbd_object_map.12a21ad382ee:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:07.580 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:07.581 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.001890118999999, 2023-01-02T18:17:07.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001, 2023-01-02T18:17:07.581 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.581 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.581 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:07.582 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:07.582 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:07.582 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33 2023-01-02T18:17:07.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.582 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:07.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:07.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462856+0000", 2023-01-02T18:17:07.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4710000000000004e-06 2023-01-02T18:17:07.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462862+0000", 2023-01-02T18:17:07.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:17:07.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462875+0000", 2023-01-02T18:17:07.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.491e-05 2023-01-02T18:17:07.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462890+0000", 2023-01-02T18:17:07.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9657999999999999e-05 2023-01-02T18:17:07.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462930+0000", 2023-01-02T18:17:07.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1362999999999999e-05 2023-01-02T18:17:07.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463021+0000", 2023-01-02T18:17:07.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015166800000000001 2023-01-02T18:17:07.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:17:07.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463173+0000", 2023-01-02T18:17:07.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074740899999999999 2023-01-02T18:17:07.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:07.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463920+0000", 2023-01-02T18:17:07.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045107699999999998 2023-01-02T18:17:07.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:07.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464372+0000", 2023-01-02T18:17:07.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6213e-05 2023-01-02T18:17:07.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464408+0000", 2023-01-02T18:17:07.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.535e-05 2023-01-02T18:17:07.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464433+0000", 2023-01-02T18:17:07.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001 2023-01-02T18:17:07.594 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.594 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.595 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.595 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:45 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:07.595 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:07.596 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.991180513, 2023-01-02T18:17:07.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892, 2023-01-02T18:17:07.596 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.596 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.596 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:07.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:07.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473565+0000", 2023-01-02T18:17:07.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5140000000000004e-06 2023-01-02T18:17:07.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473573+0000", 2023-01-02T18:17:07.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2473000000000001e-05 2023-01-02T18:17:07.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473585+0000", 2023-01-02T18:17:07.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2159999999999997e-06 2023-01-02T18:17:07.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473591+0000", 2023-01-02T18:17:07.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0025999999999999e-05 2023-01-02T18:17:07.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473631+0000", 2023-01-02T18:17:07.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3309000000000001e-05 2023-01-02T18:17:07.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473644+0000", 2023-01-02T18:17:07.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057332800000000001 2023-01-02T18:17:07.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474217+0000", 2023-01-02T18:17:07.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0043999999999999e-05 2023-01-02T18:17:07.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474247+0000", 2023-01-02T18:17:07.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892 2023-01-02T18:17:07.606 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.606 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.606 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.606 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:46 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'3, mlcod=46'1)", 2023-01-02T18:17:07.607 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:07.607 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.989848751, 2023-01-02T18:17:07.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997, 2023-01-02T18:17:07.607 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.607 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.608 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:07.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:07.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474897+0000", 2023-01-02T18:17:07.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8789999999999992e-06 2023-01-02T18:17:07.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474906+0000", 2023-01-02T18:17:07.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3468e-05 2023-01-02T18:17:07.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474920+0000", 2023-01-02T18:17:07.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8460000000000002e-06 2023-01-02T18:17:07.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474926+0000", 2023-01-02T18:17:07.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6996000000000003e-05 2023-01-02T18:17:07.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474963+0000", 2023-01-02T18:17:07.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2276000000000001e-05 2023-01-02T18:17:07.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474976+0000", 2023-01-02T18:17:07.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066849900000000002 2023-01-02T18:17:07.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475644+0000", 2023-01-02T18:17:07.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2233999999999997e-05 2023-01-02T18:17:07.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475676+0000", 2023-01-02T18:17:07.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997 2023-01-02T18:17:07.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.617 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.618 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:53 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:07.618 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:07.618 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.954936562, 2023-01-02T18:17:07.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082, 2023-01-02T18:17:07.619 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.619 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.619 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:07.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:07.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:07.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:07.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3499999999999996e-06 2023-01-02T18:17:07.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509815+0000", 2023-01-02T18:17:07.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0020999999999999e-05 2023-01-02T18:17:07.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509825+0000", 2023-01-02T18:17:07.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1399999999999997e-06 2023-01-02T18:17:07.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509832+0000", 2023-01-02T18:17:07.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3279999999999999e-05 2023-01-02T18:17:07.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509875+0000", 2023-01-02T18:17:07.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0288e-05 2023-01-02T18:17:07.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509895+0000", 2023-01-02T18:17:07.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000905152 2023-01-02T18:17:07.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510800+0000", 2023-01-02T18:17:07.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1238000000000001e-05 2023-01-02T18:17:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510832+0000", 2023-01-02T18:17:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082 2023-01-02T18:17:07.628 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.629 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:17:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.952946020999999, 2023-01-02T18:17:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:17:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.630 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:17:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:17:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:17:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:17:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:17:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:17:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:17:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:17:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:17:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:17:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:17:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:17:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:17:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:17:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:17:07.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:17:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.640 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:66 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.941787863999998, 2023-01-02T18:17:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997, 2023-01-02T18:17:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.641 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:07.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:07.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522958+0000", 2023-01-02T18:17:07.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6449999999999994e-06 2023-01-02T18:17:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522967+0000", 2023-01-02T18:17:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3166000000000001e-05 2023-01-02T18:17:07.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522980+0000", 2023-01-02T18:17:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:17:07.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522987+0000", 2023-01-02T18:17:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4501000000000001e-05 2023-01-02T18:17:07.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523022+0000", 2023-01-02T18:17:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5023e-05 2023-01-02T18:17:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523037+0000", 2023-01-02T18:17:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057705099999999997 2023-01-02T18:17:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523614+0000", 2023-01-02T18:17:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1579999999999999e-05 2023-01-02T18:17:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523645+0000", 2023-01-02T18:17:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997 2023-01-02T18:17:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.651 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:26 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'6, mlcod=46'4)", 2023-01-02T18:17:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:07.652 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.926423258, 2023-01-02T18:17:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005, 2023-01-02T18:17:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538323+0000", 2023-01-02T18:17:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8736000000000002e-05 2023-01-02T18:17:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538342+0000", 2023-01-02T18:17:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6739999999999992e-06 2023-01-02T18:17:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538351+0000", 2023-01-02T18:17:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6460000000000001e-06 2023-01-02T18:17:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538356+0000", 2023-01-02T18:17:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.57e-05 2023-01-02T18:17:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538402+0000", 2023-01-02T18:17:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6050999999999998e-05 2023-01-02T18:17:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538428+0000", 2023-01-02T18:17:07.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055106199999999995 2023-01-02T18:17:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538979+0000", 2023-01-02T18:17:07.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7333000000000001e-05 2023-01-02T18:17:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539006+0000", 2023-01-02T18:17:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005 2023-01-02T18:17:07.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.663 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:27 3.f e46/43 3:f63788c7:::rbd_id.image5:head v 46'6, mlcod=46'4)", 2023-01-02T18:17:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.925103187000001, 2023-01-02T18:17:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001, 2023-01-02T18:17:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.664 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:07.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:07.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539643+0000", 2023-01-02T18:17:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0418999999999999e-05 2023-01-02T18:17:07.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539663+0000", 2023-01-02T18:17:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3852999999999999e-05 2023-01-02T18:17:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539677+0000", 2023-01-02T18:17:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5100000000000004e-06 2023-01-02T18:17:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539684+0000", 2023-01-02T18:17:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9595999999999998e-05 2023-01-02T18:17:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539723+0000", 2023-01-02T18:17:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7207999999999999e-05 2023-01-02T18:17:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539741+0000", 2023-01-02T18:17:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063475200000000004 2023-01-02T18:17:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540375+0000", 2023-01-02T18:17:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5425e-05 2023-01-02T18:17:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540411+0000", 2023-01-02T18:17:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001 2023-01-02T18:17:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.674 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:17:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.030990358, 2023-01-02T18:17:07.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:17:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:07.676 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:17:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:17:07.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:17:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:17:07.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:17:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:17:07.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:17:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:17:07.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:17:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:17:07.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:17:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:17:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:17:07.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:17:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:17:07.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:17:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:17:07.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:17:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:17:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:17:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:17:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:17:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:17:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:17:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:17:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:17:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:17:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:17:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.166209299999998, 2023-01-02T18:17:07.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:17:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:07.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:17:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:17:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:17:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:17:07.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:17:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:17:07.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:17:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:17:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:17:07.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:17:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:17:07.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:17:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:17:07.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:17:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:17:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:17:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:17:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:17:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:17:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:17:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:17:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:17:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:17:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:17:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:17:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:17:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:17:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.708 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:272 4.9 4:911e4614:::rbd_id.image18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:17:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:07.709 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.15458078, 2023-01-02T18:17:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999, 2023-01-02T18:17:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:07.710 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 272 2023-01-02T18:17:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:07.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310165+0000", 2023-01-02T18:17:07.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.628e-06 2023-01-02T18:17:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310174+0000", 2023-01-02T18:17:07.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2023-01-02T18:17:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310190+0000", 2023-01-02T18:17:07.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:17:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310198+0000", 2023-01-02T18:17:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6770000000000001e-05 2023-01-02T18:17:07.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310245+0000", 2023-01-02T18:17:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159517 2023-01-02T18:17:07.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310404+0000", 2023-01-02T18:17:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023075600000000001 2023-01-02T18:17:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310635+0000", 2023-01-02T18:17:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088889700000000004 2023-01-02T18:17:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311524+0000", 2023-01-02T18:17:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011021 2023-01-02T18:17:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311634+0000", 2023-01-02T18:17:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2626000000000002e-05 2023-01-02T18:17:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311667+0000", 2023-01-02T18:17:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9774000000000002e-05 2023-01-02T18:17:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:07.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311706+0000", 2023-01-02T18:17:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999 2023-01-02T18:17:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:07.724 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:07.724 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:07.725 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:07.478+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:07.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:07.727 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:07.726+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:07.727 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:07.728 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:07.728 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:07.728 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:07.728 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:07.728 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:07.729 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:07.729 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:07.730 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:07.730 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:07.730 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:07.730 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:07.730 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:07.731 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:07.731 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:07.731 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:07.826 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:07.827+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:07.893 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:07.894 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:07.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:07.927 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:07.927+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:08.028 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:08.029+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:08.068 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:08.069 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:08.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:08.162 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:08.163+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:08.230 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:08.230+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:08.243 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:08.243 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:08.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:08.330 INFO:teuthology.orchestra.run.smithi007.stderr:set 5.6 pg_upmap_items mapping to [4->6,0->5] 2023-01-02T18:17:08.336 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:08.337+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:08.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:17:08.419 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:08.419 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:08.429 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:08.470 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:08.471+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:08.532 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:08.533+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:08.596 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:08.596 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:08.608 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:08.634 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:08.634+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:08.735 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:08.735+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:08.772 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:08.773 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:08.782 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:08.835 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:08.835+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:08.936 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:08.936+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:08.948 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:08.949 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:08.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:09.037 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:09.037+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:09.084 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:09.085 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:09.094 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:09.138 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:09.138+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:09.238 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:09.238+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:09.260 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:09.260 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:09.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:09.321 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:17:09.339 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:09.339+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:09.433 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:09.434 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:09.440 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:09.440+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:09.444 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:09.541 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:09.541+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:09.621 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:09.621 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:09.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:09.635 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 1 2023-01-02T18:17:09.635 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:17:09.635 INFO:tasks.workunit.client.0.smithi007.stdout:image: image34 2023-01-02T18:17:09.635 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image34 2023-01-02T18:17:09.667 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 2 2023-01-02T18:17:09.667 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:17:09.667 INFO:tasks.workunit.client.0.smithi007.stdout:image: image34 2023-01-02T18:17:09.667 INFO:tasks.workunit.client.0.smithi007.stdout:image: image35 2023-01-02T18:17:09.668 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image34 2023-01-02T18:17:09.668 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image35 2023-01-02T18:17:09.668 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:09.667+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:09.719 INFO:tasks.workunit.client.0.smithi007.stdout:100.00% done 2023-01-02T18:17:09.719 INFO:tasks.workunit.client.0.smithi007.stdout:num images is: 3 2023-01-02T18:17:09.719 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 3 2023-01-02T18:17:09.719 INFO:tasks.workunit.client.0.smithi007.stdout:image: image34 2023-01-02T18:17:09.719 INFO:tasks.workunit.client.0.smithi007.stdout:image: image35 2023-01-02T18:17:09.720 INFO:tasks.workunit.client.0.smithi007.stdout:image: image36 2023-01-02T18:17:09.720 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image34 2023-01-02T18:17:09.720 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image35 2023-01-02T18:17:09.720 INFO:tasks.workunit.client.0.smithi007.stdout:expected = image36 2023-01-02T18:17:09.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:09.742 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:09.742+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:09.752 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestDeepCopyPP (4352 ms) 2023-01-02T18:17:09.752 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnap 2023-01-02T18:17:09.752 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:09.771 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:09.771 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:09.783 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:09.868 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:09.868+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:09.893 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:09.910 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:09.928 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:09.943 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:09.944+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:09.945 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:09.961 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:09.961 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:09.961 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:09.964 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:09.971 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:09.981 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:10.001 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:10.020 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:10.021 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:10.022 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:10.023 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:10.073 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:10.073+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:10.109 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:10.109 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:10.110 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:10.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:10.145 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:10.146+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:10.246 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:10.245+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:10.286 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:10.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:6 3.1a e45/43 3:5cea7035:::rbd_info:head v 45'1, mlcod=0'0)", 2023-01-02T18:17:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:10.287 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.868278793999998, 2023-01-02T18:17:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998, 2023-01-02T18:17:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3349999999999997e-06 2023-01-02T18:17:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417398+0000", 2023-01-02T18:17:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7995999999999998e-05 2023-01-02T18:17:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417416+0000", 2023-01-02T18:17:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2250000000000003e-06 2023-01-02T18:17:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417423+0000", 2023-01-02T18:17:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6785e-05 2023-01-02T18:17:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417470+0000", 2023-01-02T18:17:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2886000000000001e-05 2023-01-02T18:17:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417492+0000", 2023-01-02T18:17:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070370800000000005 2023-01-02T18:17:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418196+0000", 2023-01-02T18:17:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1628999999999998e-05 2023-01-02T18:17:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418228+0000", 2023-01-02T18:17:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998 2023-01-02T18:17:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.298 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:10.299 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.861704223, 2023-01-02T18:17:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.300 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:10.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:10.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:10.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:10.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:10.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:10.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:10.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:10.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:10.310 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:10.311 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.802504514999999, 2023-01-02T18:17:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.313 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:10.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:10.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:10.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:10.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.326 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3d3f3250:::rbd_id.image2:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d3f3250:::rbd_id.image2:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:17:10.327 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.838278750000001, 2023-01-02T18:17:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004, 2023-01-02T18:17:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:10.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447391+0000", 2023-01-02T18:17:10.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8275e-05 2023-01-02T18:17:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447410+0000", 2023-01-02T18:17:10.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3377999999999999e-05 2023-01-02T18:17:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447433+0000", 2023-01-02T18:17:10.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6303e-05 2023-01-02T18:17:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447449+0000", 2023-01-02T18:17:10.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000438212 2023-01-02T18:17:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447888+0000", 2023-01-02T18:17:10.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.169e-05 2023-01-02T18:17:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447899+0000", 2023-01-02T18:17:10.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035861500000000001 2023-01-02T18:17:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448258+0000", 2023-01-02T18:17:10.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004 2023-01-02T18:17:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.338 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.957143674000001, 2023-01-02T18:17:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:10.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:10.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:10.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:10.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:10.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:10.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:10.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:10.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.349 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:17:10.350 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.944707871999999, 2023-01-02T18:17:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:17:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.351 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:10.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:17:10.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:17:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:17:10.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:17:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:17:10.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:17:10.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:17:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:17:10.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:17:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:17:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:17:10.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:17:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:17:10.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:17:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:17:10.361 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.362 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.910035134000001, 2023-01-02T18:17:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.363 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:10.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:10.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:10.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:10.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:10.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:10.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:10.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:10.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:10.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.373 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:10.374 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.899758115000001, 2023-01-02T18:17:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.375 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:556 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'20, mlcod=60'18)", 2023-01-02T18:17:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.439869+0000", 2023-01-02T18:17:10.386 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.845801810000001, 2023-01-02T18:17:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078681900000000002, 2023-01-02T18:17:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439869+0000", 2023-01-02T18:17:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439869+0000", 2023-01-02T18:17:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439868+0000", 2023-01-02T18:17:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0736e-05 2023-01-02T18:17:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439879+0000", 2023-01-02T18:17:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8017e-05 2023-01-02T18:17:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439897+0000", 2023-01-02T18:17:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7259999999999996e-06 2023-01-02T18:17:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439904+0000", 2023-01-02T18:17:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5453e-05 2023-01-02T18:17:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439949+0000", 2023-01-02T18:17:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4899999999999999e-05 2023-01-02T18:17:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.439974+0000", 2023-01-02T18:17:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064138400000000005 2023-01-02T18:17:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440616+0000", 2023-01-02T18:17:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0667999999999998e-05 2023-01-02T18:17:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.440656+0000", 2023-01-02T18:17:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078681900000000002 2023-01-02T18:17:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.397 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:572 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'22, mlcod=60'20)", 2023-01-02T18:17:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:17:10.398 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.835865872999999, 2023-01-02T18:17:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078864600000000005, 2023-01-02T18:17:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:17:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:17:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449804+0000", 2023-01-02T18:17:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.401e-05 2023-01-02T18:17:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449818+0000", 2023-01-02T18:17:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0809999999999999e-05 2023-01-02T18:17:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449838+0000", 2023-01-02T18:17:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5199999999999997e-06 2023-01-02T18:17:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449847+0000", 2023-01-02T18:17:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9821999999999996e-05 2023-01-02T18:17:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449927+0000", 2023-01-02T18:17:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7619000000000001e-05 2023-01-02T18:17:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449954+0000", 2023-01-02T18:17:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060264800000000001 2023-01-02T18:17:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450557+0000", 2023-01-02T18:17:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7101000000000003e-05 2023-01-02T18:17:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450594+0000", 2023-01-02T18:17:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078864600000000005 2023-01-02T18:17:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:580 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'23, mlcod=60'21)", 2023-01-02T18:17:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.454705+0000", 2023-01-02T18:17:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.830966183000001, 2023-01-02T18:17:10.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000778679, 2023-01-02T18:17:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454705+0000", 2023-01-02T18:17:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454705+0000", 2023-01-02T18:17:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454704+0000", 2023-01-02T18:17:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1161e-05 2023-01-02T18:17:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454715+0000", 2023-01-02T18:17:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7254000000000001e-05 2023-01-02T18:17:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454732+0000", 2023-01-02T18:17:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9e-06 2023-01-02T18:17:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454739+0000", 2023-01-02T18:17:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6258000000000003e-05 2023-01-02T18:17:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454785+0000", 2023-01-02T18:17:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:17:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.454811+0000", 2023-01-02T18:17:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063813100000000001 2023-01-02T18:17:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.455449+0000", 2023-01-02T18:17:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4975000000000003e-05 2023-01-02T18:17:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.455484+0000", 2023-01-02T18:17:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000778679 2023-01-02T18:17:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.421 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:629 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'30, mlcod=60'28)", 2023-01-02T18:17:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:17:10.422 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.803926889, 2023-01-02T18:17:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083191500000000002, 2023-01-02T18:17:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:17:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:17:10.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:10.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481743+0000", 2023-01-02T18:17:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4339999999999992e-06 2023-01-02T18:17:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481752+0000", 2023-01-02T18:17:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4435e-05 2023-01-02T18:17:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481766+0000", 2023-01-02T18:17:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0129999999999996e-06 2023-01-02T18:17:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481773+0000", 2023-01-02T18:17:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8954000000000004e-05 2023-01-02T18:17:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481842+0000", 2023-01-02T18:17:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5635000000000001e-05 2023-01-02T18:17:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481868+0000", 2023-01-02T18:17:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067504900000000005 2023-01-02T18:17:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482543+0000", 2023-01-02T18:17:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3379e-05 2023-01-02T18:17:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482576+0000", 2023-01-02T18:17:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083191500000000002 2023-01-02T18:17:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:369 7.1c e64/61 7:3831950c:::rbd_directory:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.972068728, 2023-01-02T18:17:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004, 2023-01-02T18:17:10.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:10.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313602+0000", 2023-01-02T18:17:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2730000000000002e-06 2023-01-02T18:17:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313607+0000", 2023-01-02T18:17:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1277999999999999e-05 2023-01-02T18:17:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313619+0000", 2023-01-02T18:17:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4730000000000003e-06 2023-01-02T18:17:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313626+0000", 2023-01-02T18:17:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8665999999999998e-05 2023-01-02T18:17:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313675+0000", 2023-01-02T18:17:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8902e-05 2023-01-02T18:17:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313694+0000", 2023-01-02T18:17:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079486599999999998 2023-01-02T18:17:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314489+0000", 2023-01-02T18:17:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7184999999999997e-05 2023-01-02T18:17:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314526+0000", 2023-01-02T18:17:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004 2023-01-02T18:17:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.591409695999999, 2023-01-02T18:17:10.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:10.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2084 8.3 e69/65 8:c28f5e81:::rbd_object_map.12a230fb06bc.0000000000000004:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.7009358710000004, 2023-01-02T18:17:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003, 2023-01-02T18:17:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9859999999999997e-06 2023-01-02T18:17:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584742+0000", 2023-01-02T18:17:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4059999999999999e-05 2023-01-02T18:17:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584756+0000", 2023-01-02T18:17:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1331999999999999e-05 2023-01-02T18:17:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584767+0000", 2023-01-02T18:17:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2049000000000002e-05 2023-01-02T18:17:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584829+0000", 2023-01-02T18:17:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5982e-05 2023-01-02T18:17:10.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584845+0000", 2023-01-02T18:17:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080091699999999995 2023-01-02T18:17:10.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585646+0000", 2023-01-02T18:17:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8123000000000002e-05 2023-01-02T18:17:10.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585674+0000", 2023-01-02T18:17:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003 2023-01-02T18:17:10.473 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.474 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.6560948059999996, 2023-01-02T18:17:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:10.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:10.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:10.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:10.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:10.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:10.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:10.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:10.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:10.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:10.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:10.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:10.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:10.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.490 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2160 8.0 e69/65 8:0415d193:::rbd_header.12a27aa439c7:head v 69'4, mlcod=69'2)", 2023-01-02T18:17:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.635247+0000", 2023-01-02T18:17:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.6504242800000002, 2023-01-02T18:17:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078162000000000001, 2023-01-02T18:17:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.491 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635247+0000", 2023-01-02T18:17:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635247+0000", 2023-01-02T18:17:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635246+0000", 2023-01-02T18:17:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1000000000000004e-06 2023-01-02T18:17:10.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635254+0000", 2023-01-02T18:17:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3658e-05 2023-01-02T18:17:10.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635268+0000", 2023-01-02T18:17:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7150000000000001e-06 2023-01-02T18:17:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635274+0000", 2023-01-02T18:17:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0018e-05 2023-01-02T18:17:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635334+0000", 2023-01-02T18:17:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2140000000000001e-05 2023-01-02T18:17:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635347+0000", 2023-01-02T18:17:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065700700000000003 2023-01-02T18:17:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636004+0000", 2023-01-02T18:17:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4956e-05 2023-01-02T18:17:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636029+0000", 2023-01-02T18:17:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078162000000000001 2023-01-02T18:17:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.501 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2484 8.15 e72/65 8:af65fa5d:::rbd_header.12a2b157d0cc:head v 72'16, mlcod=71'14)", 2023-01-02T18:17:10.502 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.9580761430000004, 2023-01-02T18:17:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086154600000000003, 2023-01-02T18:17:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2400000000000004e-06 2023-01-02T18:17:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327601+0000", 2023-01-02T18:17:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3924e-05 2023-01-02T18:17:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327625+0000", 2023-01-02T18:17:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3620000000000002e-06 2023-01-02T18:17:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327631+0000", 2023-01-02T18:17:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5776999999999998e-05 2023-01-02T18:17:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327687+0000", 2023-01-02T18:17:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5990999999999999e-05 2023-01-02T18:17:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327713+0000", 2023-01-02T18:17:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070477300000000001 2023-01-02T18:17:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.328418+0000", 2023-01-02T18:17:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8707000000000001e-05 2023-01-02T18:17:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.328457+0000", 2023-01-02T18:17:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086154600000000003 2023-01-02T18:17:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.513 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2487 8.b e72/65 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head v 72'1, mlcod=0'0)", 2023-01-02T18:17:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:10.514 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.9521531689999998, 2023-01-02T18:17:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001, 2023-01-02T18:17:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.515 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:10.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4989999999999999e-06 2023-01-02T18:17:10.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333524+0000", 2023-01-02T18:17:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5179999999999993e-06 2023-01-02T18:17:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333534+0000", 2023-01-02T18:17:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9309999999999996e-06 2023-01-02T18:17:10.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333540+0000", 2023-01-02T18:17:10.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4733e-05 2023-01-02T18:17:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333584+0000", 2023-01-02T18:17:10.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3536e-05 2023-01-02T18:17:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333608+0000", 2023-01-02T18:17:10.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076285800000000005 2023-01-02T18:17:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334371+0000", 2023-01-02T18:17:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4526000000000001e-05 2023-01-02T18:17:10.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334405+0000", 2023-01-02T18:17:10.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001 2023-01-02T18:17:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.526 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2494 8.15 e72/65 8:af65fa5d:::rbd_header.12a2b157d0cc:head v 72'17, mlcod=71'15)", 2023-01-02T18:17:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.9457668850000003, 2023-01-02T18:17:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997, 2023-01-02T18:17:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:10.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:10.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:10.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.456e-06 2023-01-02T18:17:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339912+0000", 2023-01-02T18:17:10.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0529e-05 2023-01-02T18:17:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339922+0000", 2023-01-02T18:17:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4649999999999996e-06 2023-01-02T18:17:10.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339927+0000", 2023-01-02T18:17:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8563999999999999e-05 2023-01-02T18:17:10.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339966+0000", 2023-01-02T18:17:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7017e-05 2023-01-02T18:17:10.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339983+0000", 2023-01-02T18:17:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077748699999999999 2023-01-02T18:17:10.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340760+0000", 2023-01-02T18:17:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2043999999999999e-05 2023-01-02T18:17:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:10.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340802+0000", 2023-01-02T18:17:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997 2023-01-02T18:17:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.537 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:10.538 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:10.538 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:10.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:10.540 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:10.539+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:10.641 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:10.641+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:10.712 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:10.713 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:10.713 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:10.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:10.764 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:10.764+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:10.843 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:10.843+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:10.887 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:10.888 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:10.888 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:10.897 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:10.944 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:10.945+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:11.045 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:11.045+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:11.064 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:11.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.579957220000001, 2023-01-02T18:17:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:11.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:11.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:11.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:11.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:11.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:11.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:11.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:11.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:11.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:11.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:11.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:11.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:11.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:11.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:11.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:11.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:11.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:11.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:11.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:11.076 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.076 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.076 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.077 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:11.077 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:11.077 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.715890689999998, 2023-01-02T18:17:11.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:11.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.077 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.078 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:11.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:11.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:11.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:11.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:11.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:11.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:11.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:11.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:11.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:11.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:11.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:11.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:11.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:11.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:11.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:11.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:11.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:11.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:11.088 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.088 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.088 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.089 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:11.089 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:11.089 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.714211077000002, 2023-01-02T18:17:11.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:11.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.090 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:11.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:11.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:11.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:11.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:11.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:11.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:11.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:11.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:11.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:11.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:11.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:11.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:11.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:11.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:11.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:11.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:11.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:11.099 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.100 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.100 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:11.101 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:11.101 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.747383192999999, 2023-01-02T18:17:11.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:11.101 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.102 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:11.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:11.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:11.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:11.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:11.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:11.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:11.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:11.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:11.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:11.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:11.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:11.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:11.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:11.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:11.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:11.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:11.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:11.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:11.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.111 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.112 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:11.112 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:11.112 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.417245649, 2023-01-02T18:17:11.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:11.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.113 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.113 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:11.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:11.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:11.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:11.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:11.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:11.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:11.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:11.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:11.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:11.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:11.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:11.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:11.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:11.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:11.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:11.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:11.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:11.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:11.123 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.123 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.123 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.123 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:981 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'4, mlcod=64'2)", 2023-01-02T18:17:11.124 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:11.124 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.404905952, 2023-01-02T18:17:11.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003, 2023-01-02T18:17:11.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.124 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.125 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:11.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:11.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658715+0000", 2023-01-02T18:17:11.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2509999999999997e-06 2023-01-02T18:17:11.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658723+0000", 2023-01-02T18:17:11.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6970000000000005e-06 2023-01-02T18:17:11.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658732+0000", 2023-01-02T18:17:11.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3159999999999998e-06 2023-01-02T18:17:11.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658737+0000", 2023-01-02T18:17:11.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2293000000000003e-05 2023-01-02T18:17:11.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658779+0000", 2023-01-02T18:17:11.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2996000000000001e-05 2023-01-02T18:17:11.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658802+0000", 2023-01-02T18:17:11.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066023399999999999 2023-01-02T18:17:11.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659462+0000", 2023-01-02T18:17:11.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4413000000000002e-05 2023-01-02T18:17:11.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659487+0000", 2023-01-02T18:17:11.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003 2023-01-02T18:17:11.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.134 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.135 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:11.135 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:11.135 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.7398929459999994, 2023-01-02T18:17:11.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:11.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.136 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:11.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:11.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:11.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:11.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:11.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:11.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:11.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:11.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:11.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:11.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:11.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.146 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:11.146 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:11.146 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.7380998610000002, 2023-01-02T18:17:11.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:11.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.147 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:11.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:11.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:11.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:11.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:11.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:11.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:11.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:11.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:11.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:11.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:11.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:11.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:11.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:11.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:11.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:11.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:11.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:11.156 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.157 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.157 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:11.157 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:11.158 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.7272620770000007, 2023-01-02T18:17:11.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:11.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.158 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:11.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:11.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:11.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:11.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:11.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:11.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:11.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:11.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:11.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:11.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:11.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:11.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:11.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:11.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:11.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:11.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:11.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:11.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:11.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.167 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.168 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1511 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'37, mlcod=68'35)", 2023-01-02T18:17:11.168 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:11.168 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6050658050000006, 2023-01-02T18:17:11.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005, 2023-01-02T18:17:11.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.169 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:11.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:11.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458554+0000", 2023-01-02T18:17:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4627000000000001e-05 2023-01-02T18:17:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458569+0000", 2023-01-02T18:17:11.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6376e-05 2023-01-02T18:17:11.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458595+0000", 2023-01-02T18:17:11.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2846e-05 2023-01-02T18:17:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458608+0000", 2023-01-02T18:17:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0798999999999997e-05 2023-01-02T18:17:11.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458689+0000", 2023-01-02T18:17:11.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1622999999999998e-05 2023-01-02T18:17:11.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458731+0000", 2023-01-02T18:17:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050369499999999997 2023-01-02T18:17:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459234+0000", 2023-01-02T18:17:11.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6656999999999998e-05 2023-01-02T18:17:11.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459271+0000", 2023-01-02T18:17:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005 2023-01-02T18:17:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.178 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.179 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1618 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'52, mlcod=68'50)", 2023-01-02T18:17:11.179 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:11.179 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.5588853829999998, 2023-01-02T18:17:11.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068253599999999997, 2023-01-02T18:17:11.180 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.180 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.180 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:11.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504736+0000", 2023-01-02T18:17:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3439999999999997e-06 2023-01-02T18:17:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504742+0000", 2023-01-02T18:17:11.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0339999999999999e-05 2023-01-02T18:17:11.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504753+0000", 2023-01-02T18:17:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000002e-06 2023-01-02T18:17:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504759+0000", 2023-01-02T18:17:11.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8566999999999998e-05 2023-01-02T18:17:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504808+0000", 2023-01-02T18:17:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3618e-05 2023-01-02T18:17:11.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504831+0000", 2023-01-02T18:17:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055935399999999997 2023-01-02T18:17:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.505391+0000", 2023-01-02T18:17:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8598999999999998e-05 2023-01-02T18:17:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.505419+0000", 2023-01-02T18:17:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068253599999999997 2023-01-02T18:17:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.189 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1642 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'55, mlcod=68'53)", 2023-01-02T18:17:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.5479353069999995, 2023-01-02T18:17:11.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068970200000000005, 2023-01-02T18:17:11.191 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.191 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.191 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515686+0000", 2023-01-02T18:17:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2879999999999998e-06 2023-01-02T18:17:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515692+0000", 2023-01-02T18:17:11.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0679000000000001e-05 2023-01-02T18:17:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515703+0000", 2023-01-02T18:17:11.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7849999999999999e-06 2023-01-02T18:17:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515708+0000", 2023-01-02T18:17:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4620000000000003e-05 2023-01-02T18:17:11.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515752+0000", 2023-01-02T18:17:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2283999999999999e-05 2023-01-02T18:17:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515775+0000", 2023-01-02T18:17:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057592299999999999 2023-01-02T18:17:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.516351+0000", 2023-01-02T18:17:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5884000000000002e-05 2023-01-02T18:17:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.516376+0000", 2023-01-02T18:17:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068970200000000005 2023-01-02T18:17:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1698 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'62, mlcod=68'60)", 2023-01-02T18:17:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.5225954930000007, 2023-01-02T18:17:11.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069486999999999999, 2023-01-02T18:17:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541026+0000", 2023-01-02T18:17:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1589999999999998e-06 2023-01-02T18:17:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541032+0000", 2023-01-02T18:17:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0879e-05 2023-01-02T18:17:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541043+0000", 2023-01-02T18:17:11.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5360000000000003e-06 2023-01-02T18:17:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541047+0000", 2023-01-02T18:17:11.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6459999999999999e-05 2023-01-02T18:17:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541094+0000", 2023-01-02T18:17:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323e-05 2023-01-02T18:17:11.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541117+0000", 2023-01-02T18:17:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057111 2023-01-02T18:17:11.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541688+0000", 2023-01-02T18:17:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3217999999999999e-05 2023-01-02T18:17:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541721+0000", 2023-01-02T18:17:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069486999999999999 2023-01-02T18:17:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.211 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1774 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'72, mlcod=68'70)", 2023-01-02T18:17:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.4879877149999992, 2023-01-02T18:17:11.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004, 2023-01-02T18:17:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:11.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:11.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575633+0000", 2023-01-02T18:17:11.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1912999999999999e-05 2023-01-02T18:17:11.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575645+0000", 2023-01-02T18:17:11.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5690000000000001e-05 2023-01-02T18:17:11.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575660+0000", 2023-01-02T18:17:11.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1430000000000001e-06 2023-01-02T18:17:11.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575668+0000", 2023-01-02T18:17:11.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9123000000000003e-05 2023-01-02T18:17:11.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575727+0000", 2023-01-02T18:17:11.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0632000000000001e-05 2023-01-02T18:17:11.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575757+0000", 2023-01-02T18:17:11.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057452100000000004 2023-01-02T18:17:11.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576332+0000", 2023-01-02T18:17:11.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8958999999999998e-05 2023-01-02T18:17:11.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576361+0000", 2023-01-02T18:17:11.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004 2023-01-02T18:17:11.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.222 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.223 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1783 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'73, mlcod=68'71)", 2023-01-02T18:17:11.223 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.579687+0000", 2023-01-02T18:17:11.223 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.4839349619999993, 2023-01-02T18:17:11.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067999399999999995, 2023-01-02T18:17:11.224 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.224 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579687+0000", 2023-01-02T18:17:11.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579687+0000", 2023-01-02T18:17:11.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579686+0000", 2023-01-02T18:17:11.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1459999999999996e-06 2023-01-02T18:17:11.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579694+0000", 2023-01-02T18:17:11.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4207e-05 2023-01-02T18:17:11.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579709+0000", 2023-01-02T18:17:11.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5180000000000001e-06 2023-01-02T18:17:11.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579715+0000", 2023-01-02T18:17:11.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5882e-05 2023-01-02T18:17:11.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579751+0000", 2023-01-02T18:17:11.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4052e-05 2023-01-02T18:17:11.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.579765+0000", 2023-01-02T18:17:11.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057860500000000005 2023-01-02T18:17:11.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.580344+0000", 2023-01-02T18:17:11.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504999999999999e-05 2023-01-02T18:17:11.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.580367+0000", 2023-01-02T18:17:11.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067999399999999995 2023-01-02T18:17:11.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.234 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.235 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1819 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'77, mlcod=68'75)", 2023-01-02T18:17:11.235 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:11.235 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.4680611549999991, 2023-01-02T18:17:11.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068721400000000001, 2023-01-02T18:17:11.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.236 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:11.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:11.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:11.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595559+0000", 2023-01-02T18:17:11.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0942e-05 2023-01-02T18:17:11.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595570+0000", 2023-01-02T18:17:11.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8321999999999998e-05 2023-01-02T18:17:11.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595589+0000", 2023-01-02T18:17:11.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0069999999999997e-06 2023-01-02T18:17:11.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595597+0000", 2023-01-02T18:17:11.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7846999999999999e-05 2023-01-02T18:17:11.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595635+0000", 2023-01-02T18:17:11.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6322000000000001e-05 2023-01-02T18:17:11.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595651+0000", 2023-01-02T18:17:11.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056746499999999996 2023-01-02T18:17:11.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.596218+0000", 2023-01-02T18:17:11.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9777999999999998e-05 2023-01-02T18:17:11.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.596248+0000", 2023-01-02T18:17:11.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068721400000000001 2023-01-02T18:17:11.245 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.246 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.246 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1842 8.4 e68/65 8:24c831c0:::rbd_header.12a2b9663ff5:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:11.247 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:11.247 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.4507261860000007, 2023-01-02T18:17:11.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997, 2023-01-02T18:17:11.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.248 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:11.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:11.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:11.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612894+0000", 2023-01-02T18:17:11.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:11.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612908+0000", 2023-01-02T18:17:11.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6006000000000001e-05 2023-01-02T18:17:11.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612934+0000", 2023-01-02T18:17:11.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.509e-05 2023-01-02T18:17:11.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612949+0000", 2023-01-02T18:17:11.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7535999999999998e-05 2023-01-02T18:17:11.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613027+0000", 2023-01-02T18:17:11.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0413000000000001e-05 2023-01-02T18:17:11.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613067+0000", 2023-01-02T18:17:11.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056083499999999998 2023-01-02T18:17:11.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613628+0000", 2023-01-02T18:17:11.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0998000000000001e-05 2023-01-02T18:17:11.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613649+0000", 2023-01-02T18:17:11.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997 2023-01-02T18:17:11.257 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.258 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2136 8.16 e69/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:11.258 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:11.259 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.442644713, 2023-01-02T18:17:11.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995, 2023-01-02T18:17:11.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.259 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.259 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:11.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:11.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:11.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:11.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8340000000000001e-06 2023-01-02T18:17:11.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620984+0000", 2023-01-02T18:17:11.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5201000000000001e-05 2023-01-02T18:17:11.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620999+0000", 2023-01-02T18:17:11.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9990000000000008e-06 2023-01-02T18:17:11.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621007+0000", 2023-01-02T18:17:11.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9780999999999997e-05 2023-01-02T18:17:11.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621047+0000", 2023-01-02T18:17:11.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2869e-05 2023-01-02T18:17:11.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621060+0000", 2023-01-02T18:17:11.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061950799999999995 2023-01-02T18:17:11.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621679+0000", 2023-01-02T18:17:11.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2191999999999999e-05 2023-01-02T18:17:11.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621711+0000", 2023-01-02T18:17:11.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995 2023-01-02T18:17:11.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.269 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.270 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2604 8.16 e72/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 72'4, mlcod=69'2)", 2023-01-02T18:17:11.270 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:11.270 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.6710833689999998, 2023-01-02T18:17:11.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068205399999999997, 2023-01-02T18:17:11.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.270 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.271 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:11.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:11.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:11.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392538+0000", 2023-01-02T18:17:11.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5759999999999999e-06 2023-01-02T18:17:11.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392543+0000", 2023-01-02T18:17:11.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1090999999999999e-05 2023-01-02T18:17:11.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392554+0000", 2023-01-02T18:17:11.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8440000000000003e-06 2023-01-02T18:17:11.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392560+0000", 2023-01-02T18:17:11.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5738000000000002e-05 2023-01-02T18:17:11.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392606+0000", 2023-01-02T18:17:11.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6169000000000001e-05 2023-01-02T18:17:11.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392622+0000", 2023-01-02T18:17:11.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056720399999999997 2023-01-02T18:17:11.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.393189+0000", 2023-01-02T18:17:11.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1707e-05 2023-01-02T18:17:11.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.393221+0000", 2023-01-02T18:17:11.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068205399999999997 2023-01-02T18:17:11.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.280 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.281 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2611 8.1b e72/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 72'85, mlcod=69'83)", 2023-01-02T18:17:11.281 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:11.281 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.6630589779999996, 2023-01-02T18:17:11.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999, 2023-01-02T18:17:11.281 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.282 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:11.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:11.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400562+0000", 2023-01-02T18:17:11.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1299999999999998e-06 2023-01-02T18:17:11.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400568+0000", 2023-01-02T18:17:11.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0643e-05 2023-01-02T18:17:11.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400579+0000", 2023-01-02T18:17:11.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4920000000000004e-06 2023-01-02T18:17:11.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400584+0000", 2023-01-02T18:17:11.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4360999999999998e-05 2023-01-02T18:17:11.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400618+0000", 2023-01-02T18:17:11.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4246999999999999e-05 2023-01-02T18:17:11.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400632+0000", 2023-01-02T18:17:11.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061679400000000004 2023-01-02T18:17:11.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401249+0000", 2023-01-02T18:17:11.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7705999999999999e-05 2023-01-02T18:17:11.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401277+0000", 2023-01-02T18:17:11.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999 2023-01-02T18:17:11.291 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.291 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.291 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.291 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.291 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.292 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:11.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:11.294 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:11.293+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:11.339 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:17:11.393 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:11.394+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:11.462 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:11.462 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:11.462 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:11.472 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:11.516 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:11.516+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:11.596 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:11.596+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:11.601 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:11.602 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:11.602 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:11.602 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:11.602 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:11.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:11.697 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:11.697+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:11.782 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:11.782 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:11.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:11.783 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:11.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.783 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:11.783 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:11.783 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.345282619000002, 2023-01-02T18:17:11.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:11.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.784 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.784 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.785 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:11.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.786 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:11.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:11.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:11.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:11.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:11.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:11.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:11.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:11.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:11.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:11.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:11.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:11.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:11.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:11.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:11.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:11.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:11.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:11.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:11.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:11.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:11.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:11.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:11.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:11.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:11.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:11.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:11.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:11.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:11.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:11.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:11.800 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.800 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.800 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.801 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:11.801 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:11.801 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.295897625999999, 2023-01-02T18:17:11.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:17:11.802 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.802 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.802 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.802 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:11.803 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:11.803 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:17:11.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.803 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:11.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:11.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:11.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:17:11.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:17:11.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:17:11.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:17:11.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:17:11.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:17:11.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:17:11.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:17:11.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:17:11.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:17:11.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:17:11.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:17:11.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:11.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:17:11.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:17:11.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:17:11.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:17:11.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:17:11.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:17:11.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:17:11.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:17:11.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:17:11.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:17:11.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.816 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.817 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:52 3.8 3:105263f9:::rbd_id.image4:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:11.817 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:11.817 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.276199761999997, 2023-01-02T18:17:11.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001, 2023-01-02T18:17:11.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.818 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.818 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 52 2023-01-02T18:17:11.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.819 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:11.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504932+0000", 2023-01-02T18:17:11.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504931+0000", 2023-01-02T18:17:11.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5480000000000004e-06 2023-01-02T18:17:11.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504938+0000", 2023-01-02T18:17:11.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2118e-05 2023-01-02T18:17:11.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504950+0000", 2023-01-02T18:17:11.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.259e-06 2023-01-02T18:17:11.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504956+0000", 2023-01-02T18:17:11.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1742999999999997e-05 2023-01-02T18:17:11.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.504987+0000", 2023-01-02T18:17:11.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3327999999999999e-05 2023-01-02T18:17:11.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505071+0000", 2023-01-02T18:17:11.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012434100000000001 2023-01-02T18:17:11.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.505195+0000", 2023-01-02T18:17:11.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083202299999999999 2023-01-02T18:17:11.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506027+0000", 2023-01-02T18:17:11.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031725600000000003 2023-01-02T18:17:11.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506344+0000", 2023-01-02T18:17:11.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9904e-05 2023-01-02T18:17:11.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506374+0000", 2023-01-02T18:17:11.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9748e-05 2023-01-02T18:17:11.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.506414+0000", 2023-01-02T18:17:11.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014821120000000001 2023-01-02T18:17:11.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.832 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.833 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:427 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:11.833 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:11.833 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.415179370000001, 2023-01-02T18:17:11.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001, 2023-01-02T18:17:11.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 427 2023-01-02T18:17:11.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.835 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:11.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:11.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365951+0000", 2023-01-02T18:17:11.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4900000000000002e-06 2023-01-02T18:17:11.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365956+0000", 2023-01-02T18:17:11.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5820000000000004e-06 2023-01-02T18:17:11.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365963+0000", 2023-01-02T18:17:11.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8339999999999998e-06 2023-01-02T18:17:11.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365968+0000", 2023-01-02T18:17:11.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000271091 2023-01-02T18:17:11.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366239+0000", 2023-01-02T18:17:11.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2132000000000006e-05 2023-01-02T18:17:11.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366321+0000", 2023-01-02T18:17:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000222733 2023-01-02T18:17:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366544+0000", 2023-01-02T18:17:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056500799999999998 2023-01-02T18:17:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367109+0000", 2023-01-02T18:17:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030673499999999998 2023-01-02T18:17:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367416+0000", 2023-01-02T18:17:11.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3107000000000003e-05 2023-01-02T18:17:11.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367489+0000", 2023-01-02T18:17:11.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3927000000000001e-05 2023-01-02T18:17:11.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367543+0000", 2023-01-02T18:17:11.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001 2023-01-02T18:17:11.847 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.847 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.847 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.848 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:444 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:11.848 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:11.848 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.405881393000001, 2023-01-02T18:17:11.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489, 2023-01-02T18:17:11.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.849 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.849 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 444 2023-01-02T18:17:11.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.850 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:11.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:11.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375249+0000", 2023-01-02T18:17:11.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9409999999999998e-06 2023-01-02T18:17:11.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375254+0000", 2023-01-02T18:17:11.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5210000000000008e-06 2023-01-02T18:17:11.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375264+0000", 2023-01-02T18:17:11.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9629999999999997e-06 2023-01-02T18:17:11.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375269+0000", 2023-01-02T18:17:11.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.333e-05 2023-01-02T18:17:11.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375312+0000", 2023-01-02T18:17:11.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6695999999999998e-05 2023-01-02T18:17:11.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375399+0000", 2023-01-02T18:17:11.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016210000000000001 2023-01-02T18:17:11.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375561+0000", 2023-01-02T18:17:11.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087961699999999996 2023-01-02T18:17:11.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376440+0000", 2023-01-02T18:17:11.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055437200000000002 2023-01-02T18:17:11.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376995+0000", 2023-01-02T18:17:11.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6236999999999997e-05 2023-01-02T18:17:11.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377051+0000", 2023-01-02T18:17:11.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0509e-05 2023-01-02T18:17:11.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377102+0000", 2023-01-02T18:17:11.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489 2023-01-02T18:17:11.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.864 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.864 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.864 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:11.865 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:11.865 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.395574151999998, 2023-01-02T18:17:11.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:17:11.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.866 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.866 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.866 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:17:11.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.866 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:11.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:11.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:17:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:17:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:17:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:17:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:17:11.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:17:11.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:17:11.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:17:11.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:17:11.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:17:11.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:17:11.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:17:11.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:17:11.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:17:11.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:17:11.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:17:11.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:17:11.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:17:11.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:17:11.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:17:11.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:17:11.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:17:11.879 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.879 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.879 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.880 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:629 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:11.880 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:11.880 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.299853192, 2023-01-02T18:17:11.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999, 2023-01-02T18:17:11.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.881 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.881 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.881 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.881 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 629 2023-01-02T18:17:11.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.882 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:11.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:11.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481277+0000", 2023-01-02T18:17:11.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.981e-06 2023-01-02T18:17:11.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481283+0000", 2023-01-02T18:17:11.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3018e-05 2023-01-02T18:17:11.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481296+0000", 2023-01-02T18:17:11.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0430000000000004e-06 2023-01-02T18:17:11.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481302+0000", 2023-01-02T18:17:11.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7145999999999999e-05 2023-01-02T18:17:11.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481349+0000", 2023-01-02T18:17:11.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6058999999999996e-05 2023-01-02T18:17:11.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481445+0000", 2023-01-02T18:17:11.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000219621 2023-01-02T18:17:11.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481665+0000", 2023-01-02T18:17:11.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076564299999999999 2023-01-02T18:17:11.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482431+0000", 2023-01-02T18:17:11.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027227600000000001 2023-01-02T18:17:11.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482703+0000", 2023-01-02T18:17:11.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5970000000000001e-05 2023-01-02T18:17:11.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482759+0000", 2023-01-02T18:17:11.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2224000000000001e-05 2023-01-02T18:17:11.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482801+0000", 2023-01-02T18:17:11.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999 2023-01-02T18:17:11.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.894 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.895 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:677 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:11.895 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:11.895 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.272161948000001, 2023-01-02T18:17:11.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911, 2023-01-02T18:17:11.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.896 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.896 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.896 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 677 2023-01-02T18:17:11.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.897 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:11.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:11.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508969+0000", 2023-01-02T18:17:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.268e-06 2023-01-02T18:17:11.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508975+0000", 2023-01-02T18:17:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4151000000000001e-05 2023-01-02T18:17:11.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508989+0000", 2023-01-02T18:17:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9569999999999996e-06 2023-01-02T18:17:11.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508996+0000", 2023-01-02T18:17:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6683e-05 2023-01-02T18:17:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509043+0000", 2023-01-02T18:17:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6942999999999997e-05 2023-01-02T18:17:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509130+0000", 2023-01-02T18:17:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020122099999999999 2023-01-02T18:17:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509331+0000", 2023-01-02T18:17:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063843400000000001 2023-01-02T18:17:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509969+0000", 2023-01-02T18:17:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062000599999999999 2023-01-02T18:17:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510589+0000", 2023-01-02T18:17:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8503000000000001e-05 2023-01-02T18:17:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510618+0000", 2023-01-02T18:17:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7784999999999998e-05 2023-01-02T18:17:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510655+0000", 2023-01-02T18:17:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911 2023-01-02T18:17:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:709 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.253139534999999, 2023-01-02T18:17:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999, 2023-01-02T18:17:11.910 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.911 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.911 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.911 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.911 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.911 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 709 2023-01-02T18:17:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527991+0000", 2023-01-02T18:17:11.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5170000000000001e-06 2023-01-02T18:17:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527996+0000", 2023-01-02T18:17:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2990000000000002e-06 2023-01-02T18:17:11.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528005+0000", 2023-01-02T18:17:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7049999999999996e-06 2023-01-02T18:17:11.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528011+0000", 2023-01-02T18:17:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3952999999999998e-05 2023-01-02T18:17:11.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528045+0000", 2023-01-02T18:17:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1950999999999998e-05 2023-01-02T18:17:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528097+0000", 2023-01-02T18:17:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000157078 2023-01-02T18:17:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528254+0000", 2023-01-02T18:17:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076010699999999999 2023-01-02T18:17:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529014+0000", 2023-01-02T18:17:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045062500000000002 2023-01-02T18:17:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529464+0000", 2023-01-02T18:17:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1790999999999999e-05 2023-01-02T18:17:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529516+0000", 2023-01-02T18:17:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1063999999999999e-05 2023-01-02T18:17:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529557+0000", 2023-01-02T18:17:11.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999 2023-01-02T18:17:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.47174251, 2023-01-02T18:17:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:11.925 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:11.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:11.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:11.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:11.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:11.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:11.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:11.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:11.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:11.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:11.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:11.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:11.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:11.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:11.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.940 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.941 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:372 7.1 7:83feba0f:::rbd_object_map.11d56649889d:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:11.941 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:11.941 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.461803446999999, 2023-01-02T18:17:11.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479, 2023-01-02T18:17:11.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:11.943 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:11.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 372 2023-01-02T18:17:11.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.943 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:11.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:11.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:11.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319326+0000", 2023-01-02T18:17:11.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1199999999999996e-06 2023-01-02T18:17:11.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319334+0000", 2023-01-02T18:17:11.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2170999999999999e-05 2023-01-02T18:17:11.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319346+0000", 2023-01-02T18:17:11.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7789999999999996e-06 2023-01-02T18:17:11.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319353+0000", 2023-01-02T18:17:11.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8445999999999997e-05 2023-01-02T18:17:11.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319392+0000", 2023-01-02T18:17:11.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010474700000000001 2023-01-02T18:17:11.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319497+0000", 2023-01-02T18:17:11.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138159 2023-01-02T18:17:11.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:11.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319635+0000", 2023-01-02T18:17:11.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071603699999999999 2023-01-02T18:17:11.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320351+0000", 2023-01-02T18:17:11.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063369800000000003 2023-01-02T18:17:11.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320985+0000", 2023-01-02T18:17:11.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5822000000000002e-05 2023-01-02T18:17:11.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321040+0000", 2023-01-02T18:17:11.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4125999999999997e-05 2023-01-02T18:17:11.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321085+0000", 2023-01-02T18:17:11.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479 2023-01-02T18:17:11.955 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.955 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.955 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.956 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1953 8.8 8:1376a730:::rbd_id.image30:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:11.956 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:11.956 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.124719023000001, 2023-01-02T18:17:11.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939, 2023-01-02T18:17:11.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.957 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.957 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.958 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.958 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1953 2023-01-02T18:17:11.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.958 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:11.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:11.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:11.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656411+0000", 2023-01-02T18:17:11.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5109999999999992e-06 2023-01-02T18:17:11.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656421+0000", 2023-01-02T18:17:11.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3118000000000001e-05 2023-01-02T18:17:11.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656444+0000", 2023-01-02T18:17:11.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.841e-06 2023-01-02T18:17:11.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656452+0000", 2023-01-02T18:17:11.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8368000000000003e-05 2023-01-02T18:17:11.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656490+0000", 2023-01-02T18:17:11.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6940000000000004e-05 2023-01-02T18:17:11.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656587+0000", 2023-01-02T18:17:11.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013780300000000001 2023-01-02T18:17:11.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:11.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656725+0000", 2023-01-02T18:17:11.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000707375 2023-01-02T18:17:11.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.657432+0000", 2023-01-02T18:17:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062476800000000005 2023-01-02T18:17:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658057+0000", 2023-01-02T18:17:11.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4223000000000001e-05 2023-01-02T18:17:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658091+0000", 2023-01-02T18:17:11.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5299e-05 2023-01-02T18:17:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658116+0000", 2023-01-02T18:17:11.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939 2023-01-02T18:17:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.971 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.1657825549999998, 2023-01-02T18:17:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.972 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:11.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:11.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:11.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:11.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:11.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:11.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2160 8.0 8:0415d193:::rbd_header.12a27aa439c7:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.1464516469999992, 2023-01-02T18:17:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014998629999999999, 2023-01-02T18:17:11.989 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2160 2023-01-02T18:17:11.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:11.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:11.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634679+0000", 2023-01-02T18:17:11.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9569999999999999e-06 2023-01-02T18:17:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634685+0000", 2023-01-02T18:17:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1110999999999999e-05 2023-01-02T18:17:11.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634696+0000", 2023-01-02T18:17:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5769999999999999e-06 2023-01-02T18:17:11.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634702+0000", 2023-01-02T18:17:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2962000000000001e-05 2023-01-02T18:17:11.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634735+0000", 2023-01-02T18:17:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3204000000000001e-05 2023-01-02T18:17:11.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634789+0000", 2023-01-02T18:17:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036566000000000002 2023-01-02T18:17:11.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635154+0000", 2023-01-02T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074706800000000004 2023-01-02T18:17:11.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635901+0000", 2023-01-02T18:17:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000225295 2023-01-02T18:17:12.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636127+0000", 2023-01-02T18:17:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0684e-05 2023-01-02T18:17:12.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636157+0000", 2023-01-02T18:17:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2378000000000002e-05 2023-01-02T18:17:12.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636180+0000", 2023-01-02T18:17:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014998629999999999 2023-01-02T18:17:12.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:12.004 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.4513107410000003, 2023-01-02T18:17:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:12.005 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.006 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:12.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:12.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:12.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:12.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:12.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:12.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.020 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.021 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4422093399999998, 2023-01-02T18:17:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:12.022 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.023 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:12.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:12.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:12.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:12.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.033 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:12.034 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.1708530479999999, 2023-01-02T18:17:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:12.035 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.036 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:12.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:12.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:12.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:12.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2643 3.7 3:e026f164:::rbd_object_map.12a23fc13ef0.0000000000000004:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.16633952, 2023-01-02T18:17:12.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001, 2023-01-02T18:17:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:12.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2643 2023-01-02T18:17:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:12.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614790+0000", 2023-01-02T18:17:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3409999999999992e-06 2023-01-02T18:17:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614799+0000", 2023-01-02T18:17:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0420000000000008e-06 2023-01-02T18:17:12.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614808+0000", 2023-01-02T18:17:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1370000000000001e-06 2023-01-02T18:17:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614814+0000", 2023-01-02T18:17:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064692000000000005 2023-01-02T18:17:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615460+0000", 2023-01-02T18:17:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012489599999999999 2023-01-02T18:17:12.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615585+0000", 2023-01-02T18:17:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015799100000000001 2023-01-02T18:17:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615743+0000", 2023-01-02T18:17:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097339900000000001 2023-01-02T18:17:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.616717+0000", 2023-01-02T18:17:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045439800000000001 2023-01-02T18:17:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617171+0000", 2023-01-02T18:17:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8190999999999999e-05 2023-01-02T18:17:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617229+0000", 2023-01-02T18:17:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5250000000000002e-05 2023-01-02T18:17:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617275+0000", 2023-01-02T18:17:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001 2023-01-02T18:17:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.063 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2655 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:12.064 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.623308+0000", 2023-01-02T18:17:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.1578235400000001, 2023-01-02T18:17:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015068, 2023-01-02T18:17:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:12.065 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2655 2023-01-02T18:17:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.066 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623308+0000", 2023-01-02T18:17:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:12.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623308+0000", 2023-01-02T18:17:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:12.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:12.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623307+0000", 2023-01-02T18:17:12.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.472e-06 2023-01-02T18:17:12.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:12.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623313+0000", 2023-01-02T18:17:12.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2065000000000001e-05 2023-01-02T18:17:12.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:12.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623325+0000", 2023-01-02T18:17:12.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9799999999999998e-06 2023-01-02T18:17:12.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:12.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623330+0000", 2023-01-02T18:17:12.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9981000000000001e-05 2023-01-02T18:17:12.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623380+0000", 2023-01-02T18:17:12.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103321 2023-01-02T18:17:12.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:12.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623484+0000", 2023-01-02T18:17:12.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035723299999999999 2023-01-02T18:17:12.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2023-01-02T18:17:12.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623841+0000", 2023-01-02T18:17:12.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075045500000000002 2023-01-02T18:17:12.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:12.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.624591+0000", 2023-01-02T18:17:12.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158164 2023-01-02T18:17:12.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:12.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.624749+0000", 2023-01-02T18:17:12.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8476999999999998e-05 2023-01-02T18:17:12.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:12.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.624788+0000", 2023-01-02T18:17:12.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6804999999999998e-05 2023-01-02T18:17:12.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:12.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.624815+0000", 2023-01-02T18:17:12.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015068 2023-01-02T18:17:12.080 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.080 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:12.080 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.081 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:12.081 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:12.081 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.16166339199999999, 2023-01-02T18:17:12.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:12.082 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:12.082 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:12.082 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:12.082 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:12.082 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:12.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:12.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.083 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:12.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:12.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:12.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:12.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:12.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:12.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:12.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:12.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:12.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:12.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:12.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:12.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:12.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:12.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:12.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:12.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:12.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:12.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:12.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:12.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:12.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:12.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:12.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:12.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:12.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:12.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:12.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:12.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:12.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:12.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:12.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:12.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:12.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:12.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:12.094 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.094 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:12.094 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.094 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:12.094 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:12.095 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:12.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:12.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:12.097 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:12.096+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:12.197 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:12.197+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:12.236 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:12.237 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:12.247 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:12.280 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:12.297 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:12.297+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:12.298 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:12.315 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:12.333 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:12.351 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:12.369 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:12.374 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:12.375 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:12.385 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:12.387 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:12.398 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:12.398+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:12.404 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:12.405 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:12.406 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:12.407 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:12.499 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:12.498+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:12.510 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:12.510 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:12.520 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:12.600 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:12.600+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:12.620 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:17:12.649 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:12.650 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:12.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:12.703 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:12.704+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:12.785 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:12.785 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:12.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:12.837 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:12.838+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:12.902 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:12.902+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:12.962 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:12.963 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:12.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:13.003 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:13.004+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:13.104 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:13.105+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:13.137 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:13.138 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:13.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:13.232 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:13.233+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:13.306 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:13.306+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:13.314 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:13.314 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:13.324 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:13.346 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7] out_osds: [5, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:17:13.346 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:17:13.346 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-01-02T18:17:13.346 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-01-02T18:17:13.406 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:13.406+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:13.490 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:13.491 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:13.501 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:13.507 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:13.507+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:13.608 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:13.608+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:13.628 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:13.629 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:13.636 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 1 2023-01-02T18:17:13.636 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:17:13.636 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap1 2023-01-02T18:17:13.636 INFO:tasks.workunit.client.0.smithi007.stdout:found snap1 with size 2097152 2023-01-02T18:17:13.637 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 2 2023-01-02T18:17:13.637 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:17:13.637 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap1 2023-01-02T18:17:13.637 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap2 2023-01-02T18:17:13.637 INFO:tasks.workunit.client.0.smithi007.stdout:found snap1 with size 2097152 2023-01-02T18:17:13.638 INFO:tasks.workunit.client.0.smithi007.stdout:found snap2 with size 4194304 2023-01-02T18:17:13.638 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 1 2023-01-02T18:17:13.638 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:17:13.638 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap2 2023-01-02T18:17:13.638 INFO:tasks.workunit.client.0.smithi007.stdout:found snap2 with size 4194304 2023-01-02T18:17:13.638 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 0 2023-01-02T18:17:13.639 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 0 2023-01-02T18:17:13.639 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnap (3884 ms) 2023-01-02T18:17:13.639 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestGetSnapShotTimeStamp 2023-01-02T18:17:13.639 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:13.640 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:13.675 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:13.675 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:13.675 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 80, 2023-01-02T18:17:13.676 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "4e320929-c4bb-4ea9-9e1c-d8479b7e40b1", 2023-01-02T18:17:13.676 INFO:teuthology.orchestra.run.smithi007.stdout: "created": "2023-01-02T18:15:29.542145+0000", 2023-01-02T18:17:13.676 INFO:teuthology.orchestra.run.smithi007.stdout: "modified": "2023-01-02T18:17:13.612824+0000", 2023-01-02T18:17:13.676 INFO:teuthology.orchestra.run.smithi007.stdout: "last_up_change": "2023-01-02T18:15:38.537792+0000", 2023-01-02T18:17:13.676 INFO:teuthology.orchestra.run.smithi007.stdout: "last_in_change": "2023-01-02T18:16:47.302822+0000", 2023-01-02T18:17:13.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-01-02T18:17:13.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_num": 5799936, 2023-01-02T18:17:13.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_set": [ 2023-01-02T18:17:13.677 INFO:teuthology.orchestra.run.smithi007.stdout: "pglog_hardlimit", 2023-01-02T18:17:13.677 INFO:teuthology.orchestra.run.smithi007.stdout: "purged_snapdirs", 2023-01-02T18:17:13.678 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_deletes", 2023-01-02T18:17:13.678 INFO:teuthology.orchestra.run.smithi007.stdout: "sortbitwise" 2023-01-02T18:17:13.678 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:13.678 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_version": 4, 2023-01-02T18:17:13.678 INFO:teuthology.orchestra.run.smithi007.stdout: "full_ratio": 0.94999998807907104, 2023-01-02T18:17:13.678 INFO:teuthology.orchestra.run.smithi007.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-01-02T18:17:13.679 INFO:teuthology.orchestra.run.smithi007.stdout: "nearfull_ratio": 0.85000002384185791, 2023-01-02T18:17:13.679 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_snapshot": "", 2023-01-02T18:17:13.679 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_max": 9, 2023-01-02T18:17:13.679 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd": 8, 2023-01-02T18:17:13.679 INFO:teuthology.orchestra.run.smithi007.stdout: "require_min_compat_client": "luminous", 2023-01-02T18:17:13.680 INFO:teuthology.orchestra.run.smithi007.stdout: "min_compat_client": "luminous", 2023-01-02T18:17:13.680 INFO:teuthology.orchestra.run.smithi007.stdout: "require_osd_release": "pacific", 2023-01-02T18:17:13.680 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": [ 2023-01-02T18:17:13.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.680 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 1, 2023-01-02T18:17:13.681 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "device_health_metrics", 2023-01-02T18:17:13.681 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:38.598445+0000", 2023-01-02T18:17:13.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:17:13.681 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:17:13.681 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.682 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.682 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.682 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.682 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.682 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.683 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.683 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.683 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.683 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.683 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 1, 2023-01-02T18:17:13.683 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 1, 2023-01-02T18:17:13.684 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 1, 2023-01-02T18:17:13.684 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 1, 2023-01-02T18:17:13.684 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 1, 2023-01-02T18:17:13.684 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.684 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.685 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.685 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.685 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.685 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.685 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.686 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "16", 2023-01-02T18:17:13.686 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.686 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.686 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.687 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.687 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.687 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:17:13.687 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:17:13.687 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.687 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.688 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.688 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.688 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.688 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.688 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.689 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.689 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.689 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.689 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.689 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.690 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.690 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.690 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.690 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.690 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.691 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.691 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.691 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.692 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.692 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.692 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.692 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.692 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.693 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.693 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.693 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.693 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-01-02T18:17:13.693 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_max": 32, 2023-01-02T18:17:13.694 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 1 2023-01-02T18:17:13.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.694 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.694 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_devicehealth": {} 2023-01-02T18:17:13.694 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 2, 2023-01-02T18:17:13.695 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "rbd", 2023-01-02T18:17:13.696 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:40.853543+0000", 2023-01-02T18:17:13.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:17:13.696 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:17:13.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.696 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.696 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.697 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.697 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.697 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.697 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.697 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.698 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.698 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.698 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 8, 2023-01-02T18:17:13.698 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 8, 2023-01-02T18:17:13.698 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 8, 2023-01-02T18:17:13.699 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 8, 2023-01-02T18:17:13.699 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 8, 2023-01-02T18:17:13.699 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.699 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.699 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.700 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.700 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.700 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.700 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.700 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "18", 2023-01-02T18:17:13.701 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.701 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.701 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.701 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.701 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.702 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:17:13.702 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:17:13.702 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.702 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.702 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.703 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.703 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.703 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.703 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.703 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.703 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.704 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.704 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.704 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.704 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.704 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.705 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.705 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.705 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.705 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.706 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.706 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.706 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.706 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.707 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.707 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.707 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.707 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.707 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.707 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.708 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.708 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:13.708 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.708 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd": {} 2023-01-02T18:17:13.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.709 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-01-02T18:17:13.709 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-1", 2023-01-02T18:17:13.710 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:36.229953+0000", 2023-01-02T18:17:13.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:13.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:13.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.710 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.711 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.711 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.711 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.711 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.711 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.712 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.712 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.712 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.712 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:13.712 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:13.713 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:13.713 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:13.713 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:13.713 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.713 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.714 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.714 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.714 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.714 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.714 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.715 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "80", 2023-01-02T18:17:13.715 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.715 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.715 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.715 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.716 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.716 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 7, 2023-01-02T18:17:13.716 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 80, 2023-01-02T18:17:13.716 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.716 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.717 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.717 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.717 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.717 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.718 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.718 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.718 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.718 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.718 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.718 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.719 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.719 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.719 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.719 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.719 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.720 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.720 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.720 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.721 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.721 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.721 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.721 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.722 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.722 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.722 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.722 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.722 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:13.722 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.723 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:13.723 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.723 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 4, 2023-01-02T18:17:13.724 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-2", 2023-01-02T18:17:13.724 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:39.906131+0000", 2023-01-02T18:17:13.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:13.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:13.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.725 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.725 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.725 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.725 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.725 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.726 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.726 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.726 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.726 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.726 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:13.727 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:13.727 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:13.727 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:13.727 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:13.727 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.728 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.728 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.728 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.728 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.728 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.729 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.729 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "51", 2023-01-02T18:17:13.729 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.729 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.730 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.730 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.730 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.730 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:13.730 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 51, 2023-01-02T18:17:13.731 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.731 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.731 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.731 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.731 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.732 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.732 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.732 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.732 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.732 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.733 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.733 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.733 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.733 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.733 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.734 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.734 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.734 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.734 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.735 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.735 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.735 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.735 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.736 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.736 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.736 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.736 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.736 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.736 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:13.737 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.737 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:13.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.738 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 5, 2023-01-02T18:17:13.738 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-3", 2023-01-02T18:17:13.738 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:44.455124+0000", 2023-01-02T18:17:13.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:13.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:13.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.739 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.739 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.739 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.739 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.740 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.740 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.740 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.740 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.740 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.741 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:13.741 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:13.741 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:13.741 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:13.741 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:13.742 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.742 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.742 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.742 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.742 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.742 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.743 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.743 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "56", 2023-01-02T18:17:13.743 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.743 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.744 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.744 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.744 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.744 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:13.744 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 56, 2023-01-02T18:17:13.744 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.745 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.745 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.745 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.745 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.746 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.746 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.746 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.746 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.746 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.747 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.747 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.747 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.747 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.749 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.750 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.751 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.751 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.751 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:13.751 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.751 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:13.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.752 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 6, 2023-01-02T18:17:13.752 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-4", 2023-01-02T18:17:13.753 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:49.454047+0000", 2023-01-02T18:17:13.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:13.753 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:13.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.753 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.753 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.754 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.754 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.754 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.754 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.754 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.755 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.755 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.755 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:13.755 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:13.755 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:13.756 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:13.756 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:13.756 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.756 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.756 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.757 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.757 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.757 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.757 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.758 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "60", 2023-01-02T18:17:13.758 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.758 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.758 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.759 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.759 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.759 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:13.759 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 60, 2023-01-02T18:17:13.759 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.760 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.760 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.760 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.760 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.761 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.761 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.761 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.761 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.761 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.762 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.762 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.762 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.762 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.762 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.763 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.763 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.763 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.763 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.764 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.764 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.764 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.764 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.764 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.765 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.765 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.765 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.765 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:13.765 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.766 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:13.766 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.766 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 7, 2023-01-02T18:17:13.767 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-5", 2023-01-02T18:17:13.767 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:53.843144+0000", 2023-01-02T18:17:13.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:13.767 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:13.767 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.767 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.768 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.768 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.768 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.768 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.768 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.768 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.769 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.769 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.769 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:13.769 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:13.769 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:13.770 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:13.770 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:13.770 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.770 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.770 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.771 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.771 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.771 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.771 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.771 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "64", 2023-01-02T18:17:13.772 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.772 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.772 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.772 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.772 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.773 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:13.773 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 64, 2023-01-02T18:17:13.773 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.773 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.773 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.774 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.774 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.774 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.774 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.775 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.775 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.775 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.775 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.775 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.776 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.776 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.776 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.776 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.777 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.777 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.777 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.777 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 8, 2023-01-02T18:17:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-6", 2023-01-02T18:17:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:57.794651+0000", 2023-01-02T18:17:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "72", 2023-01-02T18:17:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 7, 2023-01-02T18:17:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 72, 2023-01-02T18:17:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.788 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.788 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.788 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.788 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 9, 2023-01-02T18:17:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-7", 2023-01-02T18:17:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:05.454247+0000", 2023-01-02T18:17:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "76", 2023-01-02T18:17:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 76, 2023-01-02T18:17:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:17:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:17:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "69e18813-bd8e-4b22-9c40-d702ff3a5efd", 2023-01-02T18:17:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.6576995849609375, 2023-01-02T18:17:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 73, 2023-01-02T18:17:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6808", 2023-01-02T18:17:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6809", 2023-01-02T18:17:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6810", 2023-01-02T18:17:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6811", 2023-01-02T18:17:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.816 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6814", 2023-01-02T18:17:13.816 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:13.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6815", 2023-01-02T18:17:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6812", 2023-01-02T18:17:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6813", 2023-01-02T18:17:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6809/107063", 2023-01-02T18:17:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6811/107063", 2023-01-02T18:17:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6815/107063", 2023-01-02T18:17:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6813/107063", 2023-01-02T18:17:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:17:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "aa04dec6-4607-4f2a-85a3-a6278832fef3", 2023-01-02T18:17:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.3902130126953125, 2023-01-02T18:17:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 73, 2023-01-02T18:17:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6824", 2023-01-02T18:17:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6825", 2023-01-02T18:17:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6826", 2023-01-02T18:17:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6827", 2023-01-02T18:17:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6830", 2023-01-02T18:17:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6831", 2023-01-02T18:17:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6828", 2023-01-02T18:17:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6829", 2023-01-02T18:17:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6825/107066", 2023-01-02T18:17:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6827/107066", 2023-01-02T18:17:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6831/107066", 2023-01-02T18:17:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6829/107066", 2023-01-02T18:17:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:17:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "c98a28fb-d910-4601-a229-d4318259ab9b", 2023-01-02T18:17:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.14453125, 2023-01-02T18:17:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 73, 2023-01-02T18:17:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6816", 2023-01-02T18:17:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6817", 2023-01-02T18:17:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6818", 2023-01-02T18:17:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6819", 2023-01-02T18:17:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6822", 2023-01-02T18:17:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6823", 2023-01-02T18:17:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6820", 2023-01-02T18:17:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6821", 2023-01-02T18:17:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6817/107065", 2023-01-02T18:17:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6819/107065", 2023-01-02T18:17:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6823/107065", 2023-01-02T18:17:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6821/107065", 2023-01-02T18:17:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:17:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "3c5d48f4-5384-4563-8acb-11d866b85ef4", 2023-01-02T18:17:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 73, 2023-01-02T18:17:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2023-01-02T18:17:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2023-01-02T18:17:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6802", 2023-01-02T18:17:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6803", 2023-01-02T18:17:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6806", 2023-01-02T18:17:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6807", 2023-01-02T18:17:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6804", 2023-01-02T18:17:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6805", 2023-01-02T18:17:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6801/107064", 2023-01-02T18:17:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6803/107064", 2023-01-02T18:17:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6807/107064", 2023-01-02T18:17:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6805/107064", 2023-01-02T18:17:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:17:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "2476d495-4979-4679-a7e9-12652c270092", 2023-01-02T18:17:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 0, 2023-01-02T18:17:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 0, 2023-01-02T18:17:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 52, 2023-01-02T18:17:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6800", 2023-01-02T18:17:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6801", 2023-01-02T18:17:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6802", 2023-01-02T18:17:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6803", 2023-01-02T18:17:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6806", 2023-01-02T18:17:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6807", 2023-01-02T18:17:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6804", 2023-01-02T18:17:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6805", 2023-01-02T18:17:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6801/106900", 2023-01-02T18:17:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6803/106900", 2023-01-02T18:17:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6807/106900", 2023-01-02T18:17:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6805/106900", 2023-01-02T18:17:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:17:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "38d57e5e-b6c1-445f-b181-23fb518698f9", 2023-01-02T18:17:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 0, 2023-01-02T18:17:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 0, 2023-01-02T18:17:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 47, 2023-01-02T18:17:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6816", 2023-01-02T18:17:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6817", 2023-01-02T18:17:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6818", 2023-01-02T18:17:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6819", 2023-01-02T18:17:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6822", 2023-01-02T18:17:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6823", 2023-01-02T18:17:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6820", 2023-01-02T18:17:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6821", 2023-01-02T18:17:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6817/106930", 2023-01-02T18:17:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6819/106930", 2023-01-02T18:17:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6823/106930", 2023-01-02T18:17:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6821/106930", 2023-01-02T18:17:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:17:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "6c78f25a-2a65-47fe-b101-e47c00a5b2f6", 2023-01-02T18:17:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 73, 2023-01-02T18:17:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6808", 2023-01-02T18:17:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6809", 2023-01-02T18:17:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6810", 2023-01-02T18:17:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6811", 2023-01-02T18:17:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6814", 2023-01-02T18:17:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6815", 2023-01-02T18:17:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6812", 2023-01-02T18:17:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6813", 2023-01-02T18:17:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6809/106901", 2023-01-02T18:17:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6811/106901", 2023-01-02T18:17:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6815/106901", 2023-01-02T18:17:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6813/106901", 2023-01-02T18:17:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:17:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "b094706d-7145-4865-ae95-e5cd7e40d23b", 2023-01-02T18:17:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 73, 2023-01-02T18:17:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6824", 2023-01-02T18:17:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6825", 2023-01-02T18:17:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6826", 2023-01-02T18:17:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6827", 2023-01-02T18:17:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6830", 2023-01-02T18:17:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6831", 2023-01-02T18:17:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6828", 2023-01-02T18:17:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6829", 2023-01-02T18:17:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6825/106931", 2023-01-02T18:17:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6827/106931", 2023-01-02T18:17:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6831/106931", 2023-01-02T18:17:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6829/106931", 2023-01-02T18:17:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_xinfo": [ 2023-01-02T18:17:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:17:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.290083+0000", 2023-01-02T18:17:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:17:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.303022+0000", 2023-01-02T18:17:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:17:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.292245+0000", 2023-01-02T18:17:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:17:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.210530+0000", 2023-01-02T18:17:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:17:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 65536, 2023-01-02T18:17:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.282212+0000", 2023-01-02T18:17:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:17:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 65536, 2023-01-02T18:17:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.237376+0000", 2023-01-02T18:17:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:17:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.239974+0000", 2023-01-02T18:17:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:17:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.276340+0000", 2023-01-02T18:17:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap": [ 2023-01-02T18:17:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "2.0", 2023-01-02T18:17:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:17:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: 2, 2023-01-02T18:17:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: 3 2023-01-02T18:17:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_items": [], 2023-01-02T18:17:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_temp": [], 2023-01-02T18:17:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_temp": [], 2023-01-02T18:17:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklist": {}, 2023-01-02T18:17:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: "range_blocklist": {}, 2023-01-02T18:17:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profiles": { 2023-01-02T18:17:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: "default": { 2023-01-02T18:17:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-failure-domain": "osd", 2023-01-02T18:17:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: "k": "2", 2023-01-02T18:17:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: "m": "1", 2023-01-02T18:17:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin": "jerasure", 2023-01-02T18:17:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: "ruleset-failure-domain": "osd", 2023-01-02T18:17:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: "technique": "reed_sol_van" 2023-01-02T18:17:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps_queue": [ 2023-01-02T18:17:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-01-02T18:17:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: "snaps": [ 2023-01-02T18:17:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: "begin": 4, 2023-01-02T18:17:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: "length": 2 2023-01-02T18:17:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 9, 2023-01-02T18:17:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: "snaps": [ 2023-01-02T18:17:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: "begin": 2, 2023-01-02T18:17:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: "length": 1 2023-01-02T18:17:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: "new_removed_snaps": [ 2023-01-02T18:17:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-01-02T18:17:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: "snaps": [ 2023-01-02T18:17:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: "begin": 5, 2023-01-02T18:17:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: "length": 1 2023-01-02T18:17:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: "new_purged_snaps": [], 2023-01-02T18:17:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_node_flags": {}, 2023-01-02T18:17:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: "device_class_flags": {}, 2023-01-02T18:17:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode": { 2023-01-02T18:17:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_enabled": false, 2023-01-02T18:17:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_bucket_count": 0, 2023-01-02T18:17:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: "degraded_stretch_mode": 0, 2023-01-02T18:17:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: "recovering_stretch_mode": 0, 2023-01-02T18:17:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_bucket": 0 2023-01-02T18:17:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:13.947 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:13.949 INFO:tasks.thrashosds.thrasher:j is {'epoch': 80, 'fsid': '4e320929-c4bb-4ea9-9e1c-d8479b7e40b1', 'created': '2023-01-02T18:15:29.542145+0000', 'modified': '2023-01-02T18:17:13.612824+0000', 'last_up_change': '2023-01-02T18:15:38.537792+0000', 'last_in_change': '2023-01-02T18:16:47.302822+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 9, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-02T18:15:38.598445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-01-02T18:15:40.853543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'test-librbd-smithi007-118686-1', 'create_time': '2023-01-02T18:16:36.229953+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 80, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'test-librbd-smithi007-118686-2', 'create_time': '2023-01-02T18:16:39.906131+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 5, 'pool_name': 'test-librbd-smithi007-118686-3', 'create_time': '2023-01-02T18:16:44.455124+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 56, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 6, 'pool_name': 'test-librbd-smithi007-118686-4', 'create_time': '2023-01-02T18:16:49.454047+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 60, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 7, 'pool_name': 'test-librbd-smithi007-118686-5', 'create_time': '2023-01-02T18:16:53.843144+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 64, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 8, 'pool_name': 'test-librbd-smithi007-118686-6', 'create_time': '2023-01-02T18:16:57.794651+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 9, 'pool_name': 'test-librbd-smithi007-118686-7', 'create_time': '2023-01-02T18:17:05.454247+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '69e18813-bd8e-4b22-9c40-d702ff3a5efd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6576995849609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6808', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6809', 'nonce': 107063}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6810', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6811', 'nonce': 107063}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6814', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6815', 'nonce': 107063}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6812', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6813', 'nonce': 107063}]}, 'public_addr': '172.21.15.7:6809/107063', 'cluster_addr': '172.21.15.7:6811/107063', 'heartbeat_back_addr': '172.21.15.7:6815/107063', 'heartbeat_front_addr': '172.21.15.7:6813/107063', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa04dec6-4607-4f2a-85a3-a6278832fef3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3902130126953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6824', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6825', 'nonce': 107066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6826', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6827', 'nonce': 107066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6830', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6831', 'nonce': 107066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6828', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6829', 'nonce': 107066}]}, 'public_addr': '172.21.15.7:6825/107066', 'cluster_addr': '172.21.15.7:6827/107066', 'heartbeat_back_addr': '172.21.15.7:6831/107066', 'heartbeat_front_addr': '172.21.15.7:6829/107066', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'c98a28fb-d910-4601-a229-d4318259ab9b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.14453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6816', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6817', 'nonce': 107065}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6818', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6819', 'nonce': 107065}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6822', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6823', 'nonce': 107065}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6820', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6821', 'nonce': 107065}]}, 'public_addr': '172.21.15.7:6817/107065', 'cluster_addr': '172.21.15.7:6819/107065', 'heartbeat_back_addr': '172.21.15.7:6823/107065', 'heartbeat_front_addr': '172.21.15.7:6821/107065', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3c5d48f4-5384-4563-8acb-11d866b85ef4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6800', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6801', 'nonce': 107064}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6802', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6803', 'nonce': 107064}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6806', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6807', 'nonce': 107064}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6804', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6805', 'nonce': 107064}]}, 'public_addr': '172.21.15.7:6801/107064', 'cluster_addr': '172.21.15.7:6803/107064', 'heartbeat_back_addr': '172.21.15.7:6807/107064', 'heartbeat_front_addr': '172.21.15.7:6805/107064', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '2476d495-4979-4679-a7e9-12652c270092', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 106900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 106900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 106900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 106900}]}, 'public_addr': '172.21.15.57:6801/106900', 'cluster_addr': '172.21.15.57:6803/106900', 'heartbeat_back_addr': '172.21.15.57:6807/106900', 'heartbeat_front_addr': '172.21.15.57:6805/106900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '38d57e5e-b6c1-445f-b181-23fb518698f9', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 47, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6816', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6817', 'nonce': 106930}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6818', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 106930}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6822', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6823', 'nonce': 106930}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6820', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6821', 'nonce': 106930}]}, 'public_addr': '172.21.15.57:6817/106930', 'cluster_addr': '172.21.15.57:6819/106930', 'heartbeat_back_addr': '172.21.15.57:6823/106930', 'heartbeat_front_addr': '172.21.15.57:6821/106930', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6c78f25a-2a65-47fe-b101-e47c00a5b2f6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6808', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6809', 'nonce': 106901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6810', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6811', 'nonce': 106901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6814', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6815', 'nonce': 106901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6812', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6813', 'nonce': 106901}]}, 'public_addr': '172.21.15.57:6809/106901', 'cluster_addr': '172.21.15.57:6811/106901', 'heartbeat_back_addr': '172.21.15.57:6815/106901', 'heartbeat_front_addr': '172.21.15.57:6813/106901', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'b094706d-7145-4865-ae95-e5cd7e40d23b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 73, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6824', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6825', 'nonce': 106931}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6826', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6827', 'nonce': 106931}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6830', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6831', 'nonce': 106931}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6828', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6829', 'nonce': 106931}]}, 'public_addr': '172.21.15.57:6825/106931', 'cluster_addr': '172.21.15.57:6827/106931', 'heartbeat_back_addr': '172.21.15.57:6831/106931', 'heartbeat_front_addr': '172.21.15.57:6829/106931', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.290083+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.303022+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.292245+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.210530+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.282212+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.237376+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.239974+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.276340+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [2, 3]}], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 4, 'length': 2}]}, {'pool': 9, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 5, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-01-02T18:17:13.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:17:13.950 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:13.949+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:14.049 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:14.048+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:14.074 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:14.074 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:14.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:14.150 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:14.150+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:14.210 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:14.210 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:14.220 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:14.261 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:14.262+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:14.314 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:14.319 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:17:14.326 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2023-01-02T18:17:13.620061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1772,"num_objects":111,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":111,"num_whiteouts":0,"num_read":7366,"num_read_kb":6513,"num_write":537,"num_write_kb":462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":492,"num_keys_recovered":102,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":657,"ondisk_log_size":657,"up":466,"acting":466,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":457,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":42012,"kb_used_data":5740,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":566189028,"statfs":{"total":579820584960,"available":579777564672,"internally_reserved":0,"allocated":5877760,"data_stored":2649892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":105,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":969,"num_read_kb":865,"num_write":61,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.315834"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.324119+0000","last_change":"2023-01-02T18:17:09.324265+0000","last_active":"2023-01-02T18:17:09.324119+0000","last_peered":"2023-01-02T18:17:09.324119+0000","last_clean":"2023-01-02T18:17:09.324119+0000","last_became_active":"2023-01-02T18:17:07.348058+0000","last_became_peered":"2023-01-02T18:17:07.348058+0000","last_unstale":"2023-01-02T18:17:09.324119+0000","last_undegraded":"2023-01-02T18:17:09.324119+0000","last_fullsized":"2023-01-02T18:17:09.324119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.14","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.320902+0000","last_change":"2023-01-02T18:17:01.320137+0000","last_active":"2023-01-02T18:17:09.320902+0000","last_peered":"2023-01-02T18:17:09.320902+0000","last_clean":"2023-01-02T18:17:09.320902+0000","last_became_active":"2023-01-02T18:16:59.324809+0000","last_became_peered":"2023-01-02T18:16:59.324809+0000","last_unstale":"2023-01-02T18:17:09.320902+0000","last_undegraded":"2023-01-02T18:17:09.320902+0000","last_fullsized":"2023-01-02T18:17:09.320902+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438000+0000","last_change":"2023-01-02T18:16:48.330409+0000","last_active":"2023-01-02T18:17:08.438000+0000","last_peered":"2023-01-02T18:17:08.438000+0000","last_clean":"2023-01-02T18:17:08.438000+0000","last_became_active":"2023-01-02T18:16:48.329903+0000","last_became_peered":"2023-01-02T18:16:48.329903+0000","last_unstale":"2023-01-02T18:17:08.438000+0000","last_undegraded":"2023-01-02T18:17:08.438000+0000","last_fullsized":"2023-01-02T18:17:08.438000+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":53,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.329990+0000","last_change":"2023-01-02T18:16:42.460802+0000","last_active":"2023-01-02T18:17:08.329990+0000","last_peered":"2023-01-02T18:17:08.329990+0000","last_clean":"2023-01-02T18:17:08.329990+0000","last_became_active":"2023-01-02T18:16:42.460433+0000","last_became_peered":"2023-01-02T18:16:42.460433+0000","last_unstale":"2023-01-02T18:17:08.329990+0000","last_undegraded":"2023-01-02T18:17:08.329990+0000","last_fullsized":"2023-01-02T18:17:08.329990+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439336+0000","last_change":"2023-01-02T18:16:49.304700+0000","last_active":"2023-01-02T18:17:08.439336+0000","last_peered":"2023-01-02T18:17:08.439336+0000","last_clean":"2023-01-02T18:17:08.439336+0000","last_became_active":"2023-01-02T18:16:46.314227+0000","last_became_peered":"2023-01-02T18:16:46.314227+0000","last_unstale":"2023-01-02T18:17:08.439336+0000","last_undegraded":"2023-01-02T18:17:08.439336+0000","last_fullsized":"2023-01-02T18:17:08.439336+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":117,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438944+0000","last_change":"2023-01-02T18:16:53.346444+0000","last_active":"2023-01-02T18:17:08.438944+0000","last_peered":"2023-01-02T18:17:08.438944+0000","last_clean":"2023-01-02T18:17:08.438944+0000","last_became_active":"2023-01-02T18:16:51.340482+0000","last_became_peered":"2023-01-02T18:16:51.340482+0000","last_unstale":"2023-01-02T18:17:08.438944+0000","last_undegraded":"2023-01-02T18:17:08.438944+0000","last_fullsized":"2023-01-02T18:17:08.438944+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":80,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":125,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.329397+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:17:08.329397+0000","last_peered":"2023-01-02T18:17:08.329397+0000","last_clean":"2023-01-02T18:17:08.329397+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:17:08.329397+0000","last_undegraded":"2023-01-02T18:17:08.329397+0000","last_fullsized":"2023-01-02T18:17:08.329397+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.308772+0000","last_change":"2023-01-02T18:17:09.308994+0000","last_active":"2023-01-02T18:17:09.308772+0000","last_peered":"2023-01-02T18:17:09.308772+0000","last_clean":"2023-01-02T18:17:09.308772+0000","last_became_active":"2023-01-02T18:17:07.339263+0000","last_became_peered":"2023-01-02T18:17:07.339263+0000","last_unstale":"2023-01-02T18:17:09.308772+0000","last_undegraded":"2023-01-02T18:17:09.308772+0000","last_fullsized":"2023-01-02T18:17:09.308772+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.15","version":"72'22","reported_seq":245,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.322465+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:17:09.322465+0000","last_peered":"2023-01-02T18:17:09.322465+0000","last_clean":"2023-01-02T18:17:09.322465+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:17:09.322465+0000","last_undegraded":"2023-01-02T18:17:09.322465+0000","last_fullsized":"2023-01-02T18:17:09.322465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":276,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332457+0000","last_change":"2023-01-02T18:16:44.306676+0000","last_active":"2023-01-02T18:17:08.332457+0000","last_peered":"2023-01-02T18:17:08.332457+0000","last_clean":"2023-01-02T18:17:08.332457+0000","last_became_active":"2023-01-02T18:16:41.446794+0000","last_became_peered":"2023-01-02T18:16:41.446794+0000","last_unstale":"2023-01-02T18:17:08.332457+0000","last_undegraded":"2023-01-02T18:17:08.332457+0000","last_fullsized":"2023-01-02T18:17:08.332457+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"46'10","reported_seq":64,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333130+0000","last_change":"2023-01-02T18:16:39.438979+0000","last_active":"2023-01-02T18:17:08.333130+0000","last_peered":"2023-01-02T18:17:08.333130+0000","last_clean":"2023-01-02T18:17:08.333130+0000","last_became_active":"2023-01-02T18:16:37.427175+0000","last_became_peered":"2023-01-02T18:16:37.427175+0000","last_unstale":"2023-01-02T18:17:08.333130+0000","last_undegraded":"2023-01-02T18:17:08.333130+0000","last_fullsized":"2023-01-02T18:17:08.333130+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":28,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438154+0000","last_change":"2023-01-02T18:16:49.318455+0000","last_active":"2023-01-02T18:17:08.438154+0000","last_peered":"2023-01-02T18:17:08.438154+0000","last_clean":"2023-01-02T18:17:08.438154+0000","last_became_active":"2023-01-02T18:16:48.329597+0000","last_became_peered":"2023-01-02T18:16:48.329597+0000","last_unstale":"2023-01-02T18:17:08.438154+0000","last_undegraded":"2023-01-02T18:17:08.438154+0000","last_fullsized":"2023-01-02T18:17:08.438154+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333125+0000","last_change":"2023-01-02T18:16:53.344973+0000","last_active":"2023-01-02T18:17:08.333125+0000","last_peered":"2023-01-02T18:17:08.333125+0000","last_clean":"2023-01-02T18:17:08.333125+0000","last_became_active":"2023-01-02T18:16:51.341196+0000","last_became_peered":"2023-01-02T18:16:51.341196+0000","last_unstale":"2023-01-02T18:17:08.333125+0000","last_undegraded":"2023-01-02T18:17:08.333125+0000","last_fullsized":"2023-01-02T18:17:08.333125+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":107,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438205+0000","last_change":"2023-01-02T18:16:57.306888+0000","last_active":"2023-01-02T18:17:08.438205+0000","last_peered":"2023-01-02T18:17:08.438205+0000","last_clean":"2023-01-02T18:17:08.438205+0000","last_became_active":"2023-01-02T18:16:55.307841+0000","last_became_peered":"2023-01-02T18:16:55.307841+0000","last_unstale":"2023-01-02T18:17:08.438205+0000","last_undegraded":"2023-01-02T18:17:08.438205+0000","last_fullsized":"2023-01-02T18:17:08.438205+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"76'1","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.332463+0000","last_change":"2023-01-02T18:17:09.324016+0000","last_active":"2023-01-02T18:17:09.332463+0000","last_peered":"2023-01-02T18:17:09.332463+0000","last_clean":"2023-01-02T18:17:09.332463+0000","last_became_active":"2023-01-02T18:17:07.347854+0000","last_became_peered":"2023-01-02T18:17:07.347854+0000","last_unstale":"2023-01-02T18:17:09.332463+0000","last_undegraded":"2023-01-02T18:17:09.332463+0000","last_fullsized":"2023-01-02T18:17:09.332463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.16","version":"72'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.311137+0000","last_change":"2023-01-02T18:17:01.311706+0000","last_active":"2023-01-02T18:17:09.311137+0000","last_peered":"2023-01-02T18:17:09.311137+0000","last_clean":"2023-01-02T18:17:09.311137+0000","last_became_active":"2023-01-02T18:16:59.313908+0000","last_became_peered":"2023-01-02T18:16:59.313908+0000","last_unstale":"2023-01-02T18:17:09.311137+0000","last_undegraded":"2023-01-02T18:17:09.311137+0000","last_fullsized":"2023-01-02T18:17:09.311137+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"51'2","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333392+0000","last_change":"2023-01-02T18:16:48.343757+0000","last_active":"2023-01-02T18:17:08.333392+0000","last_peered":"2023-01-02T18:17:08.333392+0000","last_clean":"2023-01-02T18:17:08.333392+0000","last_became_active":"2023-01-02T18:16:48.326121+0000","last_became_peered":"2023-01-02T18:16:48.326121+0000","last_unstale":"2023-01-02T18:17:08.333392+0000","last_undegraded":"2023-01-02T18:17:08.333392+0000","last_fullsized":"2023-01-02T18:17:08.333392+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"46'1","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439619+0000","last_change":"2023-01-02T18:16:48.354695+0000","last_active":"2023-01-02T18:17:08.439619+0000","last_peered":"2023-01-02T18:17:08.439619+0000","last_clean":"2023-01-02T18:17:08.439619+0000","last_became_active":"2023-01-02T18:16:48.329613+0000","last_became_peered":"2023-01-02T18:16:48.329613+0000","last_unstale":"2023-01-02T18:17:08.439619+0000","last_undegraded":"2023-01-02T18:17:08.439619+0000","last_fullsized":"2023-01-02T18:17:08.439619+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1b","version":"56'1","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.330390+0000","last_change":"2023-01-02T18:16:49.324862+0000","last_active":"2023-01-02T18:17:08.330390+0000","last_peered":"2023-01-02T18:17:08.330390+0000","last_clean":"2023-01-02T18:17:08.330390+0000","last_became_active":"2023-01-02T18:16:46.315844+0000","last_became_peered":"2023-01-02T18:16:46.315844+0000","last_unstale":"2023-01-02T18:17:08.330390+0000","last_undegraded":"2023-01-02T18:17:08.330390+0000","last_fullsized":"2023-01-02T18:17:08.330390+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327216+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:17:08.327216+0000","last_peered":"2023-01-02T18:17:08.327216+0000","last_clean":"2023-01-02T18:17:08.327216+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:17:08.327216+0000","last_undegraded":"2023-01-02T18:17:08.327216+0000","last_fullsized":"2023-01-02T18:17:08.327216+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438659+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:17:08.438659+0000","last_peered":"2023-01-02T18:17:08.438659+0000","last_clean":"2023-01-02T18:17:08.438659+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:17:08.438659+0000","last_undegraded":"2023-01-02T18:17:08.438659+0000","last_fullsized":"2023-01-02T18:17:08.438659+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.308440+0000","last_change":"2023-01-02T18:17:09.308912+0000","last_active":"2023-01-02T18:17:09.308440+0000","last_peered":"2023-01-02T18:17:09.308440+0000","last_clean":"2023-01-02T18:17:09.308440+0000","last_became_active":"2023-01-02T18:17:07.339397+0000","last_became_peered":"2023-01-02T18:17:07.339397+0000","last_unstale":"2023-01-02T18:17:09.308440+0000","last_undegraded":"2023-01-02T18:17:09.308440+0000","last_fullsized":"2023-01-02T18:17:09.308440+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.17","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.322546+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:17:09.322546+0000","last_peered":"2023-01-02T18:17:09.322546+0000","last_clean":"2023-01-02T18:17:09.322546+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:17:09.322546+0000","last_undegraded":"2023-01-02T18:17:09.322546+0000","last_fullsized":"2023-01-02T18:17:09.322546+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333325+0000","last_change":"2023-01-02T18:16:48.330072+0000","last_active":"2023-01-02T18:17:08.333325+0000","last_peered":"2023-01-02T18:17:08.333325+0000","last_clean":"2023-01-02T18:17:08.333325+0000","last_became_active":"2023-01-02T18:16:48.329697+0000","last_became_peered":"2023-01-02T18:16:48.329697+0000","last_unstale":"2023-01-02T18:17:08.333325+0000","last_undegraded":"2023-01-02T18:17:08.333325+0000","last_fullsized":"2023-01-02T18:17:08.333325+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"46'21","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438348+0000","last_change":"2023-01-02T18:16:48.340958+0000","last_active":"2023-01-02T18:17:08.438348+0000","last_peered":"2023-01-02T18:17:08.438348+0000","last_clean":"2023-01-02T18:17:08.438348+0000","last_became_active":"2023-01-02T18:16:48.325842+0000","last_became_peered":"2023-01-02T18:16:48.325842+0000","last_unstale":"2023-01-02T18:17:08.438348+0000","last_undegraded":"2023-01-02T18:17:08.438348+0000","last_fullsized":"2023-01-02T18:17:08.438348+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":48,"num_read_kb":39,"num_write":21,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":51,"num_keys_recovered":30,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1a","version":"56'2","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438558+0000","last_change":"2023-01-02T18:16:49.305216+0000","last_active":"2023-01-02T18:17:08.438558+0000","last_peered":"2023-01-02T18:17:08.438558+0000","last_clean":"2023-01-02T18:17:08.438558+0000","last_became_active":"2023-01-02T18:16:48.327069+0000","last_became_peered":"2023-01-02T18:16:48.327069+0000","last_unstale":"2023-01-02T18:17:08.438558+0000","last_undegraded":"2023-01-02T18:17:08.438558+0000","last_fullsized":"2023-01-02T18:17:08.438558+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371565+0000","last_change":"2023-01-02T18:16:53.344282+0000","last_active":"2023-01-02T18:17:08.371565+0000","last_peered":"2023-01-02T18:17:08.371565+0000","last_clean":"2023-01-02T18:17:08.371565+0000","last_became_active":"2023-01-02T18:16:51.342864+0000","last_became_peered":"2023-01-02T18:16:51.342864+0000","last_unstale":"2023-01-02T18:17:08.371565+0000","last_undegraded":"2023-01-02T18:17:08.371565+0000","last_fullsized":"2023-01-02T18:17:08.371565+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":545,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438240+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:17:08.438240+0000","last_peered":"2023-01-02T18:17:08.438240+0000","last_clean":"2023-01-02T18:17:08.438240+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:17:08.438240+0000","last_undegraded":"2023-01-02T18:17:08.438240+0000","last_fullsized":"2023-01-02T18:17:08.438240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"76'50","reported_seq":347,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.532210+0000","last_change":"2023-01-02T18:17:09.321800+0000","last_active":"2023-01-02T18:17:09.532210+0000","last_peered":"2023-01-02T18:17:09.532210+0000","last_clean":"2023-01-02T18:17:09.532210+0000","last_became_active":"2023-01-02T18:17:07.340907+0000","last_became_peered":"2023-01-02T18:17:07.340907+0000","last_unstale":"2023-01-02T18:17:09.532210+0000","last_undegraded":"2023-01-02T18:17:09.532210+0000","last_fullsized":"2023-01-02T18:17:09.532210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":50,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":747,"num_read_kb":662,"num_write":47,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.10","version":"72'17","reported_seq":148,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.321122+0000","last_change":"2023-01-02T18:17:01.321350+0000","last_active":"2023-01-02T18:17:09.321122+0000","last_peered":"2023-01-02T18:17:09.321122+0000","last_clean":"2023-01-02T18:17:09.321122+0000","last_became_active":"2023-01-02T18:16:59.310618+0000","last_became_peered":"2023-01-02T18:16:59.310618+0000","last_unstale":"2023-01-02T18:17:09.321122+0000","last_undegraded":"2023-01-02T18:17:09.321122+0000","last_fullsized":"2023-01-02T18:17:09.321122+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439872+0000","last_change":"2023-01-02T18:16:57.307585+0000","last_active":"2023-01-02T18:17:08.439872+0000","last_peered":"2023-01-02T18:17:08.439872+0000","last_clean":"2023-01-02T18:17:08.439872+0000","last_became_active":"2023-01-02T18:16:55.315726+0000","last_became_peered":"2023-01-02T18:16:55.315726+0000","last_unstale":"2023-01-02T18:17:08.439872+0000","last_undegraded":"2023-01-02T18:17:08.439872+0000","last_fullsized":"2023-01-02T18:17:08.439872+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327848+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:17:08.327848+0000","last_peered":"2023-01-02T18:17:08.327848+0000","last_clean":"2023-01-02T18:17:08.327848+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:17:08.327848+0000","last_undegraded":"2023-01-02T18:17:08.327848+0000","last_fullsized":"2023-01-02T18:17:08.327848+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":60,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.330316+0000","last_change":"2023-01-02T18:16:48.349016+0000","last_active":"2023-01-02T18:17:08.330316+0000","last_peered":"2023-01-02T18:17:08.330316+0000","last_clean":"2023-01-02T18:17:08.330316+0000","last_became_active":"2023-01-02T18:16:48.331845+0000","last_became_peered":"2023-01-02T18:16:48.331845+0000","last_unstale":"2023-01-02T18:17:08.330316+0000","last_undegraded":"2023-01-02T18:17:08.330316+0000","last_fullsized":"2023-01-02T18:17:08.330316+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.328709+0000","last_change":"2023-01-02T18:16:49.324534+0000","last_active":"2023-01-02T18:17:08.328709+0000","last_peered":"2023-01-02T18:17:08.328709+0000","last_clean":"2023-01-02T18:17:08.328709+0000","last_became_active":"2023-01-02T18:16:48.327014+0000","last_became_peered":"2023-01-02T18:16:48.327014+0000","last_unstale":"2023-01-02T18:17:08.328709+0000","last_undegraded":"2023-01-02T18:17:08.328709+0000","last_fullsized":"2023-01-02T18:17:08.328709+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439755+0000","last_change":"2023-01-02T18:16:53.604464+0000","last_active":"2023-01-02T18:17:08.439755+0000","last_peered":"2023-01-02T18:17:08.439755+0000","last_clean":"2023-01-02T18:17:08.439755+0000","last_became_active":"2023-01-02T18:16:51.343193+0000","last_became_peered":"2023-01-02T18:16:51.343193+0000","last_unstale":"2023-01-02T18:17:08.439755+0000","last_undegraded":"2023-01-02T18:17:08.439755+0000","last_fullsized":"2023-01-02T18:17:08.439755+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.310410+0000","last_change":"2023-01-02T18:17:09.310675+0000","last_active":"2023-01-02T18:17:09.310410+0000","last_peered":"2023-01-02T18:17:09.310410+0000","last_clean":"2023-01-02T18:17:09.310410+0000","last_became_active":"2023-01-02T18:17:07.345963+0000","last_became_peered":"2023-01-02T18:17:07.345963+0000","last_unstale":"2023-01-02T18:17:09.310410+0000","last_undegraded":"2023-01-02T18:17:09.310410+0000","last_fullsized":"2023-01-02T18:17:09.310410+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.d","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.321993+0000","last_change":"2023-01-02T18:17:01.322905+0000","last_active":"2023-01-02T18:17:09.321993+0000","last_peered":"2023-01-02T18:17:09.321993+0000","last_clean":"2023-01-02T18:17:09.321993+0000","last_became_active":"2023-01-02T18:16:59.312747+0000","last_became_peered":"2023-01-02T18:16:59.312747+0000","last_unstale":"2023-01-02T18:17:09.321993+0000","last_undegraded":"2023-01-02T18:17:09.321993+0000","last_fullsized":"2023-01-02T18:17:09.321993+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332571+0000","last_change":"2023-01-02T18:16:49.309259+0000","last_active":"2023-01-02T18:17:08.332571+0000","last_peered":"2023-01-02T18:17:08.332571+0000","last_clean":"2023-01-02T18:17:08.332571+0000","last_became_active":"2023-01-02T18:16:46.313760+0000","last_became_peered":"2023-01-02T18:16:46.313760+0000","last_unstale":"2023-01-02T18:17:08.332571+0000","last_undegraded":"2023-01-02T18:17:08.332571+0000","last_fullsized":"2023-01-02T18:17:08.332571+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438320+0000","last_change":"2023-01-02T18:16:48.358986+0000","last_active":"2023-01-02T18:17:08.438320+0000","last_peered":"2023-01-02T18:17:08.438320+0000","last_clean":"2023-01-02T18:17:08.438320+0000","last_became_active":"2023-01-02T18:16:48.336041+0000","last_became_peered":"2023-01-02T18:16:48.336041+0000","last_unstale":"2023-01-02T18:17:08.438320+0000","last_undegraded":"2023-01-02T18:17:08.438320+0000","last_fullsized":"2023-01-02T18:17:08.438320+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.329974+0000","last_change":"2023-01-02T18:16:39.420853+0000","last_active":"2023-01-02T18:17:08.329974+0000","last_peered":"2023-01-02T18:17:08.329974+0000","last_clean":"2023-01-02T18:17:08.329974+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:17:08.329974+0000","last_undegraded":"2023-01-02T18:17:08.329974+0000","last_fullsized":"2023-01-02T18:17:08.329974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439951+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:17:08.439951+0000","last_peered":"2023-01-02T18:17:08.439951+0000","last_clean":"2023-01-02T18:17:08.439951+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:17:08.439951+0000","last_undegraded":"2023-01-02T18:17:08.439951+0000","last_fullsized":"2023-01-02T18:17:08.439951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439060+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:17:08.439060+0000","last_peered":"2023-01-02T18:17:08.439060+0000","last_clean":"2023-01-02T18:17:08.439060+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:17:08.439060+0000","last_undegraded":"2023-01-02T18:17:08.439060+0000","last_fullsized":"2023-01-02T18:17:08.439060+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333691+0000","last_change":"2023-01-02T18:16:57.312949+0000","last_active":"2023-01-02T18:17:08.333691+0000","last_peered":"2023-01-02T18:17:08.333691+0000","last_clean":"2023-01-02T18:17:08.333691+0000","last_became_active":"2023-01-02T18:16:55.315334+0000","last_became_peered":"2023-01-02T18:16:55.315334+0000","last_unstale":"2023-01-02T18:17:08.333691+0000","last_undegraded":"2023-01-02T18:17:08.333691+0000","last_fullsized":"2023-01-02T18:17:08.333691+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.324170+0000","last_change":"2023-01-02T18:17:09.324343+0000","last_active":"2023-01-02T18:17:09.324170+0000","last_peered":"2023-01-02T18:17:09.324170+0000","last_clean":"2023-01-02T18:17:09.324170+0000","last_became_active":"2023-01-02T18:17:07.347667+0000","last_became_peered":"2023-01-02T18:17:07.347667+0000","last_unstale":"2023-01-02T18:17:09.324170+0000","last_undegraded":"2023-01-02T18:17:09.324170+0000","last_fullsized":"2023-01-02T18:17:09.324170+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.c","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.320672+0000","last_change":"2023-01-02T18:17:01.319510+0000","last_active":"2023-01-02T18:17:09.320672+0000","last_peered":"2023-01-02T18:17:09.320672+0000","last_clean":"2023-01-02T18:17:09.320672+0000","last_became_active":"2023-01-02T18:16:59.327716+0000","last_became_peered":"2023-01-02T18:16:59.327716+0000","last_unstale":"2023-01-02T18:17:09.320672+0000","last_undegraded":"2023-01-02T18:17:09.320672+0000","last_fullsized":"2023-01-02T18:17:09.320672+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332568+0000","last_change":"2023-01-02T18:16:49.310704+0000","last_active":"2023-01-02T18:17:08.332568+0000","last_peered":"2023-01-02T18:17:08.332568+0000","last_clean":"2023-01-02T18:17:08.332568+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:08.332568+0000","last_undegraded":"2023-01-02T18:17:08.332568+0000","last_fullsized":"2023-01-02T18:17:08.332568+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332355+0000","last_change":"2023-01-02T18:16:44.307480+0000","last_active":"2023-01-02T18:17:08.332355+0000","last_peered":"2023-01-02T18:17:08.332355+0000","last_clean":"2023-01-02T18:17:08.332355+0000","last_became_active":"2023-01-02T18:16:41.447912+0000","last_became_peered":"2023-01-02T18:16:41.447912+0000","last_unstale":"2023-01-02T18:17:08.332355+0000","last_undegraded":"2023-01-02T18:17:08.332355+0000","last_fullsized":"2023-01-02T18:17:08.332355+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372478+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:17:08.372478+0000","last_peered":"2023-01-02T18:17:08.372478+0000","last_clean":"2023-01-02T18:17:08.372478+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:17:08.372478+0000","last_undegraded":"2023-01-02T18:17:08.372478+0000","last_fullsized":"2023-01-02T18:17:08.372478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"46'3","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.334114+0000","last_change":"2023-01-02T18:16:39.438228+0000","last_active":"2023-01-02T18:17:08.334114+0000","last_peered":"2023-01-02T18:17:08.334114+0000","last_clean":"2023-01-02T18:17:08.334114+0000","last_became_active":"2023-01-02T18:16:37.431863+0000","last_became_peered":"2023-01-02T18:16:37.431863+0000","last_unstale":"2023-01-02T18:17:08.334114+0000","last_undegraded":"2023-01-02T18:17:08.334114+0000","last_fullsized":"2023-01-02T18:17:08.334114+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333596+0000","last_change":"2023-01-02T18:16:53.344851+0000","last_active":"2023-01-02T18:17:08.333596+0000","last_peered":"2023-01-02T18:17:08.333596+0000","last_clean":"2023-01-02T18:17:08.333596+0000","last_became_active":"2023-01-02T18:16:51.341804+0000","last_became_peered":"2023-01-02T18:16:51.341804+0000","last_unstale":"2023-01-02T18:17:08.333596+0000","last_undegraded":"2023-01-02T18:17:08.333596+0000","last_fullsized":"2023-01-02T18:17:08.333596+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333295+0000","last_change":"2023-01-02T18:16:57.313134+0000","last_active":"2023-01-02T18:17:08.333295+0000","last_peered":"2023-01-02T18:17:08.333295+0000","last_clean":"2023-01-02T18:17:08.333295+0000","last_became_active":"2023-01-02T18:16:55.311645+0000","last_became_peered":"2023-01-02T18:16:55.311645+0000","last_unstale":"2023-01-02T18:17:08.333295+0000","last_undegraded":"2023-01-02T18:17:08.333295+0000","last_fullsized":"2023-01-02T18:17:08.333295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.323130+0000","last_change":"2023-01-02T18:17:09.323298+0000","last_active":"2023-01-02T18:17:09.323130+0000","last_peered":"2023-01-02T18:17:09.323130+0000","last_clean":"2023-01-02T18:17:09.323130+0000","last_became_active":"2023-01-02T18:17:07.342742+0000","last_became_peered":"2023-01-02T18:17:07.342742+0000","last_unstale":"2023-01-02T18:17:09.323130+0000","last_undegraded":"2023-01-02T18:17:09.323130+0000","last_fullsized":"2023-01-02T18:17:09.323130+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.f","version":"70'1","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.314400+0000","last_change":"2023-01-02T18:17:01.310492+0000","last_active":"2023-01-02T18:17:09.314400+0000","last_peered":"2023-01-02T18:17:09.314400+0000","last_clean":"2023-01-02T18:17:09.314400+0000","last_became_active":"2023-01-02T18:16:59.313793+0000","last_became_peered":"2023-01-02T18:16:59.313793+0000","last_unstale":"2023-01-02T18:17:09.314400+0000","last_undegraded":"2023-01-02T18:17:09.314400+0000","last_fullsized":"2023-01-02T18:17:09.314400+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"56'1","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438529+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:17:08.438529+0000","last_peered":"2023-01-02T18:17:08.438529+0000","last_clean":"2023-01-02T18:17:08.438529+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:17:08.438529+0000","last_undegraded":"2023-01-02T18:17:08.438529+0000","last_fullsized":"2023-01-02T18:17:08.438529+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":108,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439263+0000","last_change":"2023-01-02T18:16:44.300067+0000","last_active":"2023-01-02T18:17:08.439263+0000","last_peered":"2023-01-02T18:17:08.439263+0000","last_clean":"2023-01-02T18:17:08.439263+0000","last_became_active":"2023-01-02T18:16:42.450970+0000","last_became_peered":"2023-01-02T18:16:42.450970+0000","last_unstale":"2023-01-02T18:17:08.439263+0000","last_undegraded":"2023-01-02T18:17:08.439263+0000","last_fullsized":"2023-01-02T18:17:08.439263+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":83,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"46'2","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372070+0000","last_change":"2023-01-02T18:16:39.426089+0000","last_active":"2023-01-02T18:17:08.372070+0000","last_peered":"2023-01-02T18:17:08.372070+0000","last_clean":"2023-01-02T18:17:08.372070+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:17:08.372070+0000","last_undegraded":"2023-01-02T18:17:08.372070+0000","last_fullsized":"2023-01-02T18:17:08.372070+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439672+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:17:08.439672+0000","last_peered":"2023-01-02T18:17:08.439672+0000","last_clean":"2023-01-02T18:17:08.439672+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:17:08.439672+0000","last_undegraded":"2023-01-02T18:17:08.439672+0000","last_fullsized":"2023-01-02T18:17:08.439672+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438581+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:17:08.438581+0000","last_peered":"2023-01-02T18:17:08.438581+0000","last_clean":"2023-01-02T18:17:08.438581+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:17:08.438581+0000","last_undegraded":"2023-01-02T18:17:08.438581+0000","last_fullsized":"2023-01-02T18:17:08.438581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332096+0000","last_change":"2023-01-02T18:16:57.312360+0000","last_active":"2023-01-02T18:17:08.332096+0000","last_peered":"2023-01-02T18:17:08.332096+0000","last_clean":"2023-01-02T18:17:08.332096+0000","last_became_active":"2023-01-02T18:16:55.317478+0000","last_became_peered":"2023-01-02T18:16:55.317478+0000","last_unstale":"2023-01-02T18:17:08.332096+0000","last_undegraded":"2023-01-02T18:17:08.332096+0000","last_fullsized":"2023-01-02T18:17:08.332096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.320299+0000","last_change":"2023-01-02T18:17:09.321395+0000","last_active":"2023-01-02T18:17:09.320299+0000","last_peered":"2023-01-02T18:17:09.320299+0000","last_clean":"2023-01-02T18:17:09.320299+0000","last_became_active":"2023-01-02T18:17:07.344789+0000","last_became_peered":"2023-01-02T18:17:07.344789+0000","last_unstale":"2023-01-02T18:17:09.320299+0000","last_undegraded":"2023-01-02T18:17:09.320299+0000","last_fullsized":"2023-01-02T18:17:09.320299+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.a","version":"71'3","reported_seq":26,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.307242+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:17:09.307242+0000","last_peered":"2023-01-02T18:17:09.307242+0000","last_clean":"2023-01-02T18:17:09.307242+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:17:09.307242+0000","last_undegraded":"2023-01-02T18:17:09.307242+0000","last_fullsized":"2023-01-02T18:17:09.307242+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'2","reported_seq":43,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.329952+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:17:08.329952+0000","last_peered":"2023-01-02T18:17:08.329952+0000","last_clean":"2023-01-02T18:17:08.329952+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:17:08.329952+0000","last_undegraded":"2023-01-02T18:17:08.329952+0000","last_fullsized":"2023-01-02T18:17:08.329952+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"46'13","reported_seq":115,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327348+0000","last_change":"2023-01-02T18:16:48.342853+0000","last_active":"2023-01-02T18:17:08.327348+0000","last_peered":"2023-01-02T18:17:08.327348+0000","last_clean":"2023-01-02T18:17:08.327348+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:08.327348+0000","last_undegraded":"2023-01-02T18:17:08.327348+0000","last_fullsized":"2023-01-02T18:17:08.327348+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":92,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":59,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332337+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:17:08.332337+0000","last_peered":"2023-01-02T18:17:08.332337+0000","last_clean":"2023-01-02T18:17:08.332337+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:17:08.332337+0000","last_undegraded":"2023-01-02T18:17:08.332337+0000","last_fullsized":"2023-01-02T18:17:08.332337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372578+0000","last_change":"2023-01-02T18:16:49.298888+0000","last_active":"2023-01-02T18:17:08.372578+0000","last_peered":"2023-01-02T18:17:08.372578+0000","last_clean":"2023-01-02T18:17:08.372578+0000","last_became_active":"2023-01-02T18:16:46.314689+0000","last_became_peered":"2023-01-02T18:16:46.314689+0000","last_unstale":"2023-01-02T18:17:08.372578+0000","last_undegraded":"2023-01-02T18:17:08.372578+0000","last_fullsized":"2023-01-02T18:17:08.372578+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371935+0000","last_change":"2023-01-02T18:16:53.344265+0000","last_active":"2023-01-02T18:17:08.371935+0000","last_peered":"2023-01-02T18:17:08.371935+0000","last_clean":"2023-01-02T18:17:08.371935+0000","last_became_active":"2023-01-02T18:16:51.342951+0000","last_became_peered":"2023-01-02T18:16:51.342951+0000","last_unstale":"2023-01-02T18:17:08.371935+0000","last_undegraded":"2023-01-02T18:17:08.371935+0000","last_fullsized":"2023-01-02T18:17:08.371935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439879+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:17:08.439879+0000","last_peered":"2023-01-02T18:17:08.439879+0000","last_clean":"2023-01-02T18:17:08.439879+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:17:08.439879+0000","last_undegraded":"2023-01-02T18:17:08.439879+0000","last_fullsized":"2023-01-02T18:17:08.439879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.304533+0000","last_change":"2023-01-02T18:17:09.306719+0000","last_active":"2023-01-02T18:17:09.304533+0000","last_peered":"2023-01-02T18:17:09.304533+0000","last_clean":"2023-01-02T18:17:09.304533+0000","last_became_active":"2023-01-02T18:17:07.336185+0000","last_became_peered":"2023-01-02T18:17:07.336185+0000","last_unstale":"2023-01-02T18:17:09.304533+0000","last_undegraded":"2023-01-02T18:17:09.304533+0000","last_fullsized":"2023-01-02T18:17:09.304533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.9","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.330776+0000","last_change":"2023-01-02T18:17:01.316849+0000","last_active":"2023-01-02T18:17:09.330776+0000","last_peered":"2023-01-02T18:17:09.330776+0000","last_clean":"2023-01-02T18:17:09.330776+0000","last_became_active":"2023-01-02T18:16:59.320366+0000","last_became_peered":"2023-01-02T18:16:59.320366+0000","last_unstale":"2023-01-02T18:17:09.330776+0000","last_undegraded":"2023-01-02T18:17:09.330776+0000","last_fullsized":"2023-01-02T18:17:09.330776+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.441230+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:17:08.441230+0000","last_peered":"2023-01-02T18:17:08.441230+0000","last_clean":"2023-01-02T18:17:08.441230+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:17:08.441230+0000","last_undegraded":"2023-01-02T18:17:08.441230+0000","last_fullsized":"2023-01-02T18:17:08.441230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":54,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439445+0000","last_change":"2023-01-02T18:16:48.345373+0000","last_active":"2023-01-02T18:17:08.439445+0000","last_peered":"2023-01-02T18:17:08.439445+0000","last_clean":"2023-01-02T18:17:08.439445+0000","last_became_active":"2023-01-02T18:16:48.328041+0000","last_became_peered":"2023-01-02T18:16:48.328041+0000","last_unstale":"2023-01-02T18:17:08.439445+0000","last_undegraded":"2023-01-02T18:17:08.439445+0000","last_fullsized":"2023-01-02T18:17:08.439445+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"46'5","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333510+0000","last_change":"2023-01-02T18:16:42.455990+0000","last_active":"2023-01-02T18:17:08.333510+0000","last_peered":"2023-01-02T18:17:08.333510+0000","last_clean":"2023-01-02T18:17:08.333510+0000","last_became_active":"2023-01-02T18:16:42.441589+0000","last_became_peered":"2023-01-02T18:16:42.441589+0000","last_unstale":"2023-01-02T18:17:08.333510+0000","last_undegraded":"2023-01-02T18:17:08.333510+0000","last_fullsized":"2023-01-02T18:17:08.333510+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439115+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:17:08.439115+0000","last_peered":"2023-01-02T18:17:08.439115+0000","last_clean":"2023-01-02T18:17:08.439115+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:17:08.439115+0000","last_undegraded":"2023-01-02T18:17:08.439115+0000","last_fullsized":"2023-01-02T18:17:08.439115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439225+0000","last_change":"2023-01-02T18:16:42.460481+0000","last_active":"2023-01-02T18:17:08.439225+0000","last_peered":"2023-01-02T18:17:08.439225+0000","last_clean":"2023-01-02T18:17:08.439225+0000","last_became_active":"2023-01-02T18:16:42.460130+0000","last_became_peered":"2023-01-02T18:16:42.460130+0000","last_unstale":"2023-01-02T18:17:08.439225+0000","last_undegraded":"2023-01-02T18:17:08.439225+0000","last_fullsized":"2023-01-02T18:17:08.439225+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":547,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.334262+0000","last_change":"2023-01-02T18:16:53.345442+0000","last_active":"2023-01-02T18:17:08.334262+0000","last_peered":"2023-01-02T18:17:08.334262+0000","last_clean":"2023-01-02T18:17:08.334262+0000","last_became_active":"2023-01-02T18:16:51.341121+0000","last_became_peered":"2023-01-02T18:16:51.341121+0000","last_unstale":"2023-01-02T18:17:08.334262+0000","last_undegraded":"2023-01-02T18:17:08.334262+0000","last_fullsized":"2023-01-02T18:17:08.334262+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.330384+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:17:08.330384+0000","last_peered":"2023-01-02T18:17:08.330384+0000","last_clean":"2023-01-02T18:17:08.330384+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:17:08.330384+0000","last_undegraded":"2023-01-02T18:17:08.330384+0000","last_fullsized":"2023-01-02T18:17:08.330384+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.322680+0000","last_change":"2023-01-02T18:17:09.322846+0000","last_active":"2023-01-02T18:17:09.322680+0000","last_peered":"2023-01-02T18:17:09.322680+0000","last_clean":"2023-01-02T18:17:09.322680+0000","last_became_active":"2023-01-02T18:17:07.342985+0000","last_became_peered":"2023-01-02T18:17:07.342985+0000","last_unstale":"2023-01-02T18:17:09.322680+0000","last_undegraded":"2023-01-02T18:17:09.322680+0000","last_fullsized":"2023-01-02T18:17:09.322680+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.b","version":"72'1","reported_seq":24,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.309317+0000","last_change":"2023-01-02T18:17:01.311985+0000","last_active":"2023-01-02T18:17:09.309317+0000","last_peered":"2023-01-02T18:17:09.309317+0000","last_clean":"2023-01-02T18:17:09.309317+0000","last_became_active":"2023-01-02T18:16:59.316880+0000","last_became_peered":"2023-01-02T18:16:59.316880+0000","last_unstale":"2023-01-02T18:17:09.309317+0000","last_undegraded":"2023-01-02T18:17:09.309317+0000","last_fullsized":"2023-01-02T18:17:09.309317+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372528+0000","last_change":"2023-01-02T18:16:44.298099+0000","last_active":"2023-01-02T18:17:08.372528+0000","last_peered":"2023-01-02T18:17:08.372528+0000","last_clean":"2023-01-02T18:17:08.372528+0000","last_became_active":"2023-01-02T18:16:42.439207+0000","last_became_peered":"2023-01-02T18:16:42.439207+0000","last_unstale":"2023-01-02T18:17:08.372528+0000","last_undegraded":"2023-01-02T18:17:08.372528+0000","last_fullsized":"2023-01-02T18:17:08.372528+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"46'7","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371217+0000","last_change":"2023-01-02T18:16:39.426307+0000","last_active":"2023-01-02T18:17:08.371217+0000","last_peered":"2023-01-02T18:17:08.371217+0000","last_clean":"2023-01-02T18:17:08.371217+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:17:08.371217+0000","last_undegraded":"2023-01-02T18:17:08.371217+0000","last_fullsized":"2023-01-02T18:17:08.371217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":95,"num_read_kb":82,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332414+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:17:08.332414+0000","last_peered":"2023-01-02T18:17:08.332414+0000","last_clean":"2023-01-02T18:17:08.332414+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:17:08.332414+0000","last_undegraded":"2023-01-02T18:17:08.332414+0000","last_fullsized":"2023-01-02T18:17:08.332414+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.328802+0000","last_change":"2023-01-02T18:16:49.298954+0000","last_active":"2023-01-02T18:17:08.328802+0000","last_peered":"2023-01-02T18:17:08.328802+0000","last_clean":"2023-01-02T18:17:08.328802+0000","last_became_active":"2023-01-02T18:16:46.316378+0000","last_became_peered":"2023-01-02T18:16:46.316378+0000","last_unstale":"2023-01-02T18:17:08.328802+0000","last_undegraded":"2023-01-02T18:17:08.328802+0000","last_fullsized":"2023-01-02T18:17:08.328802+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439759+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:17:08.439759+0000","last_peered":"2023-01-02T18:17:08.439759+0000","last_clean":"2023-01-02T18:17:08.439759+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:17:08.439759+0000","last_undegraded":"2023-01-02T18:17:08.439759+0000","last_fullsized":"2023-01-02T18:17:08.439759+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.328467+0000","last_change":"2023-01-02T18:16:57.306312+0000","last_active":"2023-01-02T18:17:08.328467+0000","last_peered":"2023-01-02T18:17:08.328467+0000","last_clean":"2023-01-02T18:17:08.328467+0000","last_became_active":"2023-01-02T18:16:55.314537+0000","last_became_peered":"2023-01-02T18:16:55.314537+0000","last_unstale":"2023-01-02T18:17:08.328467+0000","last_undegraded":"2023-01-02T18:17:08.328467+0000","last_fullsized":"2023-01-02T18:17:08.328467+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.320962+0000","last_change":"2023-01-02T18:17:09.322082+0000","last_active":"2023-01-02T18:17:09.320962+0000","last_peered":"2023-01-02T18:17:09.320962+0000","last_clean":"2023-01-02T18:17:09.320962+0000","last_became_active":"2023-01-02T18:17:07.340751+0000","last_became_peered":"2023-01-02T18:17:07.340751+0000","last_unstale":"2023-01-02T18:17:09.320962+0000","last_undegraded":"2023-01-02T18:17:09.320962+0000","last_fullsized":"2023-01-02T18:17:09.320962+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.8","version":"68'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.304560+0000","last_change":"2023-01-02T18:17:01.311731+0000","last_active":"2023-01-02T18:17:09.304560+0000","last_peered":"2023-01-02T18:17:09.304560+0000","last_clean":"2023-01-02T18:17:09.304560+0000","last_became_active":"2023-01-02T18:16:59.312608+0000","last_became_peered":"2023-01-02T18:16:59.312608+0000","last_unstale":"2023-01-02T18:17:09.304560+0000","last_undegraded":"2023-01-02T18:17:09.304560+0000","last_fullsized":"2023-01-02T18:17:09.304560+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371995+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:17:08.371995+0000","last_peered":"2023-01-02T18:17:08.371995+0000","last_clean":"2023-01-02T18:17:08.371995+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:17:08.371995+0000","last_undegraded":"2023-01-02T18:17:08.371995+0000","last_fullsized":"2023-01-02T18:17:08.371995+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"46'1","reported_seq":34,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438573+0000","last_change":"2023-01-02T18:16:48.356953+0000","last_active":"2023-01-02T18:17:08.438573+0000","last_peered":"2023-01-02T18:17:08.438573+0000","last_clean":"2023-01-02T18:17:08.438573+0000","last_became_active":"2023-01-02T18:16:48.335418+0000","last_became_peered":"2023-01-02T18:16:48.335418+0000","last_unstale":"2023-01-02T18:17:08.438573+0000","last_undegraded":"2023-01-02T18:17:08.438573+0000","last_fullsized":"2023-01-02T18:17:08.438573+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371657+0000","last_change":"2023-01-02T18:16:42.442424+0000","last_active":"2023-01-02T18:17:08.371657+0000","last_peered":"2023-01-02T18:17:08.371657+0000","last_clean":"2023-01-02T18:17:08.371657+0000","last_became_active":"2023-01-02T18:16:42.442110+0000","last_became_peered":"2023-01-02T18:16:42.442110+0000","last_unstale":"2023-01-02T18:17:08.371657+0000","last_undegraded":"2023-01-02T18:17:08.371657+0000","last_fullsized":"2023-01-02T18:17:08.371657+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.328535+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:17:08.328535+0000","last_peered":"2023-01-02T18:17:08.328535+0000","last_clean":"2023-01-02T18:17:08.328535+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:17:08.328535+0000","last_undegraded":"2023-01-02T18:17:08.328535+0000","last_fullsized":"2023-01-02T18:17:08.328535+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333231+0000","last_change":"2023-01-02T18:16:53.345663+0000","last_active":"2023-01-02T18:17:08.333231+0000","last_peered":"2023-01-02T18:17:08.333231+0000","last_clean":"2023-01-02T18:17:08.333231+0000","last_became_active":"2023-01-02T18:16:51.341075+0000","last_became_peered":"2023-01-02T18:16:51.341075+0000","last_unstale":"2023-01-02T18:17:08.333231+0000","last_undegraded":"2023-01-02T18:17:08.333231+0000","last_fullsized":"2023-01-02T18:17:08.333231+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.440310+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:17:08.440310+0000","last_peered":"2023-01-02T18:17:08.440310+0000","last_clean":"2023-01-02T18:17:08.440310+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:17:08.440310+0000","last_undegraded":"2023-01-02T18:17:08.440310+0000","last_fullsized":"2023-01-02T18:17:08.440310+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.312201+0000","last_change":"2023-01-02T18:17:09.315581+0000","last_active":"2023-01-02T18:17:09.312201+0000","last_peered":"2023-01-02T18:17:09.312201+0000","last_clean":"2023-01-02T18:17:09.312201+0000","last_became_active":"2023-01-02T18:17:07.337862+0000","last_became_peered":"2023-01-02T18:17:07.337862+0000","last_unstale":"2023-01-02T18:17:09.312201+0000","last_undegraded":"2023-01-02T18:17:09.312201+0000","last_fullsized":"2023-01-02T18:17:09.312201+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.e","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.321207+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:17:09.321207+0000","last_peered":"2023-01-02T18:17:09.321207+0000","last_clean":"2023-01-02T18:17:09.321207+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:17:09.321207+0000","last_undegraded":"2023-01-02T18:17:09.321207+0000","last_fullsized":"2023-01-02T18:17:09.321207+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'4","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439171+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:17:08.439171+0000","last_peered":"2023-01-02T18:17:08.439171+0000","last_clean":"2023-01-02T18:17:08.439171+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:08.439171+0000","last_undegraded":"2023-01-02T18:17:08.439171+0000","last_fullsized":"2023-01-02T18:17:08.439171+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":50,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371788+0000","last_change":"2023-01-02T18:16:48.336174+0000","last_active":"2023-01-02T18:17:08.371788+0000","last_peered":"2023-01-02T18:17:08.371788+0000","last_clean":"2023-01-02T18:17:08.371788+0000","last_became_active":"2023-01-02T18:16:48.335738+0000","last_became_peered":"2023-01-02T18:16:48.335738+0000","last_unstale":"2023-01-02T18:17:08.371788+0000","last_undegraded":"2023-01-02T18:17:08.371788+0000","last_fullsized":"2023-01-02T18:17:08.371788+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"46'1","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332906+0000","last_change":"2023-01-02T18:16:42.463393+0000","last_active":"2023-01-02T18:17:08.332906+0000","last_peered":"2023-01-02T18:17:08.332906+0000","last_clean":"2023-01-02T18:17:08.332906+0000","last_became_active":"2023-01-02T18:16:42.461031+0000","last_became_peered":"2023-01-02T18:16:42.461031+0000","last_unstale":"2023-01-02T18:17:08.332906+0000","last_undegraded":"2023-01-02T18:17:08.332906+0000","last_fullsized":"2023-01-02T18:17:08.332906+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372029+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:17:08.372029+0000","last_peered":"2023-01-02T18:17:08.372029+0000","last_clean":"2023-01-02T18:17:08.372029+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:17:08.372029+0000","last_undegraded":"2023-01-02T18:17:08.372029+0000","last_fullsized":"2023-01-02T18:17:08.372029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327393+0000","last_change":"2023-01-02T18:16:53.685845+0000","last_active":"2023-01-02T18:17:08.327393+0000","last_peered":"2023-01-02T18:17:08.327393+0000","last_clean":"2023-01-02T18:17:08.327393+0000","last_became_active":"2023-01-02T18:16:51.345111+0000","last_became_peered":"2023-01-02T18:16:51.345111+0000","last_unstale":"2023-01-02T18:17:08.327393+0000","last_undegraded":"2023-01-02T18:17:08.327393+0000","last_fullsized":"2023-01-02T18:17:08.327393+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332197+0000","last_change":"2023-01-02T18:16:57.312915+0000","last_active":"2023-01-02T18:17:08.332197+0000","last_peered":"2023-01-02T18:17:08.332197+0000","last_clean":"2023-01-02T18:17:08.332197+0000","last_became_active":"2023-01-02T18:16:55.310046+0000","last_became_peered":"2023-01-02T18:16:55.310046+0000","last_unstale":"2023-01-02T18:17:08.332197+0000","last_undegraded":"2023-01-02T18:17:08.332197+0000","last_fullsized":"2023-01-02T18:17:08.332197+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"76'2","reported_seq":17,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.341905+0000","last_change":"2023-01-02T18:17:09.308235+0000","last_active":"2023-01-02T18:17:09.341905+0000","last_peered":"2023-01-02T18:17:09.341905+0000","last_clean":"2023-01-02T18:17:09.341905+0000","last_became_active":"2023-01-02T18:17:07.340498+0000","last_became_peered":"2023-01-02T18:17:07.340498+0000","last_unstale":"2023-01-02T18:17:09.341905+0000","last_undegraded":"2023-01-02T18:17:09.341905+0000","last_fullsized":"2023-01-02T18:17:09.341905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.3","version":"69'1","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.331313+0000","last_change":"2023-01-02T18:17:01.317345+0000","last_active":"2023-01-02T18:17:09.331313+0000","last_peered":"2023-01-02T18:17:09.331313+0000","last_clean":"2023-01-02T18:17:09.331313+0000","last_became_active":"2023-01-02T18:16:59.309565+0000","last_became_peered":"2023-01-02T18:16:59.309565+0000","last_unstale":"2023-01-02T18:17:09.331313+0000","last_undegraded":"2023-01-02T18:17:09.331313+0000","last_fullsized":"2023-01-02T18:17:09.331313+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":11,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372487+0000","last_change":"2023-01-02T18:16:44.298243+0000","last_active":"2023-01-02T18:17:08.372487+0000","last_peered":"2023-01-02T18:17:08.372487+0000","last_clean":"2023-01-02T18:17:08.372487+0000","last_became_active":"2023-01-02T18:16:41.448643+0000","last_became_peered":"2023-01-02T18:16:41.448643+0000","last_unstale":"2023-01-02T18:17:08.372487+0000","last_undegraded":"2023-01-02T18:17:08.372487+0000","last_fullsized":"2023-01-02T18:17:08.372487+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"46'7","reported_seq":55,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332227+0000","last_change":"2023-01-02T18:16:39.438368+0000","last_active":"2023-01-02T18:17:08.332227+0000","last_peered":"2023-01-02T18:17:08.332227+0000","last_clean":"2023-01-02T18:17:08.332227+0000","last_became_active":"2023-01-02T18:16:37.414106+0000","last_became_peered":"2023-01-02T18:16:37.414106+0000","last_unstale":"2023-01-02T18:17:08.332227+0000","last_undegraded":"2023-01-02T18:17:08.332227+0000","last_fullsized":"2023-01-02T18:17:08.332227+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":9,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.330226+0000","last_change":"2023-01-02T18:16:49.324748+0000","last_active":"2023-01-02T18:17:08.330226+0000","last_peered":"2023-01-02T18:17:08.330226+0000","last_clean":"2023-01-02T18:17:08.330226+0000","last_became_active":"2023-01-02T18:16:48.317958+0000","last_became_peered":"2023-01-02T18:16:48.317958+0000","last_unstale":"2023-01-02T18:17:08.330226+0000","last_undegraded":"2023-01-02T18:17:08.330226+0000","last_fullsized":"2023-01-02T18:17:08.330226+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.328703+0000","last_change":"2023-01-02T18:16:53.686661+0000","last_active":"2023-01-02T18:17:08.328703+0000","last_peered":"2023-01-02T18:17:08.328703+0000","last_clean":"2023-01-02T18:17:08.328703+0000","last_became_active":"2023-01-02T18:16:51.345330+0000","last_became_peered":"2023-01-02T18:16:51.345330+0000","last_unstale":"2023-01-02T18:17:08.328703+0000","last_undegraded":"2023-01-02T18:17:08.328703+0000","last_fullsized":"2023-01-02T18:17:08.328703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.440101+0000","last_change":"2023-01-02T18:16:57.307540+0000","last_active":"2023-01-02T18:17:08.440101+0000","last_peered":"2023-01-02T18:17:08.440101+0000","last_clean":"2023-01-02T18:17:08.440101+0000","last_became_active":"2023-01-02T18:16:55.319082+0000","last_became_peered":"2023-01-02T18:16:55.319082+0000","last_unstale":"2023-01-02T18:17:08.440101+0000","last_undegraded":"2023-01-02T18:17:08.440101+0000","last_fullsized":"2023-01-02T18:17:08.440101+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.322965+0000","last_change":"2023-01-02T18:17:09.323147+0000","last_active":"2023-01-02T18:17:09.322965+0000","last_peered":"2023-01-02T18:17:09.322965+0000","last_clean":"2023-01-02T18:17:09.322965+0000","last_became_active":"2023-01-02T18:17:07.341052+0000","last_became_peered":"2023-01-02T18:17:07.341052+0000","last_unstale":"2023-01-02T18:17:09.322965+0000","last_undegraded":"2023-01-02T18:17:09.322965+0000","last_fullsized":"2023-01-02T18:17:09.322965+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.2","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.320297+0000","last_change":"2023-01-02T18:17:01.318897+0000","last_active":"2023-01-02T18:17:09.320297+0000","last_peered":"2023-01-02T18:17:09.320297+0000","last_clean":"2023-01-02T18:17:09.320297+0000","last_became_active":"2023-01-02T18:16:59.321009+0000","last_became_peered":"2023-01-02T18:16:59.321009+0000","last_unstale":"2023-01-02T18:17:09.320297+0000","last_undegraded":"2023-01-02T18:17:09.320297+0000","last_fullsized":"2023-01-02T18:17:09.320297+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"51'1","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439819+0000","last_change":"2023-01-02T18:16:48.352507+0000","last_active":"2023-01-02T18:17:08.439819+0000","last_peered":"2023-01-02T18:17:08.439819+0000","last_clean":"2023-01-02T18:17:08.439819+0000","last_became_active":"2023-01-02T18:16:48.330483+0000","last_became_peered":"2023-01-02T18:16:48.330483+0000","last_unstale":"2023-01-02T18:17:08.439819+0000","last_undegraded":"2023-01-02T18:17:08.439819+0000","last_fullsized":"2023-01-02T18:17:08.439819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439654+0000","last_change":"2023-01-02T18:16:48.323820+0000","last_active":"2023-01-02T18:17:08.439654+0000","last_peered":"2023-01-02T18:17:08.439654+0000","last_clean":"2023-01-02T18:17:08.439654+0000","last_became_active":"2023-01-02T18:16:48.322710+0000","last_became_peered":"2023-01-02T18:16:48.322710+0000","last_unstale":"2023-01-02T18:17:08.439654+0000","last_undegraded":"2023-01-02T18:17:08.439654+0000","last_fullsized":"2023-01-02T18:17:08.439654+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":37,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.440192+0000","last_change":"2023-01-02T18:16:49.319064+0000","last_active":"2023-01-02T18:17:08.440192+0000","last_peered":"2023-01-02T18:17:08.440192+0000","last_clean":"2023-01-02T18:17:08.440192+0000","last_became_active":"2023-01-02T18:16:48.324476+0000","last_became_peered":"2023-01-02T18:16:48.324476+0000","last_unstale":"2023-01-02T18:17:08.440192+0000","last_undegraded":"2023-01-02T18:17:08.440192+0000","last_fullsized":"2023-01-02T18:17:08.440192+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333586+0000","last_change":"2023-01-02T18:16:53.345390+0000","last_active":"2023-01-02T18:17:08.333586+0000","last_peered":"2023-01-02T18:17:08.333586+0000","last_clean":"2023-01-02T18:17:08.333586+0000","last_became_active":"2023-01-02T18:16:51.339020+0000","last_became_peered":"2023-01-02T18:16:51.339020+0000","last_unstale":"2023-01-02T18:17:08.333586+0000","last_undegraded":"2023-01-02T18:17:08.333586+0000","last_fullsized":"2023-01-02T18:17:08.333586+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439858+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:17:08.439858+0000","last_peered":"2023-01-02T18:17:08.439858+0000","last_clean":"2023-01-02T18:17:08.439858+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:17:08.439858+0000","last_undegraded":"2023-01-02T18:17:08.439858+0000","last_fullsized":"2023-01-02T18:17:08.439858+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.330282+0000","last_change":"2023-01-02T18:17:09.330500+0000","last_active":"2023-01-02T18:17:09.330282+0000","last_peered":"2023-01-02T18:17:09.330282+0000","last_clean":"2023-01-02T18:17:09.330282+0000","last_became_active":"2023-01-02T18:17:07.345902+0000","last_became_peered":"2023-01-02T18:17:07.345902+0000","last_unstale":"2023-01-02T18:17:09.330282+0000","last_undegraded":"2023-01-02T18:17:09.330282+0000","last_fullsized":"2023-01-02T18:17:09.330282+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.1","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.305768+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:17:09.305768+0000","last_peered":"2023-01-02T18:17:09.305768+0000","last_clean":"2023-01-02T18:17:09.305768+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:17:09.305768+0000","last_undegraded":"2023-01-02T18:17:09.305768+0000","last_fullsized":"2023-01-02T18:17:09.305768+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372378+0000","last_change":"2023-01-02T18:16:48.329052+0000","last_active":"2023-01-02T18:17:08.372378+0000","last_peered":"2023-01-02T18:17:08.372378+0000","last_clean":"2023-01-02T18:17:08.372378+0000","last_became_active":"2023-01-02T18:16:48.327662+0000","last_became_peered":"2023-01-02T18:16:48.327662+0000","last_unstale":"2023-01-02T18:17:08.372378+0000","last_undegraded":"2023-01-02T18:17:08.372378+0000","last_fullsized":"2023-01-02T18:17:08.372378+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'4","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438701+0000","last_change":"2023-01-02T18:16:48.350389+0000","last_active":"2023-01-02T18:17:08.438701+0000","last_peered":"2023-01-02T18:17:08.438701+0000","last_clean":"2023-01-02T18:17:08.438701+0000","last_became_active":"2023-01-02T18:16:48.329461+0000","last_became_peered":"2023-01-02T18:16:48.329461+0000","last_unstale":"2023-01-02T18:17:08.438701+0000","last_undegraded":"2023-01-02T18:17:08.438701+0000","last_fullsized":"2023-01-02T18:17:08.438701+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327709+0000","last_change":"2023-01-02T18:16:49.323150+0000","last_active":"2023-01-02T18:17:08.327709+0000","last_peered":"2023-01-02T18:17:08.327709+0000","last_clean":"2023-01-02T18:17:08.327709+0000","last_became_active":"2023-01-02T18:16:48.326635+0000","last_became_peered":"2023-01-02T18:16:48.326635+0000","last_unstale":"2023-01-02T18:17:08.327709+0000","last_undegraded":"2023-01-02T18:17:08.327709+0000","last_fullsized":"2023-01-02T18:17:08.327709+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.334002+0000","last_change":"2023-01-02T18:16:53.345223+0000","last_active":"2023-01-02T18:17:08.334002+0000","last_peered":"2023-01-02T18:17:08.334002+0000","last_clean":"2023-01-02T18:17:08.334002+0000","last_became_active":"2023-01-02T18:16:51.341580+0000","last_became_peered":"2023-01-02T18:16:51.341580+0000","last_unstale":"2023-01-02T18:17:08.334002+0000","last_undegraded":"2023-01-02T18:17:08.334002+0000","last_fullsized":"2023-01-02T18:17:08.334002+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.328955+0000","last_change":"2023-01-02T18:16:57.305459+0000","last_active":"2023-01-02T18:17:08.328955+0000","last_peered":"2023-01-02T18:17:08.328955+0000","last_clean":"2023-01-02T18:17:08.328955+0000","last_became_active":"2023-01-02T18:16:55.315865+0000","last_became_peered":"2023-01-02T18:16:55.315865+0000","last_unstale":"2023-01-02T18:17:08.328955+0000","last_undegraded":"2023-01-02T18:17:08.328955+0000","last_fullsized":"2023-01-02T18:17:08.328955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.307596+0000","last_change":"2023-01-02T18:17:09.307789+0000","last_active":"2023-01-02T18:17:09.307596+0000","last_peered":"2023-01-02T18:17:09.307596+0000","last_clean":"2023-01-02T18:17:09.307596+0000","last_became_active":"2023-01-02T18:17:07.345090+0000","last_became_peered":"2023-01-02T18:17:07.345090+0000","last_unstale":"2023-01-02T18:17:09.307596+0000","last_undegraded":"2023-01-02T18:17:09.307596+0000","last_fullsized":"2023-01-02T18:17:09.307596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.0","version":"72'11","reported_seq":72,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.304694+0000","last_change":"2023-01-02T18:17:01.311899+0000","last_active":"2023-01-02T18:17:09.304694+0000","last_peered":"2023-01-02T18:17:09.304694+0000","last_clean":"2023-01-02T18:17:09.304694+0000","last_became_active":"2023-01-02T18:16:59.309612+0000","last_became_peered":"2023-01-02T18:16:59.309612+0000","last_unstale":"2023-01-02T18:17:09.304694+0000","last_undegraded":"2023-01-02T18:17:09.304694+0000","last_fullsized":"2023-01-02T18:17:09.304694+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":64,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333673+0000","last_change":"2023-01-02T18:16:48.328829+0000","last_active":"2023-01-02T18:17:08.333673+0000","last_peered":"2023-01-02T18:17:08.333673+0000","last_clean":"2023-01-02T18:17:08.333673+0000","last_became_active":"2023-01-02T18:16:48.328372+0000","last_became_peered":"2023-01-02T18:16:48.328372+0000","last_unstale":"2023-01-02T18:17:08.333673+0000","last_undegraded":"2023-01-02T18:17:08.333673+0000","last_fullsized":"2023-01-02T18:17:08.333673+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":45,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332930+0000","last_change":"2023-01-02T18:16:39.438088+0000","last_active":"2023-01-02T18:17:08.332930+0000","last_peered":"2023-01-02T18:17:08.332930+0000","last_clean":"2023-01-02T18:17:08.332930+0000","last_became_active":"2023-01-02T18:16:37.415896+0000","last_became_peered":"2023-01-02T18:16:37.415896+0000","last_unstale":"2023-01-02T18:17:08.332930+0000","last_undegraded":"2023-01-02T18:17:08.332930+0000","last_fullsized":"2023-01-02T18:17:08.332930+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'3","reported_seq":39,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439447+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:17:08.439447+0000","last_peered":"2023-01-02T18:17:08.439447+0000","last_clean":"2023-01-02T18:17:08.439447+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:17:08.439447+0000","last_undegraded":"2023-01-02T18:17:08.439447+0000","last_fullsized":"2023-01-02T18:17:08.439447+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372296+0000","last_change":"2023-01-02T18:16:53.344544+0000","last_active":"2023-01-02T18:17:08.372296+0000","last_peered":"2023-01-02T18:17:08.372296+0000","last_clean":"2023-01-02T18:17:08.372296+0000","last_became_active":"2023-01-02T18:16:51.339073+0000","last_became_peered":"2023-01-02T18:16:51.339073+0000","last_unstale":"2023-01-02T18:17:08.372296+0000","last_undegraded":"2023-01-02T18:17:08.372296+0000","last_fullsized":"2023-01-02T18:17:08.372296+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":122,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.329949+0000","last_change":"2023-01-02T18:16:57.307483+0000","last_active":"2023-01-02T18:17:08.329949+0000","last_peered":"2023-01-02T18:17:08.329949+0000","last_clean":"2023-01-02T18:17:08.329949+0000","last_became_active":"2023-01-02T18:16:55.316680+0000","last_became_peered":"2023-01-02T18:16:55.316680+0000","last_unstale":"2023-01-02T18:17:08.329949+0000","last_undegraded":"2023-01-02T18:17:08.329949+0000","last_fullsized":"2023-01-02T18:17:08.329949+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.315634+0000","last_change":"2023-01-02T18:17:09.315999+0000","last_active":"2023-01-02T18:17:09.315634+0000","last_peered":"2023-01-02T18:17:09.315634+0000","last_clean":"2023-01-02T18:17:09.315634+0000","last_became_active":"2023-01-02T18:17:07.342453+0000","last_became_peered":"2023-01-02T18:17:07.342453+0000","last_unstale":"2023-01-02T18:17:09.315634+0000","last_undegraded":"2023-01-02T18:17:09.315634+0000","last_fullsized":"2023-01-02T18:17:09.315634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.7","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.312219+0000","last_change":"2023-01-02T18:17:01.310439+0000","last_active":"2023-01-02T18:17:09.312219+0000","last_peered":"2023-01-02T18:17:09.312219+0000","last_clean":"2023-01-02T18:17:09.312219+0000","last_became_active":"2023-01-02T18:16:59.315925+0000","last_became_peered":"2023-01-02T18:16:59.315925+0000","last_unstale":"2023-01-02T18:17:09.312219+0000","last_undegraded":"2023-01-02T18:17:09.312219+0000","last_fullsized":"2023-01-02T18:17:09.312219+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.330172+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:17:08.330172+0000","last_peered":"2023-01-02T18:17:08.330172+0000","last_clean":"2023-01-02T18:17:08.330172+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:17:08.330172+0000","last_undegraded":"2023-01-02T18:17:08.330172+0000","last_fullsized":"2023-01-02T18:17:08.330172+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'5","reported_seq":61,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333317+0000","last_change":"2023-01-02T18:16:42.448542+0000","last_active":"2023-01-02T18:17:08.333317+0000","last_peered":"2023-01-02T18:17:08.333317+0000","last_clean":"2023-01-02T18:17:08.333317+0000","last_became_active":"2023-01-02T18:16:42.441102+0000","last_became_peered":"2023-01-02T18:16:42.441102+0000","last_unstale":"2023-01-02T18:17:08.333317+0000","last_undegraded":"2023-01-02T18:17:08.333317+0000","last_fullsized":"2023-01-02T18:17:08.333317+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333593+0000","last_change":"2023-01-02T18:16:49.309370+0000","last_active":"2023-01-02T18:17:08.333593+0000","last_peered":"2023-01-02T18:17:08.333593+0000","last_clean":"2023-01-02T18:17:08.333593+0000","last_became_active":"2023-01-02T18:16:48.323683+0000","last_became_peered":"2023-01-02T18:16:48.323683+0000","last_unstale":"2023-01-02T18:17:08.333593+0000","last_undegraded":"2023-01-02T18:17:08.333593+0000","last_fullsized":"2023-01-02T18:17:08.333593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439477+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:17:08.439477+0000","last_peered":"2023-01-02T18:17:08.439477+0000","last_clean":"2023-01-02T18:17:08.439477+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:17:08.439477+0000","last_undegraded":"2023-01-02T18:17:08.439477+0000","last_fullsized":"2023-01-02T18:17:08.439477+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439204+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:17:08.439204+0000","last_peered":"2023-01-02T18:17:08.439204+0000","last_clean":"2023-01-02T18:17:08.439204+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:17:08.439204+0000","last_undegraded":"2023-01-02T18:17:08.439204+0000","last_fullsized":"2023-01-02T18:17:08.439204+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.324035+0000","last_change":"2023-01-02T18:17:09.324144+0000","last_active":"2023-01-02T18:17:09.324035+0000","last_peered":"2023-01-02T18:17:09.324035+0000","last_clean":"2023-01-02T18:17:09.324035+0000","last_became_active":"2023-01-02T18:17:07.346984+0000","last_became_peered":"2023-01-02T18:17:07.346984+0000","last_unstale":"2023-01-02T18:17:09.324035+0000","last_undegraded":"2023-01-02T18:17:09.324035+0000","last_fullsized":"2023-01-02T18:17:09.324035+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.6","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.321414+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:17:09.321414+0000","last_peered":"2023-01-02T18:17:09.321414+0000","last_clean":"2023-01-02T18:17:09.321414+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:17:09.321414+0000","last_undegraded":"2023-01-02T18:17:09.321414+0000","last_fullsized":"2023-01-02T18:17:09.321414+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438381+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:17:08.438381+0000","last_peered":"2023-01-02T18:17:08.438381+0000","last_clean":"2023-01-02T18:17:08.438381+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:17:08.438381+0000","last_undegraded":"2023-01-02T18:17:08.438381+0000","last_fullsized":"2023-01-02T18:17:08.438381+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"46'4","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439720+0000","last_change":"2023-01-02T18:16:42.453646+0000","last_active":"2023-01-02T18:17:08.439720+0000","last_peered":"2023-01-02T18:17:08.439720+0000","last_clean":"2023-01-02T18:17:08.439720+0000","last_became_active":"2023-01-02T18:16:42.445252+0000","last_became_peered":"2023-01-02T18:16:42.445252+0000","last_unstale":"2023-01-02T18:17:08.439720+0000","last_undegraded":"2023-01-02T18:17:08.439720+0000","last_fullsized":"2023-01-02T18:17:08.439720+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":30,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"56'8","reported_seq":47,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327245+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:17:08.327245+0000","last_peered":"2023-01-02T18:17:08.327245+0000","last_clean":"2023-01-02T18:17:08.327245+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:17:08.327245+0000","last_undegraded":"2023-01-02T18:17:08.327245+0000","last_fullsized":"2023-01-02T18:17:08.327245+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439418+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:17:08.439418+0000","last_peered":"2023-01-02T18:17:08.439418+0000","last_clean":"2023-01-02T18:17:08.439418+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:17:08.439418+0000","last_undegraded":"2023-01-02T18:17:08.439418+0000","last_fullsized":"2023-01-02T18:17:08.439418+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327814+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:17:08.327814+0000","last_peered":"2023-01-02T18:17:08.327814+0000","last_clean":"2023-01-02T18:17:08.327814+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:17:08.327814+0000","last_undegraded":"2023-01-02T18:17:08.327814+0000","last_fullsized":"2023-01-02T18:17:08.327814+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.307600+0000","last_change":"2023-01-02T18:17:09.308354+0000","last_active":"2023-01-02T18:17:09.307600+0000","last_peered":"2023-01-02T18:17:09.307600+0000","last_clean":"2023-01-02T18:17:09.307600+0000","last_became_active":"2023-01-02T18:17:07.339211+0000","last_became_peered":"2023-01-02T18:17:07.339211+0000","last_unstale":"2023-01-02T18:17:09.307600+0000","last_undegraded":"2023-01-02T18:17:09.307600+0000","last_fullsized":"2023-01-02T18:17:09.307600+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.5","version":"71'2","reported_seq":35,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.331119+0000","last_change":"2023-01-02T18:17:01.317443+0000","last_active":"2023-01-02T18:17:09.331119+0000","last_peered":"2023-01-02T18:17:09.331119+0000","last_clean":"2023-01-02T18:17:09.331119+0000","last_became_active":"2023-01-02T18:16:59.311550+0000","last_became_peered":"2023-01-02T18:16:59.311550+0000","last_unstale":"2023-01-02T18:17:09.331119+0000","last_undegraded":"2023-01-02T18:17:09.331119+0000","last_fullsized":"2023-01-02T18:17:09.331119+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"51'3","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332306+0000","last_change":"2023-01-02T18:16:48.345208+0000","last_active":"2023-01-02T18:17:08.332306+0000","last_peered":"2023-01-02T18:17:08.332306+0000","last_clean":"2023-01-02T18:17:08.332306+0000","last_became_active":"2023-01-02T18:16:48.327080+0000","last_became_peered":"2023-01-02T18:16:48.327080+0000","last_unstale":"2023-01-02T18:17:08.332306+0000","last_undegraded":"2023-01-02T18:17:08.332306+0000","last_fullsized":"2023-01-02T18:17:08.332306+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439484+0000","last_change":"2023-01-02T18:16:48.347211+0000","last_active":"2023-01-02T18:17:08.439484+0000","last_peered":"2023-01-02T18:17:08.439484+0000","last_clean":"2023-01-02T18:17:08.439484+0000","last_became_active":"2023-01-02T18:16:48.327374+0000","last_became_peered":"2023-01-02T18:16:48.327374+0000","last_unstale":"2023-01-02T18:17:08.439484+0000","last_undegraded":"2023-01-02T18:17:08.439484+0000","last_fullsized":"2023-01-02T18:17:08.439484+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327304+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:17:08.327304+0000","last_peered":"2023-01-02T18:17:08.327304+0000","last_clean":"2023-01-02T18:17:08.327304+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:17:08.327304+0000","last_undegraded":"2023-01-02T18:17:08.327304+0000","last_fullsized":"2023-01-02T18:17:08.327304+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333214+0000","last_change":"2023-01-02T18:16:53.342610+0000","last_active":"2023-01-02T18:17:08.333214+0000","last_peered":"2023-01-02T18:17:08.333214+0000","last_clean":"2023-01-02T18:17:08.333214+0000","last_became_active":"2023-01-02T18:16:51.341683+0000","last_became_peered":"2023-01-02T18:16:51.341683+0000","last_unstale":"2023-01-02T18:17:08.333214+0000","last_undegraded":"2023-01-02T18:17:08.333214+0000","last_fullsized":"2023-01-02T18:17:08.333214+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333387+0000","last_change":"2023-01-02T18:16:57.312289+0000","last_active":"2023-01-02T18:17:08.333387+0000","last_peered":"2023-01-02T18:17:08.333387+0000","last_clean":"2023-01-02T18:17:08.333387+0000","last_became_active":"2023-01-02T18:16:55.317023+0000","last_became_peered":"2023-01-02T18:16:55.317023+0000","last_unstale":"2023-01-02T18:17:08.333387+0000","last_undegraded":"2023-01-02T18:17:08.333387+0000","last_fullsized":"2023-01-02T18:17:08.333387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.323918+0000","last_change":"2023-01-02T18:17:09.324091+0000","last_active":"2023-01-02T18:17:09.323918+0000","last_peered":"2023-01-02T18:17:09.323918+0000","last_clean":"2023-01-02T18:17:09.323918+0000","last_became_active":"2023-01-02T18:17:07.346545+0000","last_became_peered":"2023-01-02T18:17:07.346545+0000","last_unstale":"2023-01-02T18:17:09.323918+0000","last_undegraded":"2023-01-02T18:17:09.323918+0000","last_fullsized":"2023-01-02T18:17:09.323918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.4","version":"72'10","reported_seq":127,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.330892+0000","last_change":"2023-01-02T18:17:01.317071+0000","last_active":"2023-01-02T18:17:09.330892+0000","last_peered":"2023-01-02T18:17:09.330892+0000","last_clean":"2023-01-02T18:17:09.330892+0000","last_became_active":"2023-01-02T18:16:59.310165+0000","last_became_peered":"2023-01-02T18:16:59.310165+0000","last_unstale":"2023-01-02T18:17:09.330892+0000","last_undegraded":"2023-01-02T18:17:09.330892+0000","last_fullsized":"2023-01-02T18:17:09.330892+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"51'1","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438871+0000","last_change":"2023-01-02T18:16:44.299209+0000","last_active":"2023-01-02T18:17:08.438871+0000","last_peered":"2023-01-02T18:17:08.438871+0000","last_clean":"2023-01-02T18:17:08.438871+0000","last_became_active":"2023-01-02T18:16:42.441304+0000","last_became_peered":"2023-01-02T18:16:42.441304+0000","last_unstale":"2023-01-02T18:17:08.438871+0000","last_undegraded":"2023-01-02T18:17:08.438871+0000","last_fullsized":"2023-01-02T18:17:08.438871+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"46'7","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.440925+0000","last_change":"2023-01-02T18:16:48.341709+0000","last_active":"2023-01-02T18:17:08.440925+0000","last_peered":"2023-01-02T18:17:08.440925+0000","last_clean":"2023-01-02T18:17:08.440925+0000","last_became_active":"2023-01-02T18:16:48.324242+0000","last_became_peered":"2023-01-02T18:16:48.324242+0000","last_unstale":"2023-01-02T18:17:08.440925+0000","last_undegraded":"2023-01-02T18:17:08.440925+0000","last_fullsized":"2023-01-02T18:17:08.440925+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":46,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439573+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:17:08.439573+0000","last_peered":"2023-01-02T18:17:08.439573+0000","last_clean":"2023-01-02T18:17:08.439573+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:08.439573+0000","last_undegraded":"2023-01-02T18:17:08.439573+0000","last_fullsized":"2023-01-02T18:17:08.439573+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438299+0000","last_change":"2023-01-02T18:16:53.604245+0000","last_active":"2023-01-02T18:17:08.438299+0000","last_peered":"2023-01-02T18:17:08.438299+0000","last_clean":"2023-01-02T18:17:08.438299+0000","last_became_active":"2023-01-02T18:16:51.338292+0000","last_became_peered":"2023-01-02T18:16:51.338292+0000","last_unstale":"2023-01-02T18:17:08.438299+0000","last_undegraded":"2023-01-02T18:17:08.438299+0000","last_fullsized":"2023-01-02T18:17:08.438299+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371552+0000","last_change":"2023-01-02T18:16:57.317106+0000","last_active":"2023-01-02T18:17:08.371552+0000","last_peered":"2023-01-02T18:17:08.371552+0000","last_clean":"2023-01-02T18:17:08.371552+0000","last_became_active":"2023-01-02T18:16:55.308873+0000","last_became_peered":"2023-01-02T18:16:55.308873+0000","last_unstale":"2023-01-02T18:17:08.371552+0000","last_undegraded":"2023-01-02T18:17:08.371552+0000","last_fullsized":"2023-01-02T18:17:08.371552+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"76'2","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.529044+0000","last_change":"2023-01-02T18:17:09.308112+0000","last_active":"2023-01-02T18:17:09.529044+0000","last_peered":"2023-01-02T18:17:09.529044+0000","last_clean":"2023-01-02T18:17:09.529044+0000","last_became_active":"2023-01-02T18:17:07.336295+0000","last_became_peered":"2023-01-02T18:17:07.336295+0000","last_unstale":"2023-01-02T18:17:09.529044+0000","last_undegraded":"2023-01-02T18:17:09.529044+0000","last_fullsized":"2023-01-02T18:17:09.529044+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.1b","version":"72'85","reported_seq":682,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.330239+0000","last_change":"2023-01-02T18:17:01.316472+0000","last_active":"2023-01-02T18:17:09.330239+0000","last_peered":"2023-01-02T18:17:09.330239+0000","last_clean":"2023-01-02T18:17:09.330239+0000","last_became_active":"2023-01-02T18:16:59.310142+0000","last_became_peered":"2023-01-02T18:16:59.310142+0000","last_unstale":"2023-01-02T18:17:09.330239+0000","last_undegraded":"2023-01-02T18:17:09.330239+0000","last_fullsized":"2023-01-02T18:17:09.330239+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1544,"num_read_kb":1398,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.334083+0000","last_change":"2023-01-02T18:16:44.308280+0000","last_active":"2023-01-02T18:17:08.334083+0000","last_peered":"2023-01-02T18:17:08.334083+0000","last_clean":"2023-01-02T18:17:08.334083+0000","last_became_active":"2023-01-02T18:16:41.446391+0000","last_became_peered":"2023-01-02T18:16:41.446391+0000","last_unstale":"2023-01-02T18:17:08.334083+0000","last_undegraded":"2023-01-02T18:17:08.334083+0000","last_fullsized":"2023-01-02T18:17:08.334083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"46'2","reported_seq":51,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438086+0000","last_change":"2023-01-02T18:16:39.440808+0000","last_active":"2023-01-02T18:17:08.438086+0000","last_peered":"2023-01-02T18:17:08.438086+0000","last_clean":"2023-01-02T18:17:08.438086+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:17:08.438086+0000","last_undegraded":"2023-01-02T18:17:08.438086+0000","last_fullsized":"2023-01-02T18:17:08.438086+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333185+0000","last_change":"2023-01-02T18:16:49.310953+0000","last_active":"2023-01-02T18:17:08.333185+0000","last_peered":"2023-01-02T18:17:08.333185+0000","last_clean":"2023-01-02T18:17:08.333185+0000","last_became_active":"2023-01-02T18:16:46.312067+0000","last_became_peered":"2023-01-02T18:16:46.312067+0000","last_unstale":"2023-01-02T18:17:08.333185+0000","last_undegraded":"2023-01-02T18:17:08.333185+0000","last_fullsized":"2023-01-02T18:17:08.333185+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439807+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:17:08.439807+0000","last_peered":"2023-01-02T18:17:08.439807+0000","last_clean":"2023-01-02T18:17:08.439807+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:17:08.439807+0000","last_undegraded":"2023-01-02T18:17:08.439807+0000","last_fullsized":"2023-01-02T18:17:08.439807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333080+0000","last_change":"2023-01-02T18:16:57.313875+0000","last_active":"2023-01-02T18:17:08.333080+0000","last_peered":"2023-01-02T18:17:08.333080+0000","last_clean":"2023-01-02T18:17:08.333080+0000","last_became_active":"2023-01-02T18:16:55.318719+0000","last_became_peered":"2023-01-02T18:16:55.318719+0000","last_unstale":"2023-01-02T18:17:08.333080+0000","last_undegraded":"2023-01-02T18:17:08.333080+0000","last_fullsized":"2023-01-02T18:17:08.333080+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.307198+0000","last_change":"2023-01-02T18:17:09.307476+0000","last_active":"2023-01-02T18:17:09.307198+0000","last_peered":"2023-01-02T18:17:09.307198+0000","last_clean":"2023-01-02T18:17:09.307198+0000","last_became_active":"2023-01-02T18:17:07.336526+0000","last_became_peered":"2023-01-02T18:17:07.336526+0000","last_unstale":"2023-01-02T18:17:09.307198+0000","last_undegraded":"2023-01-02T18:17:09.307198+0000","last_fullsized":"2023-01-02T18:17:09.307198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.1a","version":"68'2","reported_seq":130,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.330608+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:17:09.330608+0000","last_peered":"2023-01-02T18:17:09.330608+0000","last_clean":"2023-01-02T18:17:09.330608+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:17:09.330608+0000","last_undegraded":"2023-01-02T18:17:09.330608+0000","last_fullsized":"2023-01-02T18:17:09.330608+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332982+0000","last_change":"2023-01-02T18:16:44.307606+0000","last_active":"2023-01-02T18:17:08.332982+0000","last_peered":"2023-01-02T18:17:08.332982+0000","last_clean":"2023-01-02T18:17:08.332982+0000","last_became_active":"2023-01-02T18:16:41.449266+0000","last_became_peered":"2023-01-02T18:16:41.449266+0000","last_unstale":"2023-01-02T18:17:08.332982+0000","last_undegraded":"2023-01-02T18:17:08.332982+0000","last_fullsized":"2023-01-02T18:17:08.332982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439427+0000","last_change":"2023-01-02T18:16:48.349656+0000","last_active":"2023-01-02T18:17:08.439427+0000","last_peered":"2023-01-02T18:17:08.439427+0000","last_clean":"2023-01-02T18:17:08.439427+0000","last_became_active":"2023-01-02T18:16:48.329249+0000","last_became_peered":"2023-01-02T18:16:48.329249+0000","last_unstale":"2023-01-02T18:17:08.439427+0000","last_undegraded":"2023-01-02T18:17:08.439427+0000","last_fullsized":"2023-01-02T18:17:08.439427+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.334208+0000","last_change":"2023-01-02T18:16:49.311129+0000","last_active":"2023-01-02T18:17:08.334208+0000","last_peered":"2023-01-02T18:17:08.334208+0000","last_clean":"2023-01-02T18:17:08.334208+0000","last_became_active":"2023-01-02T18:16:46.312301+0000","last_became_peered":"2023-01-02T18:16:46.312301+0000","last_unstale":"2023-01-02T18:17:08.334208+0000","last_undegraded":"2023-01-02T18:17:08.334208+0000","last_fullsized":"2023-01-02T18:17:08.334208+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.328078+0000","last_change":"2023-01-02T18:16:53.350359+0000","last_active":"2023-01-02T18:17:08.328078+0000","last_peered":"2023-01-02T18:17:08.328078+0000","last_clean":"2023-01-02T18:17:08.328078+0000","last_became_active":"2023-01-02T18:16:51.338043+0000","last_became_peered":"2023-01-02T18:16:51.338043+0000","last_unstale":"2023-01-02T18:17:08.328078+0000","last_undegraded":"2023-01-02T18:17:08.328078+0000","last_fullsized":"2023-01-02T18:17:08.328078+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439387+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:17:08.439387+0000","last_peered":"2023-01-02T18:17:08.439387+0000","last_clean":"2023-01-02T18:17:08.439387+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:17:08.439387+0000","last_undegraded":"2023-01-02T18:17:08.439387+0000","last_fullsized":"2023-01-02T18:17:08.439387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.330228+0000","last_change":"2023-01-02T18:17:09.330482+0000","last_active":"2023-01-02T18:17:09.330228+0000","last_peered":"2023-01-02T18:17:09.330228+0000","last_clean":"2023-01-02T18:17:09.330228+0000","last_became_active":"2023-01-02T18:17:07.344261+0000","last_became_peered":"2023-01-02T18:17:07.344261+0000","last_unstale":"2023-01-02T18:17:09.330228+0000","last_undegraded":"2023-01-02T18:17:09.330228+0000","last_fullsized":"2023-01-02T18:17:09.330228+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.19","version":"68'4","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.330233+0000","last_change":"2023-01-02T18:17:01.316528+0000","last_active":"2023-01-02T18:17:09.330233+0000","last_peered":"2023-01-02T18:17:09.330233+0000","last_clean":"2023-01-02T18:17:09.330233+0000","last_became_active":"2023-01-02T18:16:59.324956+0000","last_became_peered":"2023-01-02T18:16:59.324956+0000","last_unstale":"2023-01-02T18:17:09.330233+0000","last_undegraded":"2023-01-02T18:17:09.330233+0000","last_fullsized":"2023-01-02T18:17:09.330233+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":40,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439119+0000","last_change":"2023-01-02T18:16:44.299509+0000","last_active":"2023-01-02T18:17:08.439119+0000","last_peered":"2023-01-02T18:17:08.439119+0000","last_clean":"2023-01-02T18:17:08.439119+0000","last_became_active":"2023-01-02T18:16:42.439600+0000","last_became_peered":"2023-01-02T18:16:42.439600+0000","last_unstale":"2023-01-02T18:17:08.439119+0000","last_undegraded":"2023-01-02T18:17:08.439119+0000","last_fullsized":"2023-01-02T18:17:08.439119+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":48,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438654+0000","last_change":"2023-01-02T18:16:39.509367+0000","last_active":"2023-01-02T18:17:08.438654+0000","last_peered":"2023-01-02T18:17:08.438654+0000","last_clean":"2023-01-02T18:17:08.438654+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:17:08.438654+0000","last_undegraded":"2023-01-02T18:17:08.438654+0000","last_fullsized":"2023-01-02T18:17:08.438654+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333401+0000","last_change":"2023-01-02T18:16:49.310391+0000","last_active":"2023-01-02T18:17:08.333401+0000","last_peered":"2023-01-02T18:17:08.333401+0000","last_clean":"2023-01-02T18:17:08.333401+0000","last_became_active":"2023-01-02T18:16:46.316328+0000","last_became_peered":"2023-01-02T18:16:46.316328+0000","last_unstale":"2023-01-02T18:17:08.333401+0000","last_undegraded":"2023-01-02T18:17:08.333401+0000","last_fullsized":"2023-01-02T18:17:08.333401+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.330123+0000","last_change":"2023-01-02T18:16:53.686538+0000","last_active":"2023-01-02T18:17:08.330123+0000","last_peered":"2023-01-02T18:17:08.330123+0000","last_clean":"2023-01-02T18:17:08.330123+0000","last_became_active":"2023-01-02T18:16:51.336975+0000","last_became_peered":"2023-01-02T18:16:51.336975+0000","last_unstale":"2023-01-02T18:17:08.330123+0000","last_undegraded":"2023-01-02T18:17:08.330123+0000","last_fullsized":"2023-01-02T18:17:08.330123+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.329840+0000","last_change":"2023-01-02T18:16:57.306845+0000","last_active":"2023-01-02T18:17:08.329840+0000","last_peered":"2023-01-02T18:17:08.329840+0000","last_clean":"2023-01-02T18:17:08.329840+0000","last_became_active":"2023-01-02T18:16:55.318612+0000","last_became_peered":"2023-01-02T18:16:55.318612+0000","last_unstale":"2023-01-02T18:17:08.329840+0000","last_undegraded":"2023-01-02T18:17:08.329840+0000","last_fullsized":"2023-01-02T18:17:08.329840+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.307258+0000","last_change":"2023-01-02T18:17:09.307508+0000","last_active":"2023-01-02T18:17:09.307258+0000","last_peered":"2023-01-02T18:17:09.307258+0000","last_clean":"2023-01-02T18:17:09.307258+0000","last_became_active":"2023-01-02T18:17:07.344914+0000","last_became_peered":"2023-01-02T18:17:07.344914+0000","last_unstale":"2023-01-02T18:17:09.307258+0000","last_undegraded":"2023-01-02T18:17:09.307258+0000","last_fullsized":"2023-01-02T18:17:09.307258+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.18","version":"69'1","reported_seq":28,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.304426+0000","last_change":"2023-01-02T18:17:01.307624+0000","last_active":"2023-01-02T18:17:09.304426+0000","last_peered":"2023-01-02T18:17:09.304426+0000","last_clean":"2023-01-02T18:17:09.304426+0000","last_became_active":"2023-01-02T18:16:59.311706+0000","last_became_peered":"2023-01-02T18:16:59.311706+0000","last_unstale":"2023-01-02T18:17:09.304426+0000","last_undegraded":"2023-01-02T18:17:09.304426+0000","last_fullsized":"2023-01-02T18:17:09.304426+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333222+0000","last_change":"2023-01-02T18:16:44.307239+0000","last_active":"2023-01-02T18:17:08.333222+0000","last_peered":"2023-01-02T18:17:08.333222+0000","last_clean":"2023-01-02T18:17:08.333222+0000","last_became_active":"2023-01-02T18:16:41.447671+0000","last_became_peered":"2023-01-02T18:16:41.447671+0000","last_unstale":"2023-01-02T18:17:08.333222+0000","last_undegraded":"2023-01-02T18:17:08.333222+0000","last_fullsized":"2023-01-02T18:17:08.333222+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":53,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439006+0000","last_change":"2023-01-02T18:16:48.325246+0000","last_active":"2023-01-02T18:17:08.439006+0000","last_peered":"2023-01-02T18:17:08.439006+0000","last_clean":"2023-01-02T18:17:08.439006+0000","last_became_active":"2023-01-02T18:16:48.322940+0000","last_became_peered":"2023-01-02T18:16:48.322940+0000","last_unstale":"2023-01-02T18:17:08.439006+0000","last_undegraded":"2023-01-02T18:17:08.439006+0000","last_fullsized":"2023-01-02T18:17:08.439006+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372289+0000","last_change":"2023-01-02T18:16:49.300038+0000","last_active":"2023-01-02T18:17:08.372289+0000","last_peered":"2023-01-02T18:17:08.372289+0000","last_clean":"2023-01-02T18:17:08.372289+0000","last_became_active":"2023-01-02T18:16:46.315569+0000","last_became_peered":"2023-01-02T18:16:46.315569+0000","last_unstale":"2023-01-02T18:17:08.372289+0000","last_undegraded":"2023-01-02T18:17:08.372289+0000","last_fullsized":"2023-01-02T18:17:08.372289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439296+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:17:08.439296+0000","last_peered":"2023-01-02T18:17:08.439296+0000","last_clean":"2023-01-02T18:17:08.439296+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:17:08.439296+0000","last_undegraded":"2023-01-02T18:17:08.439296+0000","last_fullsized":"2023-01-02T18:17:08.439296+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.441021+0000","last_change":"2023-01-02T18:16:57.312176+0000","last_active":"2023-01-02T18:17:08.441021+0000","last_peered":"2023-01-02T18:17:08.441021+0000","last_clean":"2023-01-02T18:17:08.441021+0000","last_became_active":"2023-01-02T18:16:55.311934+0000","last_became_peered":"2023-01-02T18:16:55.311934+0000","last_unstale":"2023-01-02T18:17:08.441021+0000","last_undegraded":"2023-01-02T18:17:08.441021+0000","last_fullsized":"2023-01-02T18:17:08.441021+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.325011+0000","last_change":"2023-01-02T18:17:09.325339+0000","last_active":"2023-01-02T18:17:09.325011+0000","last_peered":"2023-01-02T18:17:09.325011+0000","last_clean":"2023-01-02T18:17:09.325011+0000","last_became_active":"2023-01-02T18:17:07.341155+0000","last_became_peered":"2023-01-02T18:17:07.341155+0000","last_unstale":"2023-01-02T18:17:09.325011+0000","last_undegraded":"2023-01-02T18:17:09.325011+0000","last_fullsized":"2023-01-02T18:17:09.325011+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.1f","version":"69'4","reported_seq":31,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.323841+0000","last_change":"2023-01-02T18:17:01.320344+0000","last_active":"2023-01-02T18:17:09.323841+0000","last_peered":"2023-01-02T18:17:09.323841+0000","last_clean":"2023-01-02T18:17:09.323841+0000","last_became_active":"2023-01-02T18:16:59.324530+0000","last_became_peered":"2023-01-02T18:16:59.324530+0000","last_unstale":"2023-01-02T18:17:09.323841+0000","last_undegraded":"2023-01-02T18:17:09.323841+0000","last_fullsized":"2023-01-02T18:17:09.323841+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":33,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438485+0000","last_change":"2023-01-02T18:16:48.329830+0000","last_active":"2023-01-02T18:17:08.438485+0000","last_peered":"2023-01-02T18:17:08.438485+0000","last_clean":"2023-01-02T18:17:08.438485+0000","last_became_active":"2023-01-02T18:16:48.329469+0000","last_became_peered":"2023-01-02T18:16:48.329469+0000","last_unstale":"2023-01-02T18:17:08.438485+0000","last_undegraded":"2023-01-02T18:17:08.438485+0000","last_fullsized":"2023-01-02T18:17:08.438485+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.441115+0000","last_change":"2023-01-02T18:16:48.343876+0000","last_active":"2023-01-02T18:17:08.441115+0000","last_peered":"2023-01-02T18:17:08.441115+0000","last_clean":"2023-01-02T18:17:08.441115+0000","last_became_active":"2023-01-02T18:16:48.326351+0000","last_became_peered":"2023-01-02T18:16:48.326351+0000","last_unstale":"2023-01-02T18:17:08.441115+0000","last_undegraded":"2023-01-02T18:17:08.441115+0000","last_fullsized":"2023-01-02T18:17:08.441115+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333495+0000","last_change":"2023-01-02T18:16:49.310459+0000","last_active":"2023-01-02T18:17:08.333495+0000","last_peered":"2023-01-02T18:17:08.333495+0000","last_clean":"2023-01-02T18:17:08.333495+0000","last_became_active":"2023-01-02T18:16:46.312215+0000","last_became_peered":"2023-01-02T18:16:46.312215+0000","last_unstale":"2023-01-02T18:17:08.333495+0000","last_undegraded":"2023-01-02T18:17:08.333495+0000","last_fullsized":"2023-01-02T18:17:08.333495+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332277+0000","last_change":"2023-01-02T18:16:53.342357+0000","last_active":"2023-01-02T18:17:08.332277+0000","last_peered":"2023-01-02T18:17:08.332277+0000","last_clean":"2023-01-02T18:17:08.332277+0000","last_became_active":"2023-01-02T18:16:51.341254+0000","last_became_peered":"2023-01-02T18:16:51.341254+0000","last_unstale":"2023-01-02T18:17:08.332277+0000","last_undegraded":"2023-01-02T18:17:08.332277+0000","last_fullsized":"2023-01-02T18:17:08.332277+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332169+0000","last_change":"2023-01-02T18:16:57.312710+0000","last_active":"2023-01-02T18:17:08.332169+0000","last_peered":"2023-01-02T18:17:08.332169+0000","last_clean":"2023-01-02T18:17:08.332169+0000","last_became_active":"2023-01-02T18:16:55.317525+0000","last_became_peered":"2023-01-02T18:16:55.317525+0000","last_unstale":"2023-01-02T18:17:08.332169+0000","last_undegraded":"2023-01-02T18:17:08.332169+0000","last_fullsized":"2023-01-02T18:17:08.332169+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.308383+0000","last_change":"2023-01-02T18:17:09.308664+0000","last_active":"2023-01-02T18:17:09.308383+0000","last_peered":"2023-01-02T18:17:09.308383+0000","last_clean":"2023-01-02T18:17:09.308383+0000","last_became_active":"2023-01-02T18:17:07.344272+0000","last_became_peered":"2023-01-02T18:17:07.344272+0000","last_unstale":"2023-01-02T18:17:09.308383+0000","last_undegraded":"2023-01-02T18:17:09.308383+0000","last_fullsized":"2023-01-02T18:17:09.308383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.1e","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.310929+0000","last_change":"2023-01-02T18:17:01.311474+0000","last_active":"2023-01-02T18:17:09.310929+0000","last_peered":"2023-01-02T18:17:09.310929+0000","last_clean":"2023-01-02T18:17:09.310929+0000","last_became_active":"2023-01-02T18:16:59.314245+0000","last_became_peered":"2023-01-02T18:16:59.314245+0000","last_unstale":"2023-01-02T18:17:09.310929+0000","last_undegraded":"2023-01-02T18:17:09.310929+0000","last_fullsized":"2023-01-02T18:17:09.310929+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438775+0000","last_change":"2023-01-02T18:16:44.320516+0000","last_active":"2023-01-02T18:17:08.438775+0000","last_peered":"2023-01-02T18:17:08.438775+0000","last_clean":"2023-01-02T18:17:08.438775+0000","last_became_active":"2023-01-02T18:16:41.444704+0000","last_became_peered":"2023-01-02T18:16:41.444704+0000","last_unstale":"2023-01-02T18:17:08.438775+0000","last_undegraded":"2023-01-02T18:17:08.438775+0000","last_fullsized":"2023-01-02T18:17:08.438775+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"46'5","reported_seq":66,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439537+0000","last_change":"2023-01-02T18:16:39.509436+0000","last_active":"2023-01-02T18:17:08.439537+0000","last_peered":"2023-01-02T18:17:08.439537+0000","last_clean":"2023-01-02T18:17:08.439537+0000","last_became_active":"2023-01-02T18:16:37.436152+0000","last_became_peered":"2023-01-02T18:16:37.436152+0000","last_unstale":"2023-01-02T18:17:08.439537+0000","last_undegraded":"2023-01-02T18:17:08.439537+0000","last_fullsized":"2023-01-02T18:17:08.439537+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333023+0000","last_change":"2023-01-02T18:16:49.309763+0000","last_active":"2023-01-02T18:17:08.333023+0000","last_peered":"2023-01-02T18:17:08.333023+0000","last_clean":"2023-01-02T18:17:08.333023+0000","last_became_active":"2023-01-02T18:16:46.308336+0000","last_became_peered":"2023-01-02T18:16:46.308336+0000","last_unstale":"2023-01-02T18:17:08.333023+0000","last_undegraded":"2023-01-02T18:17:08.333023+0000","last_fullsized":"2023-01-02T18:17:08.333023+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.327619+0000","last_change":"2023-01-02T18:16:53.686000+0000","last_active":"2023-01-02T18:17:08.327619+0000","last_peered":"2023-01-02T18:17:08.327619+0000","last_clean":"2023-01-02T18:17:08.327619+0000","last_became_active":"2023-01-02T18:16:51.345471+0000","last_became_peered":"2023-01-02T18:16:51.345471+0000","last_unstale":"2023-01-02T18:17:08.327619+0000","last_undegraded":"2023-01-02T18:17:08.327619+0000","last_fullsized":"2023-01-02T18:17:08.327619+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439195+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:17:08.439195+0000","last_peered":"2023-01-02T18:17:08.439195+0000","last_clean":"2023-01-02T18:17:08.439195+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:17:08.439195+0000","last_undegraded":"2023-01-02T18:17:08.439195+0000","last_fullsized":"2023-01-02T18:17:08.439195+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"76'1","reported_seq":15,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.308316+0000","last_change":"2023-01-02T18:17:09.308316+0000","last_active":"2023-01-02T18:17:09.308316+0000","last_peered":"2023-01-02T18:17:09.308316+0000","last_clean":"2023-01-02T18:17:09.308316+0000","last_became_active":"2023-01-02T18:17:07.339700+0000","last_became_peered":"2023-01-02T18:17:07.339700+0000","last_unstale":"2023-01-02T18:17:09.308316+0000","last_undegraded":"2023-01-02T18:17:09.308316+0000","last_fullsized":"2023-01-02T18:17:09.308316+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.1d","version":"71'4","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.320792+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:17:09.320792+0000","last_peered":"2023-01-02T18:17:09.320792+0000","last_clean":"2023-01-02T18:17:09.320792+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:17:09.320792+0000","last_undegraded":"2023-01-02T18:17:09.320792+0000","last_fullsized":"2023-01-02T18:17:09.320792+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332525+0000","last_change":"2023-01-02T18:16:44.306989+0000","last_active":"2023-01-02T18:17:08.332525+0000","last_peered":"2023-01-02T18:17:08.332525+0000","last_clean":"2023-01-02T18:17:08.332525+0000","last_became_active":"2023-01-02T18:16:41.448619+0000","last_became_peered":"2023-01-02T18:16:41.448619+0000","last_unstale":"2023-01-02T18:17:08.332525+0000","last_undegraded":"2023-01-02T18:17:08.332525+0000","last_fullsized":"2023-01-02T18:17:08.332525+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"46'1","reported_seq":56,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439389+0000","last_change":"2023-01-02T18:16:42.446044+0000","last_active":"2023-01-02T18:17:08.439389+0000","last_peered":"2023-01-02T18:17:08.439389+0000","last_clean":"2023-01-02T18:17:08.439389+0000","last_became_active":"2023-01-02T18:16:42.440314+0000","last_became_peered":"2023-01-02T18:16:42.440314+0000","last_unstale":"2023-01-02T18:17:08.439389+0000","last_undegraded":"2023-01-02T18:17:08.439389+0000","last_fullsized":"2023-01-02T18:17:08.439389+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":44,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.439335+0000","last_change":"2023-01-02T18:16:49.304745+0000","last_active":"2023-01-02T18:17:08.439335+0000","last_peered":"2023-01-02T18:17:08.439335+0000","last_clean":"2023-01-02T18:17:08.439335+0000","last_became_active":"2023-01-02T18:16:48.325920+0000","last_became_peered":"2023-01-02T18:16:48.325920+0000","last_unstale":"2023-01-02T18:17:08.439335+0000","last_undegraded":"2023-01-02T18:17:08.439335+0000","last_fullsized":"2023-01-02T18:17:08.439335+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333401+0000","last_change":"2023-01-02T18:16:53.342417+0000","last_active":"2023-01-02T18:17:08.333401+0000","last_peered":"2023-01-02T18:17:08.333401+0000","last_clean":"2023-01-02T18:17:08.333401+0000","last_became_active":"2023-01-02T18:16:51.341971+0000","last_became_peered":"2023-01-02T18:16:51.341971+0000","last_unstale":"2023-01-02T18:17:08.333401+0000","last_undegraded":"2023-01-02T18:17:08.333401+0000","last_fullsized":"2023-01-02T18:17:08.333401+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438093+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:17:08.438093+0000","last_peered":"2023-01-02T18:17:08.438093+0000","last_clean":"2023-01-02T18:17:08.438093+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:17:08.438093+0000","last_undegraded":"2023-01-02T18:17:08.438093+0000","last_fullsized":"2023-01-02T18:17:08.438093+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.324958+0000","last_change":"2023-01-02T18:17:09.329860+0000","last_active":"2023-01-02T18:17:09.324958+0000","last_peered":"2023-01-02T18:17:09.324958+0000","last_clean":"2023-01-02T18:17:09.324958+0000","last_became_active":"2023-01-02T18:17:07.343666+0000","last_became_peered":"2023-01-02T18:17:07.343666+0000","last_unstale":"2023-01-02T18:17:09.324958+0000","last_undegraded":"2023-01-02T18:17:09.324958+0000","last_fullsized":"2023-01-02T18:17:09.324958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.1c","version":"71'6","reported_seq":50,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.321944+0000","last_change":"2023-01-02T18:17:01.322371+0000","last_active":"2023-01-02T18:17:09.321944+0000","last_peered":"2023-01-02T18:17:09.321944+0000","last_clean":"2023-01-02T18:17:09.321944+0000","last_became_active":"2023-01-02T18:16:59.324902+0000","last_became_peered":"2023-01-02T18:16:59.324902+0000","last_unstale":"2023-01-02T18:17:09.321944+0000","last_undegraded":"2023-01-02T18:17:09.321944+0000","last_fullsized":"2023-01-02T18:17:09.321944+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332469+0000","last_change":"2023-01-02T18:16:44.306689+0000","last_active":"2023-01-02T18:17:08.332469+0000","last_peered":"2023-01-02T18:17:08.332469+0000","last_clean":"2023-01-02T18:17:08.332469+0000","last_became_active":"2023-01-02T18:16:41.448162+0000","last_became_peered":"2023-01-02T18:16:41.448162+0000","last_unstale":"2023-01-02T18:17:08.332469+0000","last_undegraded":"2023-01-02T18:17:08.332469+0000","last_fullsized":"2023-01-02T18:17:08.332469+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.334219+0000","last_change":"2023-01-02T18:16:42.440271+0000","last_active":"2023-01-02T18:17:08.334219+0000","last_peered":"2023-01-02T18:17:08.334219+0000","last_clean":"2023-01-02T18:17:08.334219+0000","last_became_active":"2023-01-02T18:16:42.435382+0000","last_became_peered":"2023-01-02T18:16:42.435382+0000","last_unstale":"2023-01-02T18:17:08.334219+0000","last_undegraded":"2023-01-02T18:17:08.334219+0000","last_fullsized":"2023-01-02T18:17:08.334219+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":44,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438204+0000","last_change":"2023-01-02T18:16:49.318037+0000","last_active":"2023-01-02T18:17:08.438204+0000","last_peered":"2023-01-02T18:17:08.438204+0000","last_clean":"2023-01-02T18:17:08.438204+0000","last_became_active":"2023-01-02T18:16:48.330758+0000","last_became_peered":"2023-01-02T18:16:48.330758+0000","last_unstale":"2023-01-02T18:17:08.438204+0000","last_undegraded":"2023-01-02T18:17:08.438204+0000","last_fullsized":"2023-01-02T18:17:08.438204+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":129,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.438848+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:17:08.438848+0000","last_peered":"2023-01-02T18:17:08.438848+0000","last_clean":"2023-01-02T18:17:08.438848+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:17:08.438848+0000","last_undegraded":"2023-01-02T18:17:08.438848+0000","last_fullsized":"2023-01-02T18:17:08.438848+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.329480+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:17:08.329480+0000","last_peered":"2023-01-02T18:17:08.329480+0000","last_clean":"2023-01-02T18:17:08.329480+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:17:08.329480+0000","last_undegraded":"2023-01-02T18:17:08.329480+0000","last_fullsized":"2023-01-02T18:17:08.329480+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.320260+0000","last_change":"2023-01-02T18:17:09.322570+0000","last_active":"2023-01-02T18:17:09.320260+0000","last_peered":"2023-01-02T18:17:09.320260+0000","last_clean":"2023-01-02T18:17:09.320260+0000","last_became_active":"2023-01-02T18:17:07.342026+0000","last_became_peered":"2023-01-02T18:17:07.342026+0000","last_unstale":"2023-01-02T18:17:09.320260+0000","last_undegraded":"2023-01-02T18:17:09.320260+0000","last_fullsized":"2023-01-02T18:17:09.320260+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.13","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.308501+0000","last_change":"2023-01-02T18:17:01.311515+0000","last_active":"2023-01-02T18:17:09.308501+0000","last_peered":"2023-01-02T18:17:09.308501+0000","last_clean":"2023-01-02T18:17:09.308501+0000","last_became_active":"2023-01-02T18:16:59.322412+0000","last_became_peered":"2023-01-02T18:16:59.322412+0000","last_unstale":"2023-01-02T18:17:09.308501+0000","last_undegraded":"2023-01-02T18:17:09.308501+0000","last_fullsized":"2023-01-02T18:17:09.308501+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":42,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.440116+0000","last_change":"2023-01-02T18:16:44.320520+0000","last_active":"2023-01-02T18:17:08.440116+0000","last_peered":"2023-01-02T18:17:08.440116+0000","last_clean":"2023-01-02T18:17:08.440116+0000","last_became_active":"2023-01-02T18:16:42.441192+0000","last_became_peered":"2023-01-02T18:16:42.441192+0000","last_unstale":"2023-01-02T18:17:08.440116+0000","last_undegraded":"2023-01-02T18:17:08.440116+0000","last_fullsized":"2023-01-02T18:17:08.440116+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332463+0000","last_change":"2023-01-02T18:16:39.437971+0000","last_active":"2023-01-02T18:17:08.332463+0000","last_peered":"2023-01-02T18:17:08.332463+0000","last_clean":"2023-01-02T18:17:08.332463+0000","last_became_active":"2023-01-02T18:16:37.415177+0000","last_became_peered":"2023-01-02T18:16:37.415177+0000","last_unstale":"2023-01-02T18:17:08.332463+0000","last_undegraded":"2023-01-02T18:17:08.332463+0000","last_fullsized":"2023-01-02T18:17:08.332463+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.330303+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:17:08.330303+0000","last_peered":"2023-01-02T18:17:08.330303+0000","last_clean":"2023-01-02T18:17:08.330303+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:17:08.330303+0000","last_undegraded":"2023-01-02T18:17:08.330303+0000","last_fullsized":"2023-01-02T18:17:08.330303+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372232+0000","last_change":"2023-01-02T18:16:53.344508+0000","last_active":"2023-01-02T18:17:08.372232+0000","last_peered":"2023-01-02T18:17:08.372232+0000","last_clean":"2023-01-02T18:17:08.372232+0000","last_became_active":"2023-01-02T18:16:51.339305+0000","last_became_peered":"2023-01-02T18:16:51.339305+0000","last_unstale":"2023-01-02T18:17:08.372232+0000","last_undegraded":"2023-01-02T18:17:08.372232+0000","last_fullsized":"2023-01-02T18:17:08.372232+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":36,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333497+0000","last_change":"2023-01-02T18:16:57.314050+0000","last_active":"2023-01-02T18:17:08.333497+0000","last_peered":"2023-01-02T18:17:08.333497+0000","last_clean":"2023-01-02T18:17:08.333497+0000","last_became_active":"2023-01-02T18:16:55.315221+0000","last_became_peered":"2023-01-02T18:16:55.315221+0000","last_unstale":"2023-01-02T18:17:08.333497+0000","last_undegraded":"2023-01-02T18:17:08.333497+0000","last_fullsized":"2023-01-02T18:17:08.333497+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.322891+0000","last_change":"2023-01-02T18:17:09.323079+0000","last_active":"2023-01-02T18:17:09.322891+0000","last_peered":"2023-01-02T18:17:09.322891+0000","last_clean":"2023-01-02T18:17:09.322891+0000","last_became_active":"2023-01-02T18:17:07.344746+0000","last_became_peered":"2023-01-02T18:17:07.344746+0000","last_unstale":"2023-01-02T18:17:09.322891+0000","last_undegraded":"2023-01-02T18:17:09.322891+0000","last_fullsized":"2023-01-02T18:17:09.322891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.12","version":"0'0","reported_seq":23,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.330239+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:17:09.330239+0000","last_peered":"2023-01-02T18:17:09.330239+0000","last_clean":"2023-01-02T18:17:09.330239+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:17:09.330239+0000","last_undegraded":"2023-01-02T18:17:09.330239+0000","last_fullsized":"2023-01-02T18:17:09.330239+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372324+0000","last_change":"2023-01-02T18:16:57.317052+0000","last_active":"2023-01-02T18:17:08.372324+0000","last_peered":"2023-01-02T18:17:08.372324+0000","last_clean":"2023-01-02T18:17:08.372324+0000","last_became_active":"2023-01-02T18:16:55.310981+0000","last_became_peered":"2023-01-02T18:16:55.310981+0000","last_unstale":"2023-01-02T18:17:08.372324+0000","last_undegraded":"2023-01-02T18:17:08.372324+0000","last_fullsized":"2023-01-02T18:17:08.372324+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.330057+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:17:08.330057+0000","last_peered":"2023-01-02T18:17:08.330057+0000","last_clean":"2023-01-02T18:17:08.330057+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:17:08.330057+0000","last_undegraded":"2023-01-02T18:17:08.330057+0000","last_fullsized":"2023-01-02T18:17:08.330057+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":68,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371358+0000","last_change":"2023-01-02T18:16:39.426086+0000","last_active":"2023-01-02T18:17:08.371358+0000","last_peered":"2023-01-02T18:17:08.371358+0000","last_clean":"2023-01-02T18:17:08.371358+0000","last_became_active":"2023-01-02T18:16:37.416142+0000","last_became_peered":"2023-01-02T18:16:37.416142+0000","last_unstale":"2023-01-02T18:17:08.371358+0000","last_undegraded":"2023-01-02T18:17:08.371358+0000","last_fullsized":"2023-01-02T18:17:08.371358+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"56'15","reported_seq":102,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.440035+0000","last_change":"2023-01-02T18:16:49.319188+0000","last_active":"2023-01-02T18:17:08.440035+0000","last_peered":"2023-01-02T18:17:08.440035+0000","last_clean":"2023-01-02T18:17:08.440035+0000","last_became_active":"2023-01-02T18:16:48.329016+0000","last_became_peered":"2023-01-02T18:16:48.329016+0000","last_unstale":"2023-01-02T18:17:08.440035+0000","last_undegraded":"2023-01-02T18:17:08.440035+0000","last_fullsized":"2023-01-02T18:17:08.440035+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":135,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.441186+0000","last_change":"2023-01-02T18:16:53.346722+0000","last_active":"2023-01-02T18:17:08.441186+0000","last_peered":"2023-01-02T18:17:08.441186+0000","last_clean":"2023-01-02T18:17:08.441186+0000","last_became_active":"2023-01-02T18:16:51.339164+0000","last_became_peered":"2023-01-02T18:16:51.339164+0000","last_unstale":"2023-01-02T18:17:08.441186+0000","last_undegraded":"2023-01-02T18:17:08.441186+0000","last_fullsized":"2023-01-02T18:17:08.441186+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.322293+0000","last_change":"2023-01-02T18:17:09.322935+0000","last_active":"2023-01-02T18:17:09.322293+0000","last_peered":"2023-01-02T18:17:09.322293+0000","last_clean":"2023-01-02T18:17:09.322293+0000","last_became_active":"2023-01-02T18:17:07.346620+0000","last_became_peered":"2023-01-02T18:17:07.346620+0000","last_unstale":"2023-01-02T18:17:09.322293+0000","last_undegraded":"2023-01-02T18:17:09.322293+0000","last_fullsized":"2023-01-02T18:17:09.322293+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"8.11","version":"72'4","reported_seq":29,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-01-02T18:17:09.320987+0000","last_change":"2023-01-02T18:17:01.321057+0000","last_active":"2023-01-02T18:17:09.320987+0000","last_peered":"2023-01-02T18:17:09.320987+0000","last_clean":"2023-01-02T18:17:09.320987+0000","last_became_active":"2023-01-02T18:16:59.310738+0000","last_became_peered":"2023-01-02T18:16:59.310738+0000","last_unstale":"2023-01-02T18:17:09.320987+0000","last_undegraded":"2023-01-02T18:17:09.320987+0000","last_fullsized":"2023-01-02T18:17:09.320987+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":28,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.372224+0000","last_change":"2023-01-02T18:16:57.317294+0000","last_active":"2023-01-02T18:17:08.372224+0000","last_peered":"2023-01-02T18:17:08.372224+0000","last_clean":"2023-01-02T18:17:08.372224+0000","last_became_active":"2023-01-02T18:16:55.316682+0000","last_became_peered":"2023-01-02T18:16:55.316682+0000","last_unstale":"2023-01-02T18:17:08.372224+0000","last_undegraded":"2023-01-02T18:17:08.372224+0000","last_fullsized":"2023-01-02T18:17:08.372224+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":52,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.332881+0000","last_change":"2023-01-02T18:16:44.308144+0000","last_active":"2023-01-02T18:17:08.332881+0000","last_peered":"2023-01-02T18:17:08.332881+0000","last_clean":"2023-01-02T18:17:08.332881+0000","last_became_active":"2023-01-02T18:16:41.446839+0000","last_became_peered":"2023-01-02T18:16:41.446839+0000","last_unstale":"2023-01-02T18:17:08.332881+0000","last_undegraded":"2023-01-02T18:17:08.332881+0000","last_fullsized":"2023-01-02T18:17:08.332881+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"46'3","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.371681+0000","last_change":"2023-01-02T18:16:48.334513+0000","last_active":"2023-01-02T18:17:08.371681+0000","last_peered":"2023-01-02T18:17:08.371681+0000","last_clean":"2023-01-02T18:17:08.371681+0000","last_became_active":"2023-01-02T18:16:48.329379+0000","last_became_peered":"2023-01-02T18:16:48.329379+0000","last_unstale":"2023-01-02T18:17:08.371681+0000","last_undegraded":"2023-01-02T18:17:08.371681+0000","last_fullsized":"2023-01-02T18:17:08.371681+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.333766+0000","last_change":"2023-01-02T18:16:49.310230+0000","last_active":"2023-01-02T18:17:08.333766+0000","last_peered":"2023-01-02T18:17:08.333766+0000","last_clean":"2023-01-02T18:17:08.333766+0000","last_became_active":"2023-01-02T18:16:48.324944+0000","last_became_peered":"2023-01-02T18:16:48.324944+0000","last_unstale":"2023-01-02T18:17:08.333766+0000","last_undegraded":"2023-01-02T18:17:08.333766+0000","last_fullsized":"2023-01-02T18:17:08.333766+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":31,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-01-02T18:17:08.334000+0000","last_change":"2023-01-02T18:16:53.345118+0000","last_active":"2023-01-02T18:17:08.334000+0000","last_peered":"2023-01-02T18:17:08.334000+0000","last_clean":"2023-01-02T18:17:08.334000+0000","last_became_active":"2023-01-02T18:16:51.341889+0000","last_became_peered":"2023-01-02T18:16:51.341889+0000","last_unstale":"2023-01-02T18:17:08.334000+0000","last_undegraded":"2023-01-02T18:17:08.334000+0000","last_fullsized":"2023-01-02T18:17:08.334000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":804,"num_read_kb":712,"num_write":53,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":465,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2462,"num_read_kb":2197,"num_write":146,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":1365,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":753,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":0,"num_read":831,"num_read_kb":661,"num_write":96,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":422,"num_keys_recovered":94,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":1848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":104,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":70,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":109,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":1365,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7052,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":6080,"kb_avail":94364788,"statfs":{"total":96636764160,"available":96629542912,"internally_reserved":0,"allocated":987136,"data_stored":438764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6225920},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.61899999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.39200000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.59699999999999998}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.81499999999999995}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.72399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7048,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":6080,"kb_avail":94364792,"statfs":{"total":96636764160,"available":96629547008,"internally_reserved":0,"allocated":983040,"data_stored":438846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6225920},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.59399999999999997}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.373},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.436},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.54200000000000004}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.628}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.50900000000000001}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.68100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7056,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":6080,"kb_avail":94364784,"statfs":{"total":96636764160,"available":96629538816,"internally_reserved":0,"allocated":991232,"data_stored":447451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6225920},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.434},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.48299999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.34599999999999997}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.375}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.53000000000000003}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.496}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6976,"kb_used_data":952,"kb_used_omap":0,"kb_used_meta":6016,"kb_avail":94364864,"statfs":{"total":96636764160,"available":96629620736,"internally_reserved":0,"allocated":974848,"data_stored":438761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6160384},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.35299999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.38},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.25700000000000001}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.33400000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.39800000000000002}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.40600000000000003}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.52000000000000002}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.46700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6744,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":94365096,"statfs":{"total":96636764160,"available":96629858304,"internally_reserved":0,"allocated":933888,"data_stored":438439,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.36499999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.314},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.41699999999999998}]},{"osd":4,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.61399999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.66100000000000003}]},{"osd":6,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.628}]},{"osd":7,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.73599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7136,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":6144,"kb_avail":94364704,"statfs":{"total":96636764160,"available":96629456896,"internally_reserved":0,"allocated":1007616,"data_stored":447631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6291456},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.33900000000000002}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.312},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.35899999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.39300000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.502},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.45600000000000002}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.438}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.49299999999999999}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.51200000000000001}]}]},{"osd":4,"up_from":0,"seq":55834574869,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":0,"seq":55834574868,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":83,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:17:14.338 INFO:tasks.thrashosds.thrasher:Setting 6.f to [6, 4, 1, 5] 2023-01-02T18:17:14.338 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '6.f', '6', '4', '1', '5'] 2023-01-02T18:17:14.339 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 6.f 6 4 1 5 2023-01-02T18:17:14.351 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:14.352+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:14.354 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:14.355 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:14.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:14.417 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:14.493 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:14.493+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:14.537 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:14.537 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:14.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:14.553 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:14.554+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:14.607 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:14.626 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:14.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:17:14.644 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:14.655 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:14.654+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:14.664 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:14.683 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:14.704 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:14.737 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:14.743 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:14.743 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:14.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:14.744 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:14.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.744 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:10 3.17 e46/43 3:ece625d0:::rbd_id.image1:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:14.744 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.431393+0000", 2023-01-02T18:17:14.744 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.309707039000003, 2023-01-02T18:17:14.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001058579, 2023-01-02T18:17:14.745 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.745 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.745 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431393+0000", 2023-01-02T18:17:14.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431393+0000", 2023-01-02T18:17:14.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:14.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431393+0000", 2023-01-02T18:17:14.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8380000000000002e-06 2023-01-02T18:17:14.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431401+0000", 2023-01-02T18:17:14.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0225e-05 2023-01-02T18:17:14.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431421+0000", 2023-01-02T18:17:14.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0044000000000001e-05 2023-01-02T18:17:14.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431431+0000", 2023-01-02T18:17:14.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3806000000000005e-05 2023-01-02T18:17:14.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431505+0000", 2023-01-02T18:17:14.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5550000000000001e-05 2023-01-02T18:17:14.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.431531+0000", 2023-01-02T18:17:14.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086934800000000004 2023-01-02T18:17:14.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.432400+0000", 2023-01-02T18:17:14.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1996999999999997e-05 2023-01-02T18:17:14.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.432452+0000", 2023-01-02T18:17:14.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001058579 2023-01-02T18:17:14.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.755 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.756 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:11 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:14.756 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:17:14.756 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.307826796000001, 2023-01-02T18:17:14.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020029140000000002, 2023-01-02T18:17:14.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:14.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:14.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 11 2023-01-02T18:17:14.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.758 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:17:14.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:17:14.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:14.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433272+0000", 2023-01-02T18:17:14.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8709999999999999e-06 2023-01-02T18:17:14.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433279+0000", 2023-01-02T18:17:14.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0445000000000001e-05 2023-01-02T18:17:14.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433289+0000", 2023-01-02T18:17:14.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9549999999999992e-06 2023-01-02T18:17:14.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433297+0000", 2023-01-02T18:17:14.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9743999999999997e-05 2023-01-02T18:17:14.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433347+0000", 2023-01-02T18:17:14.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012520899999999999 2023-01-02T18:17:14.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433472+0000", 2023-01-02T18:17:14.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000183139 2023-01-02T18:17:14.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:17:14.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433655+0000", 2023-01-02T18:17:14.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062228000000000001 2023-01-02T18:17:14.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.434278+0000", 2023-01-02T18:17:14.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089530100000000004 2023-01-02T18:17:14.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435173+0000", 2023-01-02T18:17:14.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9444000000000002e-05 2023-01-02T18:17:14.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435232+0000", 2023-01-02T18:17:14.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4172000000000003e-05 2023-01-02T18:17:14.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435277+0000", 2023-01-02T18:17:14.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020029140000000002 2023-01-02T18:17:14.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.770 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.770 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:24 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [watch watch cookie 140115456398928] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:14.771 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:17:14.771 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.292191639000002, 2023-01-02T18:17:14.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671591, 2023-01-02T18:17:14.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.771 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.772 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:14.772 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:14.772 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 24 2023-01-02T18:17:14.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.772 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:17:14.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:17:14.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448908+0000", 2023-01-02T18:17:14.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8049999999999997e-06 2023-01-02T18:17:14.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448913+0000", 2023-01-02T18:17:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6050000000000004e-06 2023-01-02T18:17:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448922+0000", 2023-01-02T18:17:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.296e-06 2023-01-02T18:17:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448927+0000", 2023-01-02T18:17:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2249999999999997e-05 2023-01-02T18:17:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448969+0000", 2023-01-02T18:17:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1073000000000001e-05 2023-01-02T18:17:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449050+0000", 2023-01-02T18:17:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019599400000000001 2023-01-02T18:17:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:17:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449246+0000", 2023-01-02T18:17:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055298399999999996 2023-01-02T18:17:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449799+0000", 2023-01-02T18:17:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067574099999999999 2023-01-02T18:17:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450475+0000", 2023-01-02T18:17:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2527999999999997e-05 2023-01-02T18:17:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450517+0000", 2023-01-02T18:17:14.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3255000000000003e-05 2023-01-02T18:17:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450580+0000", 2023-01-02T18:17:14.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671591 2023-01-02T18:17:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.785 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:25 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [watch unwatch cookie 140115456398928] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:17:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.290344140000002, 2023-01-02T18:17:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001161561, 2023-01-02T18:17:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 25 2023-01-02T18:17:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.787 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:17:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:17:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450755+0000", 2023-01-02T18:17:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.575e-06 2023-01-02T18:17:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450761+0000", 2023-01-02T18:17:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0091e-05 2023-01-02T18:17:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450771+0000", 2023-01-02T18:17:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8749999999999999e-06 2023-01-02T18:17:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450776+0000", 2023-01-02T18:17:14.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0066e-05 2023-01-02T18:17:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450806+0000", 2023-01-02T18:17:14.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9995999999999998e-05 2023-01-02T18:17:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450886+0000", 2023-01-02T18:17:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014307999999999999 2023-01-02T18:17:14.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:17:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451029+0000", 2023-01-02T18:17:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044226600000000002 2023-01-02T18:17:14.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451471+0000", 2023-01-02T18:17:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036714799999999998 2023-01-02T18:17:14.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451838+0000", 2023-01-02T18:17:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6917999999999999e-05 2023-01-02T18:17:14.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451865+0000", 2023-01-02T18:17:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2561e-05 2023-01-02T18:17:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451918+0000", 2023-01-02T18:17:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001161561 2023-01-02T18:17:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:370 7.1b 7:da80f00d:::rbd_id.image25:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:17:14.800 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.425900046999999, 2023-01-02T18:17:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002415571, 2023-01-02T18:17:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.801 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 370 2023-01-02T18:17:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:17:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:17:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315198+0000", 2023-01-02T18:17:14.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2340999999999999e-05 2023-01-02T18:17:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315211+0000", 2023-01-02T18:17:14.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2734e-05 2023-01-02T18:17:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315233+0000", 2023-01-02T18:17:14.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7020000000000007e-06 2023-01-02T18:17:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315242+0000", 2023-01-02T18:17:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017169700000000001 2023-01-02T18:17:14.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315414+0000", 2023-01-02T18:17:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014588700000000001 2023-01-02T18:17:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315560+0000", 2023-01-02T18:17:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020772999999999999 2023-01-02T18:17:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:14.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315767+0000", 2023-01-02T18:17:14.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001379641 2023-01-02T18:17:14.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317147+0000", 2023-01-02T18:17:14.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000359675 2023-01-02T18:17:14.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317507+0000", 2023-01-02T18:17:14.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2816000000000003e-05 2023-01-02T18:17:14.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317569+0000", 2023-01-02T18:17:14.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6452999999999997e-05 2023-01-02T18:17:14.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317616+0000", 2023-01-02T18:17:14.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002415571 2023-01-02T18:17:14.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.814 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.815 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:965 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.815 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.647408+0000", 2023-01-02T18:17:14.815 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.093692695000001, 2023-01-02T18:17:14.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001131087, 2023-01-02T18:17:14.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.816 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.816 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.816 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.816 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 965 2023-01-02T18:17:14.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.816 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647408+0000", 2023-01-02T18:17:14.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647408+0000", 2023-01-02T18:17:14.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:14.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647406+0000", 2023-01-02T18:17:14.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3695e-05 2023-01-02T18:17:14.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647420+0000", 2023-01-02T18:17:14.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2337000000000001e-05 2023-01-02T18:17:14.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647432+0000", 2023-01-02T18:17:14.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7000000000000003e-06 2023-01-02T18:17:14.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647442+0000", 2023-01-02T18:17:14.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0462e-05 2023-01-02T18:17:14.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647482+0000", 2023-01-02T18:17:14.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2937999999999997e-05 2023-01-02T18:17:14.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647575+0000", 2023-01-02T18:17:14.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015813700000000001 2023-01-02T18:17:14.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:14.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647733+0000", 2023-01-02T18:17:14.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042289999999999998 2023-01-02T18:17:14.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648156+0000", 2023-01-02T18:17:14.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032719900000000002 2023-01-02T18:17:14.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648483+0000", 2023-01-02T18:17:14.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2518999999999998e-05 2023-01-02T18:17:14.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648516+0000", 2023-01-02T18:17:14.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2821000000000001e-05 2023-01-02T18:17:14.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648539+0000", 2023-01-02T18:17:14.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001131087 2023-01-02T18:17:14.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.828 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.829 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:966 7.9 7:97049a9d:::rbd_object_map.11d52e7a19d9:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.829 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.648613+0000", 2023-01-02T18:17:14.829 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.092487108, 2023-01-02T18:17:14.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322847, 2023-01-02T18:17:14.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.830 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.830 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.830 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 966 2023-01-02T18:17:14.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.831 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648613+0000", 2023-01-02T18:17:14.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648613+0000", 2023-01-02T18:17:14.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648612+0000", 2023-01-02T18:17:14.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5140000000000001e-06 2023-01-02T18:17:14.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648618+0000", 2023-01-02T18:17:14.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1105e-05 2023-01-02T18:17:14.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648629+0000", 2023-01-02T18:17:14.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999993e-06 2023-01-02T18:17:14.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648637+0000", 2023-01-02T18:17:14.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2023-01-02T18:17:14.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648669+0000", 2023-01-02T18:17:14.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2801999999999998e-05 2023-01-02T18:17:14.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648751+0000", 2023-01-02T18:17:14.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011778299999999999 2023-01-02T18:17:14.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:14.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648869+0000", 2023-01-02T18:17:14.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077642399999999995 2023-01-02T18:17:14.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.649646+0000", 2023-01-02T18:17:14.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023746800000000001 2023-01-02T18:17:14.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.649883+0000", 2023-01-02T18:17:14.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0284999999999999e-05 2023-01-02T18:17:14.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.649913+0000", 2023-01-02T18:17:14.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2809000000000001e-05 2023-01-02T18:17:14.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.649936+0000", 2023-01-02T18:17:14.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322847 2023-01-02T18:17:14.842 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.842 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.843 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:978 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [watch watch cookie 140114919489248] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.843 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.655493+0000", 2023-01-02T18:17:14.843 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.085607587999998, 2023-01-02T18:17:14.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001004617, 2023-01-02T18:17:14.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.844 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.844 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.844 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.844 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 978 2023-01-02T18:17:14.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.845 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655493+0000", 2023-01-02T18:17:14.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655493+0000", 2023-01-02T18:17:14.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655492+0000", 2023-01-02T18:17:14.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0110000000000002e-06 2023-01-02T18:17:14.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655496+0000", 2023-01-02T18:17:14.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8429999999999999e-06 2023-01-02T18:17:14.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655505+0000", 2023-01-02T18:17:14.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6389999999999998e-06 2023-01-02T18:17:14.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655509+0000", 2023-01-02T18:17:14.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8826000000000001e-05 2023-01-02T18:17:14.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655537+0000", 2023-01-02T18:17:14.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4048000000000002e-05 2023-01-02T18:17:14.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655581+0000", 2023-01-02T18:17:14.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6469000000000001e-05 2023-01-02T18:17:14.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:14.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.655678+0000", 2023-01-02T18:17:14.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047453399999999998 2023-01-02T18:17:14.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.656152+0000", 2023-01-02T18:17:14.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024776000000000003 2023-01-02T18:17:14.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.656400+0000", 2023-01-02T18:17:14.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0898000000000001e-05 2023-01-02T18:17:14.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.656431+0000", 2023-01-02T18:17:14.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6309000000000005e-05 2023-01-02T18:17:14.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.656497+0000", 2023-01-02T18:17:14.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001004617 2023-01-02T18:17:14.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.856 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.857 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.857 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:981 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.857 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:17:14.857 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.082921125999999, 2023-01-02T18:17:14.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00147178, 2023-01-02T18:17:14.858 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.858 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.858 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.859 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.859 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 981 2023-01-02T18:17:14.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.859 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:17:14.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:17:14.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658178+0000", 2023-01-02T18:17:14.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:17:14.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658184+0000", 2023-01-02T18:17:14.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0121e-05 2023-01-02T18:17:14.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658194+0000", 2023-01-02T18:17:14.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6249999999999998e-06 2023-01-02T18:17:14.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658199+0000", 2023-01-02T18:17:14.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4972000000000003e-05 2023-01-02T18:17:14.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658234+0000", 2023-01-02T18:17:14.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9951000000000003e-05 2023-01-02T18:17:14.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658284+0000", 2023-01-02T18:17:14.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036241799999999998 2023-01-02T18:17:14.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:14.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658646+0000", 2023-01-02T18:17:14.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064372099999999999 2023-01-02T18:17:14.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659290+0000", 2023-01-02T18:17:14.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029051100000000002 2023-01-02T18:17:14.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659580+0000", 2023-01-02T18:17:14.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3173999999999997e-05 2023-01-02T18:17:14.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659624+0000", 2023-01-02T18:17:14.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7484999999999999e-05 2023-01-02T18:17:14.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659651+0000", 2023-01-02T18:17:14.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00147178 2023-01-02T18:17:14.871 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.871 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.871 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.871 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:998 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [watch watch cookie 140114651010384] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.872 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.667803+0000", 2023-01-02T18:17:14.872 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.073297804999999, 2023-01-02T18:17:14.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011496410000000001, 2023-01-02T18:17:14.872 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.872 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.873 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.873 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.873 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.873 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 998 2023-01-02T18:17:14.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.873 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667803+0000", 2023-01-02T18:17:14.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667803+0000", 2023-01-02T18:17:14.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:14.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667802+0000", 2023-01-02T18:17:14.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8879999999999999e-06 2023-01-02T18:17:14.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667806+0000", 2023-01-02T18:17:14.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.473e-06 2023-01-02T18:17:14.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667814+0000", 2023-01-02T18:17:14.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4330000000000001e-06 2023-01-02T18:17:14.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667821+0000", 2023-01-02T18:17:14.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8524e-05 2023-01-02T18:17:14.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667849+0000", 2023-01-02T18:17:14.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5154999999999997e-05 2023-01-02T18:17:14.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667894+0000", 2023-01-02T18:17:14.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4506999999999995e-05 2023-01-02T18:17:14.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:14.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667989+0000", 2023-01-02T18:17:14.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00049995200000000001 2023-01-02T18:17:14.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668489+0000", 2023-01-02T18:17:14.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032874800000000002 2023-01-02T18:17:14.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668818+0000", 2023-01-02T18:17:14.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3557999999999998e-05 2023-01-02T18:17:14.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668871+0000", 2023-01-02T18:17:14.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1117000000000003e-05 2023-01-02T18:17:14.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668952+0000", 2023-01-02T18:17:14.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011496410000000001 2023-01-02T18:17:14.885 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.885 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.886 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.886 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1077 7.f 7:f3cee7db:::rbd_header.11d51c086ce8:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.886 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.693014+0000", 2023-01-02T18:17:14.886 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.048086853000001, 2023-01-02T18:17:14.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011761650000000001, 2023-01-02T18:17:14.887 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.887 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.887 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.887 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.888 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.888 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1077 2023-01-02T18:17:14.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.888 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693014+0000", 2023-01-02T18:17:14.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693014+0000", 2023-01-02T18:17:14.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693013+0000", 2023-01-02T18:17:14.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8529999999999997e-06 2023-01-02T18:17:14.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693018+0000", 2023-01-02T18:17:14.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1385e-05 2023-01-02T18:17:14.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693030+0000", 2023-01-02T18:17:14.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5849999999999996e-06 2023-01-02T18:17:14.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693036+0000", 2023-01-02T18:17:14.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7567999999999997e-05 2023-01-02T18:17:14.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693074+0000", 2023-01-02T18:17:14.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0801e-05 2023-01-02T18:17:14.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693165+0000", 2023-01-02T18:17:14.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014202900000000001 2023-01-02T18:17:14.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:14.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693307+0000", 2023-01-02T18:17:14.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050517900000000002 2023-01-02T18:17:14.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693812+0000", 2023-01-02T18:17:14.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032358899999999999 2023-01-02T18:17:14.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694136+0000", 2023-01-02T18:17:14.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1708999999999997e-05 2023-01-02T18:17:14.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694167+0000", 2023-01-02T18:17:14.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2405e-05 2023-01-02T18:17:14.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694190+0000", 2023-01-02T18:17:14.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011761650000000001 2023-01-02T18:17:14.900 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.900 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.900 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.901 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1090 7.f 7:f3cee7db:::rbd_header.11d51c086ce8:head [watch watch cookie 140114919527408] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.901 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.702979+0000", 2023-01-02T18:17:14.901 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.038121718999999, 2023-01-02T18:17:14.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097907799999999998, 2023-01-02T18:17:14.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.902 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.902 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.902 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.902 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1090 2023-01-02T18:17:14.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.903 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.702979+0000", 2023-01-02T18:17:14.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.702979+0000", 2023-01-02T18:17:14.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.702978+0000", 2023-01-02T18:17:14.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7040000000000002e-06 2023-01-02T18:17:14.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.702982+0000", 2023-01-02T18:17:14.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1470000000000007e-06 2023-01-02T18:17:14.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.702992+0000", 2023-01-02T18:17:14.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.604e-06 2023-01-02T18:17:14.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.702997+0000", 2023-01-02T18:17:14.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8067e-05 2023-01-02T18:17:14.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.703035+0000", 2023-01-02T18:17:14.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5837000000000002e-05 2023-01-02T18:17:14.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.703081+0000", 2023-01-02T18:17:14.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6712999999999994e-05 2023-01-02T18:17:14.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:14.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.703178+0000", 2023-01-02T18:17:14.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00043004099999999998 2023-01-02T18:17:14.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.703608+0000", 2023-01-02T18:17:14.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00025490499999999999 2023-01-02T18:17:14.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.703863+0000", 2023-01-02T18:17:14.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8698e-05 2023-01-02T18:17:14.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.703911+0000", 2023-01-02T18:17:14.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6263000000000001e-05 2023-01-02T18:17:14.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.703958+0000", 2023-01-02T18:17:14.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097907799999999998 2023-01-02T18:17:14.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.915 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.916 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1093 7.f 7:f3cee7db:::rbd_header.11d51c086ce8:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.916 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:17:14.916 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.034882330999999, 2023-01-02T18:17:14.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001424745, 2023-01-02T18:17:14.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.917 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.917 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.918 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1093 2023-01-02T18:17:14.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.918 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:17:14.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:17:14.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706217+0000", 2023-01-02T18:17:14.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0279999999999997e-06 2023-01-02T18:17:14.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706223+0000", 2023-01-02T18:17:14.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1197e-05 2023-01-02T18:17:14.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706234+0000", 2023-01-02T18:17:14.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1184e-05 2023-01-02T18:17:14.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706246+0000", 2023-01-02T18:17:14.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0102000000000001e-05 2023-01-02T18:17:14.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706276+0000", 2023-01-02T18:17:14.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9431000000000002e-05 2023-01-02T18:17:14.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706325+0000", 2023-01-02T18:17:14.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036410199999999999 2023-01-02T18:17:14.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:14.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706689+0000", 2023-01-02T18:17:14.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059671500000000005 2023-01-02T18:17:14.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707286+0000", 2023-01-02T18:17:14.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030682099999999998 2023-01-02T18:17:14.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707593+0000", 2023-01-02T18:17:14.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7835e-05 2023-01-02T18:17:14.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707621+0000", 2023-01-02T18:17:14.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2303999999999999e-05 2023-01-02T18:17:14.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707643+0000", 2023-01-02T18:17:14.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001424745 2023-01-02T18:17:14.930 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.930 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.930 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.931 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1094 7.f 7:f3cee7db:::rbd_header.11d51c086ce8:head [watch unwatch cookie 140114919527408] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.931 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.707780+0000", 2023-01-02T18:17:14.931 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.033320786000001, 2023-01-02T18:17:14.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001071925, 2023-01-02T18:17:14.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.932 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.932 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.932 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.932 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1094 2023-01-02T18:17:14.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.933 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707780+0000", 2023-01-02T18:17:14.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707780+0000", 2023-01-02T18:17:14.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707779+0000", 2023-01-02T18:17:14.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9239999999999998e-06 2023-01-02T18:17:14.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707784+0000", 2023-01-02T18:17:14.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0069e-05 2023-01-02T18:17:14.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707794+0000", 2023-01-02T18:17:14.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4989999999999996e-06 2023-01-02T18:17:14.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707798+0000", 2023-01-02T18:17:14.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3269999999999998e-05 2023-01-02T18:17:14.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707831+0000", 2023-01-02T18:17:14.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0584999999999998e-05 2023-01-02T18:17:14.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707882+0000", 2023-01-02T18:17:14.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012383399999999999 2023-01-02T18:17:14.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:14.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708006+0000", 2023-01-02T18:17:14.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038151599999999998 2023-01-02T18:17:14.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708387+0000", 2023-01-02T18:17:14.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039533800000000002 2023-01-02T18:17:14.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708783+0000", 2023-01-02T18:17:14.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2339999999999999e-05 2023-01-02T18:17:14.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708815+0000", 2023-01-02T18:17:14.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6480999999999999e-05 2023-01-02T18:17:14.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708852+0000", 2023-01-02T18:17:14.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001071925 2023-01-02T18:17:14.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.945 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.945 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.945 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1184 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [watch unwatch cookie 140114651010384] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:14.946 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.737790+0000", 2023-01-02T18:17:14.946 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.003310290000002, 2023-01-02T18:17:14.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010672120000000001, 2023-01-02T18:17:14.946 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.946 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.947 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:14.947 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:14.947 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1184 2023-01-02T18:17:14.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.947 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737790+0000", 2023-01-02T18:17:14.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737790+0000", 2023-01-02T18:17:14.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737789+0000", 2023-01-02T18:17:14.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2950000000000004e-06 2023-01-02T18:17:14.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737794+0000", 2023-01-02T18:17:14.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9129999999999992e-06 2023-01-02T18:17:14.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737802+0000", 2023-01-02T18:17:14.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9829999999999998e-06 2023-01-02T18:17:14.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737806+0000", 2023-01-02T18:17:14.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2997999999999998e-05 2023-01-02T18:17:14.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737839+0000", 2023-01-02T18:17:14.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0204999999999998e-05 2023-01-02T18:17:14.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737890+0000", 2023-01-02T18:17:14.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4488999999999996e-05 2023-01-02T18:17:14.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:14.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.737984+0000", 2023-01-02T18:17:14.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052551500000000005 2023-01-02T18:17:14.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738510+0000", 2023-01-02T18:17:14.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027646700000000002 2023-01-02T18:17:14.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738786+0000", 2023-01-02T18:17:14.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0886999999999998e-05 2023-01-02T18:17:14.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738817+0000", 2023-01-02T18:17:14.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0321000000000002e-05 2023-01-02T18:17:14.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.738857+0000", 2023-01-02T18:17:14.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010672120000000001 2023-01-02T18:17:14.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.960 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.961 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1233 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:14.961 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:17:14.961 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.414116912000001, 2023-01-02T18:17:14.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001876817, 2023-01-02T18:17:14.961 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.962 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.962 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.962 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:14.962 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:14.962 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1233 2023-01-02T18:17:14.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.963 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:17:14.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:17:14.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:14.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326982+0000", 2023-01-02T18:17:14.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5199999999999997e-06 2023-01-02T18:17:14.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326990+0000", 2023-01-02T18:17:14.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.413e-05 2023-01-02T18:17:14.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327004+0000", 2023-01-02T18:17:14.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3750000000000002e-06 2023-01-02T18:17:14.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327010+0000", 2023-01-02T18:17:14.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4917999999999999e-05 2023-01-02T18:17:14.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327055+0000", 2023-01-02T18:17:14.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010794999999999999 2023-01-02T18:17:14.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327163+0000", 2023-01-02T18:17:14.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014037500000000001 2023-01-02T18:17:14.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:14.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327303+0000", 2023-01-02T18:17:14.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063062999999999997 2023-01-02T18:17:14.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327934+0000", 2023-01-02T18:17:14.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082138100000000004 2023-01-02T18:17:14.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328755+0000", 2023-01-02T18:17:14.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9277000000000002e-05 2023-01-02T18:17:14.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328814+0000", 2023-01-02T18:17:14.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6063000000000003e-05 2023-01-02T18:17:14.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328860+0000", 2023-01-02T18:17:14.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001876817 2023-01-02T18:17:14.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.975 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.975 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.976 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1251 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:14.976 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.340223+0000", 2023-01-02T18:17:14.976 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.40087769, 2023-01-02T18:17:14.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001198834, 2023-01-02T18:17:14.977 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.977 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:14.977 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.977 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:14.977 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1251 2023-01-02T18:17:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340223+0000", 2023-01-02T18:17:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340223+0000", 2023-01-02T18:17:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340221+0000", 2023-01-02T18:17:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5889999999999992e-06 2023-01-02T18:17:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340231+0000", 2023-01-02T18:17:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7547999999999999e-05 2023-01-02T18:17:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340248+0000", 2023-01-02T18:17:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.139e-06 2023-01-02T18:17:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340254+0000", 2023-01-02T18:17:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6189000000000002e-05 2023-01-02T18:17:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:14.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340291+0000", 2023-01-02T18:17:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6729000000000004e-05 2023-01-02T18:17:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:14.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340357+0000", 2023-01-02T18:17:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014813200000000001 2023-01-02T18:17:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:14.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340505+0000", 2023-01-02T18:17:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000494945 2023-01-02T18:17:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.341000+0000", 2023-01-02T18:17:14.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036168399999999997 2023-01-02T18:17:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.341362+0000", 2023-01-02T18:17:14.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1439999999999997e-05 2023-01-02T18:17:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.341394+0000", 2023-01-02T18:17:14.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8025e-05 2023-01-02T18:17:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.341422+0000", 2023-01-02T18:17:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001198834 2023-01-02T18:17:14.990 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.991 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2085 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.585933+0000", 2023-01-02T18:17:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.155167899, 2023-01-02T18:17:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001397602, 2023-01-02T18:17:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:14.992 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2085 2023-01-02T18:17:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.993 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585933+0000", 2023-01-02T18:17:14.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585933+0000", 2023-01-02T18:17:14.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585931+0000", 2023-01-02T18:17:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1999999999999997e-06 2023-01-02T18:17:14.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585939+0000", 2023-01-02T18:17:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4425e-05 2023-01-02T18:17:15.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585953+0000", 2023-01-02T18:17:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:15.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585960+0000", 2023-01-02T18:17:15.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3235999999999997e-05 2023-01-02T18:17:15.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.586003+0000", 2023-01-02T18:17:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5804999999999998e-05 2023-01-02T18:17:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.586059+0000", 2023-01-02T18:17:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012714149999999999 2023-01-02T18:17:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.587330+0000", 2023-01-02T18:17:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001397602 2023-01-02T18:17:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.005 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.006 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2090 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:15.006 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:17:15.007 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.152194614000001, 2023-01-02T18:17:15.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016870089999999999, 2023-01-02T18:17:15.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.007 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.007 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:15.008 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:15.008 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:15.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2090 2023-01-02T18:17:15.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.008 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:17:15.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:17:15.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:15.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588905+0000", 2023-01-02T18:17:15.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.205e-05 2023-01-02T18:17:15.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588917+0000", 2023-01-02T18:17:15.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1358999999999999e-05 2023-01-02T18:17:15.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588928+0000", 2023-01-02T18:17:15.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6299999999999997e-06 2023-01-02T18:17:15.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588933+0000", 2023-01-02T18:17:15.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9691999999999999e-05 2023-01-02T18:17:15.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588973+0000", 2023-01-02T18:17:15.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2386999999999998e-05 2023-01-02T18:17:15.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589025+0000", 2023-01-02T18:17:15.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013092999999999999 2023-01-02T18:17:15.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:15.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589156+0000", 2023-01-02T18:17:15.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051767999999999996 2023-01-02T18:17:15.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:15.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589674+0000", 2023-01-02T18:17:15.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086517400000000002 2023-01-02T18:17:15.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:15.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590539+0000", 2023-01-02T18:17:15.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0923999999999997e-05 2023-01-02T18:17:15.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590570+0000", 2023-01-02T18:17:15.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2023-01-02T18:17:15.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590593+0000", 2023-01-02T18:17:15.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016870089999999999 2023-01-02T18:17:15.020 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.021 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.021 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.021 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2641 3.10 e77/43 3:0f155940:::rbd_header.12a23fc13ef0:head v 77'6, mlcod=76'4)", 2023-01-02T18:17:15.022 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.608918+0000", 2023-01-02T18:17:15.022 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.1321819250000003, 2023-01-02T18:17:15.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097110700000000002, 2023-01-02T18:17:15.022 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.022 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.023 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.608918+0000", 2023-01-02T18:17:15.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.608918+0000", 2023-01-02T18:17:15.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:15.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.608918+0000", 2023-01-02T18:17:15.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0450000000000003e-06 2023-01-02T18:17:15.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.608925+0000", 2023-01-02T18:17:15.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8372e-05 2023-01-02T18:17:15.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.608944+0000", 2023-01-02T18:17:15.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8009999999999998e-06 2023-01-02T18:17:15.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.608950+0000", 2023-01-02T18:17:15.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1718999999999997e-05 2023-01-02T18:17:15.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.609002+0000", 2023-01-02T18:17:15.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4885999999999999e-05 2023-01-02T18:17:15.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.609027+0000", 2023-01-02T18:17:15.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082899700000000005 2023-01-02T18:17:15.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.609856+0000", 2023-01-02T18:17:15.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3541999999999998e-05 2023-01-02T18:17:15.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.609890+0000", 2023-01-02T18:17:15.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097110700000000002 2023-01-02T18:17:15.032 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.032 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.033 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.033 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.033 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.033 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:15.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:15.035 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:15.036 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:15.037 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:15.038 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:15.038 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:15.035+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:15.136 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:15.136+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:15.202 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:15.202 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:15.202 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:15.202 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:15.212 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:15.253 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:15.253+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:15.318 INFO:teuthology.orchestra.run.smithi007.stderr:set 6.f pg_upmap_items mapping to [6->4,1->5] 2023-01-02T18:17:15.320 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:17:15.337 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:15.338+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:15.346 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestGetSnapShotTimeStamp (1710 ms) 2023-01-02T18:17:15.346 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestCreateLsDeleteSnapPP 2023-01-02T18:17:15.347 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:15.391 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:15.391 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:15.391 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:15.392 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:15.392 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:15.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:15.438 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:15.438+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:15.538 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:15.538+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:15.568 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:15.569 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:15.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:15.569 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:15.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.570 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:6 3.1a e45/43 3:5cea7035:::rbd_info:head v 45'1, mlcod=0'0)", 2023-01-02T18:17:15.570 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:15.570 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.150873832000002, 2023-01-02T18:17:15.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998, 2023-01-02T18:17:15.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:15.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3349999999999997e-06 2023-01-02T18:17:15.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417398+0000", 2023-01-02T18:17:15.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7995999999999998e-05 2023-01-02T18:17:15.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417416+0000", 2023-01-02T18:17:15.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2250000000000003e-06 2023-01-02T18:17:15.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417423+0000", 2023-01-02T18:17:15.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6785e-05 2023-01-02T18:17:15.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417470+0000", 2023-01-02T18:17:15.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2886000000000001e-05 2023-01-02T18:17:15.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417492+0000", 2023-01-02T18:17:15.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070370800000000005 2023-01-02T18:17:15.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418196+0000", 2023-01-02T18:17:15.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1628999999999998e-05 2023-01-02T18:17:15.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418228+0000", 2023-01-02T18:17:15.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998 2023-01-02T18:17:15.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.581 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.581 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.581 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:15.582 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:15.582 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.144299261, 2023-01-02T18:17:15.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:15.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.582 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.582 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:15.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:15.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:15.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:15.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:15.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:15.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:15.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:15.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:15.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:15.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:15.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:15.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:15.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:15.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:15.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:15.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:15.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:15.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:15.591 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.591 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.592 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.592 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:15.592 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:15.592 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.085099552999999, 2023-01-02T18:17:15.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:15.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.593 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.593 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:15.594 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:15.594 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:15.594 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:15.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.594 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:15.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:15.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:15.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:15.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:15.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:15.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:15.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:15.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:15.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:15.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:15.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:15.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:15.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:15.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:15.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:15.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:15.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:15.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:15.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:15.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:15.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:15.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:15.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:15.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:15.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:15.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:15.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:15.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.606 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.607 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.607 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3d3f3250:::rbd_id.image2:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d3f3250:::rbd_id.image2:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:17:15.607 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:15.607 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.120873787999997, 2023-01-02T18:17:15.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004, 2023-01-02T18:17:15.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:15.608 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:15.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:15.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:15.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447391+0000", 2023-01-02T18:17:15.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8275e-05 2023-01-02T18:17:15.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447410+0000", 2023-01-02T18:17:15.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3377999999999999e-05 2023-01-02T18:17:15.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447433+0000", 2023-01-02T18:17:15.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6303e-05 2023-01-02T18:17:15.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447449+0000", 2023-01-02T18:17:15.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000438212 2023-01-02T18:17:15.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447888+0000", 2023-01-02T18:17:15.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.169e-05 2023-01-02T18:17:15.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447899+0000", 2023-01-02T18:17:15.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035861500000000001 2023-01-02T18:17:15.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448258+0000", 2023-01-02T18:17:15.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004 2023-01-02T18:17:15.616 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.616 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.617 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.617 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:15.617 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:15.618 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.239738712000001, 2023-01-02T18:17:15.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:15.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.618 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.618 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:15.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:15.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:15.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:15.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:15.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:15.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:15.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:15.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:15.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:15.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:15.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:15.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:15.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:15.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:15.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:15.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:15.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:15.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:15.628 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.628 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.628 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.628 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:17:15.629 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:15.629 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.227302909999999, 2023-01-02T18:17:15.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:17:15.629 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.629 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.630 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:15.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:15.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:15.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:15.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:17:15.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:17:15.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:17:15.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:17:15.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:17:15.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:17:15.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:17:15.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:17:15.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:17:15.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:17:15.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:17:15.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:17:15.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:17:15.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:17:15.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:17:15.639 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.639 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.639 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.640 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:15.640 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:15.640 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.192630172000001, 2023-01-02T18:17:15.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:15.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.641 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.641 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:15.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:15.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:15.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:15.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:15.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:15.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:15.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:15.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:15.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:15.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:15.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:15.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:15.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:15.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:15.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:15.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:15.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:15.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:15.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.650 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.651 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:15.651 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:15.651 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.182353153000001, 2023-01-02T18:17:15.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:15.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.652 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.652 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:15.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:15.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:15.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:15.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:15.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:15.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:15.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:15.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:15.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:15.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:15.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:15.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:15.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:15.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:15.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:15.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:15.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:15.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:15.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.662 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.662 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:572 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'22, mlcod=60'20)", 2023-01-02T18:17:15.663 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:17:15.663 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.118460911, 2023-01-02T18:17:15.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078864600000000005, 2023-01-02T18:17:15.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.663 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.663 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:17:15.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449805+0000", 2023-01-02T18:17:15.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:15.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449804+0000", 2023-01-02T18:17:15.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.401e-05 2023-01-02T18:17:15.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449818+0000", 2023-01-02T18:17:15.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0809999999999999e-05 2023-01-02T18:17:15.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449838+0000", 2023-01-02T18:17:15.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5199999999999997e-06 2023-01-02T18:17:15.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449847+0000", 2023-01-02T18:17:15.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9821999999999996e-05 2023-01-02T18:17:15.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449927+0000", 2023-01-02T18:17:15.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7619000000000001e-05 2023-01-02T18:17:15.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.449954+0000", 2023-01-02T18:17:15.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060264800000000001 2023-01-02T18:17:15.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450557+0000", 2023-01-02T18:17:15.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7101000000000003e-05 2023-01-02T18:17:15.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.450594+0000", 2023-01-02T18:17:15.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078864600000000005 2023-01-02T18:17:15.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.673 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.674 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:629 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'30, mlcod=60'28)", 2023-01-02T18:17:15.674 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:17:15.674 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.086521927, 2023-01-02T18:17:15.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083191500000000002, 2023-01-02T18:17:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:17:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481744+0000", 2023-01-02T18:17:15.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:15.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481743+0000", 2023-01-02T18:17:15.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4339999999999992e-06 2023-01-02T18:17:15.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481752+0000", 2023-01-02T18:17:15.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4435e-05 2023-01-02T18:17:15.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481766+0000", 2023-01-02T18:17:15.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0129999999999996e-06 2023-01-02T18:17:15.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481773+0000", 2023-01-02T18:17:15.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8954000000000004e-05 2023-01-02T18:17:15.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481842+0000", 2023-01-02T18:17:15.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5635000000000001e-05 2023-01-02T18:17:15.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481868+0000", 2023-01-02T18:17:15.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067504900000000005 2023-01-02T18:17:15.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482543+0000", 2023-01-02T18:17:15.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3379e-05 2023-01-02T18:17:15.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482576+0000", 2023-01-02T18:17:15.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083191500000000002 2023-01-02T18:17:15.684 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.684 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.684 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.685 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:369 7.1c e64/61 7:3831950c:::rbd_directory:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:15.685 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:15.685 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.254663766, 2023-01-02T18:17:15.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004, 2023-01-02T18:17:15.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.686 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.686 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:15.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:15.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:15.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313602+0000", 2023-01-02T18:17:15.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2730000000000002e-06 2023-01-02T18:17:15.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313607+0000", 2023-01-02T18:17:15.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1277999999999999e-05 2023-01-02T18:17:15.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313619+0000", 2023-01-02T18:17:15.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4730000000000003e-06 2023-01-02T18:17:15.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313626+0000", 2023-01-02T18:17:15.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8665999999999998e-05 2023-01-02T18:17:15.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313675+0000", 2023-01-02T18:17:15.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8902e-05 2023-01-02T18:17:15.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313694+0000", 2023-01-02T18:17:15.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079486599999999998 2023-01-02T18:17:15.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314489+0000", 2023-01-02T18:17:15.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7184999999999997e-05 2023-01-02T18:17:15.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314526+0000", 2023-01-02T18:17:15.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004 2023-01-02T18:17:15.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.696 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.696 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:15.697 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:15.697 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.874004734, 2023-01-02T18:17:15.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:15.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:15.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:15.698 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:15.698 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:15.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.698 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:15.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:15.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:15.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:15.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:15.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:15.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:15.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:15.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:15.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:15.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:15.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:15.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:15.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:15.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:15.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:15.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:15.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:15.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:15.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:15.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:15.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:15.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:15.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:15.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:15.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:15.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:15.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:15.711 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.711 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.711 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.712 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2084 8.3 e69/65 8:c28f5e81:::rbd_object_map.12a230fb06bc.0000000000000004:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:15.712 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:15.712 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.983530909000001, 2023-01-02T18:17:15.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003, 2023-01-02T18:17:15.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.713 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:15.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:15.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:15.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:15.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9859999999999997e-06 2023-01-02T18:17:15.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584742+0000", 2023-01-02T18:17:15.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4059999999999999e-05 2023-01-02T18:17:15.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584756+0000", 2023-01-02T18:17:15.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1331999999999999e-05 2023-01-02T18:17:15.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584767+0000", 2023-01-02T18:17:15.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2049000000000002e-05 2023-01-02T18:17:15.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584829+0000", 2023-01-02T18:17:15.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5982e-05 2023-01-02T18:17:15.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584845+0000", 2023-01-02T18:17:15.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080091699999999995 2023-01-02T18:17:15.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585646+0000", 2023-01-02T18:17:15.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8123000000000002e-05 2023-01-02T18:17:15.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585674+0000", 2023-01-02T18:17:15.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003 2023-01-02T18:17:15.722 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.722 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.722 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.723 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:15.723 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:15.723 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.938689844000001, 2023-01-02T18:17:15.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:15.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.724 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.724 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:15.724 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:15.724 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:15.725 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:15.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.725 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:15.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:15.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:15.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:15.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:15.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:15.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:15.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:15.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:15.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:15.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:15.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:15.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:15.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:15.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:15.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:15.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:15.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:15.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2484 8.15 e72/65 8:af65fa5d:::rbd_header.12a2b157d0cc:head v 72'16, mlcod=71'14)", 2023-01-02T18:17:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.240671181, 2023-01-02T18:17:15.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086154600000000003, 2023-01-02T18:17:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2400000000000004e-06 2023-01-02T18:17:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327601+0000", 2023-01-02T18:17:15.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3924e-05 2023-01-02T18:17:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327625+0000", 2023-01-02T18:17:15.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3620000000000002e-06 2023-01-02T18:17:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327631+0000", 2023-01-02T18:17:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5776999999999998e-05 2023-01-02T18:17:15.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327687+0000", 2023-01-02T18:17:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5990999999999999e-05 2023-01-02T18:17:15.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327713+0000", 2023-01-02T18:17:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070477300000000001 2023-01-02T18:17:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.328418+0000", 2023-01-02T18:17:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8707000000000001e-05 2023-01-02T18:17:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.328457+0000", 2023-01-02T18:17:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086154600000000003 2023-01-02T18:17:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2487 8.b e72/65 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head v 72'1, mlcod=0'0)", 2023-01-02T18:17:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:15.749 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.234748207000001, 2023-01-02T18:17:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001, 2023-01-02T18:17:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4989999999999999e-06 2023-01-02T18:17:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333524+0000", 2023-01-02T18:17:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5179999999999993e-06 2023-01-02T18:17:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333534+0000", 2023-01-02T18:17:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9309999999999996e-06 2023-01-02T18:17:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333540+0000", 2023-01-02T18:17:15.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4733e-05 2023-01-02T18:17:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333584+0000", 2023-01-02T18:17:15.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3536e-05 2023-01-02T18:17:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333608+0000", 2023-01-02T18:17:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076285800000000005 2023-01-02T18:17:15.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334371+0000", 2023-01-02T18:17:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4526000000000001e-05 2023-01-02T18:17:15.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334405+0000", 2023-01-02T18:17:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001 2023-01-02T18:17:15.759 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.760 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2494 8.15 e72/65 8:af65fa5d:::rbd_header.12a2b157d0cc:head v 72'17, mlcod=71'15)", 2023-01-02T18:17:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.228361923, 2023-01-02T18:17:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997, 2023-01-02T18:17:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:15.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.456e-06 2023-01-02T18:17:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339912+0000", 2023-01-02T18:17:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0529e-05 2023-01-02T18:17:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339922+0000", 2023-01-02T18:17:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4649999999999996e-06 2023-01-02T18:17:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339927+0000", 2023-01-02T18:17:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8563999999999999e-05 2023-01-02T18:17:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339966+0000", 2023-01-02T18:17:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7017e-05 2023-01-02T18:17:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339983+0000", 2023-01-02T18:17:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077748699999999999 2023-01-02T18:17:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340760+0000", 2023-01-02T18:17:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2043999999999999e-05 2023-01-02T18:17:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340802+0000", 2023-01-02T18:17:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997 2023-01-02T18:17:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.934784987, 2023-01-02T18:17:15.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:15.773 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:15.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:15.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:15.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:15.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.230243317, 2023-01-02T18:17:15.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:15.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:15.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:15.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:15.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:15.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:15.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2057 3.6 e82/43 3:6334c7d3:::rbd_object_map.11d574d0a887:head v 82'1, mlcod=0'0)", 2023-01-02T18:17:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.21200059800000001, 2023-01-02T18:17:15.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091887800000000003, 2023-01-02T18:17:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:15.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:15.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356265+0000", 2023-01-02T18:17:15.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5269999999999999e-06 2023-01-02T18:17:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356269+0000", 2023-01-02T18:17:15.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7110000000000007e-06 2023-01-02T18:17:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356279+0000", 2023-01-02T18:17:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3370000000000001e-06 2023-01-02T18:17:15.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356283+0000", 2023-01-02T18:17:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9932999999999998e-05 2023-01-02T18:17:15.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356333+0000", 2023-01-02T18:17:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2926999999999999e-05 2023-01-02T18:17:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356356+0000", 2023-01-02T18:17:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078956299999999996 2023-01-02T18:17:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357145+0000", 2023-01-02T18:17:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9088999999999998e-05 2023-01-02T18:17:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:15.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357185+0000", 2023-01-02T18:17:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091887800000000003 2023-01-02T18:17:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.808 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:15.809 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:15.809 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:15.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:15.811 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:15.811+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:15.911 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:15.911+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:15.977 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:15.978 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:15.978 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:15.988 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:16.012 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:16.012+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:16.112 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:16.113+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:16.154 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:16.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:16.238 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:16.238 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:16.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:16.241 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:16.240+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:16.334 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 1 2023-01-02T18:17:16.334 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:17:16.335 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap1 2023-01-02T18:17:16.335 INFO:tasks.workunit.client.0.smithi007.stdout:found snap1 with size 2097152 2023-01-02T18:17:16.340 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:16.341+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:16.373 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:16.374 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:16.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:16.374 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:16.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.374 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:16.375 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:16.375 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.889597268999999, 2023-01-02T18:17:16.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:16.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.376 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:16.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:16.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:16.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:16.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:16.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:16.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:16.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:16.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:16.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:16.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:16.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:16.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:16.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:16.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:16.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:16.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:16.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:16.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:16.390 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.390 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.390 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.391 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:16.391 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:16.392 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.025530739000001, 2023-01-02T18:17:16.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:16.392 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.393 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.393 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:16.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:16.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:16.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:16.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:16.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:16.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:16.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:16.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:16.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:16.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:16.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:16.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:16.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:16.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:16.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:16.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:16.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:16.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:16.403 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.403 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.403 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.404 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:16.404 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:16.404 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.023851126, 2023-01-02T18:17:16.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:16.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.405 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:16.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:16.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:16.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:16.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:16.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:16.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:16.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:16.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:16.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:16.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:16.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:16.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:16.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:16.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:16.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:16.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:16.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:16.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:16.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.418 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.419 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:16.419 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.057023242, 2023-01-02T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:16.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.421 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:16.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:16.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:16.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:16.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:16.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:16.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:16.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:16.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:16.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:16.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:16.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:16.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:16.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:16.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:16.431 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.432 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.432 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:16.432 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:16.433 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.726885698, 2023-01-02T18:17:16.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:16.433 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.433 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.433 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:16.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:16.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:16.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:16.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:16.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:16.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:16.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:16.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:16.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:16.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:16.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:16.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:16.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:16.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:16.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:16.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:16.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:16.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:16.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.443 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.444 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:981 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'4, mlcod=64'2)", 2023-01-02T18:17:16.444 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:16.444 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.714546000999999, 2023-01-02T18:17:16.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003, 2023-01-02T18:17:16.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.445 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:16.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:16.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:16.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658715+0000", 2023-01-02T18:17:16.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2509999999999997e-06 2023-01-02T18:17:16.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658723+0000", 2023-01-02T18:17:16.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6970000000000005e-06 2023-01-02T18:17:16.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658732+0000", 2023-01-02T18:17:16.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3159999999999998e-06 2023-01-02T18:17:16.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658737+0000", 2023-01-02T18:17:16.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2293000000000003e-05 2023-01-02T18:17:16.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658779+0000", 2023-01-02T18:17:16.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2996000000000001e-05 2023-01-02T18:17:16.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658802+0000", 2023-01-02T18:17:16.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066023399999999999 2023-01-02T18:17:16.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659462+0000", 2023-01-02T18:17:16.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4413000000000002e-05 2023-01-02T18:17:16.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659487+0000", 2023-01-02T18:17:16.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003 2023-01-02T18:17:16.455 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.456 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.456 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.456 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:16.457 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:16.457 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.049532995, 2023-01-02T18:17:16.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:16.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.458 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:16.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:16.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:16.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:16.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:16.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:16.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:16.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:16.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:16.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:16.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:16.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:16.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:16.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:16.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:16.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:16.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:16.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:16.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:16.467 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.467 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.467 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.468 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:16.468 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:16.468 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.047739910000001, 2023-01-02T18:17:16.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:16.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.469 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:16.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:16.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:16.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:16.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:16.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:16.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:16.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:16.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:16.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:16.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:16.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:16.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:16.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:16.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:16.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.478 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.479 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:16.479 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:16.479 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.036902125999999, 2023-01-02T18:17:16.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:16.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.480 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:16.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:16.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:16.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:16.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:16.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:16.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:16.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:16.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:16.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:16.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:16.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:16.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:16.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:16.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:16.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:16.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:16.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:16.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.489 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.490 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1511 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'37, mlcod=68'35)", 2023-01-02T18:17:16.490 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:16.490 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.914705853999999, 2023-01-02T18:17:16.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005, 2023-01-02T18:17:16.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.491 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:16.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:16.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:16.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458554+0000", 2023-01-02T18:17:16.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4627000000000001e-05 2023-01-02T18:17:16.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458569+0000", 2023-01-02T18:17:16.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6376e-05 2023-01-02T18:17:16.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458595+0000", 2023-01-02T18:17:16.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2846e-05 2023-01-02T18:17:16.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458608+0000", 2023-01-02T18:17:16.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0798999999999997e-05 2023-01-02T18:17:16.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458689+0000", 2023-01-02T18:17:16.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1622999999999998e-05 2023-01-02T18:17:16.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458731+0000", 2023-01-02T18:17:16.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050369499999999997 2023-01-02T18:17:16.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459234+0000", 2023-01-02T18:17:16.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6656999999999998e-05 2023-01-02T18:17:16.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459271+0000", 2023-01-02T18:17:16.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005 2023-01-02T18:17:16.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.500 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.501 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1618 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'52, mlcod=68'50)", 2023-01-02T18:17:16.501 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:16.502 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.868525432, 2023-01-02T18:17:16.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068253599999999997, 2023-01-02T18:17:16.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.502 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.502 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:16.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504737+0000", 2023-01-02T18:17:16.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:16.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504736+0000", 2023-01-02T18:17:16.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3439999999999997e-06 2023-01-02T18:17:16.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504742+0000", 2023-01-02T18:17:16.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0339999999999999e-05 2023-01-02T18:17:16.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504753+0000", 2023-01-02T18:17:16.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5300000000000002e-06 2023-01-02T18:17:16.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504759+0000", 2023-01-02T18:17:16.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8566999999999998e-05 2023-01-02T18:17:16.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504808+0000", 2023-01-02T18:17:16.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3618e-05 2023-01-02T18:17:16.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.504831+0000", 2023-01-02T18:17:16.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055935399999999997 2023-01-02T18:17:16.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.505391+0000", 2023-01-02T18:17:16.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8598999999999998e-05 2023-01-02T18:17:16.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.505419+0000", 2023-01-02T18:17:16.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068253599999999997 2023-01-02T18:17:16.511 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.511 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.512 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.512 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1642 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'55, mlcod=68'53)", 2023-01-02T18:17:16.512 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:16.512 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.857575356, 2023-01-02T18:17:16.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068970200000000005, 2023-01-02T18:17:16.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.513 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:16.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:16.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:16.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515686+0000", 2023-01-02T18:17:16.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2879999999999998e-06 2023-01-02T18:17:16.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515692+0000", 2023-01-02T18:17:16.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0679000000000001e-05 2023-01-02T18:17:16.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515703+0000", 2023-01-02T18:17:16.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7849999999999999e-06 2023-01-02T18:17:16.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515708+0000", 2023-01-02T18:17:16.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4620000000000003e-05 2023-01-02T18:17:16.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515752+0000", 2023-01-02T18:17:16.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2283999999999999e-05 2023-01-02T18:17:16.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515775+0000", 2023-01-02T18:17:16.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057592299999999999 2023-01-02T18:17:16.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.516351+0000", 2023-01-02T18:17:16.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5884000000000002e-05 2023-01-02T18:17:16.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.516376+0000", 2023-01-02T18:17:16.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068970200000000005 2023-01-02T18:17:16.527 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.527 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.527 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.527 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1698 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'62, mlcod=68'60)", 2023-01-02T18:17:16.527 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:16.528 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.832235541999999, 2023-01-02T18:17:16.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069486999999999999, 2023-01-02T18:17:16.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.528 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:16.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:16.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:16.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541026+0000", 2023-01-02T18:17:16.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1589999999999998e-06 2023-01-02T18:17:16.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541032+0000", 2023-01-02T18:17:16.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0879e-05 2023-01-02T18:17:16.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541043+0000", 2023-01-02T18:17:16.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5360000000000003e-06 2023-01-02T18:17:16.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541047+0000", 2023-01-02T18:17:16.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6459999999999999e-05 2023-01-02T18:17:16.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541094+0000", 2023-01-02T18:17:16.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323e-05 2023-01-02T18:17:16.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541117+0000", 2023-01-02T18:17:16.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057111 2023-01-02T18:17:16.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541688+0000", 2023-01-02T18:17:16.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3217999999999999e-05 2023-01-02T18:17:16.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541721+0000", 2023-01-02T18:17:16.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069486999999999999 2023-01-02T18:17:16.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.538 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.539 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1774 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'72, mlcod=68'70)", 2023-01-02T18:17:16.539 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:16.540 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.797627764, 2023-01-02T18:17:16.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004, 2023-01-02T18:17:16.540 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.540 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:16.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:16.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:16.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575633+0000", 2023-01-02T18:17:16.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1912999999999999e-05 2023-01-02T18:17:16.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575645+0000", 2023-01-02T18:17:16.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5690000000000001e-05 2023-01-02T18:17:16.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575660+0000", 2023-01-02T18:17:16.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1430000000000001e-06 2023-01-02T18:17:16.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575668+0000", 2023-01-02T18:17:16.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9123000000000003e-05 2023-01-02T18:17:16.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575727+0000", 2023-01-02T18:17:16.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0632000000000001e-05 2023-01-02T18:17:16.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575757+0000", 2023-01-02T18:17:16.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057452100000000004 2023-01-02T18:17:16.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576332+0000", 2023-01-02T18:17:16.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8958999999999998e-05 2023-01-02T18:17:16.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576361+0000", 2023-01-02T18:17:16.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004 2023-01-02T18:17:16.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.550 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.551 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1819 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'77, mlcod=68'75)", 2023-01-02T18:17:16.551 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:16.551 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.777701204, 2023-01-02T18:17:16.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068721400000000001, 2023-01-02T18:17:16.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.552 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:16.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:16.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:16.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595559+0000", 2023-01-02T18:17:16.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0942e-05 2023-01-02T18:17:16.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595570+0000", 2023-01-02T18:17:16.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8321999999999998e-05 2023-01-02T18:17:16.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595589+0000", 2023-01-02T18:17:16.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0069999999999997e-06 2023-01-02T18:17:16.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595597+0000", 2023-01-02T18:17:16.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7846999999999999e-05 2023-01-02T18:17:16.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595635+0000", 2023-01-02T18:17:16.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6322000000000001e-05 2023-01-02T18:17:16.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595651+0000", 2023-01-02T18:17:16.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056746499999999996 2023-01-02T18:17:16.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.596218+0000", 2023-01-02T18:17:16.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9777999999999998e-05 2023-01-02T18:17:16.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.596248+0000", 2023-01-02T18:17:16.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068721400000000001 2023-01-02T18:17:16.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.561 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.562 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1842 8.4 e68/65 8:24c831c0:::rbd_header.12a2b9663ff5:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:16.562 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:16.562 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.760366234999999, 2023-01-02T18:17:16.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997, 2023-01-02T18:17:16.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.563 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:16.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:16.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:16.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612894+0000", 2023-01-02T18:17:16.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:16.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612908+0000", 2023-01-02T18:17:16.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6006000000000001e-05 2023-01-02T18:17:16.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612934+0000", 2023-01-02T18:17:16.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.509e-05 2023-01-02T18:17:16.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612949+0000", 2023-01-02T18:17:16.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7535999999999998e-05 2023-01-02T18:17:16.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613027+0000", 2023-01-02T18:17:16.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0413000000000001e-05 2023-01-02T18:17:16.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613067+0000", 2023-01-02T18:17:16.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056083499999999998 2023-01-02T18:17:16.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613628+0000", 2023-01-02T18:17:16.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0998000000000001e-05 2023-01-02T18:17:16.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613649+0000", 2023-01-02T18:17:16.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997 2023-01-02T18:17:16.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.573 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.574 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2136 8.16 e69/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:16.574 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:16.574 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.752284762, 2023-01-02T18:17:16.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995, 2023-01-02T18:17:16.574 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.575 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:16.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:16.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:16.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:16.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8340000000000001e-06 2023-01-02T18:17:16.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620984+0000", 2023-01-02T18:17:16.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5201000000000001e-05 2023-01-02T18:17:16.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620999+0000", 2023-01-02T18:17:16.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9990000000000008e-06 2023-01-02T18:17:16.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621007+0000", 2023-01-02T18:17:16.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9780999999999997e-05 2023-01-02T18:17:16.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621047+0000", 2023-01-02T18:17:16.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2869e-05 2023-01-02T18:17:16.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621060+0000", 2023-01-02T18:17:16.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061950799999999995 2023-01-02T18:17:16.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621679+0000", 2023-01-02T18:17:16.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2191999999999999e-05 2023-01-02T18:17:16.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621711+0000", 2023-01-02T18:17:16.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995 2023-01-02T18:17:16.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.584 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.585 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2604 8.16 e72/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 72'4, mlcod=69'2)", 2023-01-02T18:17:16.585 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:16.586 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.980723418, 2023-01-02T18:17:16.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068205399999999997, 2023-01-02T18:17:16.586 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.587 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:16.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392539+0000", 2023-01-02T18:17:16.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:16.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392538+0000", 2023-01-02T18:17:16.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5759999999999999e-06 2023-01-02T18:17:16.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392543+0000", 2023-01-02T18:17:16.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1090999999999999e-05 2023-01-02T18:17:16.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392554+0000", 2023-01-02T18:17:16.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8440000000000003e-06 2023-01-02T18:17:16.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392560+0000", 2023-01-02T18:17:16.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5738000000000002e-05 2023-01-02T18:17:16.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392606+0000", 2023-01-02T18:17:16.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6169000000000001e-05 2023-01-02T18:17:16.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.392622+0000", 2023-01-02T18:17:16.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056720399999999997 2023-01-02T18:17:16.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.393189+0000", 2023-01-02T18:17:16.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1707e-05 2023-01-02T18:17:16.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.393221+0000", 2023-01-02T18:17:16.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068205399999999997 2023-01-02T18:17:16.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.599 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.600 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.600 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2611 8.1b e72/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 72'85, mlcod=69'83)", 2023-01-02T18:17:16.600 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:16.600 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.972699027000001, 2023-01-02T18:17:16.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999, 2023-01-02T18:17:16.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.601 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.601 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:16.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:16.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:16.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400562+0000", 2023-01-02T18:17:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1299999999999998e-06 2023-01-02T18:17:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400568+0000", 2023-01-02T18:17:16.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0643e-05 2023-01-02T18:17:16.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400579+0000", 2023-01-02T18:17:16.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4920000000000004e-06 2023-01-02T18:17:16.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400584+0000", 2023-01-02T18:17:16.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4360999999999998e-05 2023-01-02T18:17:16.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400618+0000", 2023-01-02T18:17:16.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4246999999999999e-05 2023-01-02T18:17:16.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400632+0000", 2023-01-02T18:17:16.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061679400000000004 2023-01-02T18:17:16.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401249+0000", 2023-01-02T18:17:16.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7705999999999999e-05 2023-01-02T18:17:16.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401277+0000", 2023-01-02T18:17:16.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999 2023-01-02T18:17:16.611 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.612 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.612 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2055 3.5 e82/48 3:a39c7274:::rbd_id.image39:head v 82'2, mlcod=0'0)", 2023-01-02T18:17:16.613 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.353372+0000", 2023-01-02T18:17:16.613 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.0198900280000001, 2023-01-02T18:17:16.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071350199999999997, 2023-01-02T18:17:16.613 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:16.613 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:16.614 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:16.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:16.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353372+0000", 2023-01-02T18:17:16.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:16.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:16.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353372+0000", 2023-01-02T18:17:16.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:16.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:16.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353372+0000", 2023-01-02T18:17:16.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0710000000000002e-06 2023-01-02T18:17:16.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:16.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353377+0000", 2023-01-02T18:17:16.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3485e-05 2023-01-02T18:17:16.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:16.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353390+0000", 2023-01-02T18:17:16.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8719999999999996e-06 2023-01-02T18:17:16.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:16.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353397+0000", 2023-01-02T18:17:16.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1141999999999999e-05 2023-01-02T18:17:16.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:16.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353448+0000", 2023-01-02T18:17:16.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4799e-05 2023-01-02T18:17:16.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:16.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353463+0000", 2023-01-02T18:17:16.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059333200000000002 2023-01-02T18:17:16.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:16.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.354057+0000", 2023-01-02T18:17:16.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9068e-05 2023-01-02T18:17:16.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:16.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:16.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:16.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.354086+0000", 2023-01-02T18:17:16.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071350199999999997 2023-01-02T18:17:16.626 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.627 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:16.628 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:16.628 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:16.630 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:16.631 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:16.629+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:16.730 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:16.730+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:16.798 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:16.799 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:16.799 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:16.809 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:16.850 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:16.850+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:16.932 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:16.932+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:16.974 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:16.974 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:16.974 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:16.975 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:16.975 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:16.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:17.033 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:17.033+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:17.039 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:17.134 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:17.134+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:17.153 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:17.154 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:17.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:17.154 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:17.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.154 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:17.155 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:17.155 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.716928946000003, 2023-01-02T18:17:17.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:17.155 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.155 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.156 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.156 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.156 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.156 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:17.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.157 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:17.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:17.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:17.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:17.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:17.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:17.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:17.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:17.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:17.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:17.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:17.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:17.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:17.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:17.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:17.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:17.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:17.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:17.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:17.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:17.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:17.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:17.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:17.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:17.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:17.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:17.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:17.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:17.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:17.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:17.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:17.170 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.171 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.171 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.171 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:17.172 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:17.172 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.667543952999999, 2023-01-02T18:17:17.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:17:17.172 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.172 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.173 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.173 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:17.173 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:17.173 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:17:17.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.174 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:17.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:17.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:17.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:17:17.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:17:17.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:17:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:17:17.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:17:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:17:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:17:17.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:17:17.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:17:17.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:17:17.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:17:17.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:17:17.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:17.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:17:17.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:17:17.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:17:17.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:17:17.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:17:17.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:17:17.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:17:17.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:17:17.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:17:17.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:17:17.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.186 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.187 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:427 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:17.187 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:17.187 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.786825697000001, 2023-01-02T18:17:17.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001, 2023-01-02T18:17:17.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 427 2023-01-02T18:17:17.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.188 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:17.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:17.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:17.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365951+0000", 2023-01-02T18:17:17.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4900000000000002e-06 2023-01-02T18:17:17.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365956+0000", 2023-01-02T18:17:17.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5820000000000004e-06 2023-01-02T18:17:17.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365963+0000", 2023-01-02T18:17:17.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8339999999999998e-06 2023-01-02T18:17:17.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365968+0000", 2023-01-02T18:17:17.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000271091 2023-01-02T18:17:17.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366239+0000", 2023-01-02T18:17:17.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2132000000000006e-05 2023-01-02T18:17:17.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366321+0000", 2023-01-02T18:17:17.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000222733 2023-01-02T18:17:17.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366544+0000", 2023-01-02T18:17:17.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056500799999999998 2023-01-02T18:17:17.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367109+0000", 2023-01-02T18:17:17.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030673499999999998 2023-01-02T18:17:17.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367416+0000", 2023-01-02T18:17:17.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3107000000000003e-05 2023-01-02T18:17:17.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367489+0000", 2023-01-02T18:17:17.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3927000000000001e-05 2023-01-02T18:17:17.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367543+0000", 2023-01-02T18:17:17.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001 2023-01-02T18:17:17.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.201 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.202 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:444 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:17.202 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:17.202 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.777527719999998, 2023-01-02T18:17:17.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489, 2023-01-02T18:17:17.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.203 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.203 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.203 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.203 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 444 2023-01-02T18:17:17.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.204 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:17.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:17.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:17.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375249+0000", 2023-01-02T18:17:17.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9409999999999998e-06 2023-01-02T18:17:17.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375254+0000", 2023-01-02T18:17:17.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5210000000000008e-06 2023-01-02T18:17:17.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375264+0000", 2023-01-02T18:17:17.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9629999999999997e-06 2023-01-02T18:17:17.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375269+0000", 2023-01-02T18:17:17.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.333e-05 2023-01-02T18:17:17.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375312+0000", 2023-01-02T18:17:17.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6695999999999998e-05 2023-01-02T18:17:17.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375399+0000", 2023-01-02T18:17:17.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016210000000000001 2023-01-02T18:17:17.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375561+0000", 2023-01-02T18:17:17.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087961699999999996 2023-01-02T18:17:17.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376440+0000", 2023-01-02T18:17:17.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055437200000000002 2023-01-02T18:17:17.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376995+0000", 2023-01-02T18:17:17.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6236999999999997e-05 2023-01-02T18:17:17.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377051+0000", 2023-01-02T18:17:17.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0509e-05 2023-01-02T18:17:17.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377102+0000", 2023-01-02T18:17:17.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489 2023-01-02T18:17:17.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.216 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.217 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:17.217 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:17.217 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.767220478999999, 2023-01-02T18:17:17.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:17:17.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:17:17.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.219 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:17.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:17.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:17.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:17:17.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:17:17.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:17:17.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:17:17.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:17:17.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:17:17.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:17:17.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:17:17.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:17:17.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:17:17.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:17:17.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:17:17.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:17:17.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:17:17.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:17:17.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:17:17.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:17:17.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:17:17.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:17:17.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:17:17.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:17:17.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:17:17.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.231 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.232 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:629 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:17.232 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:17.232 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.671499519000001, 2023-01-02T18:17:17.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999, 2023-01-02T18:17:17.232 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.233 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.233 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.233 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.233 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 629 2023-01-02T18:17:17.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.234 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:17.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481278+0000", 2023-01-02T18:17:17.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:17.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481277+0000", 2023-01-02T18:17:17.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.981e-06 2023-01-02T18:17:17.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481283+0000", 2023-01-02T18:17:17.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3018e-05 2023-01-02T18:17:17.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481296+0000", 2023-01-02T18:17:17.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0430000000000004e-06 2023-01-02T18:17:17.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481302+0000", 2023-01-02T18:17:17.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7145999999999999e-05 2023-01-02T18:17:17.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481349+0000", 2023-01-02T18:17:17.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6058999999999996e-05 2023-01-02T18:17:17.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481445+0000", 2023-01-02T18:17:17.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000219621 2023-01-02T18:17:17.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.481665+0000", 2023-01-02T18:17:17.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076564299999999999 2023-01-02T18:17:17.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482431+0000", 2023-01-02T18:17:17.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00027227600000000001 2023-01-02T18:17:17.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482703+0000", 2023-01-02T18:17:17.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5970000000000001e-05 2023-01-02T18:17:17.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482759+0000", 2023-01-02T18:17:17.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2224000000000001e-05 2023-01-02T18:17:17.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.482801+0000", 2023-01-02T18:17:17.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015228679999999999 2023-01-02T18:17:17.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.246 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.247 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:677 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:17.247 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:17.247 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.643808275000001, 2023-01-02T18:17:17.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911, 2023-01-02T18:17:17.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 677 2023-01-02T18:17:17.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.248 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:17.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:17.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:17.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508969+0000", 2023-01-02T18:17:17.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.268e-06 2023-01-02T18:17:17.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508975+0000", 2023-01-02T18:17:17.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4151000000000001e-05 2023-01-02T18:17:17.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508989+0000", 2023-01-02T18:17:17.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9569999999999996e-06 2023-01-02T18:17:17.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508996+0000", 2023-01-02T18:17:17.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6683e-05 2023-01-02T18:17:17.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509043+0000", 2023-01-02T18:17:17.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6942999999999997e-05 2023-01-02T18:17:17.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509130+0000", 2023-01-02T18:17:17.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020122099999999999 2023-01-02T18:17:17.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509331+0000", 2023-01-02T18:17:17.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063843400000000001 2023-01-02T18:17:17.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509969+0000", 2023-01-02T18:17:17.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062000599999999999 2023-01-02T18:17:17.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510589+0000", 2023-01-02T18:17:17.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8503000000000001e-05 2023-01-02T18:17:17.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510618+0000", 2023-01-02T18:17:17.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7784999999999998e-05 2023-01-02T18:17:17.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510655+0000", 2023-01-02T18:17:17.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911 2023-01-02T18:17:17.260 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.261 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.261 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.261 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:709 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:17.262 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:17.262 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.624785862, 2023-01-02T18:17:17.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999, 2023-01-02T18:17:17.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.262 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.262 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.263 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.263 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.263 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 709 2023-01-02T18:17:17.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.263 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:17.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:17.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:17.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527991+0000", 2023-01-02T18:17:17.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5170000000000001e-06 2023-01-02T18:17:17.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527996+0000", 2023-01-02T18:17:17.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2990000000000002e-06 2023-01-02T18:17:17.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528005+0000", 2023-01-02T18:17:17.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7049999999999996e-06 2023-01-02T18:17:17.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528011+0000", 2023-01-02T18:17:17.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3952999999999998e-05 2023-01-02T18:17:17.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528045+0000", 2023-01-02T18:17:17.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1950999999999998e-05 2023-01-02T18:17:17.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528097+0000", 2023-01-02T18:17:17.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000157078 2023-01-02T18:17:17.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528254+0000", 2023-01-02T18:17:17.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076010699999999999 2023-01-02T18:17:17.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529014+0000", 2023-01-02T18:17:17.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045062500000000002 2023-01-02T18:17:17.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529464+0000", 2023-01-02T18:17:17.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1790999999999999e-05 2023-01-02T18:17:17.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529516+0000", 2023-01-02T18:17:17.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1063999999999999e-05 2023-01-02T18:17:17.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529557+0000", 2023-01-02T18:17:17.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999 2023-01-02T18:17:17.275 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.275 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.275 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.276 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:17.276 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:17.276 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.843388836999999, 2023-01-02T18:17:17.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:17.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:17.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:17.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:17.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.278 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:17.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:17.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:17.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:17.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:17.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:17.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:17.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:17.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:17.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:17.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:17.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:17.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:17.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:17.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:17.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:17.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:17.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:17.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:17.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:17.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:17.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:17.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:17.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:17.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:17.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:17.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:17.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:17.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:17.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:17.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.292 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.293 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:372 7.1 7:83feba0f:::rbd_object_map.11d56649889d:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:17.293 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:17.293 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.833449774000002, 2023-01-02T18:17:17.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479, 2023-01-02T18:17:17.293 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.293 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:17.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:17.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 372 2023-01-02T18:17:17.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.295 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:17.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:17.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:17.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319326+0000", 2023-01-02T18:17:17.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1199999999999996e-06 2023-01-02T18:17:17.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319334+0000", 2023-01-02T18:17:17.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2170999999999999e-05 2023-01-02T18:17:17.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319346+0000", 2023-01-02T18:17:17.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7789999999999996e-06 2023-01-02T18:17:17.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319353+0000", 2023-01-02T18:17:17.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8445999999999997e-05 2023-01-02T18:17:17.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319392+0000", 2023-01-02T18:17:17.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010474700000000001 2023-01-02T18:17:17.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319497+0000", 2023-01-02T18:17:17.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138159 2023-01-02T18:17:17.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:17.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319635+0000", 2023-01-02T18:17:17.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071603699999999999 2023-01-02T18:17:17.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320351+0000", 2023-01-02T18:17:17.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063369800000000003 2023-01-02T18:17:17.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320985+0000", 2023-01-02T18:17:17.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5822000000000002e-05 2023-01-02T18:17:17.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321040+0000", 2023-01-02T18:17:17.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4125999999999997e-05 2023-01-02T18:17:17.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321085+0000", 2023-01-02T18:17:17.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479 2023-01-02T18:17:17.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.307 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.307 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1953 8.8 8:1376a730:::rbd_id.image30:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:17.308 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:17.308 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.49636535, 2023-01-02T18:17:17.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939, 2023-01-02T18:17:17.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.309 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.309 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.309 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1953 2023-01-02T18:17:17.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.309 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:17.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:17.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:17.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656411+0000", 2023-01-02T18:17:17.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5109999999999992e-06 2023-01-02T18:17:17.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656421+0000", 2023-01-02T18:17:17.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3118000000000001e-05 2023-01-02T18:17:17.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656444+0000", 2023-01-02T18:17:17.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.841e-06 2023-01-02T18:17:17.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656452+0000", 2023-01-02T18:17:17.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8368000000000003e-05 2023-01-02T18:17:17.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656490+0000", 2023-01-02T18:17:17.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6940000000000004e-05 2023-01-02T18:17:17.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656587+0000", 2023-01-02T18:17:17.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013780300000000001 2023-01-02T18:17:17.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:17.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656725+0000", 2023-01-02T18:17:17.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000707375 2023-01-02T18:17:17.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.657432+0000", 2023-01-02T18:17:17.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062476800000000005 2023-01-02T18:17:17.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658057+0000", 2023-01-02T18:17:17.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4223000000000001e-05 2023-01-02T18:17:17.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658091+0000", 2023-01-02T18:17:17.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5299e-05 2023-01-02T18:17:17.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658116+0000", 2023-01-02T18:17:17.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939 2023-01-02T18:17:17.321 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.322 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.322 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.322 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.537428882, 2023-01-02T18:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.323 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:17.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:17.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:17.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:17.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:17.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:17.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:17.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:17.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:17.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:17.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:17.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:17.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:17.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:17.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:17.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:17.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:17.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:17.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:17.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:17.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:17.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:17.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:17.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:17.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:17.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:17.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:17.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:17.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:17.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.338 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.339 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2160 8.0 8:0415d193:::rbd_header.12a27aa439c7:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:17.339 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:17.339 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.518097974, 2023-01-02T18:17:17.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014998629999999999, 2023-01-02T18:17:17.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2160 2023-01-02T18:17:17.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.341 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:17.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634680+0000", 2023-01-02T18:17:17.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:17.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634679+0000", 2023-01-02T18:17:17.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9569999999999999e-06 2023-01-02T18:17:17.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634685+0000", 2023-01-02T18:17:17.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1110999999999999e-05 2023-01-02T18:17:17.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634696+0000", 2023-01-02T18:17:17.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5769999999999999e-06 2023-01-02T18:17:17.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634702+0000", 2023-01-02T18:17:17.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2962000000000001e-05 2023-01-02T18:17:17.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634735+0000", 2023-01-02T18:17:17.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3204000000000001e-05 2023-01-02T18:17:17.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.634789+0000", 2023-01-02T18:17:17.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036566000000000002 2023-01-02T18:17:17.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635154+0000", 2023-01-02T18:17:17.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074706800000000004 2023-01-02T18:17:17.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.635901+0000", 2023-01-02T18:17:17.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000225295 2023-01-02T18:17:17.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636127+0000", 2023-01-02T18:17:17.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0684e-05 2023-01-02T18:17:17.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636157+0000", 2023-01-02T18:17:17.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2378000000000002e-05 2023-01-02T18:17:17.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.636180+0000", 2023-01-02T18:17:17.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014998629999999999 2023-01-02T18:17:17.353 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.353 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.353 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.354 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:17.354 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:17.354 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.822957067999999, 2023-01-02T18:17:17.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:17.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.355 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.355 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.355 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.355 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:17.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.356 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:17.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:17.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:17.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:17.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:17.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:17.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:17.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:17.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:17.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:17.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:17.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:17.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:17.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:17.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:17.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:17.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:17.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:17.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:17.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:17.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:17.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:17.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:17.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:17.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:17.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:17.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:17.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:17.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:17.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:17.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:17.369 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.369 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.370 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:17.370 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:17.370 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.8138556670000003, 2023-01-02T18:17:17.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:17.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.371 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:17.371 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.371 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:17.372 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:17.372 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:17.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.372 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:17.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:17.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:17.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:17.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:17.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:17.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:17.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:17.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:17.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:17.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:17.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:17.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:17.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:17.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:17.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:17.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.383 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.384 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:17.384 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:17.384 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.5424993750000002, 2023-01-02T18:17:17.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:17.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:17.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:17.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.386 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:17.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:17.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:17.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:17.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:17.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:17.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:17.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:17.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:17.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:17.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:17.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:17.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:17.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:17.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:17.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:17.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:17.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:17.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:17.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:17.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:17.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:17.398 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.398 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.398 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.399 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2643 3.7 3:e026f164:::rbd_object_map.12a23fc13ef0.0000000000000004:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:17.399 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:17.399 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.5379858469999999, 2023-01-02T18:17:17.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001, 2023-01-02T18:17:17.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2643 2023-01-02T18:17:17.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.401 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:17.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:17.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:17.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614790+0000", 2023-01-02T18:17:17.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3409999999999992e-06 2023-01-02T18:17:17.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614799+0000", 2023-01-02T18:17:17.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0420000000000008e-06 2023-01-02T18:17:17.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614808+0000", 2023-01-02T18:17:17.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1370000000000001e-06 2023-01-02T18:17:17.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614814+0000", 2023-01-02T18:17:17.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064692000000000005 2023-01-02T18:17:17.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615460+0000", 2023-01-02T18:17:17.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012489599999999999 2023-01-02T18:17:17.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615585+0000", 2023-01-02T18:17:17.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015799100000000001 2023-01-02T18:17:17.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:17.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615743+0000", 2023-01-02T18:17:17.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097339900000000001 2023-01-02T18:17:17.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.616717+0000", 2023-01-02T18:17:17.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045439800000000001 2023-01-02T18:17:17.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617171+0000", 2023-01-02T18:17:17.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8190999999999999e-05 2023-01-02T18:17:17.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617229+0000", 2023-01-02T18:17:17.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5250000000000002e-05 2023-01-02T18:17:17.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617275+0000", 2023-01-02T18:17:17.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001 2023-01-02T18:17:17.414 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.414 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.414 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.415 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2655 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:17.415 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.623308+0000", 2023-01-02T18:17:17.415 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.5294698670000004, 2023-01-02T18:17:17.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015068, 2023-01-02T18:17:17.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.416 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.416 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.416 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.416 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2655 2023-01-02T18:17:17.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.417 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623308+0000", 2023-01-02T18:17:17.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623308+0000", 2023-01-02T18:17:17.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:17.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623307+0000", 2023-01-02T18:17:17.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.472e-06 2023-01-02T18:17:17.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623313+0000", 2023-01-02T18:17:17.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2065000000000001e-05 2023-01-02T18:17:17.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623325+0000", 2023-01-02T18:17:17.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9799999999999998e-06 2023-01-02T18:17:17.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623330+0000", 2023-01-02T18:17:17.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9981000000000001e-05 2023-01-02T18:17:17.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623380+0000", 2023-01-02T18:17:17.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103321 2023-01-02T18:17:17.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623484+0000", 2023-01-02T18:17:17.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035723299999999999 2023-01-02T18:17:17.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 0", 2023-01-02T18:17:17.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.623841+0000", 2023-01-02T18:17:17.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075045500000000002 2023-01-02T18:17:17.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.624591+0000", 2023-01-02T18:17:17.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000158164 2023-01-02T18:17:17.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.624749+0000", 2023-01-02T18:17:17.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8476999999999998e-05 2023-01-02T18:17:17.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.624788+0000", 2023-01-02T18:17:17.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6804999999999998e-05 2023-01-02T18:17:17.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.624815+0000", 2023-01-02T18:17:17.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015068 2023-01-02T18:17:17.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.429 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.430 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:17.431 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:17.431 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.533309719, 2023-01-02T18:17:17.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:17.432 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:17.433 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.433 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.433 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.434 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:17.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.434 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:17.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:17.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:17.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:17.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:17.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:17.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:17.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:17.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:17.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:17.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:17.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:17.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:17.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:17.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:17.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:17.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:17.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:17.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:17.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:17.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:17.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:17.445 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.445 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.445 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.446 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:17.446 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:17.446 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.8251300509999999, 2023-01-02T18:17:17.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:17.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:17.447 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:17.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:17.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:17.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:17.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:17.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.448 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:17.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:17.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:17.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:17.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:17.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:17.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:17.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:17.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:17.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:17.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:17.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:17.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:17.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:17.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:17.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:17.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:17.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:17.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:17.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:17.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:17.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:17.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:17.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:17.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:17.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:17.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:17.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:17.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:17.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:17.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:17.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:17.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:17.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:17.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:17.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:17.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:17.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:17.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:17.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:17.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:17.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:17.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:17.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:17.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:17.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:17.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:17.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.463 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:17.464 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:17.464 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:17.464 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:17:17.466 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:17.466+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:17.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:17.467 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:17.468 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:17.468 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:17.468 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:17.469 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:17.469 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:17.469 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:17.470 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:17.470 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:17.470 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:17.471 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:17.471 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:17.471 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:17.472 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:17.472 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 2 2023-01-02T18:17:17.473 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:17:17.473 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap1 2023-01-02T18:17:17.473 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap2 2023-01-02T18:17:17.473 INFO:tasks.workunit.client.0.smithi007.stdout:found snap1 with size 2097152 2023-01-02T18:17:17.473 INFO:tasks.workunit.client.0.smithi007.stdout:found snap2 with size 4194304 2023-01-02T18:17:17.566 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:17.567+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:17.614 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:17.614 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:17.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:17.667 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:17.667+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:17.768 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:17.769+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:17.791 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:17.791 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:17.801 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:17.869 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:17.869+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:17.966 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:17.966 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:17.969 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:17.970+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:17.975 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:18.070 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:18.070+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:18.100 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:18.101 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:18.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:18.171 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:18.171+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:18.236 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:18.237 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:18.246 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:18.272 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:18.272+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:18.327 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:17:18.338 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 1 2023-01-02T18:17:18.338 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:17:18.339 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap2 2023-01-02T18:17:18.339 INFO:tasks.workunit.client.0.smithi007.stdout:found snap2 with size 4194304 2023-01-02T18:17:18.383 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:18.383+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:18.415 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:18.416 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:18.425 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:18.474 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:18.474+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:18.551 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:18.551 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:18.561 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:18.575 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:18.575+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:18.676 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:18.676+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:18.686 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:18.687 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:18.697 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:18.777 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:18.777+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:18.823 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:18.824 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:18.833 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:18.878 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:18.879+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:18.960 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:18.961 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:18.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:18.979 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:18.979+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:19.080 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:19.080+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:19.095 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:19.096 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:19.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:19.189 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:19.190+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:19.271 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:19.271 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:19.281 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:19.321 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:19.322+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:19.324 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 0 2023-01-02T18:17:19.324 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 0 2023-01-02T18:17:19.337 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestCreateLsDeleteSnapPP (3991 ms) 2023-01-02T18:17:19.338 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestGetNameIdSnapPP 2023-01-02T18:17:19.338 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:19.383 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:19.383+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:19.434 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:19.435 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:19.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:19.475 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:19.486 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:19.486+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:19.584 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:19.584+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:19.614 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:19.615 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:19.625 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:19.628 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:19.649 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:19.667 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:19.685 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:19.686 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:19.685+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:19.702 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:19.720 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:19.738 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:19.756 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:19.757 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:19.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:19.757 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:19.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.758 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:11 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:19.758 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:17:19.758 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.322677517999999, 2023-01-02T18:17:19.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020029140000000002, 2023-01-02T18:17:19.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.759 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.759 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:19.759 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:19.760 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 11 2023-01-02T18:17:19.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.760 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:17:19.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:17:19.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:19.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433272+0000", 2023-01-02T18:17:19.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8709999999999999e-06 2023-01-02T18:17:19.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433279+0000", 2023-01-02T18:17:19.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0445000000000001e-05 2023-01-02T18:17:19.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433289+0000", 2023-01-02T18:17:19.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9549999999999992e-06 2023-01-02T18:17:19.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433297+0000", 2023-01-02T18:17:19.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9743999999999997e-05 2023-01-02T18:17:19.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433347+0000", 2023-01-02T18:17:19.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012520899999999999 2023-01-02T18:17:19.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433472+0000", 2023-01-02T18:17:19.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000183139 2023-01-02T18:17:19.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:17:19.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433655+0000", 2023-01-02T18:17:19.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062228000000000001 2023-01-02T18:17:19.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.434278+0000", 2023-01-02T18:17:19.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089530100000000004 2023-01-02T18:17:19.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435173+0000", 2023-01-02T18:17:19.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9444000000000002e-05 2023-01-02T18:17:19.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435232+0000", 2023-01-02T18:17:19.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4172000000000003e-05 2023-01-02T18:17:19.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435277+0000", 2023-01-02T18:17:19.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020029140000000002 2023-01-02T18:17:19.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.773 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.774 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:24 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [watch watch cookie 140115456398928] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:19.774 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:17:19.774 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.307042361000001, 2023-01-02T18:17:19.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671591, 2023-01-02T18:17:19.775 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.775 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.775 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:19.775 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:19.776 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 24 2023-01-02T18:17:19.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.776 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:17:19.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:17:19.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448908+0000", 2023-01-02T18:17:19.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8049999999999997e-06 2023-01-02T18:17:19.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448913+0000", 2023-01-02T18:17:19.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6050000000000004e-06 2023-01-02T18:17:19.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448922+0000", 2023-01-02T18:17:19.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.296e-06 2023-01-02T18:17:19.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448927+0000", 2023-01-02T18:17:19.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2249999999999997e-05 2023-01-02T18:17:19.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448969+0000", 2023-01-02T18:17:19.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1073000000000001e-05 2023-01-02T18:17:19.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449050+0000", 2023-01-02T18:17:19.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019599400000000001 2023-01-02T18:17:19.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:17:19.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449246+0000", 2023-01-02T18:17:19.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055298399999999996 2023-01-02T18:17:19.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449799+0000", 2023-01-02T18:17:19.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067574099999999999 2023-01-02T18:17:19.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450475+0000", 2023-01-02T18:17:19.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2527999999999997e-05 2023-01-02T18:17:19.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450517+0000", 2023-01-02T18:17:19.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3255000000000003e-05 2023-01-02T18:17:19.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450580+0000", 2023-01-02T18:17:19.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671591 2023-01-02T18:17:19.789 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.789 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.789 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.790 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:25 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [watch unwatch cookie 140115456398928] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:19.790 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:17:19.790 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.305194862, 2023-01-02T18:17:19.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001161561, 2023-01-02T18:17:19.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.791 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.791 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.791 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:19.791 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:19.791 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 25 2023-01-02T18:17:19.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.792 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:17:19.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450756+0000", 2023-01-02T18:17:19.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450755+0000", 2023-01-02T18:17:19.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.575e-06 2023-01-02T18:17:19.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450761+0000", 2023-01-02T18:17:19.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0091e-05 2023-01-02T18:17:19.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450771+0000", 2023-01-02T18:17:19.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8749999999999999e-06 2023-01-02T18:17:19.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450776+0000", 2023-01-02T18:17:19.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0066e-05 2023-01-02T18:17:19.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450806+0000", 2023-01-02T18:17:19.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9995999999999998e-05 2023-01-02T18:17:19.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450886+0000", 2023-01-02T18:17:19.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014307999999999999 2023-01-02T18:17:19.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:17:19.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451029+0000", 2023-01-02T18:17:19.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044226600000000002 2023-01-02T18:17:19.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451471+0000", 2023-01-02T18:17:19.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036714799999999998 2023-01-02T18:17:19.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451838+0000", 2023-01-02T18:17:19.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6917999999999999e-05 2023-01-02T18:17:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451865+0000", 2023-01-02T18:17:19.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2561e-05 2023-01-02T18:17:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.451918+0000", 2023-01-02T18:17:19.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001161561 2023-01-02T18:17:19.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.805 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.806 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:370 7.1b 7:da80f00d:::rbd_id.image25:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:19.806 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:17:19.806 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.440750769000001, 2023-01-02T18:17:19.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002415571, 2023-01-02T18:17:19.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.807 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.807 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.807 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.807 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 370 2023-01-02T18:17:19.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.808 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:17:19.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:17:19.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:19.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315198+0000", 2023-01-02T18:17:19.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2340999999999999e-05 2023-01-02T18:17:19.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315211+0000", 2023-01-02T18:17:19.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2734e-05 2023-01-02T18:17:19.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315233+0000", 2023-01-02T18:17:19.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7020000000000007e-06 2023-01-02T18:17:19.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315242+0000", 2023-01-02T18:17:19.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017169700000000001 2023-01-02T18:17:19.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315414+0000", 2023-01-02T18:17:19.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014588700000000001 2023-01-02T18:17:19.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315560+0000", 2023-01-02T18:17:19.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020772999999999999 2023-01-02T18:17:19.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:19.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315767+0000", 2023-01-02T18:17:19.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001379641 2023-01-02T18:17:19.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317147+0000", 2023-01-02T18:17:19.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000359675 2023-01-02T18:17:19.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317507+0000", 2023-01-02T18:17:19.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2816000000000003e-05 2023-01-02T18:17:19.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317569+0000", 2023-01-02T18:17:19.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6452999999999997e-05 2023-01-02T18:17:19.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317616+0000", 2023-01-02T18:17:19.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002415571 2023-01-02T18:17:19.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.821 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.821 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:965 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:19.822 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.647408+0000", 2023-01-02T18:17:19.822 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.108543417, 2023-01-02T18:17:19.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001131087, 2023-01-02T18:17:19.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.822 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.823 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.823 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.823 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 965 2023-01-02T18:17:19.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.824 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647408+0000", 2023-01-02T18:17:19.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647408+0000", 2023-01-02T18:17:19.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:19.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647406+0000", 2023-01-02T18:17:19.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3695e-05 2023-01-02T18:17:19.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647420+0000", 2023-01-02T18:17:19.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2337000000000001e-05 2023-01-02T18:17:19.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647432+0000", 2023-01-02T18:17:19.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7000000000000003e-06 2023-01-02T18:17:19.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647442+0000", 2023-01-02T18:17:19.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0462e-05 2023-01-02T18:17:19.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647482+0000", 2023-01-02T18:17:19.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2937999999999997e-05 2023-01-02T18:17:19.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647575+0000", 2023-01-02T18:17:19.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015813700000000001 2023-01-02T18:17:19.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:19.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647733+0000", 2023-01-02T18:17:19.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042289999999999998 2023-01-02T18:17:19.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648156+0000", 2023-01-02T18:17:19.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032719900000000002 2023-01-02T18:17:19.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648483+0000", 2023-01-02T18:17:19.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2518999999999998e-05 2023-01-02T18:17:19.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648516+0000", 2023-01-02T18:17:19.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2821000000000001e-05 2023-01-02T18:17:19.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648539+0000", 2023-01-02T18:17:19.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001131087 2023-01-02T18:17:19.836 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.836 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.837 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.837 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:966 7.9 7:97049a9d:::rbd_object_map.11d52e7a19d9:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:19.837 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.648613+0000", 2023-01-02T18:17:19.838 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.107337829999999, 2023-01-02T18:17:19.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322847, 2023-01-02T18:17:19.838 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.838 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.839 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.839 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 966 2023-01-02T18:17:19.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.839 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648613+0000", 2023-01-02T18:17:19.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648613+0000", 2023-01-02T18:17:19.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648612+0000", 2023-01-02T18:17:19.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5140000000000001e-06 2023-01-02T18:17:19.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648618+0000", 2023-01-02T18:17:19.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1105e-05 2023-01-02T18:17:19.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648629+0000", 2023-01-02T18:17:19.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999993e-06 2023-01-02T18:17:19.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648637+0000", 2023-01-02T18:17:19.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1442999999999997e-05 2023-01-02T18:17:19.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648669+0000", 2023-01-02T18:17:19.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2801999999999998e-05 2023-01-02T18:17:19.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648751+0000", 2023-01-02T18:17:19.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00011778299999999999 2023-01-02T18:17:19.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:19.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.648869+0000", 2023-01-02T18:17:19.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077642399999999995 2023-01-02T18:17:19.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.649646+0000", 2023-01-02T18:17:19.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023746800000000001 2023-01-02T18:17:19.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.649883+0000", 2023-01-02T18:17:19.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0284999999999999e-05 2023-01-02T18:17:19.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.649913+0000", 2023-01-02T18:17:19.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2809000000000001e-05 2023-01-02T18:17:19.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.649936+0000", 2023-01-02T18:17:19.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001322847 2023-01-02T18:17:19.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.852 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.853 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:981 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:19.853 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:17:19.853 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.097771848000001, 2023-01-02T18:17:19.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00147178, 2023-01-02T18:17:19.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.854 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.854 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.854 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.855 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 981 2023-01-02T18:17:19.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.855 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:17:19.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:17:19.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658178+0000", 2023-01-02T18:17:19.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:17:19.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658184+0000", 2023-01-02T18:17:19.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0121e-05 2023-01-02T18:17:19.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658194+0000", 2023-01-02T18:17:19.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6249999999999998e-06 2023-01-02T18:17:19.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658199+0000", 2023-01-02T18:17:19.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4972000000000003e-05 2023-01-02T18:17:19.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658234+0000", 2023-01-02T18:17:19.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9951000000000003e-05 2023-01-02T18:17:19.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658284+0000", 2023-01-02T18:17:19.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036241799999999998 2023-01-02T18:17:19.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:19.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658646+0000", 2023-01-02T18:17:19.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064372099999999999 2023-01-02T18:17:19.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659290+0000", 2023-01-02T18:17:19.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029051100000000002 2023-01-02T18:17:19.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659580+0000", 2023-01-02T18:17:19.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3173999999999997e-05 2023-01-02T18:17:19.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659624+0000", 2023-01-02T18:17:19.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7484999999999999e-05 2023-01-02T18:17:19.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659651+0000", 2023-01-02T18:17:19.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00147178 2023-01-02T18:17:19.868 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.868 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.868 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.869 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:998 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [watch watch cookie 140114651010384] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:19.869 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.667803+0000", 2023-01-02T18:17:19.869 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.088148527000001, 2023-01-02T18:17:19.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011496410000000001, 2023-01-02T18:17:19.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.870 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.870 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.870 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.870 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.870 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 998 2023-01-02T18:17:19.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.871 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667803+0000", 2023-01-02T18:17:19.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667803+0000", 2023-01-02T18:17:19.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:19.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667802+0000", 2023-01-02T18:17:19.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8879999999999999e-06 2023-01-02T18:17:19.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667806+0000", 2023-01-02T18:17:19.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.473e-06 2023-01-02T18:17:19.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667814+0000", 2023-01-02T18:17:19.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4330000000000001e-06 2023-01-02T18:17:19.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667821+0000", 2023-01-02T18:17:19.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8524e-05 2023-01-02T18:17:19.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667849+0000", 2023-01-02T18:17:19.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5154999999999997e-05 2023-01-02T18:17:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667894+0000", 2023-01-02T18:17:19.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4506999999999995e-05 2023-01-02T18:17:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.667989+0000", 2023-01-02T18:17:19.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00049995200000000001 2023-01-02T18:17:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668489+0000", 2023-01-02T18:17:19.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032874800000000002 2023-01-02T18:17:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668818+0000", 2023-01-02T18:17:19.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3557999999999998e-05 2023-01-02T18:17:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668871+0000", 2023-01-02T18:17:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1117000000000003e-05 2023-01-02T18:17:19.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.668952+0000", 2023-01-02T18:17:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011496410000000001 2023-01-02T18:17:19.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.884 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1077 7.f 7:f3cee7db:::rbd_header.11d51c086ce8:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.693014+0000", 2023-01-02T18:17:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.062937574999999, 2023-01-02T18:17:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011761650000000001, 2023-01-02T18:17:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1077 2023-01-02T18:17:19.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693014+0000", 2023-01-02T18:17:19.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693014+0000", 2023-01-02T18:17:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693013+0000", 2023-01-02T18:17:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8529999999999997e-06 2023-01-02T18:17:19.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693018+0000", 2023-01-02T18:17:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1385e-05 2023-01-02T18:17:19.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693030+0000", 2023-01-02T18:17:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5849999999999996e-06 2023-01-02T18:17:19.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693036+0000", 2023-01-02T18:17:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7567999999999997e-05 2023-01-02T18:17:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693074+0000", 2023-01-02T18:17:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0801e-05 2023-01-02T18:17:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693165+0000", 2023-01-02T18:17:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014202900000000001 2023-01-02T18:17:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693307+0000", 2023-01-02T18:17:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050517900000000002 2023-01-02T18:17:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.693812+0000", 2023-01-02T18:17:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032358899999999999 2023-01-02T18:17:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694136+0000", 2023-01-02T18:17:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1708999999999997e-05 2023-01-02T18:17:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694167+0000", 2023-01-02T18:17:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2405e-05 2023-01-02T18:17:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694190+0000", 2023-01-02T18:17:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011761650000000001 2023-01-02T18:17:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.899 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1093 7.f 7:f3cee7db:::rbd_header.11d51c086ce8:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:17:19.900 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.049733053000001, 2023-01-02T18:17:19.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001424745, 2023-01-02T18:17:19.901 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.901 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.901 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.901 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.902 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.902 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1093 2023-01-02T18:17:19.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.902 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:17:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:17:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706217+0000", 2023-01-02T18:17:19.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0279999999999997e-06 2023-01-02T18:17:19.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706223+0000", 2023-01-02T18:17:19.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1197e-05 2023-01-02T18:17:19.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706234+0000", 2023-01-02T18:17:19.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1184e-05 2023-01-02T18:17:19.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706246+0000", 2023-01-02T18:17:19.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0102000000000001e-05 2023-01-02T18:17:19.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706276+0000", 2023-01-02T18:17:19.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9431000000000002e-05 2023-01-02T18:17:19.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706325+0000", 2023-01-02T18:17:19.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036410199999999999 2023-01-02T18:17:19.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:19.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706689+0000", 2023-01-02T18:17:19.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059671500000000005 2023-01-02T18:17:19.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707286+0000", 2023-01-02T18:17:19.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030682099999999998 2023-01-02T18:17:19.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707593+0000", 2023-01-02T18:17:19.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7835e-05 2023-01-02T18:17:19.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707621+0000", 2023-01-02T18:17:19.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2303999999999999e-05 2023-01-02T18:17:19.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707643+0000", 2023-01-02T18:17:19.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001424745 2023-01-02T18:17:19.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.915 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.916 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1094 7.f 7:f3cee7db:::rbd_header.11d51c086ce8:head [watch unwatch cookie 140114919527408] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:19.916 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.707780+0000", 2023-01-02T18:17:19.916 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.048171507999999, 2023-01-02T18:17:19.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001071925, 2023-01-02T18:17:19.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.917 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.917 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.917 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.918 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1094 2023-01-02T18:17:19.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.918 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707780+0000", 2023-01-02T18:17:19.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707780+0000", 2023-01-02T18:17:19.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707779+0000", 2023-01-02T18:17:19.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9239999999999998e-06 2023-01-02T18:17:19.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707784+0000", 2023-01-02T18:17:19.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0069e-05 2023-01-02T18:17:19.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707794+0000", 2023-01-02T18:17:19.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4989999999999996e-06 2023-01-02T18:17:19.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707798+0000", 2023-01-02T18:17:19.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3269999999999998e-05 2023-01-02T18:17:19.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707831+0000", 2023-01-02T18:17:19.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0584999999999998e-05 2023-01-02T18:17:19.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707882+0000", 2023-01-02T18:17:19.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012383399999999999 2023-01-02T18:17:19.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:19.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708006+0000", 2023-01-02T18:17:19.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00038151599999999998 2023-01-02T18:17:19.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708387+0000", 2023-01-02T18:17:19.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039533800000000002 2023-01-02T18:17:19.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708783+0000", 2023-01-02T18:17:19.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2339999999999999e-05 2023-01-02T18:17:19.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708815+0000", 2023-01-02T18:17:19.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6480999999999999e-05 2023-01-02T18:17:19.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.708852+0000", 2023-01-02T18:17:19.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001071925 2023-01-02T18:17:19.931 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.931 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.931 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.932 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1233 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:19.932 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:17:19.932 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.428967633999999, 2023-01-02T18:17:19.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001876817, 2023-01-02T18:17:19.933 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:19.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:19.934 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1233 2023-01-02T18:17:19.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.934 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:17:19.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:17:19.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:19.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326982+0000", 2023-01-02T18:17:19.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5199999999999997e-06 2023-01-02T18:17:19.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326990+0000", 2023-01-02T18:17:19.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.413e-05 2023-01-02T18:17:19.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327004+0000", 2023-01-02T18:17:19.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3750000000000002e-06 2023-01-02T18:17:19.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327010+0000", 2023-01-02T18:17:19.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4917999999999999e-05 2023-01-02T18:17:19.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327055+0000", 2023-01-02T18:17:19.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010794999999999999 2023-01-02T18:17:19.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327163+0000", 2023-01-02T18:17:19.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014037500000000001 2023-01-02T18:17:19.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:19.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327303+0000", 2023-01-02T18:17:19.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063062999999999997 2023-01-02T18:17:19.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327934+0000", 2023-01-02T18:17:19.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082138100000000004 2023-01-02T18:17:19.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328755+0000", 2023-01-02T18:17:19.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9277000000000002e-05 2023-01-02T18:17:19.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328814+0000", 2023-01-02T18:17:19.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6063000000000003e-05 2023-01-02T18:17:19.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328860+0000", 2023-01-02T18:17:19.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001876817 2023-01-02T18:17:19.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.947 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.947 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.947 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1251 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:19.948 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.340223+0000", 2023-01-02T18:17:19.948 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.415728412, 2023-01-02T18:17:19.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001198834, 2023-01-02T18:17:19.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.948 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.949 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.949 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:19.949 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:19.949 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1251 2023-01-02T18:17:19.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.950 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340223+0000", 2023-01-02T18:17:19.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340223+0000", 2023-01-02T18:17:19.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:19.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340221+0000", 2023-01-02T18:17:19.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5889999999999992e-06 2023-01-02T18:17:19.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340231+0000", 2023-01-02T18:17:19.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7547999999999999e-05 2023-01-02T18:17:19.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340248+0000", 2023-01-02T18:17:19.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.139e-06 2023-01-02T18:17:19.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340254+0000", 2023-01-02T18:17:19.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6189000000000002e-05 2023-01-02T18:17:19.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340291+0000", 2023-01-02T18:17:19.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6729000000000004e-05 2023-01-02T18:17:19.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340357+0000", 2023-01-02T18:17:19.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014813200000000001 2023-01-02T18:17:19.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:19.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.340505+0000", 2023-01-02T18:17:19.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000494945 2023-01-02T18:17:19.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.341000+0000", 2023-01-02T18:17:19.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036168399999999997 2023-01-02T18:17:19.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.341362+0000", 2023-01-02T18:17:19.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1439999999999997e-05 2023-01-02T18:17:19.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.341394+0000", 2023-01-02T18:17:19.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8025e-05 2023-01-02T18:17:19.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.341422+0000", 2023-01-02T18:17:19.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001198834 2023-01-02T18:17:19.962 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.962 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.963 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.963 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2085 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:19.963 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.585933+0000", 2023-01-02T18:17:19.963 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.170018621000001, 2023-01-02T18:17:19.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001397602, 2023-01-02T18:17:19.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:19.964 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.964 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:19.965 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:19.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2085 2023-01-02T18:17:19.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.965 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585933+0000", 2023-01-02T18:17:19.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585933+0000", 2023-01-02T18:17:19.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585931+0000", 2023-01-02T18:17:19.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1999999999999997e-06 2023-01-02T18:17:19.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585939+0000", 2023-01-02T18:17:19.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4425e-05 2023-01-02T18:17:19.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585953+0000", 2023-01-02T18:17:19.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:19.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585960+0000", 2023-01-02T18:17:19.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3235999999999997e-05 2023-01-02T18:17:19.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.586003+0000", 2023-01-02T18:17:19.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5804999999999998e-05 2023-01-02T18:17:19.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.586059+0000", 2023-01-02T18:17:19.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012714149999999999 2023-01-02T18:17:19.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.587330+0000", 2023-01-02T18:17:19.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001397602 2023-01-02T18:17:19.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.974 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.975 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2090 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:19.975 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:17:19.975 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.167045336000001, 2023-01-02T18:17:19.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016870089999999999, 2023-01-02T18:17:19.976 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.976 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:19.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:19.977 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2090 2023-01-02T18:17:19.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.977 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:17:19.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:17:19.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:19.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588905+0000", 2023-01-02T18:17:19.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.205e-05 2023-01-02T18:17:19.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588917+0000", 2023-01-02T18:17:19.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1358999999999999e-05 2023-01-02T18:17:19.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588928+0000", 2023-01-02T18:17:19.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6299999999999997e-06 2023-01-02T18:17:19.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588933+0000", 2023-01-02T18:17:19.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9691999999999999e-05 2023-01-02T18:17:19.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:19.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588973+0000", 2023-01-02T18:17:19.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2386999999999998e-05 2023-01-02T18:17:19.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:19.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589025+0000", 2023-01-02T18:17:19.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013092999999999999 2023-01-02T18:17:19.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:19.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589156+0000", 2023-01-02T18:17:19.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051767999999999996 2023-01-02T18:17:19.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:19.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589674+0000", 2023-01-02T18:17:19.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086517400000000002 2023-01-02T18:17:19.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:19.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590539+0000", 2023-01-02T18:17:19.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0923999999999997e-05 2023-01-02T18:17:19.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:19.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590570+0000", 2023-01-02T18:17:19.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2023-01-02T18:17:19.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:19.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590593+0000", 2023-01-02T18:17:19.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016870089999999999 2023-01-02T18:17:19.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.990 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:19.990 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:19.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.990 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2057 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:19.990 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.355857+0000", 2023-01-02T18:17:19.991 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.4000941090000003, 2023-01-02T18:17:19.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001463378, 2023-01-02T18:17:19.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:19.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:19.991 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:19.992 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:19.992 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:19.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2057 2023-01-02T18:17:19.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.992 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:19.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:19.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355857+0000", 2023-01-02T18:17:19.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:19.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:19.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355857+0000", 2023-01-02T18:17:19.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:19.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:19.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355855+0000", 2023-01-02T18:17:19.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6350000000000001e-06 2023-01-02T18:17:19.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:19.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355865+0000", 2023-01-02T18:17:19.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6724000000000001e-05 2023-01-02T18:17:19.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:19.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355882+0000", 2023-01-02T18:17:19.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6210000000000004e-06 2023-01-02T18:17:19.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:19.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:19.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:19.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355889+0000", 2023-01-02T18:17:19.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2030000000000002e-05 2023-01-02T18:17:19.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355931+0000", 2023-01-02T18:17:20.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3496000000000002e-05 2023-01-02T18:17:20.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356015+0000", 2023-01-02T18:17:20.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118177 2023-01-02T18:17:20.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:20.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356133+0000", 2023-01-02T18:17:20.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068564099999999996 2023-01-02T18:17:20.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:20.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356819+0000", 2023-01-02T18:17:20.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000447766 2023-01-02T18:17:20.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:20.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357266+0000", 2023-01-02T18:17:20.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8379999999999999e-05 2023-01-02T18:17:20.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357295+0000", 2023-01-02T18:17:20.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5585e-05 2023-01-02T18:17:20.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357320+0000", 2023-01-02T18:17:20.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001463378 2023-01-02T18:17:20.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.008 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.009 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2072 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:20.009 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.366472+0000", 2023-01-02T18:17:20.009 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.3894795850000001, 2023-01-02T18:17:20.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011949249999999999, 2023-01-02T18:17:20.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.010 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.010 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:20.010 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:20.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2072 2023-01-02T18:17:20.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.011 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366472+0000", 2023-01-02T18:17:20.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366472+0000", 2023-01-02T18:17:20.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:20.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366470+0000", 2023-01-02T18:17:20.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1310000000000006e-06 2023-01-02T18:17:20.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366478+0000", 2023-01-02T18:17:20.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3395e-05 2023-01-02T18:17:20.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366492+0000", 2023-01-02T18:17:20.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0800000000000002e-06 2023-01-02T18:17:20.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366498+0000", 2023-01-02T18:17:20.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8714000000000002e-05 2023-01-02T18:17:20.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366536+0000", 2023-01-02T18:17:20.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8739999999999997e-05 2023-01-02T18:17:20.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366595+0000", 2023-01-02T18:17:20.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015831299999999999 2023-01-02T18:17:20.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:20.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.366753+0000", 2023-01-02T18:17:20.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050311699999999997 2023-01-02T18:17:20.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:20.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.367256+0000", 2023-01-02T18:17:20.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031014500000000001 2023-01-02T18:17:20.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:20.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.367567+0000", 2023-01-02T18:17:20.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8729e-05 2023-01-02T18:17:20.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.367625+0000", 2023-01-02T18:17:20.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1109999999999998e-05 2023-01-02T18:17:20.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.367666+0000", 2023-01-02T18:17:20.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011949249999999999 2023-01-02T18:17:20.023 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.024 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.024 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.024 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2086 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e83)", 2023-01-02T18:17:20.024 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:17:20.025 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.431736602, 2023-01-02T18:17:20.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435, 2023-01-02T18:17:20.025 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.025 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:20.025 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.026 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:20.026 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:20.026 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2086 2023-01-02T18:17:20.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.026 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:17:20.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:17:20.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:20.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324212+0000", 2023-01-02T18:17:20.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2366e-05 2023-01-02T18:17:20.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324224+0000", 2023-01-02T18:17:20.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4462000000000001e-05 2023-01-02T18:17:20.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324249+0000", 2023-01-02T18:17:20.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5980000000000003e-06 2023-01-02T18:17:20.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324259+0000", 2023-01-02T18:17:20.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6119999999999999e-05 2023-01-02T18:17:20.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324305+0000", 2023-01-02T18:17:20.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7069999999999997e-06 2023-01-02T18:17:20.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:20.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324310+0000", 2023-01-02T18:17:20.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003133828 2023-01-02T18:17:20.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327444+0000", 2023-01-02T18:17:20.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1573999999999998e-05 2023-01-02T18:17:20.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327496+0000", 2023-01-02T18:17:20.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1179000000000004e-05 2023-01-02T18:17:20.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327567+0000", 2023-01-02T18:17:20.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435 2023-01-02T18:17:20.037 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.037 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.038 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.038 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2088 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:20.038 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.329737+0000", 2023-01-02T18:17:20.039 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4262139390000002, 2023-01-02T18:17:20.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017236249999999999, 2023-01-02T18:17:20.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:20.039 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.040 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:20.040 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:20.040 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2088 2023-01-02T18:17:20.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.040 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329737+0000", 2023-01-02T18:17:20.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329737+0000", 2023-01-02T18:17:20.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:20.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329736+0000", 2023-01-02T18:17:20.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3629999999999996e-06 2023-01-02T18:17:20.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329743+0000", 2023-01-02T18:17:20.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2119999999999999e-05 2023-01-02T18:17:20.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329755+0000", 2023-01-02T18:17:20.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8800000000000002e-06 2023-01-02T18:17:20.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329762+0000", 2023-01-02T18:17:20.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2735000000000002e-05 2023-01-02T18:17:20.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329815+0000", 2023-01-02T18:17:20.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7809000000000002e-05 2023-01-02T18:17:20.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329873+0000", 2023-01-02T18:17:20.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001588049 2023-01-02T18:17:20.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.331461+0000", 2023-01-02T18:17:20.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017236249999999999 2023-01-02T18:17:20.049 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.049 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.049 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.050 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2099 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:20.050 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.335730+0000", 2023-01-02T18:17:20.050 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4202210339999999, 2023-01-02T18:17:20.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001379438, 2023-01-02T18:17:20.051 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.051 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.051 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:20.051 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:20.052 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2099 2023-01-02T18:17:20.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.052 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.335730+0000", 2023-01-02T18:17:20.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.335730+0000", 2023-01-02T18:17:20.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:20.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.335729+0000", 2023-01-02T18:17:20.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6390000000000003e-06 2023-01-02T18:17:20.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.335736+0000", 2023-01-02T18:17:20.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1968e-05 2023-01-02T18:17:20.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.335748+0000", 2023-01-02T18:17:20.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8210000000000001e-06 2023-01-02T18:17:20.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.057 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:20.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.335752+0000", 2023-01-02T18:17:20.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1782000000000002e-05 2023-01-02T18:17:20.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.335784+0000", 2023-01-02T18:17:20.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0077000000000001e-05 2023-01-02T18:17:20.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.335844+0000", 2023-01-02T18:17:20.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020560700000000001 2023-01-02T18:17:20.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:20.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.336050+0000", 2023-01-02T18:17:20.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072183499999999999 2023-01-02T18:17:20.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:20.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.336772+0000", 2023-01-02T18:17:20.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024336099999999999 2023-01-02T18:17:20.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:20.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.337015+0000", 2023-01-02T18:17:20.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5405000000000002e-05 2023-01-02T18:17:20.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.337071+0000", 2023-01-02T18:17:20.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8983000000000003e-05 2023-01-02T18:17:20.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.337110+0000", 2023-01-02T18:17:20.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001379438 2023-01-02T18:17:20.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.066 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:20.067 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:20.067 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:20.067 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:20.067 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:20.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:20.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:20.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:20.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:20.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:20.071 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:20.072+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:20.172 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:20.172+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:20.240 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:20.240 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:20.240 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:20.240 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:20.250 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:20.273 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:20.274+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:20.334 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7] out_osds: [5, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:17:20.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-01-02T18:17:20.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:17:20.379 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:20.379+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:20.427 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:20.428 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:20.428 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:20.428 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:20.428 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:20.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:20.483 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:20.483+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:20.573 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.574 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:6 3.1a e45/43 3:5cea7035:::rbd_info:head v 45'1, mlcod=0'0)", 2023-01-02T18:17:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.155460886999997, 2023-01-02T18:17:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998, 2023-01-02T18:17:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:20.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:20.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417392+0000", 2023-01-02T18:17:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3349999999999997e-06 2023-01-02T18:17:20.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417398+0000", 2023-01-02T18:17:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7995999999999998e-05 2023-01-02T18:17:20.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417416+0000", 2023-01-02T18:17:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2250000000000003e-06 2023-01-02T18:17:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417423+0000", 2023-01-02T18:17:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6785e-05 2023-01-02T18:17:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417470+0000", 2023-01-02T18:17:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2886000000000001e-05 2023-01-02T18:17:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.417492+0000", 2023-01-02T18:17:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070370800000000005 2023-01-02T18:17:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418196+0000", 2023-01-02T18:17:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1628999999999998e-05 2023-01-02T18:17:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:38.418228+0000", 2023-01-02T18:17:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083533499999999998 2023-01-02T18:17:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.585 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:20.586 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.148886316000002, 2023-01-02T18:17:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.089686608000001, 2023-01-02T18:17:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:20.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:20.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:20.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:20.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:20.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:20.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:20.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:20.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3d3f3250:::rbd_id.image2:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d3f3250:::rbd_id.image2:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:17:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:20.613 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.125460842999999, 2023-01-02T18:17:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004, 2023-01-02T18:17:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447391+0000", 2023-01-02T18:17:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8275e-05 2023-01-02T18:17:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447410+0000", 2023-01-02T18:17:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3377999999999999e-05 2023-01-02T18:17:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447433+0000", 2023-01-02T18:17:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6303e-05 2023-01-02T18:17:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447449+0000", 2023-01-02T18:17:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000438212 2023-01-02T18:17:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447888+0000", 2023-01-02T18:17:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.169e-05 2023-01-02T18:17:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447899+0000", 2023-01-02T18:17:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035861500000000001 2023-01-02T18:17:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448258+0000", 2023-01-02T18:17:20.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004 2023-01-02T18:17:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.244325766999999, 2023-01-02T18:17:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:20.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:20.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:20.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:20.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:20.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:20.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:20.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:20.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:20.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.634 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:17:20.635 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.231889965000001, 2023-01-02T18:17:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:17:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.636 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:20.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:17:20.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:17:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:17:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:17:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:17:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:17:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:17:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:17:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:17:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:17:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:17:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:17:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:17:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:17:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:17:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.197217226999999, 2023-01-02T18:17:20.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:20.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:20.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:20.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.186940207999999, 2023-01-02T18:17:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:20.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:20.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:20.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:20.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:20.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:20.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:20.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:20.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:20.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:20.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:20.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:20.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:20.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:20.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:20.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:20.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:20.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:20.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:20.669 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.669 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.670 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:369 7.1c e64/61 7:3831950c:::rbd_directory:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:20.670 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:20.670 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.259250820999998, 2023-01-02T18:17:20.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004, 2023-01-02T18:17:20.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.671 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:20.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:20.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:20.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313602+0000", 2023-01-02T18:17:20.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2730000000000002e-06 2023-01-02T18:17:20.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313607+0000", 2023-01-02T18:17:20.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1277999999999999e-05 2023-01-02T18:17:20.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313619+0000", 2023-01-02T18:17:20.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4730000000000003e-06 2023-01-02T18:17:20.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313626+0000", 2023-01-02T18:17:20.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8665999999999998e-05 2023-01-02T18:17:20.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313675+0000", 2023-01-02T18:17:20.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8902e-05 2023-01-02T18:17:20.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313694+0000", 2023-01-02T18:17:20.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079486599999999998 2023-01-02T18:17:20.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314489+0000", 2023-01-02T18:17:20.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7184999999999997e-05 2023-01-02T18:17:20.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314526+0000", 2023-01-02T18:17:20.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004 2023-01-02T18:17:20.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.681 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.682 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:20.682 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:20.682 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.878591789000001, 2023-01-02T18:17:20.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:20.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.683 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.683 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.683 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:20.683 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:20.683 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:20.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.684 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:20.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:20.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:20.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:20.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:20.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:20.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:20.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:20.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:20.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:20.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:20.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:20.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:20.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:20.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:20.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:20.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:20.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:20.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:20.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:20.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:20.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:20.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:20.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:20.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:20.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:20.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:20.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:20.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.696 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.697 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2084 8.3 e69/65 8:c28f5e81:::rbd_object_map.12a230fb06bc.0000000000000004:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:20.697 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:20.697 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.988117964000001, 2023-01-02T18:17:20.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003, 2023-01-02T18:17:20.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.698 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:20.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:20.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:20.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:20.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9859999999999997e-06 2023-01-02T18:17:20.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584742+0000", 2023-01-02T18:17:20.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4059999999999999e-05 2023-01-02T18:17:20.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584756+0000", 2023-01-02T18:17:20.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1331999999999999e-05 2023-01-02T18:17:20.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584767+0000", 2023-01-02T18:17:20.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2049000000000002e-05 2023-01-02T18:17:20.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584829+0000", 2023-01-02T18:17:20.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5982e-05 2023-01-02T18:17:20.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584845+0000", 2023-01-02T18:17:20.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080091699999999995 2023-01-02T18:17:20.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585646+0000", 2023-01-02T18:17:20.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8123000000000002e-05 2023-01-02T18:17:20.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585674+0000", 2023-01-02T18:17:20.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003 2023-01-02T18:17:20.710 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.710 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.710 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.710 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:20.711 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:20.711 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.943276899000001, 2023-01-02T18:17:20.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:20.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.712 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.712 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:20.712 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:20.712 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:20.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.712 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:20.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:20.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:20.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:20.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:20.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:20.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:20.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:20.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:20.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:20.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:20.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:20.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:20.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.725 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.726 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2484 8.15 e72/65 8:af65fa5d:::rbd_header.12a2b157d0cc:head v 72'16, mlcod=71'14)", 2023-01-02T18:17:20.726 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:20.726 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.245258236, 2023-01-02T18:17:20.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086154600000000003, 2023-01-02T18:17:20.726 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.727 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:20.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:20.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:20.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327595+0000", 2023-01-02T18:17:20.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2400000000000004e-06 2023-01-02T18:17:20.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327601+0000", 2023-01-02T18:17:20.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3924e-05 2023-01-02T18:17:20.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327625+0000", 2023-01-02T18:17:20.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3620000000000002e-06 2023-01-02T18:17:20.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327631+0000", 2023-01-02T18:17:20.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5776999999999998e-05 2023-01-02T18:17:20.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327687+0000", 2023-01-02T18:17:20.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5990999999999999e-05 2023-01-02T18:17:20.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.327713+0000", 2023-01-02T18:17:20.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070477300000000001 2023-01-02T18:17:20.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.328418+0000", 2023-01-02T18:17:20.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8707000000000001e-05 2023-01-02T18:17:20.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.328457+0000", 2023-01-02T18:17:20.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086154600000000003 2023-01-02T18:17:20.736 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.737 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.737 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2487 8.b e72/65 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head v 72'1, mlcod=0'0)", 2023-01-02T18:17:20.738 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:20.738 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.239335262000001, 2023-01-02T18:17:20.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001, 2023-01-02T18:17:20.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.739 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:20.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:20.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:20.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:20.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4989999999999999e-06 2023-01-02T18:17:20.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333524+0000", 2023-01-02T18:17:20.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5179999999999993e-06 2023-01-02T18:17:20.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333534+0000", 2023-01-02T18:17:20.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9309999999999996e-06 2023-01-02T18:17:20.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333540+0000", 2023-01-02T18:17:20.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4733e-05 2023-01-02T18:17:20.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333584+0000", 2023-01-02T18:17:20.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3536e-05 2023-01-02T18:17:20.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333608+0000", 2023-01-02T18:17:20.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076285800000000005 2023-01-02T18:17:20.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334371+0000", 2023-01-02T18:17:20.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4526000000000001e-05 2023-01-02T18:17:20.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334405+0000", 2023-01-02T18:17:20.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001 2023-01-02T18:17:20.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.748 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.749 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2494 8.15 e72/65 8:af65fa5d:::rbd_header.12a2b157d0cc:head v 72'17, mlcod=71'15)", 2023-01-02T18:17:20.749 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:20.749 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.232948978, 2023-01-02T18:17:20.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997, 2023-01-02T18:17:20.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.750 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:20.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:20.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:20.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:20.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.456e-06 2023-01-02T18:17:20.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339912+0000", 2023-01-02T18:17:20.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0529e-05 2023-01-02T18:17:20.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339922+0000", 2023-01-02T18:17:20.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4649999999999996e-06 2023-01-02T18:17:20.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339927+0000", 2023-01-02T18:17:20.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8563999999999999e-05 2023-01-02T18:17:20.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339966+0000", 2023-01-02T18:17:20.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7017e-05 2023-01-02T18:17:20.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339983+0000", 2023-01-02T18:17:20.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077748699999999999 2023-01-02T18:17:20.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340760+0000", 2023-01-02T18:17:20.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2043999999999999e-05 2023-01-02T18:17:20.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340802+0000", 2023-01-02T18:17:20.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997 2023-01-02T18:17:20.760 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.760 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.760 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.761 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:20.761 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:20.761 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.9393720420000005, 2023-01-02T18:17:20.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:20.762 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.762 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:20.762 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.762 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:20.762 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:20.763 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:20.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.763 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:20.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:20.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:20.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:20.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:20.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:20.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:20.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:20.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:20.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:20.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:20.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:20.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:20.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:20.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:20.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:20.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:20.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:20.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:20.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:20.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:20.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:20.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.774 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.774 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:20.775 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:20.775 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.2348303720000002, 2023-01-02T18:17:20.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:20.775 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:20.776 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.776 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:20.776 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:20.776 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:20.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.777 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:20.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:20.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:20.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:20.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:20.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:20.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:20.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:20.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:20.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:20.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:20.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:20.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:20.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:20.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:20.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:20.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:20.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:20.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:20.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:20.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:20.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:20.787 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.787 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.787 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.788 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2057 3.6 e82/43 3:6334c7d3:::rbd_object_map.11d574d0a887:head v 82'1, mlcod=0'0)", 2023-01-02T18:17:20.788 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:20.788 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.2165876530000004, 2023-01-02T18:17:20.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091887800000000003, 2023-01-02T18:17:20.789 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.789 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.789 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:20.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:20.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:20.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356265+0000", 2023-01-02T18:17:20.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5269999999999999e-06 2023-01-02T18:17:20.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356269+0000", 2023-01-02T18:17:20.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7110000000000007e-06 2023-01-02T18:17:20.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356279+0000", 2023-01-02T18:17:20.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3370000000000001e-06 2023-01-02T18:17:20.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356283+0000", 2023-01-02T18:17:20.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9932999999999998e-05 2023-01-02T18:17:20.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356333+0000", 2023-01-02T18:17:20.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2926999999999999e-05 2023-01-02T18:17:20.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356356+0000", 2023-01-02T18:17:20.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078956299999999996 2023-01-02T18:17:20.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357145+0000", 2023-01-02T18:17:20.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9088999999999998e-05 2023-01-02T18:17:20.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357185+0000", 2023-01-02T18:17:20.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091887800000000003 2023-01-02T18:17:20.798 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.799 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.799 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:20.800 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:20.800 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2450986359999998, 2023-01-02T18:17:20.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:20.800 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:20.801 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.801 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:20.801 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:20.801 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:20.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.802 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:20.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:20.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:20.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:20.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:20.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:20.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:20.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:20.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:20.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:20.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:20.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:20.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:20.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:20.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:20.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:20.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:20.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:20.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:20.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:20.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:20.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:20.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:20.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:20.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:20.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:20.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:20.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:20.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:20.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.814 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.815 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:20.815 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:20.815 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.221772781, 2023-01-02T18:17:20.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:20.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:20.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:20.816 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:20.816 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:20.816 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:20.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:20.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.817 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:20.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:20.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:20.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:20.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:20.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:20.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:20.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:20.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:20.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:20.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:20.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:20.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:20.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:20.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:20.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:20.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:20.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:20.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:20.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:20.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:20.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:20.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:20.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:20.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:20.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:20.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:20.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:20.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:20.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:20.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:20.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:20.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:20.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:20.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:20.827 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.828 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:20.828 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:20.828 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:20.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:20.830 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:20.830+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:20.930 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:20.930+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:20.997 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:20.997 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:20.997 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:21.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:21.031 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:21.032+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:21.132 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:21.132+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:21.172 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:21.173 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:21.173 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:21.173 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:21.173 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:21.182 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:21.232 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:21.233+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:21.333 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:21.334+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:21.351 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:21.352 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:21.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:21.352 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:21.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.352 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:21.353 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:21.353 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.866681515000003, 2023-01-02T18:17:21.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:21.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.353 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.354 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:21.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:21.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:21.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:21.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:21.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:21.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:21.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:21.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:21.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:21.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:21.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:21.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:21.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:21.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:21.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:21.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:21.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:21.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:21.363 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.363 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.363 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.364 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:21.364 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:21.364 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.002614985000001, 2023-01-02T18:17:21.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:21.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.365 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.365 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:21.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:21.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:21.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:21.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:21.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:21.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:21.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:21.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:21.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:21.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:21.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:21.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:21.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:21.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:21.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:21.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:21.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:21.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:21.374 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.375 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.375 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.375 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:21.375 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:21.376 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.000935372000001, 2023-01-02T18:17:21.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:21.376 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.376 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.376 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:21.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:21.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:21.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:21.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:21.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:21.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:21.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:21.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:21.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:21.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:21.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:21.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:21.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:21.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:21.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:21.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:21.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:21.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:21.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.386 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.386 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.387 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:21.387 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:21.387 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.034107488, 2023-01-02T18:17:21.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:21.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.388 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.388 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:21.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:21.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:21.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:21.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:21.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:21.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:21.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:21.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:21.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:21.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:21.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:21.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:21.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:21.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:21.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:21.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:21.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.397 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:21.398 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.703969944000001, 2023-01-02T18:17:21.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:21.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.399 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:21.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:21.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:21.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:21.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:21.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:21.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:21.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:21.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:21.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:21.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:21.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:21.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:21.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:21.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:21.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:21.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:21.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:21.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:21.408 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.409 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.409 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:981 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'4, mlcod=64'2)", 2023-01-02T18:17:21.410 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:21.410 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.691630246999999, 2023-01-02T18:17:21.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003, 2023-01-02T18:17:21.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.410 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.411 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:21.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:21.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:21.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658715+0000", 2023-01-02T18:17:21.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2509999999999997e-06 2023-01-02T18:17:21.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658723+0000", 2023-01-02T18:17:21.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6970000000000005e-06 2023-01-02T18:17:21.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658732+0000", 2023-01-02T18:17:21.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3159999999999998e-06 2023-01-02T18:17:21.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658737+0000", 2023-01-02T18:17:21.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2293000000000003e-05 2023-01-02T18:17:21.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658779+0000", 2023-01-02T18:17:21.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2996000000000001e-05 2023-01-02T18:17:21.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658802+0000", 2023-01-02T18:17:21.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066023399999999999 2023-01-02T18:17:21.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659462+0000", 2023-01-02T18:17:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4413000000000002e-05 2023-01-02T18:17:21.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659487+0000", 2023-01-02T18:17:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003 2023-01-02T18:17:21.420 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.421 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.421 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.421 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:21.422 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:21.422 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.026617241, 2023-01-02T18:17:21.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:21.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.422 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.422 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:21.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:21.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:21.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:21.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:21.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:21.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:21.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:21.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:21.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:21.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:21.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:21.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:21.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:21.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:21.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:21.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:21.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:21.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:21.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.432 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.433 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:21.433 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:21.433 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.024824156000001, 2023-01-02T18:17:21.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:21.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:21.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:21.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:21.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:21.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:21.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:21.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:21.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:21.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:21.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:21.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:21.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:21.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:21.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:21.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:21.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:21.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:21.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.443 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.444 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.444 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:21.444 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:21.445 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.013986372000002, 2023-01-02T18:17:21.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:21.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.445 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:21.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:21.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:21.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:21.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:21.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:21.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:21.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:21.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:21.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:21.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:21.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:21.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:21.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:21.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:21.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:21.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:21.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1511 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'37, mlcod=68'35)", 2023-01-02T18:17:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.891790100000001, 2023-01-02T18:17:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005, 2023-01-02T18:17:21.456 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.457 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:21.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:21.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:21.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458554+0000", 2023-01-02T18:17:21.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4627000000000001e-05 2023-01-02T18:17:21.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458569+0000", 2023-01-02T18:17:21.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6376e-05 2023-01-02T18:17:21.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458595+0000", 2023-01-02T18:17:21.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2846e-05 2023-01-02T18:17:21.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458608+0000", 2023-01-02T18:17:21.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0798999999999997e-05 2023-01-02T18:17:21.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458689+0000", 2023-01-02T18:17:21.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1622999999999998e-05 2023-01-02T18:17:21.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458731+0000", 2023-01-02T18:17:21.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050369499999999997 2023-01-02T18:17:21.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459234+0000", 2023-01-02T18:17:21.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6656999999999998e-05 2023-01-02T18:17:21.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459271+0000", 2023-01-02T18:17:21.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005 2023-01-02T18:17:21.466 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.467 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.467 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.467 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1642 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'55, mlcod=68'53)", 2023-01-02T18:17:21.467 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:21.468 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.834659601999999, 2023-01-02T18:17:21.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068970200000000005, 2023-01-02T18:17:21.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.468 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:21.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515687+0000", 2023-01-02T18:17:21.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:21.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515686+0000", 2023-01-02T18:17:21.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2879999999999998e-06 2023-01-02T18:17:21.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515692+0000", 2023-01-02T18:17:21.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0679000000000001e-05 2023-01-02T18:17:21.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515703+0000", 2023-01-02T18:17:21.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7849999999999999e-06 2023-01-02T18:17:21.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515708+0000", 2023-01-02T18:17:21.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4620000000000003e-05 2023-01-02T18:17:21.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515752+0000", 2023-01-02T18:17:21.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2283999999999999e-05 2023-01-02T18:17:21.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.515775+0000", 2023-01-02T18:17:21.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057592299999999999 2023-01-02T18:17:21.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.516351+0000", 2023-01-02T18:17:21.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5884000000000002e-05 2023-01-02T18:17:21.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.516376+0000", 2023-01-02T18:17:21.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068970200000000005 2023-01-02T18:17:21.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.478 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.479 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1698 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'62, mlcod=68'60)", 2023-01-02T18:17:21.479 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:21.479 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.809319788, 2023-01-02T18:17:21.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069486999999999999, 2023-01-02T18:17:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:21.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541027+0000", 2023-01-02T18:17:21.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:21.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541026+0000", 2023-01-02T18:17:21.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1589999999999998e-06 2023-01-02T18:17:21.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541032+0000", 2023-01-02T18:17:21.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0879e-05 2023-01-02T18:17:21.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541043+0000", 2023-01-02T18:17:21.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5360000000000003e-06 2023-01-02T18:17:21.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541047+0000", 2023-01-02T18:17:21.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6459999999999999e-05 2023-01-02T18:17:21.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541094+0000", 2023-01-02T18:17:21.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323e-05 2023-01-02T18:17:21.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541117+0000", 2023-01-02T18:17:21.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057111 2023-01-02T18:17:21.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541688+0000", 2023-01-02T18:17:21.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3217999999999999e-05 2023-01-02T18:17:21.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.541721+0000", 2023-01-02T18:17:21.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069486999999999999 2023-01-02T18:17:21.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.490 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.490 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1774 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'72, mlcod=68'70)", 2023-01-02T18:17:21.491 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:21.491 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.774712009999998, 2023-01-02T18:17:21.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004, 2023-01-02T18:17:21.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.492 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:21.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:21.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:21.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575633+0000", 2023-01-02T18:17:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1912999999999999e-05 2023-01-02T18:17:21.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575645+0000", 2023-01-02T18:17:21.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5690000000000001e-05 2023-01-02T18:17:21.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575660+0000", 2023-01-02T18:17:21.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1430000000000001e-06 2023-01-02T18:17:21.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575668+0000", 2023-01-02T18:17:21.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9123000000000003e-05 2023-01-02T18:17:21.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575727+0000", 2023-01-02T18:17:21.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0632000000000001e-05 2023-01-02T18:17:21.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575757+0000", 2023-01-02T18:17:21.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057452100000000004 2023-01-02T18:17:21.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576332+0000", 2023-01-02T18:17:21.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8958999999999998e-05 2023-01-02T18:17:21.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576361+0000", 2023-01-02T18:17:21.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004 2023-01-02T18:17:21.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.501 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.502 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1819 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'77, mlcod=68'75)", 2023-01-02T18:17:21.502 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:21.502 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.75478545, 2023-01-02T18:17:21.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068721400000000001, 2023-01-02T18:17:21.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.503 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:21.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595561+0000", 2023-01-02T18:17:21.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:21.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595559+0000", 2023-01-02T18:17:21.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0942e-05 2023-01-02T18:17:21.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595570+0000", 2023-01-02T18:17:21.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8321999999999998e-05 2023-01-02T18:17:21.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595589+0000", 2023-01-02T18:17:21.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0069999999999997e-06 2023-01-02T18:17:21.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595597+0000", 2023-01-02T18:17:21.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7846999999999999e-05 2023-01-02T18:17:21.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595635+0000", 2023-01-02T18:17:21.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6322000000000001e-05 2023-01-02T18:17:21.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.595651+0000", 2023-01-02T18:17:21.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056746499999999996 2023-01-02T18:17:21.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.596218+0000", 2023-01-02T18:17:21.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9777999999999998e-05 2023-01-02T18:17:21.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.596248+0000", 2023-01-02T18:17:21.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068721400000000001 2023-01-02T18:17:21.512 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.513 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.513 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1842 8.4 e68/65 8:24c831c0:::rbd_header.12a2b9663ff5:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:21.514 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:21.514 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.737450481, 2023-01-02T18:17:21.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997, 2023-01-02T18:17:21.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.514 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.514 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:21.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:21.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:21.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612894+0000", 2023-01-02T18:17:21.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:21.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612908+0000", 2023-01-02T18:17:21.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6006000000000001e-05 2023-01-02T18:17:21.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612934+0000", 2023-01-02T18:17:21.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.509e-05 2023-01-02T18:17:21.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612949+0000", 2023-01-02T18:17:21.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7535999999999998e-05 2023-01-02T18:17:21.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613027+0000", 2023-01-02T18:17:21.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0413000000000001e-05 2023-01-02T18:17:21.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613067+0000", 2023-01-02T18:17:21.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056083499999999998 2023-01-02T18:17:21.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613628+0000", 2023-01-02T18:17:21.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0998000000000001e-05 2023-01-02T18:17:21.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613649+0000", 2023-01-02T18:17:21.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997 2023-01-02T18:17:21.524 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.524 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.524 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.525 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2136 8.16 e69/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:21.525 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:21.525 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.729369007999999, 2023-01-02T18:17:21.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995, 2023-01-02T18:17:21.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.526 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:21.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:21.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:21.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:21.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8340000000000001e-06 2023-01-02T18:17:21.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620984+0000", 2023-01-02T18:17:21.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5201000000000001e-05 2023-01-02T18:17:21.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620999+0000", 2023-01-02T18:17:21.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9990000000000008e-06 2023-01-02T18:17:21.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621007+0000", 2023-01-02T18:17:21.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9780999999999997e-05 2023-01-02T18:17:21.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621047+0000", 2023-01-02T18:17:21.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2869e-05 2023-01-02T18:17:21.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621060+0000", 2023-01-02T18:17:21.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061950799999999995 2023-01-02T18:17:21.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621679+0000", 2023-01-02T18:17:21.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2191999999999999e-05 2023-01-02T18:17:21.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621711+0000", 2023-01-02T18:17:21.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995 2023-01-02T18:17:21.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.536 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.536 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.536 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2611 8.1b e72/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 72'85, mlcod=69'83)", 2023-01-02T18:17:21.536 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:21.537 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.949783273, 2023-01-02T18:17:21.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999, 2023-01-02T18:17:21.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.537 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:21.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:21.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:21.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400562+0000", 2023-01-02T18:17:21.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1299999999999998e-06 2023-01-02T18:17:21.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400568+0000", 2023-01-02T18:17:21.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0643e-05 2023-01-02T18:17:21.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400579+0000", 2023-01-02T18:17:21.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4920000000000004e-06 2023-01-02T18:17:21.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400584+0000", 2023-01-02T18:17:21.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4360999999999998e-05 2023-01-02T18:17:21.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400618+0000", 2023-01-02T18:17:21.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4246999999999999e-05 2023-01-02T18:17:21.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400632+0000", 2023-01-02T18:17:21.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061679400000000004 2023-01-02T18:17:21.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401249+0000", 2023-01-02T18:17:21.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7705999999999999e-05 2023-01-02T18:17:21.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401277+0000", 2023-01-02T18:17:21.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999 2023-01-02T18:17:21.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.547 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.548 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2055 3.5 e82/48 3:a39c7274:::rbd_id.image39:head v 82'2, mlcod=0'0)", 2023-01-02T18:17:21.548 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.353372+0000", 2023-01-02T18:17:21.548 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.9969742740000003, 2023-01-02T18:17:21.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071350199999999997, 2023-01-02T18:17:21.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.549 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353372+0000", 2023-01-02T18:17:21.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353372+0000", 2023-01-02T18:17:21.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:21.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353372+0000", 2023-01-02T18:17:21.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0710000000000002e-06 2023-01-02T18:17:21.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353377+0000", 2023-01-02T18:17:21.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3485e-05 2023-01-02T18:17:21.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353390+0000", 2023-01-02T18:17:21.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8719999999999996e-06 2023-01-02T18:17:21.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353397+0000", 2023-01-02T18:17:21.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1141999999999999e-05 2023-01-02T18:17:21.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353448+0000", 2023-01-02T18:17:21.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4799e-05 2023-01-02T18:17:21.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.353463+0000", 2023-01-02T18:17:21.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059333200000000002 2023-01-02T18:17:21.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.354057+0000", 2023-01-02T18:17:21.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9068e-05 2023-01-02T18:17:21.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.354086+0000", 2023-01-02T18:17:21.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071350199999999997 2023-01-02T18:17:21.558 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.558 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.559 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.559 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:21.559 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:21.560 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.0219328120000002, 2023-01-02T18:17:21.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:21.560 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.560 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.560 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:21.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:21.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:21.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:21.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:21.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:21.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:21.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:21.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:21.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:21.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:21.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:21.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:21.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:21.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:21.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:21.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:21.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:21.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:21.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.570 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.570 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:21.571 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:21.571 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.007734272, 2023-01-02T18:17:21.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:21.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:21.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:21.572 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:21.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:21.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:21.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:21.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:21.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:21.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:21.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:21.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:21.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:21.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:21.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:21.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:21.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:21.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:21.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:21.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:21.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:21.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:21.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:21.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:21.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.581 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.581 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.581 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:21.581 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:21.581 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:21.582 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:17:21.583 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.0 to 1 (10000) 2023-01-02T18:17:21.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:21.586 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-01-02T18:17:21.586 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:21.584+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:21.684 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:21.685+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:21.754 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:21.754 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:21.754 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:21.754 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:21.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:21.810 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:21.810+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:21.885 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:21.886+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:21.891 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:21.892 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:21.902 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:21.987 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:21.988+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:22.069 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:22.069 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:22.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:22.070 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:22.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.070 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:22.070 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:22.070 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.632181736, 2023-01-02T18:17:22.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:22.071 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.071 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.071 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.071 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.072 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.072 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:22.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.072 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:22.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:22.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:22.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:22.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:22.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:22.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:22.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:22.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:22.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:22.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:22.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:22.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:22.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:22.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:22.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:22.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:22.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:22.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:22.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:22.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:22.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:22.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:22.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:22.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:22.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:22.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:22.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:22.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:22.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:22.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:22.087 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.087 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.087 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.087 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:22.088 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:22.088 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.582796743000003, 2023-01-02T18:17:22.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:17:22.088 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.089 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.089 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.089 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:22.089 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:22.089 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:17:22.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.090 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:22.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:22.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:22.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:17:22.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:17:22.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:17:22.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:17:22.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:17:22.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:17:22.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:17:22.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:17:22.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:17:22.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:17:22.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:17:22.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:17:22.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:22.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:17:22.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:17:22.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:17:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:17:22.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:17:22.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:17:22.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:17:22.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:17:22.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:17:22.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:17:22.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.102 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.103 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:427 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:22.103 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:22.103 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.702078487000001, 2023-01-02T18:17:22.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001, 2023-01-02T18:17:22.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.105 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.105 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 427 2023-01-02T18:17:22.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.105 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:22.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365952+0000", 2023-01-02T18:17:22.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:22.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365951+0000", 2023-01-02T18:17:22.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4900000000000002e-06 2023-01-02T18:17:22.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365956+0000", 2023-01-02T18:17:22.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5820000000000004e-06 2023-01-02T18:17:22.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365963+0000", 2023-01-02T18:17:22.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8339999999999998e-06 2023-01-02T18:17:22.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.365968+0000", 2023-01-02T18:17:22.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000271091 2023-01-02T18:17:22.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366239+0000", 2023-01-02T18:17:22.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2132000000000006e-05 2023-01-02T18:17:22.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366321+0000", 2023-01-02T18:17:22.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000222733 2023-01-02T18:17:22.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:22.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.366544+0000", 2023-01-02T18:17:22.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056500799999999998 2023-01-02T18:17:22.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367109+0000", 2023-01-02T18:17:22.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030673499999999998 2023-01-02T18:17:22.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367416+0000", 2023-01-02T18:17:22.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3107000000000003e-05 2023-01-02T18:17:22.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367489+0000", 2023-01-02T18:17:22.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3927000000000001e-05 2023-01-02T18:17:22.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.367543+0000", 2023-01-02T18:17:22.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015907580000000001 2023-01-02T18:17:22.118 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.119 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.119 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.119 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:444 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:22.120 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:22.120 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.692780509999999, 2023-01-02T18:17:22.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489, 2023-01-02T18:17:22.120 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.120 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.120 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.121 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.121 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.121 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 444 2023-01-02T18:17:22.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.122 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:22.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:22.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:22.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375249+0000", 2023-01-02T18:17:22.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9409999999999998e-06 2023-01-02T18:17:22.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375254+0000", 2023-01-02T18:17:22.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5210000000000008e-06 2023-01-02T18:17:22.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375264+0000", 2023-01-02T18:17:22.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9629999999999997e-06 2023-01-02T18:17:22.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375269+0000", 2023-01-02T18:17:22.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.333e-05 2023-01-02T18:17:22.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375312+0000", 2023-01-02T18:17:22.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6695999999999998e-05 2023-01-02T18:17:22.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375399+0000", 2023-01-02T18:17:22.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016210000000000001 2023-01-02T18:17:22.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:22.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375561+0000", 2023-01-02T18:17:22.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087961699999999996 2023-01-02T18:17:22.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376440+0000", 2023-01-02T18:17:22.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055437200000000002 2023-01-02T18:17:22.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376995+0000", 2023-01-02T18:17:22.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6236999999999997e-05 2023-01-02T18:17:22.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377051+0000", 2023-01-02T18:17:22.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0509e-05 2023-01-02T18:17:22.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377102+0000", 2023-01-02T18:17:22.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489 2023-01-02T18:17:22.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.134 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.135 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:22.135 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:22.135 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.682473268999999, 2023-01-02T18:17:22.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:17:22.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.136 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.136 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.136 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.136 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:17:22.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.137 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:22.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:22.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:22.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:17:22.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:17:22.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:17:22.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:17:22.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:17:22.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:17:22.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:17:22.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:17:22.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:17:22.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:17:22.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:17:22.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:17:22.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:22.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:17:22.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:17:22.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:17:22.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:17:22.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:17:22.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:17:22.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:17:22.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:17:22.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:17:22.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:17:22.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.149 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.150 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:677 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:22.150 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:22.150 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.559061065000002, 2023-01-02T18:17:22.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911, 2023-01-02T18:17:22.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.151 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.151 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.152 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 677 2023-01-02T18:17:22.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.152 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:22.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508970+0000", 2023-01-02T18:17:22.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:22.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508969+0000", 2023-01-02T18:17:22.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.268e-06 2023-01-02T18:17:22.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508975+0000", 2023-01-02T18:17:22.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4151000000000001e-05 2023-01-02T18:17:22.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508989+0000", 2023-01-02T18:17:22.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9569999999999996e-06 2023-01-02T18:17:22.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.508996+0000", 2023-01-02T18:17:22.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6683e-05 2023-01-02T18:17:22.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509043+0000", 2023-01-02T18:17:22.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6942999999999997e-05 2023-01-02T18:17:22.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509130+0000", 2023-01-02T18:17:22.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020122099999999999 2023-01-02T18:17:22.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:22.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509331+0000", 2023-01-02T18:17:22.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063843400000000001 2023-01-02T18:17:22.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.509969+0000", 2023-01-02T18:17:22.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062000599999999999 2023-01-02T18:17:22.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510589+0000", 2023-01-02T18:17:22.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8503000000000001e-05 2023-01-02T18:17:22.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510618+0000", 2023-01-02T18:17:22.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7784999999999998e-05 2023-01-02T18:17:22.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.510655+0000", 2023-01-02T18:17:22.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001685911 2023-01-02T18:17:22.164 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.164 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.165 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.165 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:709 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:22.165 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:22.166 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.540038652, 2023-01-02T18:17:22.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999, 2023-01-02T18:17:22.166 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.166 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.166 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.166 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.167 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.167 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 709 2023-01-02T18:17:22.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.167 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:22.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527992+0000", 2023-01-02T18:17:22.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:22.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527991+0000", 2023-01-02T18:17:22.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5170000000000001e-06 2023-01-02T18:17:22.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.527996+0000", 2023-01-02T18:17:22.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2990000000000002e-06 2023-01-02T18:17:22.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528005+0000", 2023-01-02T18:17:22.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7049999999999996e-06 2023-01-02T18:17:22.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528011+0000", 2023-01-02T18:17:22.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3952999999999998e-05 2023-01-02T18:17:22.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528045+0000", 2023-01-02T18:17:22.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1950999999999998e-05 2023-01-02T18:17:22.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528097+0000", 2023-01-02T18:17:22.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000157078 2023-01-02T18:17:22.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:22.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.528254+0000", 2023-01-02T18:17:22.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076010699999999999 2023-01-02T18:17:22.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529014+0000", 2023-01-02T18:17:22.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045062500000000002 2023-01-02T18:17:22.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529464+0000", 2023-01-02T18:17:22.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1790999999999999e-05 2023-01-02T18:17:22.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529516+0000", 2023-01-02T18:17:22.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1063999999999999e-05 2023-01-02T18:17:22.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.529557+0000", 2023-01-02T18:17:22.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015653659999999999 2023-01-02T18:17:22.179 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.179 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.180 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.180 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:22.180 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:22.181 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.758641626999999, 2023-01-02T18:17:22.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:22.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.181 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.182 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:22.182 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:22.182 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:22.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.182 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:22.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:22.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:22.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:22.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:22.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:22.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:22.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:22.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:22.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:22.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:22.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:22.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:22.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:22.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:22.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:22.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:22.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:22.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:22.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:22.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:22.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:22.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:22.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:22.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:22.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:22.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:22.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:22.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:22.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:22.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:22.197 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.197 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.197 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.198 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:372 7.1 7:83feba0f:::rbd_object_map.11d56649889d:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:22.198 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:22.198 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.748702563999998, 2023-01-02T18:17:22.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479, 2023-01-02T18:17:22.198 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.199 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.199 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:22.199 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:22.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 372 2023-01-02T18:17:22.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.200 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:22.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:22.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:22.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319326+0000", 2023-01-02T18:17:22.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1199999999999996e-06 2023-01-02T18:17:22.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319334+0000", 2023-01-02T18:17:22.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2170999999999999e-05 2023-01-02T18:17:22.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319346+0000", 2023-01-02T18:17:22.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7789999999999996e-06 2023-01-02T18:17:22.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319353+0000", 2023-01-02T18:17:22.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8445999999999997e-05 2023-01-02T18:17:22.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319392+0000", 2023-01-02T18:17:22.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010474700000000001 2023-01-02T18:17:22.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319497+0000", 2023-01-02T18:17:22.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138159 2023-01-02T18:17:22.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:22.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319635+0000", 2023-01-02T18:17:22.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071603699999999999 2023-01-02T18:17:22.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320351+0000", 2023-01-02T18:17:22.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063369800000000003 2023-01-02T18:17:22.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320985+0000", 2023-01-02T18:17:22.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5822000000000002e-05 2023-01-02T18:17:22.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321040+0000", 2023-01-02T18:17:22.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4125999999999997e-05 2023-01-02T18:17:22.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321085+0000", 2023-01-02T18:17:22.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479 2023-01-02T18:17:22.211 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.212 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.212 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.212 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1953 8.8 8:1376a730:::rbd_id.image30:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:17:22.213 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:22.213 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.411618140000002, 2023-01-02T18:17:22.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939, 2023-01-02T18:17:22.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.214 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.214 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.214 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.214 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1953 2023-01-02T18:17:22.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.214 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:22.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656412+0000", 2023-01-02T18:17:22.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:22.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656411+0000", 2023-01-02T18:17:22.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5109999999999992e-06 2023-01-02T18:17:22.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656421+0000", 2023-01-02T18:17:22.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3118000000000001e-05 2023-01-02T18:17:22.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656444+0000", 2023-01-02T18:17:22.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.841e-06 2023-01-02T18:17:22.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656452+0000", 2023-01-02T18:17:22.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8368000000000003e-05 2023-01-02T18:17:22.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656490+0000", 2023-01-02T18:17:22.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6940000000000004e-05 2023-01-02T18:17:22.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656587+0000", 2023-01-02T18:17:22.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013780300000000001 2023-01-02T18:17:22.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:22.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.656725+0000", 2023-01-02T18:17:22.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000707375 2023-01-02T18:17:22.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.657432+0000", 2023-01-02T18:17:22.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062476800000000005 2023-01-02T18:17:22.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658057+0000", 2023-01-02T18:17:22.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4223000000000001e-05 2023-01-02T18:17:22.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658091+0000", 2023-01-02T18:17:22.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5299e-05 2023-01-02T18:17:22.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.658116+0000", 2023-01-02T18:17:22.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001703939 2023-01-02T18:17:22.226 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.226 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.227 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.227 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:22.227 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:22.227 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.452681672000001, 2023-01-02T18:17:22.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:22.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.228 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.228 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.229 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:22.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.229 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:22.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:22.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:22.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:22.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:22.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:22.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:22.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:22.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:22.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:22.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:22.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:22.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:22.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:22.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:22.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:22.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:22.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:22.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:22.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:22.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:22.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:22.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:22.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:22.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:22.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:22.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:22.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:22.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:22.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:22.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:22.243 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.243 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.243 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.244 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:22.244 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:22.244 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.738209858000001, 2023-01-02T18:17:22.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:22.244 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.244 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.245 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.245 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.245 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.245 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:22.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.246 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:22.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:22.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:22.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:22.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:22.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:22.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:22.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:22.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:22.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:22.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:22.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:22.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:22.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:22.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:22.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:22.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:22.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:22.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:22.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:22.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:22.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:22.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:22.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:22.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:22.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:22.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:22.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:22.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:22.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:22.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:22.260 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.260 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.260 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.260 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:22.261 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:22.261 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.729108457000001, 2023-01-02T18:17:22.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:22.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.262 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:22.262 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.262 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:22.262 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:22.262 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:22.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.263 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:22.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:22.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:22.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:22.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:22.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:22.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:22.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:22.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:22.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:22.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:22.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:22.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:22.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:22.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:22.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:22.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:22.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:22.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:22.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:22.272 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.272 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.272 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.273 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:22.273 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:22.273 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.457752165, 2023-01-02T18:17:22.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:22.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:22.274 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.274 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.274 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:22.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.274 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:22.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:22.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:22.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:22.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:22.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:22.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:22.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:22.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:22.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:22.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:22.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:22.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:22.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:22.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:22.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:22.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:22.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:22.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:22.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:22.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:22.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:22.285 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.285 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.285 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.286 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2643 3.7 3:e026f164:::rbd_object_map.12a23fc13ef0.0000000000000004:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:22.286 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:22.286 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.453238637, 2023-01-02T18:17:22.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001, 2023-01-02T18:17:22.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.287 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.287 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.287 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2643 2023-01-02T18:17:22.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.287 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:22.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:22.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:22.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614790+0000", 2023-01-02T18:17:22.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3409999999999992e-06 2023-01-02T18:17:22.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614799+0000", 2023-01-02T18:17:22.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0420000000000008e-06 2023-01-02T18:17:22.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614808+0000", 2023-01-02T18:17:22.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1370000000000001e-06 2023-01-02T18:17:22.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614814+0000", 2023-01-02T18:17:22.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064692000000000005 2023-01-02T18:17:22.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615460+0000", 2023-01-02T18:17:22.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012489599999999999 2023-01-02T18:17:22.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615585+0000", 2023-01-02T18:17:22.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015799100000000001 2023-01-02T18:17:22.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615743+0000", 2023-01-02T18:17:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097339900000000001 2023-01-02T18:17:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.616717+0000", 2023-01-02T18:17:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045439800000000001 2023-01-02T18:17:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617171+0000", 2023-01-02T18:17:22.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8190999999999999e-05 2023-01-02T18:17:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617229+0000", 2023-01-02T18:17:22.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5250000000000002e-05 2023-01-02T18:17:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617275+0000", 2023-01-02T18:17:22.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001 2023-01-02T18:17:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.448562509, 2023-01-02T18:17:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.301 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.302 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:22.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:22.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:22.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:22.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:22.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:22.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:22.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:22.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:22.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:22.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:22.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:22.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:22.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:22.312 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.312 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.313 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.313 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:22.313 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:22.314 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.7403828409999997, 2023-01-02T18:17:22.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:22.314 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.314 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.314 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.315 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:22.315 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:22.315 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:22.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.315 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:22.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:22.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:22.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:22.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:22.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:22.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:22.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:22.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:22.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:22.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:22.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:22.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:22.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:22.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:22.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:22.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:22.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:22.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:22.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:22.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:22.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:22.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:22.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:22.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:22.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:22.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:22.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:22.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:22.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:22.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:22.329 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.330 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.330 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.330 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2189 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:17:22.331 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:22.331 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.730495119, 2023-01-02T18:17:22.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021348589999999998, 2023-01-02T18:17:22.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.331 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.332 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:22.332 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:22.332 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2189 2023-01-02T18:17:22.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.332 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:22.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:22.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:22.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337532+0000", 2023-01-02T18:17:22.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4099e-05 2023-01-02T18:17:22.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337547+0000", 2023-01-02T18:17:22.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5758000000000001e-05 2023-01-02T18:17:22.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337562+0000", 2023-01-02T18:17:22.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6670000000000002e-06 2023-01-02T18:17:22.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337571+0000", 2023-01-02T18:17:22.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3940999999999998e-05 2023-01-02T18:17:22.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337615+0000", 2023-01-02T18:17:22.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5260999999999997e-05 2023-01-02T18:17:22.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337680+0000", 2023-01-02T18:17:22.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000237376 2023-01-02T18:17:22.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:22.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337918+0000", 2023-01-02T18:17:22.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069068199999999997 2023-01-02T18:17:22.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.338608+0000", 2023-01-02T18:17:22.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009849049999999999 2023-01-02T18:17:22.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339593+0000", 2023-01-02T18:17:22.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4521999999999999e-05 2023-01-02T18:17:22.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339628+0000", 2023-01-02T18:17:22.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2684e-05 2023-01-02T18:17:22.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339670+0000", 2023-01-02T18:17:22.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021348589999999998 2023-01-02T18:17:22.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.344 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.345 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:22.345 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:22.345 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.71364659900000005, 2023-01-02T18:17:22.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:22.346 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.346 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:22.346 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.346 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:22.347 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:22.347 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:22.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.347 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:22.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:22.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:22.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:22.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:22.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:22.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:22.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:22.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:22.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:22.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:22.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:22.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:22.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:22.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:22.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:22.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:22.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:22.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:22.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:22.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:22.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:22.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:22.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:22.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:22.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:22.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:22.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:22.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:22.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:22.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:22.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:22.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:22.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:22.361 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.361 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.362 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2210 3.7 3:e627a383:::rbd_object_map.11d5ac377738:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:22.362 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.367290+0000", 2023-01-02T18:17:22.362 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.70074091100000002, 2023-01-02T18:17:22.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016098740000000001, 2023-01-02T18:17:22.363 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:22.363 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:22.363 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:22.363 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:22.364 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:22.364 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2210 2023-01-02T18:17:22.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.364 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:22.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:22.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367290+0000", 2023-01-02T18:17:22.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:22.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:22.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367290+0000", 2023-01-02T18:17:22.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:22.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:22.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367287+0000", 2023-01-02T18:17:22.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:17:22.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:22.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367298+0000", 2023-01-02T18:17:22.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8034e-05 2023-01-02T18:17:22.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:22.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367316+0000", 2023-01-02T18:17:22.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:22.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:22.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367323+0000", 2023-01-02T18:17:22.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4750999999999998e-05 2023-01-02T18:17:22.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:22.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367378+0000", 2023-01-02T18:17:22.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000120118 2023-01-02T18:17:22.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:22.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367498+0000", 2023-01-02T18:17:22.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001401451 2023-01-02T18:17:22.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:22.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:22.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:22.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.368900+0000", 2023-01-02T18:17:22.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016098740000000001 2023-01-02T18:17:22.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.373 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:22.373 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:22.374 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:22.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:22.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:22.377 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.1 to 1 (10000) 2023-01-02T18:17:22.377 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-01-02T18:17:22.378 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:22.375+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:22.476 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:22.477+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:22.514 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:22.514 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:22.514 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:22.515 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:22.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:22.560 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:22.578 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:22.595 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:22.608 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:22.609+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:22.613 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:22.631 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:22.648 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:22.666 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:22.679 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:22.679+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:22.684 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:22.685 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:22.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:22.687 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:22.690 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:22.691 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:22.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:22.784 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:22.785+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:22.866 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:22.866 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:22.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:22.917 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:22.917+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:22.982 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:22.983+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:23.041 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:23.042 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:23.051 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:23.094 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:23.095+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:23.177 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:23.177 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:23.183 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:23.184+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:23.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:23.285 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:23.284+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:23.354 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:23.355 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:23.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:23.366 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.2 to 1 (10000) 2023-01-02T18:17:23.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2023-01-02T18:17:23.424 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:23.424+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:23.487 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:23.487+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:23.493 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:23.493 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:23.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:23.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:17:23.587 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:23.587+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:23.628 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:23.628 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:23.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:23.688 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:23.688+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:23.763 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:23.763 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:23.773 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:23.789 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:23.789+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:23.889 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:23.890+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:23.900 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:23.900 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:23.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:23.991 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:23.991+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:24.075 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:24.075 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:24.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:24.092 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:24.092+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:24.193 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:24.193+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:24.210 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:24.211 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:24.221 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:24.293 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:24.293+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:24.314 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.3 to 1 (10000) 2023-01-02T18:17:24.315 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:17:24.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2023-01-02T18:17:24.360 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:24.361 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:24.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:24.413 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:24.413+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:24.495 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:24.495+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:24.541 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:24.541 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:24.552 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:24.636 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:24.636+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:24.696 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:24.696+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:24.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:24.720 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:24.720 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:24.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:24.815 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:24.815+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:24.842 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:24.860 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:24.877 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:24.895 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:24.898 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:24.898+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:24.900 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:24.900 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:24.900 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:24.900 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:24.910 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:24.913 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:24.931 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:24.949 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:24.967 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:24.969 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:24.970 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:25.021 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:25.021+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:25.039 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:25.039 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:25.040 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:25.040 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:25.040 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:25.049 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:25.099 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:25.100+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:25.200 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:25.201+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:25.216 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:25.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.791505293999997, 2023-01-02T18:17:25.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:25.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:25.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:25.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:25.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.227 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:25.228 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.732305586000003, 2023-01-02T18:17:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:25.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:25.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:25.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:25.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:25.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:25.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:25.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "MOSDPGPush(3.1c 49/48 [PushOp(3:3d3f3250:::rbd_id.image2:head, version: 46'3, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:3d3f3250:::rbd_id.image2:head@46'3, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:17:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.768079821000001, 2023-01-02T18:17:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004, 2023-01-02T18:17:25.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:25.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447393+0000", 2023-01-02T18:17:25.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447391+0000", 2023-01-02T18:17:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8275e-05 2023-01-02T18:17:25.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447410+0000", 2023-01-02T18:17:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3377999999999999e-05 2023-01-02T18:17:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447433+0000", 2023-01-02T18:17:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6303e-05 2023-01-02T18:17:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447449+0000", 2023-01-02T18:17:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000438212 2023-01-02T18:17:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447888+0000", 2023-01-02T18:17:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.169e-05 2023-01-02T18:17:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.447899+0000", 2023-01-02T18:17:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035861500000000001 2023-01-02T18:17:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:42.448258+0000", 2023-01-02T18:17:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086529900000000004 2023-01-02T18:17:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.886944745000001, 2023-01-02T18:17:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:25.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:25.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:25.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:17:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.874508943000002, 2023-01-02T18:17:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:17:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:25.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:25.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:17:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:17:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:17:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:17:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:17:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:17:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:17:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:17:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:17:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:17:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:17:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:17:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:17:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:17:25.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:17:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.839836205000001, 2023-01-02T18:17:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.275 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:25.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:25.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:25.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:25.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.829559186000001, 2023-01-02T18:17:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:25.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:25.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:25.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:25.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:25.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:369 7.1c e64/61 7:3831950c:::rbd_directory:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.901869799, 2023-01-02T18:17:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004, 2023-01-02T18:17:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.297 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313602+0000", 2023-01-02T18:17:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2730000000000002e-06 2023-01-02T18:17:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313607+0000", 2023-01-02T18:17:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1277999999999999e-05 2023-01-02T18:17:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313619+0000", 2023-01-02T18:17:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4730000000000003e-06 2023-01-02T18:17:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313626+0000", 2023-01-02T18:17:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8665999999999998e-05 2023-01-02T18:17:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313675+0000", 2023-01-02T18:17:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8902e-05 2023-01-02T18:17:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313694+0000", 2023-01-02T18:17:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079486599999999998 2023-01-02T18:17:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314489+0000", 2023-01-02T18:17:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7184999999999997e-05 2023-01-02T18:17:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314526+0000", 2023-01-02T18:17:25.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004 2023-01-02T18:17:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.307 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.521210766999999, 2023-01-02T18:17:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.308 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.309 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:25.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:25.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:25.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:25.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:25.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:25.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:25.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:25.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:25.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:25.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:25.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:25.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:25.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:25.321 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.321 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.321 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.322 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2084 8.3 e69/65 8:c28f5e81:::rbd_object_map.12a230fb06bc.0000000000000004:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:25.322 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:25.322 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.630736941999999, 2023-01-02T18:17:25.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003, 2023-01-02T18:17:25.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.323 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.323 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:25.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:25.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:25.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9859999999999997e-06 2023-01-02T18:17:25.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584742+0000", 2023-01-02T18:17:25.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4059999999999999e-05 2023-01-02T18:17:25.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584756+0000", 2023-01-02T18:17:25.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1331999999999999e-05 2023-01-02T18:17:25.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584767+0000", 2023-01-02T18:17:25.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2049000000000002e-05 2023-01-02T18:17:25.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584829+0000", 2023-01-02T18:17:25.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5982e-05 2023-01-02T18:17:25.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584845+0000", 2023-01-02T18:17:25.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080091699999999995 2023-01-02T18:17:25.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585646+0000", 2023-01-02T18:17:25.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8123000000000002e-05 2023-01-02T18:17:25.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585674+0000", 2023-01-02T18:17:25.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003 2023-01-02T18:17:25.332 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.332 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.332 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.333 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:25.333 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:25.333 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.585895876999999, 2023-01-02T18:17:25.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:25.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.334 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.334 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:25.334 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:25.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:25.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.335 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:25.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:25.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:25.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:25.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:25.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:25.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:25.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:25.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:25.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:25.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:25.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:25.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:25.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:25.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:25.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:25.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:25.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:25.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:25.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:25.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:25.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:25.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:25.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:25.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:25.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:25.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:25.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:25.347 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.347 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.347 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.348 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2487 8.b e72/65 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head v 72'1, mlcod=0'0)", 2023-01-02T18:17:25.348 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:25.348 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.881954239999999, 2023-01-02T18:17:25.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001, 2023-01-02T18:17:25.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.349 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.349 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:25.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:25.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4989999999999999e-06 2023-01-02T18:17:25.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333524+0000", 2023-01-02T18:17:25.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5179999999999993e-06 2023-01-02T18:17:25.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333534+0000", 2023-01-02T18:17:25.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9309999999999996e-06 2023-01-02T18:17:25.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333540+0000", 2023-01-02T18:17:25.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4733e-05 2023-01-02T18:17:25.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333584+0000", 2023-01-02T18:17:25.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3536e-05 2023-01-02T18:17:25.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333608+0000", 2023-01-02T18:17:25.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076285800000000005 2023-01-02T18:17:25.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334371+0000", 2023-01-02T18:17:25.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4526000000000001e-05 2023-01-02T18:17:25.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334405+0000", 2023-01-02T18:17:25.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001 2023-01-02T18:17:25.358 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.358 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.359 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.359 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2494 8.15 e72/65 8:af65fa5d:::rbd_header.12a2b157d0cc:head v 72'17, mlcod=71'15)", 2023-01-02T18:17:25.359 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:25.359 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.875567956000001, 2023-01-02T18:17:25.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997, 2023-01-02T18:17:25.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.360 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:25.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:25.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:25.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.456e-06 2023-01-02T18:17:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339912+0000", 2023-01-02T18:17:25.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0529e-05 2023-01-02T18:17:25.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339922+0000", 2023-01-02T18:17:25.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4649999999999996e-06 2023-01-02T18:17:25.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339927+0000", 2023-01-02T18:17:25.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8563999999999999e-05 2023-01-02T18:17:25.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339966+0000", 2023-01-02T18:17:25.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7017e-05 2023-01-02T18:17:25.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339983+0000", 2023-01-02T18:17:25.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077748699999999999 2023-01-02T18:17:25.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340760+0000", 2023-01-02T18:17:25.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2043999999999999e-05 2023-01-02T18:17:25.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340802+0000", 2023-01-02T18:17:25.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997 2023-01-02T18:17:25.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.370 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.371 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:25.371 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:25.371 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.58199102, 2023-01-02T18:17:25.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:25.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:25.372 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.372 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:25.372 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:25.372 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:25.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.373 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:25.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:25.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:25.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:25.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:25.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:25.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:25.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:25.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:25.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:25.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:25.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:25.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:25.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:25.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:25.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:25.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:25.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:25.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:25.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:25.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:25.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:25.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.383 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.384 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:25.384 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:25.384 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.8774493499999991, 2023-01-02T18:17:25.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:25.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:25.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:25.385 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:25.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:25.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.386 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:25.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:25.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:25.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:25.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:25.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:25.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:25.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:25.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:25.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:25.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:25.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:25.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:25.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:25.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:25.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:25.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:25.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:25.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:25.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:25.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:25.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:25.396 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.396 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.396 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.397 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2057 3.6 e82/43 3:6334c7d3:::rbd_object_map.11d574d0a887:head v 82'1, mlcod=0'0)", 2023-01-02T18:17:25.397 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:25.397 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.8592066309999993, 2023-01-02T18:17:25.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091887800000000003, 2023-01-02T18:17:25.397 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.398 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.398 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:25.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:25.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:25.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356265+0000", 2023-01-02T18:17:25.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5269999999999999e-06 2023-01-02T18:17:25.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356269+0000", 2023-01-02T18:17:25.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7110000000000007e-06 2023-01-02T18:17:25.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356279+0000", 2023-01-02T18:17:25.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3370000000000001e-06 2023-01-02T18:17:25.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356283+0000", 2023-01-02T18:17:25.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9932999999999998e-05 2023-01-02T18:17:25.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356333+0000", 2023-01-02T18:17:25.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2926999999999999e-05 2023-01-02T18:17:25.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356356+0000", 2023-01-02T18:17:25.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078956299999999996 2023-01-02T18:17:25.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357145+0000", 2023-01-02T18:17:25.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9088999999999998e-05 2023-01-02T18:17:25.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357185+0000", 2023-01-02T18:17:25.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091887800000000003 2023-01-02T18:17:25.407 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.407 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.407 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.408 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:25.408 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:25.408 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.8877176139999996, 2023-01-02T18:17:25.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:25.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.409 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.409 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:25.409 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:25.410 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:25.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.410 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:25.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:25.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:25.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:25.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:25.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:25.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:25.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:25.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:25.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:25.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:25.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:25.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:25.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:25.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:25.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:25.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:25.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:25.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:25.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:25.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:25.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:25.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:25.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:25.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:25.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.422 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.423 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:25.423 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:25.423 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.8643917590000001, 2023-01-02T18:17:25.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:25.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:25.424 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.424 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:25.424 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:25.424 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:25.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.425 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:25.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:25.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:25.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:25.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:25.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:25.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:25.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:25.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:25.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:25.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:25.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:25.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:25.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:25.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:25.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:25.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:25.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:25.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:25.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:25.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:25.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:25.435 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.435 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.435 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.435 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:25.436 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:25.436 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8543165290000001, 2023-01-02T18:17:25.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:17:25.436 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.436 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.437 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.437 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:25.437 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:25.437 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:17:25.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.437 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:25.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:25.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:25.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:17:25.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:17:25.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:17:25.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:17:25.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:17:25.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:17:25.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:17:25.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:17:25.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:17:25.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:17:25.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:25.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:17:25.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:17:25.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:17:25.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:17:25.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:17:25.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:17:25.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:25.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:17:25.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:17:25.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:17:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:17:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:25.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:17:25.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:17:25.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:17:25.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:17:25.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:17:25.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:17:25.451 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.451 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.451 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.452 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2241 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [call rbd.object_map_snap_remove in=25b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:25.452 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:25.452 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.8363980930000001, 2023-01-02T18:17:25.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652, 2023-01-02T18:17:25.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:25.453 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:25.453 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2241 2023-01-02T18:17:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379073+0000", 2023-01-02T18:17:25.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:25.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379080+0000", 2023-01-02T18:17:25.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1620999999999999e-05 2023-01-02T18:17:25.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379091+0000", 2023-01-02T18:17:25.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0440000000000003e-06 2023-01-02T18:17:25.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379097+0000", 2023-01-02T18:17:25.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4477999999999997e-05 2023-01-02T18:17:25.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379141+0000", 2023-01-02T18:17:25.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9756999999999997e-05 2023-01-02T18:17:25.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379201+0000", 2023-01-02T18:17:25.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010401239999999999 2023-01-02T18:17:25.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.380241+0000", 2023-01-02T18:17:25.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652 2023-01-02T18:17:25.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.463 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.463 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.464 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:25.465 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:25.466 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.6 to 1 (10000) 2023-01-02T18:17:25.466 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 0 2023-01-02T18:17:25.467 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 0 2023-01-02T18:17:25.467 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestGetNameIdSnapPP (5996 ms) 2023-01-02T18:17:25.467 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestCreateLsRenameSnapPP 2023-01-02T18:17:25.467 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:25.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2023-01-02T18:17:25.468 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:25.466+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:25.566 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:25.566+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:25.634 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:25.634 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:25.634 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:25.634 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:25.645 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:25.666 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:25.667+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:25.768 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:25.768+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:25.810 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:25.811 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:25.811 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:25.811 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:25.811 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:25.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:25.868 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:25.868+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:25.947 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:25.947 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:25.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:25.947 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:25.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.948 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:25.948 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:25.948 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.463041933, 2023-01-02T18:17:25.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:25.948 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.949 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.949 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:25.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:25.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:25.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:25.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:25.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:25.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:25.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:25.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:25.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:25.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:25.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:25.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:25.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:25.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:25.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:25.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:25.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:25.958 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.958 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.958 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.959 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:25.959 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:25.959 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.598975402999997, 2023-01-02T18:17:25.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:25.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.960 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:25.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:25.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:25.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:25.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:25.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:25.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:25.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:25.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:25.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:25.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:25.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:25.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:25.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:25.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.969 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.970 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:25.970 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:25.970 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.597295789999997, 2023-01-02T18:17:25.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:25.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.971 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:25.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:25.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:25.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:25.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:25.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:25.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:25.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:25.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:25.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:25.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:25.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:25.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:25.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:25.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:25.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:25.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:25.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:25.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:25.980 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.980 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.980 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.981 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:25.981 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:25.981 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.630467906, 2023-01-02T18:17:25.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:25.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.982 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:25.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:25.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:25.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:25.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:25.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:25.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:25.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:25.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:25.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:25.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:25.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:25.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:25.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:25.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:25.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:25.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:25.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:25.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:25.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:25.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:25.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.991 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:25.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:25.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.992 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:25.992 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:25.992 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.300330362, 2023-01-02T18:17:25.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:25.993 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:25.993 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:25.993 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:25.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:25.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:25.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:25.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:25.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:25.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:25.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:25.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:25.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:25.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:25.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:25.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:25.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:25.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:25.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:25.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:25.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:25.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:25.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:25.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:25.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:25.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:25.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:25.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:26.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:26.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:26.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:26.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:26.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:26.002 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.002 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.002 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.003 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:981 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'4, mlcod=64'2)", 2023-01-02T18:17:26.003 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:26.003 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.287990664999999, 2023-01-02T18:17:26.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003, 2023-01-02T18:17:26.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.004 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:26.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:26.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:26.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658715+0000", 2023-01-02T18:17:26.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2509999999999997e-06 2023-01-02T18:17:26.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658723+0000", 2023-01-02T18:17:26.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6970000000000005e-06 2023-01-02T18:17:26.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658732+0000", 2023-01-02T18:17:26.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3159999999999998e-06 2023-01-02T18:17:26.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658737+0000", 2023-01-02T18:17:26.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2293000000000003e-05 2023-01-02T18:17:26.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658779+0000", 2023-01-02T18:17:26.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2996000000000001e-05 2023-01-02T18:17:26.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658802+0000", 2023-01-02T18:17:26.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066023399999999999 2023-01-02T18:17:26.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659462+0000", 2023-01-02T18:17:26.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4413000000000002e-05 2023-01-02T18:17:26.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659487+0000", 2023-01-02T18:17:26.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003 2023-01-02T18:17:26.013 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.013 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.013 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.014 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:26.014 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:26.014 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.622977659, 2023-01-02T18:17:26.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:26.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.015 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.015 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:26.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:26.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:26.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:26.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:26.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:26.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:26.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:26.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:26.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:26.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:26.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:26.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:26.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:26.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:26.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:26.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:26.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:26.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:26.024 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.024 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.024 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.025 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:26.025 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:26.025 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.621184574000001, 2023-01-02T18:17:26.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:26.026 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.026 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.026 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:26.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:26.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:26.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:26.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:26.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:26.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:26.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:26.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:26.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:26.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:26.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:26.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:26.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:26.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:26.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:26.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:26.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:26.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:26.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.035 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.036 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:26.036 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:26.037 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.610346790000001, 2023-01-02T18:17:26.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:26.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.037 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:26.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:26.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:26.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:26.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:26.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:26.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:26.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:26.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:26.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:26.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:26.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:26.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:26.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:26.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:26.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:26.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:26.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:26.046 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.046 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.047 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.047 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1511 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'37, mlcod=68'35)", 2023-01-02T18:17:26.047 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:26.047 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.488150518000001, 2023-01-02T18:17:26.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005, 2023-01-02T18:17:26.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.048 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:26.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458556+0000", 2023-01-02T18:17:26.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458554+0000", 2023-01-02T18:17:26.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4627000000000001e-05 2023-01-02T18:17:26.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458569+0000", 2023-01-02T18:17:26.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6376e-05 2023-01-02T18:17:26.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458595+0000", 2023-01-02T18:17:26.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2846e-05 2023-01-02T18:17:26.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458608+0000", 2023-01-02T18:17:26.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0798999999999997e-05 2023-01-02T18:17:26.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458689+0000", 2023-01-02T18:17:26.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1622999999999998e-05 2023-01-02T18:17:26.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.458731+0000", 2023-01-02T18:17:26.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050369499999999997 2023-01-02T18:17:26.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459234+0000", 2023-01-02T18:17:26.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6656999999999998e-05 2023-01-02T18:17:26.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.459271+0000", 2023-01-02T18:17:26.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071471900000000005 2023-01-02T18:17:26.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.058 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.058 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1774 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'72, mlcod=68'70)", 2023-01-02T18:17:26.058 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:26.059 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.371072428000002, 2023-01-02T18:17:26.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004, 2023-01-02T18:17:26.059 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.059 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.059 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:26.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:26.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:26.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575633+0000", 2023-01-02T18:17:26.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1912999999999999e-05 2023-01-02T18:17:26.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575645+0000", 2023-01-02T18:17:26.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5690000000000001e-05 2023-01-02T18:17:26.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575660+0000", 2023-01-02T18:17:26.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1430000000000001e-06 2023-01-02T18:17:26.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575668+0000", 2023-01-02T18:17:26.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9123000000000003e-05 2023-01-02T18:17:26.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575727+0000", 2023-01-02T18:17:26.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0632000000000001e-05 2023-01-02T18:17:26.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575757+0000", 2023-01-02T18:17:26.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057452100000000004 2023-01-02T18:17:26.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576332+0000", 2023-01-02T18:17:26.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8958999999999998e-05 2023-01-02T18:17:26.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576361+0000", 2023-01-02T18:17:26.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004 2023-01-02T18:17:26.068 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.068 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.069 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.069 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1842 8.4 e68/65 8:24c831c0:::rbd_header.12a2b9663ff5:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:26.069 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:26.069 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.333810898999999, 2023-01-02T18:17:26.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997, 2023-01-02T18:17:26.070 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.070 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.070 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:26.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:26.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612894+0000", 2023-01-02T18:17:26.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:26.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612908+0000", 2023-01-02T18:17:26.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6006000000000001e-05 2023-01-02T18:17:26.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612934+0000", 2023-01-02T18:17:26.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.509e-05 2023-01-02T18:17:26.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612949+0000", 2023-01-02T18:17:26.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7535999999999998e-05 2023-01-02T18:17:26.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613027+0000", 2023-01-02T18:17:26.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0413000000000001e-05 2023-01-02T18:17:26.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613067+0000", 2023-01-02T18:17:26.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056083499999999998 2023-01-02T18:17:26.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613628+0000", 2023-01-02T18:17:26.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0998000000000001e-05 2023-01-02T18:17:26.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613649+0000", 2023-01-02T18:17:26.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997 2023-01-02T18:17:26.079 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.079 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.080 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.080 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2136 8.16 e69/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:26.080 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:26.081 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.325729425999999, 2023-01-02T18:17:26.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995, 2023-01-02T18:17:26.081 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.081 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.081 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:26.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:26.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:26.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:26.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8340000000000001e-06 2023-01-02T18:17:26.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620984+0000", 2023-01-02T18:17:26.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5201000000000001e-05 2023-01-02T18:17:26.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620999+0000", 2023-01-02T18:17:26.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9990000000000008e-06 2023-01-02T18:17:26.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621007+0000", 2023-01-02T18:17:26.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9780999999999997e-05 2023-01-02T18:17:26.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621047+0000", 2023-01-02T18:17:26.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2869e-05 2023-01-02T18:17:26.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621060+0000", 2023-01-02T18:17:26.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061950799999999995 2023-01-02T18:17:26.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621679+0000", 2023-01-02T18:17:26.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2191999999999999e-05 2023-01-02T18:17:26.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621711+0000", 2023-01-02T18:17:26.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995 2023-01-02T18:17:26.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.091 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.091 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2611 8.1b e72/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 72'85, mlcod=69'83)", 2023-01-02T18:17:26.092 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:26.092 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.546143691000001, 2023-01-02T18:17:26.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999, 2023-01-02T18:17:26.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.093 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:26.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400563+0000", 2023-01-02T18:17:26.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:26.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400562+0000", 2023-01-02T18:17:26.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1299999999999998e-06 2023-01-02T18:17:26.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400568+0000", 2023-01-02T18:17:26.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0643e-05 2023-01-02T18:17:26.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400579+0000", 2023-01-02T18:17:26.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4920000000000004e-06 2023-01-02T18:17:26.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400584+0000", 2023-01-02T18:17:26.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4360999999999998e-05 2023-01-02T18:17:26.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400618+0000", 2023-01-02T18:17:26.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4246999999999999e-05 2023-01-02T18:17:26.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.400632+0000", 2023-01-02T18:17:26.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061679400000000004 2023-01-02T18:17:26.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401249+0000", 2023-01-02T18:17:26.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7705999999999999e-05 2023-01-02T18:17:26.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.401277+0000", 2023-01-02T18:17:26.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071361999999999999 2023-01-02T18:17:26.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.102 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.103 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:26.103 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:26.103 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6182932300000008, 2023-01-02T18:17:26.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:26.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.104 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:26.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:26.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:26.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:26.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:26.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:26.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:26.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:26.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:26.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:26.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:26.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:26.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:26.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:26.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:26.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:26.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:26.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:26.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:26.113 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.114 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.114 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:26.114 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:26.115 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.6040946900000002, 2023-01-02T18:17:26.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:26.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.115 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.115 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:26.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:26.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:26.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:26.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:26.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:26.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:26.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:26.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:26.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:26.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:26.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:26.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:26.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:26.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:26.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:26.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:26.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:26.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:26.125 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.125 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.125 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.126 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:17:26.126 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:26.126 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.5820124160000004, 2023-01-02T18:17:26.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:17:26.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.127 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:26.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:26.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:26.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:26.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:17:26.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:17:26.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:17:26.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:17:26.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:17:26.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:17:26.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:17:26.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:17:26.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:17:26.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:17:26.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:17:26.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:17:26.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:17:26.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:17:26.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:17:26.149 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.149 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.150 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2226 3.13 e89/54 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head v 89'2, mlcod=0'0)", 2023-01-02T18:17:26.150 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:26.151 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.5795923059999999, 2023-01-02T18:17:26.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005, 2023-01-02T18:17:26.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.151 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.151 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:26.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:26.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:26.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:26.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0959999999999997e-06 2023-01-02T18:17:26.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367120+0000", 2023-01-02T18:17:26.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4494e-05 2023-01-02T18:17:26.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367135+0000", 2023-01-02T18:17:26.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5700000000000004e-06 2023-01-02T18:17:26.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367142+0000", 2023-01-02T18:17:26.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9985000000000003e-05 2023-01-02T18:17:26.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367192+0000", 2023-01-02T18:17:26.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8598e-05 2023-01-02T18:17:26.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367211+0000", 2023-01-02T18:17:26.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072699899999999998 2023-01-02T18:17:26.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367938+0000", 2023-01-02T18:17:26.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8569999999999998e-05 2023-01-02T18:17:26.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367977+0000", 2023-01-02T18:17:26.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005 2023-01-02T18:17:26.161 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.161 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.161 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.162 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:17:26.162 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:26.162 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.60637755100000001, 2023-01-02T18:17:26.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:17:26.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:26.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:26.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:26.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:26.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:17:26.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:17:26.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:17:26.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:17:26.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:17:26.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:17:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:17:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:17:26.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:17:26.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:17:26.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:17:26.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:17:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:17:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:17:26.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:17:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.172 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:17:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.60463870200000003, 2023-01-02T18:17:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:17:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.173 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:26.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:17:26.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:17:26.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:17:26.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:17:26.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:17:26.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:17:26.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:17:26.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:17:26.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:17:26.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:17:26.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:17:26.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:17:26.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:17:26.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:17:26.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:17:26.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:17:26.182 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.182 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.183 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.183 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.183 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.183 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:26.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:26.185 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:26.185+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:26.285 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:26.285+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:26.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:17:26.356 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:26.356 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:26.357 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:26.357 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:26.371 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:26.372 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.7 to 1 (10000) 2023-01-02T18:17:26.386 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 1 2023-01-02T18:17:26.387 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:17:26.387 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap1 2023-01-02T18:17:26.387 INFO:tasks.workunit.client.0.smithi007.stdout:found snap1 with size 2097152 2023-01-02T18:17:26.388 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:26.386+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:26.390 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-01-02T18:17:26.390 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:17:26.488 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:26.487+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:26.518 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:26.518 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:26.518 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:26.519 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:26.519 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:26.529 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:26.617 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:26.616+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:26.691 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:26.691+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:26.701 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.703 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:26.703 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:26.703 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.265249554999997, 2023-01-02T18:17:26.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:26.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:26.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:26.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:26.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:26.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:26.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:26.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:26.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:26.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:26.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:26.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:26.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:26.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:26.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:26.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:26.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:26.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.732 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:26.733 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:26.733 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.215864562, 2023-01-02T18:17:26.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:17:26.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:17:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:26.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:17:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:17:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:17:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:17:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:17:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:17:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:17:26.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:17:26.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:17:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:17:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:17:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:17:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:17:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:17:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:17:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:17:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:17:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:17:26.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:17:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:17:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:17:26.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:17:26.754 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.754 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.754 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:444 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.325848329000003, 2023-01-02T18:17:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489, 2023-01-02T18:17:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 444 2023-01-02T18:17:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:26.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:26.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:26.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375249+0000", 2023-01-02T18:17:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9409999999999998e-06 2023-01-02T18:17:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375254+0000", 2023-01-02T18:17:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5210000000000008e-06 2023-01-02T18:17:26.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375264+0000", 2023-01-02T18:17:26.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9629999999999997e-06 2023-01-02T18:17:26.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375269+0000", 2023-01-02T18:17:26.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.333e-05 2023-01-02T18:17:26.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375312+0000", 2023-01-02T18:17:26.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6695999999999998e-05 2023-01-02T18:17:26.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375399+0000", 2023-01-02T18:17:26.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016210000000000001 2023-01-02T18:17:26.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:26.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375561+0000", 2023-01-02T18:17:26.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087961699999999996 2023-01-02T18:17:26.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376440+0000", 2023-01-02T18:17:26.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055437200000000002 2023-01-02T18:17:26.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376995+0000", 2023-01-02T18:17:26.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6236999999999997e-05 2023-01-02T18:17:26.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377051+0000", 2023-01-02T18:17:26.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0509e-05 2023-01-02T18:17:26.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377102+0000", 2023-01-02T18:17:26.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489 2023-01-02T18:17:26.775 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.776 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.776 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.776 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:26.777 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:26.777 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.315541088000003, 2023-01-02T18:17:26.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:17:26.777 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.778 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.778 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.778 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.778 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.778 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:17:26.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.779 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:26.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:26.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:26.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:17:26.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:17:26.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:17:26.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:17:26.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:17:26.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:17:26.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:17:26.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:17:26.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:17:26.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:17:26.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:17:26.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:17:26.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:26.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:17:26.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:17:26.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:17:26.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:17:26.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:17:26.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:17:26.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:17:26.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:17:26.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:17:26.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:17:26.794 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.794 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.794 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.795 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:26.795 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:26.795 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.391709446, 2023-01-02T18:17:26.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:26.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.796 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.797 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:26.797 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:26.797 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:26.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.798 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:26.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:26.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:26.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:26.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:26.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:26.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:26.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:26.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:26.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:26.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:26.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:26.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:26.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:26.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:26.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:26.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:26.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:26.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:26.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:26.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:26.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:26.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:26.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:26.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:26.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:26.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:26.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:26.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:26.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:26.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.816 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.818 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:372 7.1 7:83feba0f:::rbd_object_map.11d56649889d:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:26.818 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:26.818 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.381770382999999, 2023-01-02T18:17:26.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479, 2023-01-02T18:17:26.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:26.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:26.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 372 2023-01-02T18:17:26.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.820 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:26.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:26.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319326+0000", 2023-01-02T18:17:26.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1199999999999996e-06 2023-01-02T18:17:26.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319334+0000", 2023-01-02T18:17:26.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2170999999999999e-05 2023-01-02T18:17:26.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319346+0000", 2023-01-02T18:17:26.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7789999999999996e-06 2023-01-02T18:17:26.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319353+0000", 2023-01-02T18:17:26.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8445999999999997e-05 2023-01-02T18:17:26.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319392+0000", 2023-01-02T18:17:26.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010474700000000001 2023-01-02T18:17:26.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319497+0000", 2023-01-02T18:17:26.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138159 2023-01-02T18:17:26.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:26.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319635+0000", 2023-01-02T18:17:26.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071603699999999999 2023-01-02T18:17:26.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320351+0000", 2023-01-02T18:17:26.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063369800000000003 2023-01-02T18:17:26.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320985+0000", 2023-01-02T18:17:26.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5822000000000002e-05 2023-01-02T18:17:26.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321040+0000", 2023-01-02T18:17:26.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4125999999999997e-05 2023-01-02T18:17:26.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321085+0000", 2023-01-02T18:17:26.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479 2023-01-02T18:17:26.835 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.835 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.836 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.836 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:26.836 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:26.837 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.085749491000001, 2023-01-02T18:17:26.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:26.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.837 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.838 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.838 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.838 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:26.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.839 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:26.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:26.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:26.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:26.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:26.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:26.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:26.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:26.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:26.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:26.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:26.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:26.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:26.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:26.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:26.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:26.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:26.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:26.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:26.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:26.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:26.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:26.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:26.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:26.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:26.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:26.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:26.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:26.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:26.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:26.855 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.856 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:26.857 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:26.857 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.371277676999998, 2023-01-02T18:17:26.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:26.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.857 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.858 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.858 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.858 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.858 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:26.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.859 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:26.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:26.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:26.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:26.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:26.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:26.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:26.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:26.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:26.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:26.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:26.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:26.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:26.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:26.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:26.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:26.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:26.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.362176276, 2023-01-02T18:17:26.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.878 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.879 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:26.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:26.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.891 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:26.892 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.090819983999999, 2023-01-02T18:17:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:26.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:26.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:26.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:26.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.907 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2643 3.7 3:e026f164:::rbd_object_map.12a23fc13ef0.0000000000000004:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:26.908 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.086306455999999, 2023-01-02T18:17:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001, 2023-01-02T18:17:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.910 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2643 2023-01-02T18:17:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614790+0000", 2023-01-02T18:17:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3409999999999992e-06 2023-01-02T18:17:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614799+0000", 2023-01-02T18:17:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0420000000000008e-06 2023-01-02T18:17:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614808+0000", 2023-01-02T18:17:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1370000000000001e-06 2023-01-02T18:17:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614814+0000", 2023-01-02T18:17:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064692000000000005 2023-01-02T18:17:26.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615460+0000", 2023-01-02T18:17:26.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012489599999999999 2023-01-02T18:17:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615585+0000", 2023-01-02T18:17:26.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015799100000000001 2023-01-02T18:17:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615743+0000", 2023-01-02T18:17:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097339900000000001 2023-01-02T18:17:26.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.616717+0000", 2023-01-02T18:17:26.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045439800000000001 2023-01-02T18:17:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617171+0000", 2023-01-02T18:17:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8190999999999999e-05 2023-01-02T18:17:26.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617229+0000", 2023-01-02T18:17:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5250000000000002e-05 2023-01-02T18:17:26.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617275+0000", 2023-01-02T18:17:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001 2023-01-02T18:17:26.924 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.081630327999999, 2023-01-02T18:17:26.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.927 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:26.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:26.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:26.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.940 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:26.941 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.37345066, 2023-01-02T18:17:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:26.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:26.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:26.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:26.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:26.960 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2189 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:17:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.3635629380000003, 2023-01-02T18:17:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021348589999999998, 2023-01-02T18:17:26.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:26.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2189 2023-01-02T18:17:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337532+0000", 2023-01-02T18:17:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4099e-05 2023-01-02T18:17:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337547+0000", 2023-01-02T18:17:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5758000000000001e-05 2023-01-02T18:17:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337562+0000", 2023-01-02T18:17:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6670000000000002e-06 2023-01-02T18:17:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337571+0000", 2023-01-02T18:17:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3940999999999998e-05 2023-01-02T18:17:26.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337615+0000", 2023-01-02T18:17:26.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5260999999999997e-05 2023-01-02T18:17:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337680+0000", 2023-01-02T18:17:26.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000237376 2023-01-02T18:17:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:26.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337918+0000", 2023-01-02T18:17:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069068199999999997 2023-01-02T18:17:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.338608+0000", 2023-01-02T18:17:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009849049999999999 2023-01-02T18:17:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339593+0000", 2023-01-02T18:17:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4521999999999999e-05 2023-01-02T18:17:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339628+0000", 2023-01-02T18:17:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2684e-05 2023-01-02T18:17:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339670+0000", 2023-01-02T18:17:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021348589999999998 2023-01-02T18:17:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.978 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:26.979 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.3467144180000004, 2023-01-02T18:17:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:26.980 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.981 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:26.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:26.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:26.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:26.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:26.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:26.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:26.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:26.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:26.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:26.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:26.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:26.998 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:26.999 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.3466668220000004, 2023-01-02T18:17:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:17:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:27.000 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:17:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.001 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:27.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:27.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:17:27.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:17:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:27.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:17:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:17:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:27.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:17:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:17:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:27.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:17:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:17:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:17:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:17:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:17:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:17:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:17:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:17:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:17:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:17:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:17:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:17:27.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:17:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:17:27.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:17:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:17:27.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:17:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:17:27.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:17:27.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:17:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2238 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_trash_add in=21b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.326472227, 2023-01-02T18:17:27.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002, 2023-01-02T18:17:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:27.020 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2238 2023-01-02T18:17:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:27.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374625+0000", 2023-01-02T18:17:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9540000000000003e-06 2023-01-02T18:17:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374630+0000", 2023-01-02T18:17:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0295000000000001e-05 2023-01-02T18:17:27.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374641+0000", 2023-01-02T18:17:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3980000000000001e-06 2023-01-02T18:17:27.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374645+0000", 2023-01-02T18:17:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0728999999999997e-05 2023-01-02T18:17:27.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374676+0000", 2023-01-02T18:17:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8452000000000003e-05 2023-01-02T18:17:27.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374724+0000", 2023-01-02T18:17:27.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019847300000000001 2023-01-02T18:17:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:27.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374923+0000", 2023-01-02T18:17:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054292499999999998 2023-01-02T18:17:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.375466+0000", 2023-01-02T18:17:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025375240000000002 2023-01-02T18:17:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378003+0000", 2023-01-02T18:17:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1505e-05 2023-01-02T18:17:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378085+0000", 2023-01-02T18:17:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2633000000000002e-05 2023-01-02T18:17:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378107+0000", 2023-01-02T18:17:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002 2023-01-02T18:17:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:27.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:27.036 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.383597736, 2023-01-02T18:17:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:17:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:27.037 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:17:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.038 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:27.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:27.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:17:27.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:17:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:17:27.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:17:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:17:27.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:17:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:17:27.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:17:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:27.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:17:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:17:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:17:27.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:17:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:27.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:17:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:17:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:27.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:17:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:17:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:17:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:17:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:17:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:17:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:17:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:17:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:17:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:17:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:17:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:17:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.054 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2285 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [watch unwatch cookie 140114919434064] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:27.055 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.3693117029999999, 2023-01-02T18:17:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022783640000000002, 2023-01-02T18:17:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:27.056 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2285 2023-01-02T18:17:27.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:27.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:27.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:27.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331786+0000", 2023-01-02T18:17:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0419999999999998e-06 2023-01-02T18:17:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:27.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331789+0000", 2023-01-02T18:17:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8580000000000002e-06 2023-01-02T18:17:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:27.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331796+0000", 2023-01-02T18:17:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8789999999999996e-06 2023-01-02T18:17:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:27.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331800+0000", 2023-01-02T18:17:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016221000000000001 2023-01-02T18:17:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:27.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331962+0000", 2023-01-02T18:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6188999999999998e-05 2023-01-02T18:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:27.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332038+0000", 2023-01-02T18:17:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101796 2023-01-02T18:17:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:27.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332140+0000", 2023-01-02T18:17:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046557400000000001 2023-01-02T18:17:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:27.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332606+0000", 2023-01-02T18:17:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001331734 2023-01-02T18:17:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:27.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.333938+0000", 2023-01-02T18:17:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1469e-05 2023-01-02T18:17:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:27.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.333969+0000", 2023-01-02T18:17:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6107000000000007e-05 2023-01-02T18:17:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:27.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334065+0000", 2023-01-02T18:17:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022783640000000002 2023-01-02T18:17:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2286 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.369095076, 2023-01-02T18:17:27.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00219163, 2023-01-02T18:17:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:27.073 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2286 2023-01-02T18:17:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332002+0000", 2023-01-02T18:17:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332008+0000", 2023-01-02T18:17:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.995e-06 2023-01-02T18:17:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332018+0000", 2023-01-02T18:17:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4619999999999996e-06 2023-01-02T18:17:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332027+0000", 2023-01-02T18:17:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031803400000000003 2023-01-02T18:17:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332345+0000", 2023-01-02T18:17:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1441999999999997e-05 2023-01-02T18:17:27.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:17:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332426+0000", 2023-01-02T18:17:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001672378 2023-01-02T18:17:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334098+0000", 2023-01-02T18:17:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.731e-05 2023-01-02T18:17:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334136+0000", 2023-01-02T18:17:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9179999999999999e-05 2023-01-02T18:17:27.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334195+0000", 2023-01-02T18:17:27.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00219163 2023-01-02T18:17:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:27.086 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:27.087 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:27.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:27.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:27.096 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:17:27.098 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:26.807+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:27.101 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":140,"stamp":"2023-01-02T18:17:26.537562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2147,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":8890,"num_read_kb":7829,"num_write":689,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":492,"num_keys_recovered":102,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":814,"ondisk_log_size":814,"up":466,"acting":466,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":466,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":45220,"kb_used_data":6964,"kb_used_omap":0,"kb_used_meta":38208,"kb_avail":566185820,"statfs":{"total":579820584960,"available":579774279680,"internally_reserved":0,"allocated":7131136,"data_stored":3434048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39124992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":176,"num_write":27,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001207"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374531+0000","last_change":"2023-01-02T18:17:09.324265+0000","last_active":"2023-01-02T18:17:23.374531+0000","last_peered":"2023-01-02T18:17:23.374531+0000","last_clean":"2023-01-02T18:17:23.374531+0000","last_became_active":"2023-01-02T18:17:07.348058+0000","last_became_peered":"2023-01-02T18:17:07.348058+0000","last_unstale":"2023-01-02T18:17:23.374531+0000","last_undegraded":"2023-01-02T18:17:23.374531+0000","last_fullsized":"2023-01-02T18:17:23.374531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373462+0000","last_change":"2023-01-02T18:17:01.320137+0000","last_active":"2023-01-02T18:17:22.373462+0000","last_peered":"2023-01-02T18:17:22.373462+0000","last_clean":"2023-01-02T18:17:22.373462+0000","last_became_active":"2023-01-02T18:16:59.324809+0000","last_became_peered":"2023-01-02T18:16:59.324809+0000","last_unstale":"2023-01-02T18:17:22.373462+0000","last_undegraded":"2023-01-02T18:17:22.373462+0000","last_fullsized":"2023-01-02T18:17:22.373462+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369360+0000","last_change":"2023-01-02T18:16:48.330409+0000","last_active":"2023-01-02T18:17:23.369360+0000","last_peered":"2023-01-02T18:17:23.369360+0000","last_clean":"2023-01-02T18:17:23.369360+0000","last_became_active":"2023-01-02T18:16:48.329903+0000","last_became_peered":"2023-01-02T18:16:48.329903+0000","last_unstale":"2023-01-02T18:17:23.369360+0000","last_undegraded":"2023-01-02T18:17:23.369360+0000","last_fullsized":"2023-01-02T18:17:23.369360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365850+0000","last_change":"2023-01-02T18:17:23.366280+0000","last_active":"2023-01-02T18:17:23.365850+0000","last_peered":"2023-01-02T18:17:23.365850+0000","last_clean":"2023-01-02T18:17:23.365850+0000","last_became_active":"2023-01-02T18:16:42.460433+0000","last_became_peered":"2023-01-02T18:16:42.460433+0000","last_unstale":"2023-01-02T18:17:23.365850+0000","last_undegraded":"2023-01-02T18:17:23.365850+0000","last_fullsized":"2023-01-02T18:17:23.365850+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"2"},{"start":"e","length":"1"}]},{"pgid":"5.19","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374188+0000","last_change":"2023-01-02T18:16:49.304700+0000","last_active":"2023-01-02T18:17:23.374188+0000","last_peered":"2023-01-02T18:17:23.374188+0000","last_clean":"2023-01-02T18:17:23.374188+0000","last_became_active":"2023-01-02T18:16:46.314227+0000","last_became_peered":"2023-01-02T18:16:46.314227+0000","last_unstale":"2023-01-02T18:17:23.374188+0000","last_undegraded":"2023-01-02T18:17:23.374188+0000","last_fullsized":"2023-01-02T18:17:23.374188+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373646+0000","last_change":"2023-01-02T18:16:53.346444+0000","last_active":"2023-01-02T18:17:23.373646+0000","last_peered":"2023-01-02T18:17:23.373646+0000","last_clean":"2023-01-02T18:17:23.373646+0000","last_became_active":"2023-01-02T18:16:51.340482+0000","last_became_peered":"2023-01-02T18:16:51.340482+0000","last_unstale":"2023-01-02T18:17:23.373646+0000","last_undegraded":"2023-01-02T18:17:23.373646+0000","last_fullsized":"2023-01-02T18:17:23.373646+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":80,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":139,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373181+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:17:22.373181+0000","last_peered":"2023-01-02T18:17:22.373181+0000","last_clean":"2023-01-02T18:17:22.373181+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:17:22.373181+0000","last_undegraded":"2023-01-02T18:17:22.373181+0000","last_fullsized":"2023-01-02T18:17:22.373181+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375132+0000","last_change":"2023-01-02T18:17:09.308994+0000","last_active":"2023-01-02T18:17:23.375132+0000","last_peered":"2023-01-02T18:17:23.375132+0000","last_clean":"2023-01-02T18:17:23.375132+0000","last_became_active":"2023-01-02T18:17:07.339263+0000","last_became_peered":"2023-01-02T18:17:07.339263+0000","last_unstale":"2023-01-02T18:17:23.375132+0000","last_undegraded":"2023-01-02T18:17:23.375132+0000","last_fullsized":"2023-01-02T18:17:23.375132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'22","reported_seq":260,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374385+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:17:23.374385+0000","last_peered":"2023-01-02T18:17:23.374385+0000","last_clean":"2023-01-02T18:17:23.374385+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:17:23.374385+0000","last_undegraded":"2023-01-02T18:17:23.374385+0000","last_fullsized":"2023-01-02T18:17:23.374385+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":276,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364807+0000","last_change":"2023-01-02T18:16:44.306676+0000","last_active":"2023-01-02T18:17:23.364807+0000","last_peered":"2023-01-02T18:17:23.364807+0000","last_clean":"2023-01-02T18:17:23.364807+0000","last_became_active":"2023-01-02T18:16:41.446794+0000","last_became_peered":"2023-01-02T18:16:41.446794+0000","last_unstale":"2023-01-02T18:17:23.364807+0000","last_undegraded":"2023-01-02T18:17:23.364807+0000","last_fullsized":"2023-01-02T18:17:23.364807+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"91'21","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.329406+0000","last_change":"2023-01-02T18:17:24.322097+0000","last_active":"2023-01-02T18:17:24.329406+0000","last_peered":"2023-01-02T18:17:24.329406+0000","last_clean":"2023-01-02T18:17:24.329406+0000","last_became_active":"2023-01-02T18:16:37.427175+0000","last_became_peered":"2023-01-02T18:16:37.427175+0000","last_unstale":"2023-01-02T18:17:24.329406+0000","last_undegraded":"2023-01-02T18:17:24.329406+0000","last_fullsized":"2023-01-02T18:17:24.329406+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":205,"num_write":31,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.18","version":"0'0","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369625+0000","last_change":"2023-01-02T18:16:49.318455+0000","last_active":"2023-01-02T18:17:23.369625+0000","last_peered":"2023-01-02T18:17:23.369625+0000","last_clean":"2023-01-02T18:17:23.369625+0000","last_became_active":"2023-01-02T18:16:48.329597+0000","last_became_peered":"2023-01-02T18:16:48.329597+0000","last_unstale":"2023-01-02T18:17:23.369625+0000","last_undegraded":"2023-01-02T18:17:23.369625+0000","last_fullsized":"2023-01-02T18:17:23.369625+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366367+0000","last_change":"2023-01-02T18:16:53.344973+0000","last_active":"2023-01-02T18:17:23.366367+0000","last_peered":"2023-01-02T18:17:23.366367+0000","last_clean":"2023-01-02T18:17:23.366367+0000","last_became_active":"2023-01-02T18:16:51.341196+0000","last_became_peered":"2023-01-02T18:16:51.341196+0000","last_unstale":"2023-01-02T18:17:23.366367+0000","last_undegraded":"2023-01-02T18:17:23.366367+0000","last_fullsized":"2023-01-02T18:17:23.366367+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369943+0000","last_change":"2023-01-02T18:16:57.306888+0000","last_active":"2023-01-02T18:17:23.369943+0000","last_peered":"2023-01-02T18:17:23.369943+0000","last_clean":"2023-01-02T18:17:23.369943+0000","last_became_active":"2023-01-02T18:16:55.307841+0000","last_became_peered":"2023-01-02T18:16:55.307841+0000","last_unstale":"2023-01-02T18:17:23.369943+0000","last_undegraded":"2023-01-02T18:17:23.369943+0000","last_fullsized":"2023-01-02T18:17:23.369943+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"76'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374966+0000","last_change":"2023-01-02T18:17:09.324016+0000","last_active":"2023-01-02T18:17:23.374966+0000","last_peered":"2023-01-02T18:17:23.374966+0000","last_clean":"2023-01-02T18:17:23.374966+0000","last_became_active":"2023-01-02T18:17:07.347854+0000","last_became_peered":"2023-01-02T18:17:07.347854+0000","last_unstale":"2023-01-02T18:17:23.374966+0000","last_undegraded":"2023-01-02T18:17:23.374966+0000","last_fullsized":"2023-01-02T18:17:23.374966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"72'4","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364897+0000","last_change":"2023-01-02T18:17:01.311706+0000","last_active":"2023-01-02T18:17:23.364897+0000","last_peered":"2023-01-02T18:17:23.364897+0000","last_clean":"2023-01-02T18:17:23.364897+0000","last_became_active":"2023-01-02T18:16:59.313908+0000","last_became_peered":"2023-01-02T18:16:59.313908+0000","last_unstale":"2023-01-02T18:17:23.364897+0000","last_undegraded":"2023-01-02T18:17:23.364897+0000","last_fullsized":"2023-01-02T18:17:23.364897+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"51'2","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365523+0000","last_change":"2023-01-02T18:16:48.343757+0000","last_active":"2023-01-02T18:17:23.365523+0000","last_peered":"2023-01-02T18:17:23.365523+0000","last_clean":"2023-01-02T18:17:23.365523+0000","last_became_active":"2023-01-02T18:16:48.326121+0000","last_became_peered":"2023-01-02T18:16:48.326121+0000","last_unstale":"2023-01-02T18:17:23.365523+0000","last_undegraded":"2023-01-02T18:17:23.365523+0000","last_fullsized":"2023-01-02T18:17:23.365523+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"86'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.325567+0000","last_change":"2023-01-02T18:17:24.325723+0000","last_active":"2023-01-02T18:17:24.325567+0000","last_peered":"2023-01-02T18:17:24.325567+0000","last_clean":"2023-01-02T18:17:24.325567+0000","last_became_active":"2023-01-02T18:16:48.329613+0000","last_became_peered":"2023-01-02T18:16:48.329613+0000","last_unstale":"2023-01-02T18:17:24.325567+0000","last_undegraded":"2023-01-02T18:17:24.325567+0000","last_fullsized":"2023-01-02T18:17:24.325567+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1b","version":"56'1","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373664+0000","last_change":"2023-01-02T18:16:49.324862+0000","last_active":"2023-01-02T18:17:22.373664+0000","last_peered":"2023-01-02T18:17:22.373664+0000","last_clean":"2023-01-02T18:17:22.373664+0000","last_became_active":"2023-01-02T18:16:46.315844+0000","last_became_peered":"2023-01-02T18:16:46.315844+0000","last_unstale":"2023-01-02T18:17:22.373664+0000","last_undegraded":"2023-01-02T18:17:22.373664+0000","last_fullsized":"2023-01-02T18:17:22.373664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372526+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:17:22.372526+0000","last_peered":"2023-01-02T18:17:22.372526+0000","last_clean":"2023-01-02T18:17:22.372526+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:17:22.372526+0000","last_undegraded":"2023-01-02T18:17:22.372526+0000","last_fullsized":"2023-01-02T18:17:22.372526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370465+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:17:23.370465+0000","last_peered":"2023-01-02T18:17:23.370465+0000","last_clean":"2023-01-02T18:17:23.370465+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:17:23.370465+0000","last_undegraded":"2023-01-02T18:17:23.370465+0000","last_fullsized":"2023-01-02T18:17:23.370465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"76'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377142+0000","last_change":"2023-01-02T18:17:09.308912+0000","last_active":"2023-01-02T18:17:23.377142+0000","last_peered":"2023-01-02T18:17:23.377142+0000","last_clean":"2023-01-02T18:17:23.377142+0000","last_became_active":"2023-01-02T18:17:07.339397+0000","last_became_peered":"2023-01-02T18:17:07.339397+0000","last_unstale":"2023-01-02T18:17:23.377142+0000","last_undegraded":"2023-01-02T18:17:23.377142+0000","last_fullsized":"2023-01-02T18:17:23.377142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375069+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:17:23.375069+0000","last_peered":"2023-01-02T18:17:23.375069+0000","last_clean":"2023-01-02T18:17:23.375069+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:17:23.375069+0000","last_undegraded":"2023-01-02T18:17:23.375069+0000","last_fullsized":"2023-01-02T18:17:23.375069+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364928+0000","last_change":"2023-01-02T18:16:48.330072+0000","last_active":"2023-01-02T18:17:23.364928+0000","last_peered":"2023-01-02T18:17:23.364928+0000","last_clean":"2023-01-02T18:17:23.364928+0000","last_became_active":"2023-01-02T18:16:48.329697+0000","last_became_peered":"2023-01-02T18:16:48.329697+0000","last_unstale":"2023-01-02T18:17:23.364928+0000","last_undegraded":"2023-01-02T18:17:23.364928+0000","last_fullsized":"2023-01-02T18:17:23.364928+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"86'25","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.325147+0000","last_change":"2023-01-02T18:17:24.325502+0000","last_active":"2023-01-02T18:17:24.325147+0000","last_peered":"2023-01-02T18:17:24.325147+0000","last_clean":"2023-01-02T18:17:24.325147+0000","last_became_active":"2023-01-02T18:16:48.325842+0000","last_became_peered":"2023-01-02T18:16:48.325842+0000","last_unstale":"2023-01-02T18:17:24.325147+0000","last_undegraded":"2023-01-02T18:17:24.325147+0000","last_fullsized":"2023-01-02T18:17:24.325147+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":25,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":51,"num_keys_recovered":30,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1a","version":"56'2","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373350+0000","last_change":"2023-01-02T18:16:49.305216+0000","last_active":"2023-01-02T18:17:23.373350+0000","last_peered":"2023-01-02T18:17:23.373350+0000","last_clean":"2023-01-02T18:17:23.373350+0000","last_became_active":"2023-01-02T18:16:48.327069+0000","last_became_peered":"2023-01-02T18:16:48.327069+0000","last_unstale":"2023-01-02T18:17:23.373350+0000","last_undegraded":"2023-01-02T18:17:23.373350+0000","last_fullsized":"2023-01-02T18:17:23.373350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373914+0000","last_change":"2023-01-02T18:16:53.344282+0000","last_active":"2023-01-02T18:17:23.373914+0000","last_peered":"2023-01-02T18:17:23.373914+0000","last_clean":"2023-01-02T18:17:23.373914+0000","last_became_active":"2023-01-02T18:16:51.342864+0000","last_became_peered":"2023-01-02T18:16:51.342864+0000","last_unstale":"2023-01-02T18:17:23.373914+0000","last_undegraded":"2023-01-02T18:17:23.373914+0000","last_fullsized":"2023-01-02T18:17:23.373914+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":560,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369717+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:17:23.369717+0000","last_peered":"2023-01-02T18:17:23.369717+0000","last_clean":"2023-01-02T18:17:23.369717+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:17:23.369717+0000","last_undegraded":"2023-01-02T18:17:23.369717+0000","last_fullsized":"2023-01-02T18:17:23.369717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"76'79","reported_seq":552,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373349+0000","last_change":"2023-01-02T18:17:09.321800+0000","last_active":"2023-01-02T18:17:23.373349+0000","last_peered":"2023-01-02T18:17:23.373349+0000","last_clean":"2023-01-02T18:17:23.373349+0000","last_became_active":"2023-01-02T18:17:07.340907+0000","last_became_peered":"2023-01-02T18:17:07.340907+0000","last_unstale":"2023-01-02T18:17:23.373349+0000","last_undegraded":"2023-01-02T18:17:23.373349+0000","last_fullsized":"2023-01-02T18:17:23.373349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1144,"num_read_kb":1037,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'17","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373355+0000","last_change":"2023-01-02T18:17:01.321350+0000","last_active":"2023-01-02T18:17:23.373355+0000","last_peered":"2023-01-02T18:17:23.373355+0000","last_clean":"2023-01-02T18:17:23.373355+0000","last_became_active":"2023-01-02T18:16:59.310618+0000","last_became_peered":"2023-01-02T18:16:59.310618+0000","last_unstale":"2023-01-02T18:17:23.373355+0000","last_undegraded":"2023-01-02T18:17:23.373355+0000","last_fullsized":"2023-01-02T18:17:23.373355+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370998+0000","last_change":"2023-01-02T18:16:57.307585+0000","last_active":"2023-01-02T18:17:23.370998+0000","last_peered":"2023-01-02T18:17:23.370998+0000","last_clean":"2023-01-02T18:17:23.370998+0000","last_became_active":"2023-01-02T18:16:55.315726+0000","last_became_peered":"2023-01-02T18:16:55.315726+0000","last_unstale":"2023-01-02T18:17:23.370998+0000","last_undegraded":"2023-01-02T18:17:23.370998+0000","last_fullsized":"2023-01-02T18:17:23.370998+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375711+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:17:23.375711+0000","last_peered":"2023-01-02T18:17:23.375711+0000","last_clean":"2023-01-02T18:17:23.375711+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:17:23.375711+0000","last_undegraded":"2023-01-02T18:17:23.375711+0000","last_fullsized":"2023-01-02T18:17:23.375711+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.362867+0000","last_change":"2023-01-02T18:17:23.363161+0000","last_active":"2023-01-02T18:17:23.362867+0000","last_peered":"2023-01-02T18:17:23.362867+0000","last_clean":"2023-01-02T18:17:23.362867+0000","last_became_active":"2023-01-02T18:16:48.331845+0000","last_became_peered":"2023-01-02T18:16:48.331845+0000","last_unstale":"2023-01-02T18:17:23.362867+0000","last_undegraded":"2023-01-02T18:17:23.362867+0000","last_fullsized":"2023-01-02T18:17:23.362867+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"2"},{"start":"e","length":"1"}]},{"pgid":"5.1d","version":"0'0","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374255+0000","last_change":"2023-01-02T18:16:49.324534+0000","last_active":"2023-01-02T18:17:22.374255+0000","last_peered":"2023-01-02T18:17:22.374255+0000","last_clean":"2023-01-02T18:17:22.374255+0000","last_became_active":"2023-01-02T18:16:48.327014+0000","last_became_peered":"2023-01-02T18:16:48.327014+0000","last_unstale":"2023-01-02T18:17:22.374255+0000","last_undegraded":"2023-01-02T18:17:22.374255+0000","last_fullsized":"2023-01-02T18:17:22.374255+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371166+0000","last_change":"2023-01-02T18:16:53.604464+0000","last_active":"2023-01-02T18:17:23.371166+0000","last_peered":"2023-01-02T18:17:23.371166+0000","last_clean":"2023-01-02T18:17:23.371166+0000","last_became_active":"2023-01-02T18:16:51.343193+0000","last_became_peered":"2023-01-02T18:16:51.343193+0000","last_unstale":"2023-01-02T18:17:23.371166+0000","last_undegraded":"2023-01-02T18:17:23.371166+0000","last_fullsized":"2023-01-02T18:17:23.371166+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364770+0000","last_change":"2023-01-02T18:17:09.310675+0000","last_active":"2023-01-02T18:17:23.364770+0000","last_peered":"2023-01-02T18:17:23.364770+0000","last_clean":"2023-01-02T18:17:23.364770+0000","last_became_active":"2023-01-02T18:17:07.345963+0000","last_became_peered":"2023-01-02T18:17:07.345963+0000","last_unstale":"2023-01-02T18:17:23.364770+0000","last_undegraded":"2023-01-02T18:17:23.364770+0000","last_fullsized":"2023-01-02T18:17:23.364770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374003+0000","last_change":"2023-01-02T18:17:01.322905+0000","last_active":"2023-01-02T18:17:23.374003+0000","last_peered":"2023-01-02T18:17:23.374003+0000","last_clean":"2023-01-02T18:17:23.374003+0000","last_became_active":"2023-01-02T18:16:59.312747+0000","last_became_peered":"2023-01-02T18:16:59.312747+0000","last_unstale":"2023-01-02T18:17:23.374003+0000","last_undegraded":"2023-01-02T18:17:23.374003+0000","last_fullsized":"2023-01-02T18:17:23.374003+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364690+0000","last_change":"2023-01-02T18:16:49.309259+0000","last_active":"2023-01-02T18:17:23.364690+0000","last_peered":"2023-01-02T18:17:23.364690+0000","last_clean":"2023-01-02T18:17:23.364690+0000","last_became_active":"2023-01-02T18:16:46.313760+0000","last_became_peered":"2023-01-02T18:16:46.313760+0000","last_unstale":"2023-01-02T18:17:23.364690+0000","last_undegraded":"2023-01-02T18:17:23.364690+0000","last_fullsized":"2023-01-02T18:17:23.364690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370067+0000","last_change":"2023-01-02T18:16:48.358986+0000","last_active":"2023-01-02T18:17:23.370067+0000","last_peered":"2023-01-02T18:17:23.370067+0000","last_clean":"2023-01-02T18:17:23.370067+0000","last_became_active":"2023-01-02T18:16:48.336041+0000","last_became_peered":"2023-01-02T18:16:48.336041+0000","last_unstale":"2023-01-02T18:17:23.370067+0000","last_undegraded":"2023-01-02T18:17:23.370067+0000","last_fullsized":"2023-01-02T18:17:23.370067+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363770+0000","last_change":"2023-01-02T18:17:23.364273+0000","last_active":"2023-01-02T18:17:23.363770+0000","last_peered":"2023-01-02T18:17:23.363770+0000","last_clean":"2023-01-02T18:17:23.363770+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:17:23.363770+0000","last_undegraded":"2023-01-02T18:17:23.363770+0000","last_fullsized":"2023-01-02T18:17:23.363770+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371141+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:17:23.371141+0000","last_peered":"2023-01-02T18:17:23.371141+0000","last_clean":"2023-01-02T18:17:23.371141+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:17:23.371141+0000","last_undegraded":"2023-01-02T18:17:23.371141+0000","last_fullsized":"2023-01-02T18:17:23.371141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374181+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:17:23.374181+0000","last_peered":"2023-01-02T18:17:23.374181+0000","last_clean":"2023-01-02T18:17:23.374181+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:17:23.374181+0000","last_undegraded":"2023-01-02T18:17:23.374181+0000","last_fullsized":"2023-01-02T18:17:23.374181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366068+0000","last_change":"2023-01-02T18:16:57.312949+0000","last_active":"2023-01-02T18:17:23.366068+0000","last_peered":"2023-01-02T18:17:23.366068+0000","last_clean":"2023-01-02T18:17:23.366068+0000","last_became_active":"2023-01-02T18:16:55.315334+0000","last_became_peered":"2023-01-02T18:16:55.315334+0000","last_unstale":"2023-01-02T18:17:23.366068+0000","last_undegraded":"2023-01-02T18:17:23.366068+0000","last_fullsized":"2023-01-02T18:17:23.366068+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374488+0000","last_change":"2023-01-02T18:17:09.324343+0000","last_active":"2023-01-02T18:17:23.374488+0000","last_peered":"2023-01-02T18:17:23.374488+0000","last_clean":"2023-01-02T18:17:23.374488+0000","last_became_active":"2023-01-02T18:17:07.347667+0000","last_became_peered":"2023-01-02T18:17:07.347667+0000","last_unstale":"2023-01-02T18:17:23.374488+0000","last_undegraded":"2023-01-02T18:17:23.374488+0000","last_fullsized":"2023-01-02T18:17:23.374488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373431+0000","last_change":"2023-01-02T18:17:01.319510+0000","last_active":"2023-01-02T18:17:22.373431+0000","last_peered":"2023-01-02T18:17:22.373431+0000","last_clean":"2023-01-02T18:17:22.373431+0000","last_became_active":"2023-01-02T18:16:59.327716+0000","last_became_peered":"2023-01-02T18:16:59.327716+0000","last_unstale":"2023-01-02T18:17:22.373431+0000","last_undegraded":"2023-01-02T18:17:22.373431+0000","last_fullsized":"2023-01-02T18:17:22.373431+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365558+0000","last_change":"2023-01-02T18:16:49.310704+0000","last_active":"2023-01-02T18:17:23.365558+0000","last_peered":"2023-01-02T18:17:23.365558+0000","last_clean":"2023-01-02T18:17:23.365558+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:23.365558+0000","last_undegraded":"2023-01-02T18:17:23.365558+0000","last_fullsized":"2023-01-02T18:17:23.365558+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364238+0000","last_change":"2023-01-02T18:16:44.307480+0000","last_active":"2023-01-02T18:17:23.364238+0000","last_peered":"2023-01-02T18:17:23.364238+0000","last_clean":"2023-01-02T18:17:23.364238+0000","last_became_active":"2023-01-02T18:16:41.447912+0000","last_became_peered":"2023-01-02T18:16:41.447912+0000","last_unstale":"2023-01-02T18:17:23.364238+0000","last_undegraded":"2023-01-02T18:17:23.364238+0000","last_fullsized":"2023-01-02T18:17:23.364238+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377611+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:17:23.377611+0000","last_peered":"2023-01-02T18:17:23.377611+0000","last_clean":"2023-01-02T18:17:23.377611+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:17:23.377611+0000","last_undegraded":"2023-01-02T18:17:23.377611+0000","last_fullsized":"2023-01-02T18:17:23.377611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'12","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.322433+0000","last_change":"2023-01-02T18:17:24.322433+0000","last_active":"2023-01-02T18:17:24.322433+0000","last_peered":"2023-01-02T18:17:24.322433+0000","last_clean":"2023-01-02T18:17:24.322433+0000","last_became_active":"2023-01-02T18:16:37.431863+0000","last_became_peered":"2023-01-02T18:16:37.431863+0000","last_unstale":"2023-01-02T18:17:24.322433+0000","last_undegraded":"2023-01-02T18:17:24.322433+0000","last_fullsized":"2023-01-02T18:17:24.322433+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":35,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"6.2","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365986+0000","last_change":"2023-01-02T18:16:53.344851+0000","last_active":"2023-01-02T18:17:23.365986+0000","last_peered":"2023-01-02T18:17:23.365986+0000","last_clean":"2023-01-02T18:17:23.365986+0000","last_became_active":"2023-01-02T18:16:51.341804+0000","last_became_peered":"2023-01-02T18:16:51.341804+0000","last_unstale":"2023-01-02T18:17:23.365986+0000","last_undegraded":"2023-01-02T18:17:23.365986+0000","last_fullsized":"2023-01-02T18:17:23.365986+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365742+0000","last_change":"2023-01-02T18:16:57.313134+0000","last_active":"2023-01-02T18:17:23.365742+0000","last_peered":"2023-01-02T18:17:23.365742+0000","last_clean":"2023-01-02T18:17:23.365742+0000","last_became_active":"2023-01-02T18:16:55.311645+0000","last_became_peered":"2023-01-02T18:16:55.311645+0000","last_unstale":"2023-01-02T18:17:23.365742+0000","last_undegraded":"2023-01-02T18:17:23.365742+0000","last_fullsized":"2023-01-02T18:17:23.365742+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373922+0000","last_change":"2023-01-02T18:17:09.323298+0000","last_active":"2023-01-02T18:17:23.373922+0000","last_peered":"2023-01-02T18:17:23.373922+0000","last_clean":"2023-01-02T18:17:23.373922+0000","last_became_active":"2023-01-02T18:17:07.342742+0000","last_became_peered":"2023-01-02T18:17:07.342742+0000","last_unstale":"2023-01-02T18:17:23.373922+0000","last_undegraded":"2023-01-02T18:17:23.373922+0000","last_fullsized":"2023-01-02T18:17:23.373922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366253+0000","last_change":"2023-01-02T18:17:01.310492+0000","last_active":"2023-01-02T18:17:23.366253+0000","last_peered":"2023-01-02T18:17:23.366253+0000","last_clean":"2023-01-02T18:17:23.366253+0000","last_became_active":"2023-01-02T18:16:59.313793+0000","last_became_peered":"2023-01-02T18:16:59.313793+0000","last_unstale":"2023-01-02T18:17:23.366253+0000","last_undegraded":"2023-01-02T18:17:23.366253+0000","last_fullsized":"2023-01-02T18:17:23.366253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"56'1","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370249+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:17:23.370249+0000","last_peered":"2023-01-02T18:17:23.370249+0000","last_clean":"2023-01-02T18:17:23.370249+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:17:23.370249+0000","last_undegraded":"2023-01-02T18:17:23.370249+0000","last_fullsized":"2023-01-02T18:17:23.370249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":123,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374923+0000","last_change":"2023-01-02T18:16:44.300067+0000","last_active":"2023-01-02T18:17:23.374923+0000","last_peered":"2023-01-02T18:17:23.374923+0000","last_clean":"2023-01-02T18:17:23.374923+0000","last_became_active":"2023-01-02T18:16:42.450970+0000","last_became_peered":"2023-01-02T18:16:42.450970+0000","last_unstale":"2023-01-02T18:17:23.374923+0000","last_undegraded":"2023-01-02T18:17:23.374923+0000","last_fullsized":"2023-01-02T18:17:23.374923+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":83,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"46'2","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.311347+0000","last_change":"2023-01-02T18:17:24.311593+0000","last_active":"2023-01-02T18:17:24.311347+0000","last_peered":"2023-01-02T18:17:24.311347+0000","last_clean":"2023-01-02T18:17:24.311347+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:17:24.311347+0000","last_undegraded":"2023-01-02T18:17:24.311347+0000","last_fullsized":"2023-01-02T18:17:24.311347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374063+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:17:23.374063+0000","last_peered":"2023-01-02T18:17:23.374063+0000","last_clean":"2023-01-02T18:17:23.374063+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:17:23.374063+0000","last_undegraded":"2023-01-02T18:17:23.374063+0000","last_fullsized":"2023-01-02T18:17:23.374063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370381+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:17:23.370381+0000","last_peered":"2023-01-02T18:17:23.370381+0000","last_clean":"2023-01-02T18:17:23.370381+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:17:23.370381+0000","last_undegraded":"2023-01-02T18:17:23.370381+0000","last_fullsized":"2023-01-02T18:17:23.370381+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364052+0000","last_change":"2023-01-02T18:16:57.312360+0000","last_active":"2023-01-02T18:17:23.364052+0000","last_peered":"2023-01-02T18:17:23.364052+0000","last_clean":"2023-01-02T18:17:23.364052+0000","last_became_active":"2023-01-02T18:16:55.317478+0000","last_became_peered":"2023-01-02T18:16:55.317478+0000","last_unstale":"2023-01-02T18:17:23.364052+0000","last_undegraded":"2023-01-02T18:17:23.364052+0000","last_fullsized":"2023-01-02T18:17:23.364052+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373139+0000","last_change":"2023-01-02T18:17:09.321395+0000","last_active":"2023-01-02T18:17:22.373139+0000","last_peered":"2023-01-02T18:17:22.373139+0000","last_clean":"2023-01-02T18:17:22.373139+0000","last_became_active":"2023-01-02T18:17:07.344789+0000","last_became_peered":"2023-01-02T18:17:07.344789+0000","last_unstale":"2023-01-02T18:17:22.373139+0000","last_undegraded":"2023-01-02T18:17:22.373139+0000","last_fullsized":"2023-01-02T18:17:22.373139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"71'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373590+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:17:23.373590+0000","last_peered":"2023-01-02T18:17:23.373590+0000","last_clean":"2023-01-02T18:17:23.373590+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:17:23.373590+0000","last_undegraded":"2023-01-02T18:17:23.373590+0000","last_fullsized":"2023-01-02T18:17:23.373590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'2","reported_seq":57,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373729+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:17:22.373729+0000","last_peered":"2023-01-02T18:17:22.373729+0000","last_clean":"2023-01-02T18:17:22.373729+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:17:22.373729+0000","last_undegraded":"2023-01-02T18:17:22.373729+0000","last_fullsized":"2023-01-02T18:17:22.373729+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"46'13","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.362124+0000","last_change":"2023-01-02T18:17:23.362426+0000","last_active":"2023-01-02T18:17:23.362124+0000","last_peered":"2023-01-02T18:17:23.362124+0000","last_clean":"2023-01-02T18:17:23.362124+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:23.362124+0000","last_undegraded":"2023-01-02T18:17:23.362124+0000","last_fullsized":"2023-01-02T18:17:23.362124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":92,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.367326+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:17:23.367326+0000","last_peered":"2023-01-02T18:17:23.367326+0000","last_clean":"2023-01-02T18:17:23.367326+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:17:23.367326+0000","last_undegraded":"2023-01-02T18:17:23.367326+0000","last_fullsized":"2023-01-02T18:17:23.367326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377645+0000","last_change":"2023-01-02T18:16:49.298888+0000","last_active":"2023-01-02T18:17:23.377645+0000","last_peered":"2023-01-02T18:17:23.377645+0000","last_clean":"2023-01-02T18:17:23.377645+0000","last_became_active":"2023-01-02T18:16:46.314689+0000","last_became_peered":"2023-01-02T18:16:46.314689+0000","last_unstale":"2023-01-02T18:17:23.377645+0000","last_undegraded":"2023-01-02T18:17:23.377645+0000","last_fullsized":"2023-01-02T18:17:23.377645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375415+0000","last_change":"2023-01-02T18:16:53.344265+0000","last_active":"2023-01-02T18:17:23.375415+0000","last_peered":"2023-01-02T18:17:23.375415+0000","last_clean":"2023-01-02T18:17:23.375415+0000","last_became_active":"2023-01-02T18:16:51.342951+0000","last_became_peered":"2023-01-02T18:16:51.342951+0000","last_unstale":"2023-01-02T18:17:23.375415+0000","last_undegraded":"2023-01-02T18:17:23.375415+0000","last_fullsized":"2023-01-02T18:17:23.375415+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374300+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:17:23.374300+0000","last_peered":"2023-01-02T18:17:23.374300+0000","last_clean":"2023-01-02T18:17:23.374300+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:17:23.374300+0000","last_undegraded":"2023-01-02T18:17:23.374300+0000","last_fullsized":"2023-01-02T18:17:23.374300+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363837+0000","last_change":"2023-01-02T18:17:09.306719+0000","last_active":"2023-01-02T18:17:23.363837+0000","last_peered":"2023-01-02T18:17:23.363837+0000","last_clean":"2023-01-02T18:17:23.363837+0000","last_became_active":"2023-01-02T18:17:07.336185+0000","last_became_peered":"2023-01-02T18:17:07.336185+0000","last_unstale":"2023-01-02T18:17:23.363837+0000","last_undegraded":"2023-01-02T18:17:23.363837+0000","last_fullsized":"2023-01-02T18:17:23.363837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370225+0000","last_change":"2023-01-02T18:17:01.316849+0000","last_active":"2023-01-02T18:17:23.370225+0000","last_peered":"2023-01-02T18:17:23.370225+0000","last_clean":"2023-01-02T18:17:23.370225+0000","last_became_active":"2023-01-02T18:16:59.320366+0000","last_became_peered":"2023-01-02T18:16:59.320366+0000","last_unstale":"2023-01-02T18:17:23.370225+0000","last_undegraded":"2023-01-02T18:17:23.370225+0000","last_fullsized":"2023-01-02T18:17:23.370225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374915+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:17:23.374915+0000","last_peered":"2023-01-02T18:17:23.374915+0000","last_clean":"2023-01-02T18:17:23.374915+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:17:23.374915+0000","last_undegraded":"2023-01-02T18:17:23.374915+0000","last_fullsized":"2023-01-02T18:17:23.374915+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370857+0000","last_change":"2023-01-02T18:16:48.345373+0000","last_active":"2023-01-02T18:17:23.370857+0000","last_peered":"2023-01-02T18:17:23.370857+0000","last_clean":"2023-01-02T18:17:23.370857+0000","last_became_active":"2023-01-02T18:16:48.328041+0000","last_became_peered":"2023-01-02T18:16:48.328041+0000","last_unstale":"2023-01-02T18:17:23.370857+0000","last_undegraded":"2023-01-02T18:17:23.370857+0000","last_fullsized":"2023-01-02T18:17:23.370857+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'6","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.317654+0000","last_change":"2023-01-02T18:17:24.317942+0000","last_active":"2023-01-02T18:17:24.317654+0000","last_peered":"2023-01-02T18:17:24.317654+0000","last_clean":"2023-01-02T18:17:24.317654+0000","last_became_active":"2023-01-02T18:16:42.441589+0000","last_became_peered":"2023-01-02T18:16:42.441589+0000","last_unstale":"2023-01-02T18:17:24.317654+0000","last_undegraded":"2023-01-02T18:17:24.317654+0000","last_fullsized":"2023-01-02T18:17:24.317654+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373410+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:17:23.373410+0000","last_peered":"2023-01-02T18:17:23.373410+0000","last_clean":"2023-01-02T18:17:23.373410+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:17:23.373410+0000","last_undegraded":"2023-01-02T18:17:23.373410+0000","last_fullsized":"2023-01-02T18:17:23.373410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374695+0000","last_change":"2023-01-02T18:16:42.460481+0000","last_active":"2023-01-02T18:17:23.374695+0000","last_peered":"2023-01-02T18:17:23.374695+0000","last_clean":"2023-01-02T18:17:23.374695+0000","last_became_active":"2023-01-02T18:16:42.460130+0000","last_became_peered":"2023-01-02T18:16:42.460130+0000","last_unstale":"2023-01-02T18:17:23.374695+0000","last_undegraded":"2023-01-02T18:17:23.374695+0000","last_fullsized":"2023-01-02T18:17:23.374695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":562,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.367208+0000","last_change":"2023-01-02T18:16:53.345442+0000","last_active":"2023-01-02T18:17:23.367208+0000","last_peered":"2023-01-02T18:17:23.367208+0000","last_clean":"2023-01-02T18:17:23.367208+0000","last_became_active":"2023-01-02T18:16:51.341121+0000","last_became_peered":"2023-01-02T18:16:51.341121+0000","last_unstale":"2023-01-02T18:17:23.367208+0000","last_undegraded":"2023-01-02T18:17:23.367208+0000","last_fullsized":"2023-01-02T18:17:23.367208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373984+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:17:22.373984+0000","last_peered":"2023-01-02T18:17:22.373984+0000","last_clean":"2023-01-02T18:17:22.373984+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:17:22.373984+0000","last_undegraded":"2023-01-02T18:17:22.373984+0000","last_fullsized":"2023-01-02T18:17:22.373984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"76'9","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373452+0000","last_change":"2023-01-02T18:17:09.322846+0000","last_active":"2023-01-02T18:17:23.373452+0000","last_peered":"2023-01-02T18:17:23.373452+0000","last_clean":"2023-01-02T18:17:23.373452+0000","last_became_active":"2023-01-02T18:17:07.342985+0000","last_became_peered":"2023-01-02T18:17:07.342985+0000","last_unstale":"2023-01-02T18:17:23.373452+0000","last_undegraded":"2023-01-02T18:17:23.373452+0000","last_fullsized":"2023-01-02T18:17:23.373452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"72'1","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364813+0000","last_change":"2023-01-02T18:17:01.311985+0000","last_active":"2023-01-02T18:17:23.364813+0000","last_peered":"2023-01-02T18:17:23.364813+0000","last_clean":"2023-01-02T18:17:23.364813+0000","last_became_active":"2023-01-02T18:16:59.316880+0000","last_became_peered":"2023-01-02T18:16:59.316880+0000","last_unstale":"2023-01-02T18:17:23.364813+0000","last_undegraded":"2023-01-02T18:17:23.364813+0000","last_fullsized":"2023-01-02T18:17:23.364813+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377506+0000","last_change":"2023-01-02T18:16:44.298099+0000","last_active":"2023-01-02T18:17:23.377506+0000","last_peered":"2023-01-02T18:17:23.377506+0000","last_clean":"2023-01-02T18:17:23.377506+0000","last_became_active":"2023-01-02T18:16:42.439207+0000","last_became_peered":"2023-01-02T18:16:42.439207+0000","last_unstale":"2023-01-02T18:17:23.377506+0000","last_undegraded":"2023-01-02T18:17:23.377506+0000","last_fullsized":"2023-01-02T18:17:23.377506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"90'10","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.311297+0000","last_change":"2023-01-02T18:17:24.311558+0000","last_active":"2023-01-02T18:17:24.311297+0000","last_peered":"2023-01-02T18:17:24.311297+0000","last_clean":"2023-01-02T18:17:24.311297+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:17:24.311297+0000","last_undegraded":"2023-01-02T18:17:24.311297+0000","last_fullsized":"2023-01-02T18:17:24.311297+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":84,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364725+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:17:23.364725+0000","last_peered":"2023-01-02T18:17:23.364725+0000","last_clean":"2023-01-02T18:17:23.364725+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:17:23.364725+0000","last_undegraded":"2023-01-02T18:17:23.364725+0000","last_fullsized":"2023-01-02T18:17:23.364725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377430+0000","last_change":"2023-01-02T18:16:49.298954+0000","last_active":"2023-01-02T18:17:23.377430+0000","last_peered":"2023-01-02T18:17:23.377430+0000","last_clean":"2023-01-02T18:17:23.377430+0000","last_became_active":"2023-01-02T18:16:46.316378+0000","last_became_peered":"2023-01-02T18:16:46.316378+0000","last_unstale":"2023-01-02T18:17:23.377430+0000","last_undegraded":"2023-01-02T18:17:23.377430+0000","last_fullsized":"2023-01-02T18:17:23.377430+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374202+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:17:23.374202+0000","last_peered":"2023-01-02T18:17:23.374202+0000","last_clean":"2023-01-02T18:17:23.374202+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:17:23.374202+0000","last_undegraded":"2023-01-02T18:17:23.374202+0000","last_fullsized":"2023-01-02T18:17:23.374202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373328+0000","last_change":"2023-01-02T18:16:57.306312+0000","last_active":"2023-01-02T18:17:22.373328+0000","last_peered":"2023-01-02T18:17:22.373328+0000","last_clean":"2023-01-02T18:17:22.373328+0000","last_became_active":"2023-01-02T18:16:55.314537+0000","last_became_peered":"2023-01-02T18:16:55.314537+0000","last_unstale":"2023-01-02T18:17:22.373328+0000","last_undegraded":"2023-01-02T18:17:22.373328+0000","last_fullsized":"2023-01-02T18:17:22.373328+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"76'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373453+0000","last_change":"2023-01-02T18:17:09.322082+0000","last_active":"2023-01-02T18:17:23.373453+0000","last_peered":"2023-01-02T18:17:23.373453+0000","last_clean":"2023-01-02T18:17:23.373453+0000","last_became_active":"2023-01-02T18:17:07.340751+0000","last_became_peered":"2023-01-02T18:17:07.340751+0000","last_unstale":"2023-01-02T18:17:23.373453+0000","last_undegraded":"2023-01-02T18:17:23.373453+0000","last_fullsized":"2023-01-02T18:17:23.373453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363949+0000","last_change":"2023-01-02T18:17:01.311731+0000","last_active":"2023-01-02T18:17:23.363949+0000","last_peered":"2023-01-02T18:17:23.363949+0000","last_clean":"2023-01-02T18:17:23.363949+0000","last_became_active":"2023-01-02T18:16:59.312608+0000","last_became_peered":"2023-01-02T18:16:59.312608+0000","last_unstale":"2023-01-02T18:17:23.363949+0000","last_undegraded":"2023-01-02T18:17:23.363949+0000","last_fullsized":"2023-01-02T18:17:23.363949+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375557+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:17:23.375557+0000","last_peered":"2023-01-02T18:17:23.375557+0000","last_clean":"2023-01-02T18:17:23.375557+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:17:23.375557+0000","last_undegraded":"2023-01-02T18:17:23.375557+0000","last_fullsized":"2023-01-02T18:17:23.375557+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"85'12","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.325049+0000","last_change":"2023-01-02T18:17:24.325499+0000","last_active":"2023-01-02T18:17:24.325049+0000","last_peered":"2023-01-02T18:17:24.325049+0000","last_clean":"2023-01-02T18:17:24.325049+0000","last_became_active":"2023-01-02T18:16:48.335418+0000","last_became_peered":"2023-01-02T18:16:48.335418+0000","last_unstale":"2023-01-02T18:17:24.325049+0000","last_undegraded":"2023-01-02T18:17:24.325049+0000","last_fullsized":"2023-01-02T18:17:24.325049+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374708+0000","last_change":"2023-01-02T18:16:42.442424+0000","last_active":"2023-01-02T18:17:23.374708+0000","last_peered":"2023-01-02T18:17:23.374708+0000","last_clean":"2023-01-02T18:17:23.374708+0000","last_became_active":"2023-01-02T18:16:42.442110+0000","last_became_peered":"2023-01-02T18:16:42.442110+0000","last_unstale":"2023-01-02T18:17:23.374708+0000","last_undegraded":"2023-01-02T18:17:23.374708+0000","last_fullsized":"2023-01-02T18:17:23.374708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374162+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:17:22.374162+0000","last_peered":"2023-01-02T18:17:22.374162+0000","last_clean":"2023-01-02T18:17:22.374162+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:17:22.374162+0000","last_undegraded":"2023-01-02T18:17:22.374162+0000","last_fullsized":"2023-01-02T18:17:22.374162+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365380+0000","last_change":"2023-01-02T18:16:53.345663+0000","last_active":"2023-01-02T18:17:23.365380+0000","last_peered":"2023-01-02T18:17:23.365380+0000","last_clean":"2023-01-02T18:17:23.365380+0000","last_became_active":"2023-01-02T18:16:51.341075+0000","last_became_peered":"2023-01-02T18:16:51.341075+0000","last_unstale":"2023-01-02T18:17:23.365380+0000","last_undegraded":"2023-01-02T18:17:23.365380+0000","last_fullsized":"2023-01-02T18:17:23.365380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371402+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:17:23.371402+0000","last_peered":"2023-01-02T18:17:23.371402+0000","last_clean":"2023-01-02T18:17:23.371402+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:17:23.371402+0000","last_undegraded":"2023-01-02T18:17:23.371402+0000","last_fullsized":"2023-01-02T18:17:23.371402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365700+0000","last_change":"2023-01-02T18:17:09.315581+0000","last_active":"2023-01-02T18:17:23.365700+0000","last_peered":"2023-01-02T18:17:23.365700+0000","last_clean":"2023-01-02T18:17:23.365700+0000","last_became_active":"2023-01-02T18:17:07.337862+0000","last_became_peered":"2023-01-02T18:17:07.337862+0000","last_unstale":"2023-01-02T18:17:23.365700+0000","last_undegraded":"2023-01-02T18:17:23.365700+0000","last_fullsized":"2023-01-02T18:17:23.365700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373526+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:17:22.373526+0000","last_peered":"2023-01-02T18:17:22.373526+0000","last_clean":"2023-01-02T18:17:22.373526+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:17:22.373526+0000","last_undegraded":"2023-01-02T18:17:22.373526+0000","last_fullsized":"2023-01-02T18:17:22.373526+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'4","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370531+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:17:23.370531+0000","last_peered":"2023-01-02T18:17:23.370531+0000","last_clean":"2023-01-02T18:17:23.370531+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:23.370531+0000","last_undegraded":"2023-01-02T18:17:23.370531+0000","last_fullsized":"2023-01-02T18:17:23.370531+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375238+0000","last_change":"2023-01-02T18:16:48.336174+0000","last_active":"2023-01-02T18:17:23.375238+0000","last_peered":"2023-01-02T18:17:23.375238+0000","last_clean":"2023-01-02T18:17:23.375238+0000","last_became_active":"2023-01-02T18:16:48.335738+0000","last_became_peered":"2023-01-02T18:16:48.335738+0000","last_unstale":"2023-01-02T18:17:23.375238+0000","last_undegraded":"2023-01-02T18:17:23.375238+0000","last_fullsized":"2023-01-02T18:17:23.375238+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"82'2","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.319986+0000","last_change":"2023-01-02T18:17:24.320205+0000","last_active":"2023-01-02T18:17:24.319986+0000","last_peered":"2023-01-02T18:17:24.319986+0000","last_clean":"2023-01-02T18:17:24.319986+0000","last_became_active":"2023-01-02T18:16:42.461031+0000","last_became_peered":"2023-01-02T18:16:42.461031+0000","last_unstale":"2023-01-02T18:17:24.319986+0000","last_undegraded":"2023-01-02T18:17:24.319986+0000","last_fullsized":"2023-01-02T18:17:24.319986+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375633+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:17:23.375633+0000","last_peered":"2023-01-02T18:17:23.375633+0000","last_clean":"2023-01-02T18:17:23.375633+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:17:23.375633+0000","last_undegraded":"2023-01-02T18:17:23.375633+0000","last_fullsized":"2023-01-02T18:17:23.375633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372622+0000","last_change":"2023-01-02T18:16:53.685845+0000","last_active":"2023-01-02T18:17:22.372622+0000","last_peered":"2023-01-02T18:17:22.372622+0000","last_clean":"2023-01-02T18:17:22.372622+0000","last_became_active":"2023-01-02T18:16:51.345111+0000","last_became_peered":"2023-01-02T18:16:51.345111+0000","last_unstale":"2023-01-02T18:17:22.372622+0000","last_undegraded":"2023-01-02T18:17:22.372622+0000","last_fullsized":"2023-01-02T18:17:22.372622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364338+0000","last_change":"2023-01-02T18:16:57.312915+0000","last_active":"2023-01-02T18:17:23.364338+0000","last_peered":"2023-01-02T18:17:23.364338+0000","last_clean":"2023-01-02T18:17:23.364338+0000","last_became_active":"2023-01-02T18:16:55.310046+0000","last_became_peered":"2023-01-02T18:16:55.310046+0000","last_unstale":"2023-01-02T18:17:23.364338+0000","last_undegraded":"2023-01-02T18:17:23.364338+0000","last_fullsized":"2023-01-02T18:17:23.364338+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"76'12","reported_seq":140,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364321+0000","last_change":"2023-01-02T18:17:09.308235+0000","last_active":"2023-01-02T18:17:23.364321+0000","last_peered":"2023-01-02T18:17:23.364321+0000","last_clean":"2023-01-02T18:17:23.364321+0000","last_became_active":"2023-01-02T18:17:07.340498+0000","last_became_peered":"2023-01-02T18:17:07.340498+0000","last_unstale":"2023-01-02T18:17:23.364321+0000","last_undegraded":"2023-01-02T18:17:23.364321+0000","last_fullsized":"2023-01-02T18:17:23.364321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"69'1","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370475+0000","last_change":"2023-01-02T18:17:01.317345+0000","last_active":"2023-01-02T18:17:23.370475+0000","last_peered":"2023-01-02T18:17:23.370475+0000","last_clean":"2023-01-02T18:17:23.370475+0000","last_became_active":"2023-01-02T18:16:59.309565+0000","last_became_peered":"2023-01-02T18:16:59.309565+0000","last_unstale":"2023-01-02T18:17:23.370475+0000","last_undegraded":"2023-01-02T18:17:23.370475+0000","last_fullsized":"2023-01-02T18:17:23.370475+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":11,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377418+0000","last_change":"2023-01-02T18:16:44.298243+0000","last_active":"2023-01-02T18:17:23.377418+0000","last_peered":"2023-01-02T18:17:23.377418+0000","last_clean":"2023-01-02T18:17:23.377418+0000","last_became_active":"2023-01-02T18:16:41.448643+0000","last_became_peered":"2023-01-02T18:16:41.448643+0000","last_unstale":"2023-01-02T18:17:23.377418+0000","last_undegraded":"2023-01-02T18:17:23.377418+0000","last_fullsized":"2023-01-02T18:17:23.377418+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"76'8","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.317126+0000","last_change":"2023-01-02T18:17:24.317864+0000","last_active":"2023-01-02T18:17:24.317126+0000","last_peered":"2023-01-02T18:17:24.317126+0000","last_clean":"2023-01-02T18:17:24.317126+0000","last_became_active":"2023-01-02T18:16:37.414106+0000","last_became_peered":"2023-01-02T18:16:37.414106+0000","last_unstale":"2023-01-02T18:17:24.317126+0000","last_undegraded":"2023-01-02T18:17:24.317126+0000","last_fullsized":"2023-01-02T18:17:24.317126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.e","version":"0'0","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374055+0000","last_change":"2023-01-02T18:16:49.324748+0000","last_active":"2023-01-02T18:17:22.374055+0000","last_peered":"2023-01-02T18:17:22.374055+0000","last_clean":"2023-01-02T18:17:22.374055+0000","last_became_active":"2023-01-02T18:16:48.317958+0000","last_became_peered":"2023-01-02T18:16:48.317958+0000","last_unstale":"2023-01-02T18:17:22.374055+0000","last_undegraded":"2023-01-02T18:17:22.374055+0000","last_fullsized":"2023-01-02T18:17:22.374055+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374268+0000","last_change":"2023-01-02T18:16:53.686661+0000","last_active":"2023-01-02T18:17:22.374268+0000","last_peered":"2023-01-02T18:17:22.374268+0000","last_clean":"2023-01-02T18:17:22.374268+0000","last_became_active":"2023-01-02T18:16:51.345330+0000","last_became_peered":"2023-01-02T18:16:51.345330+0000","last_unstale":"2023-01-02T18:17:22.374268+0000","last_undegraded":"2023-01-02T18:17:22.374268+0000","last_fullsized":"2023-01-02T18:17:22.374268+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370786+0000","last_change":"2023-01-02T18:16:57.307540+0000","last_active":"2023-01-02T18:17:23.370786+0000","last_peered":"2023-01-02T18:17:23.370786+0000","last_clean":"2023-01-02T18:17:23.370786+0000","last_became_active":"2023-01-02T18:16:55.319082+0000","last_became_peered":"2023-01-02T18:16:55.319082+0000","last_unstale":"2023-01-02T18:17:23.370786+0000","last_undegraded":"2023-01-02T18:17:23.370786+0000","last_fullsized":"2023-01-02T18:17:23.370786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"76'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374824+0000","last_change":"2023-01-02T18:17:09.323147+0000","last_active":"2023-01-02T18:17:23.374824+0000","last_peered":"2023-01-02T18:17:23.374824+0000","last_clean":"2023-01-02T18:17:23.374824+0000","last_became_active":"2023-01-02T18:17:07.341052+0000","last_became_peered":"2023-01-02T18:17:07.341052+0000","last_unstale":"2023-01-02T18:17:23.374824+0000","last_undegraded":"2023-01-02T18:17:23.374824+0000","last_fullsized":"2023-01-02T18:17:23.374824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372809+0000","last_change":"2023-01-02T18:17:01.318897+0000","last_active":"2023-01-02T18:17:22.372809+0000","last_peered":"2023-01-02T18:17:22.372809+0000","last_clean":"2023-01-02T18:17:22.372809+0000","last_became_active":"2023-01-02T18:16:59.321009+0000","last_became_peered":"2023-01-02T18:16:59.321009+0000","last_unstale":"2023-01-02T18:17:22.372809+0000","last_undegraded":"2023-01-02T18:17:22.372809+0000","last_fullsized":"2023-01-02T18:17:22.372809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"51'1","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371082+0000","last_change":"2023-01-02T18:16:48.352507+0000","last_active":"2023-01-02T18:17:23.371082+0000","last_peered":"2023-01-02T18:17:23.371082+0000","last_clean":"2023-01-02T18:17:23.371082+0000","last_became_active":"2023-01-02T18:16:48.330483+0000","last_became_peered":"2023-01-02T18:16:48.330483+0000","last_unstale":"2023-01-02T18:17:23.371082+0000","last_undegraded":"2023-01-02T18:17:23.371082+0000","last_fullsized":"2023-01-02T18:17:23.371082+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.334862+0000","last_change":"2023-01-02T18:17:24.335074+0000","last_active":"2023-01-02T18:17:24.334862+0000","last_peered":"2023-01-02T18:17:24.334862+0000","last_clean":"2023-01-02T18:17:24.334862+0000","last_became_active":"2023-01-02T18:16:48.322710+0000","last_became_peered":"2023-01-02T18:16:48.322710+0000","last_unstale":"2023-01-02T18:17:24.334862+0000","last_undegraded":"2023-01-02T18:17:24.334862+0000","last_fullsized":"2023-01-02T18:17:24.334862+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.f","version":"0'0","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371320+0000","last_change":"2023-01-02T18:16:49.319064+0000","last_active":"2023-01-02T18:17:23.371320+0000","last_peered":"2023-01-02T18:17:23.371320+0000","last_clean":"2023-01-02T18:17:23.371320+0000","last_became_active":"2023-01-02T18:16:48.324476+0000","last_became_peered":"2023-01-02T18:16:48.324476+0000","last_unstale":"2023-01-02T18:17:23.371320+0000","last_undegraded":"2023-01-02T18:17:23.371320+0000","last_fullsized":"2023-01-02T18:17:23.371320+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365275+0000","last_change":"2023-01-02T18:16:53.345390+0000","last_active":"2023-01-02T18:17:23.365275+0000","last_peered":"2023-01-02T18:17:23.365275+0000","last_clean":"2023-01-02T18:17:23.365275+0000","last_became_active":"2023-01-02T18:16:51.339020+0000","last_became_peered":"2023-01-02T18:16:51.339020+0000","last_unstale":"2023-01-02T18:17:23.365275+0000","last_undegraded":"2023-01-02T18:17:23.365275+0000","last_fullsized":"2023-01-02T18:17:23.365275+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371193+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:17:23.371193+0000","last_peered":"2023-01-02T18:17:23.371193+0000","last_clean":"2023-01-02T18:17:23.371193+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:17:23.371193+0000","last_undegraded":"2023-01-02T18:17:23.371193+0000","last_fullsized":"2023-01-02T18:17:23.371193+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369215+0000","last_change":"2023-01-02T18:17:09.330500+0000","last_active":"2023-01-02T18:17:23.369215+0000","last_peered":"2023-01-02T18:17:23.369215+0000","last_clean":"2023-01-02T18:17:23.369215+0000","last_became_active":"2023-01-02T18:17:07.345902+0000","last_became_peered":"2023-01-02T18:17:07.345902+0000","last_unstale":"2023-01-02T18:17:23.369215+0000","last_undegraded":"2023-01-02T18:17:23.369215+0000","last_fullsized":"2023-01-02T18:17:23.369215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373529+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:17:23.373529+0000","last_peered":"2023-01-02T18:17:23.373529+0000","last_clean":"2023-01-02T18:17:23.373529+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:17:23.373529+0000","last_undegraded":"2023-01-02T18:17:23.373529+0000","last_fullsized":"2023-01-02T18:17:23.373529+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.376891+0000","last_change":"2023-01-02T18:16:48.329052+0000","last_active":"2023-01-02T18:17:23.376891+0000","last_peered":"2023-01-02T18:17:23.376891+0000","last_clean":"2023-01-02T18:17:23.376891+0000","last_became_active":"2023-01-02T18:16:48.327662+0000","last_became_peered":"2023-01-02T18:16:48.327662+0000","last_unstale":"2023-01-02T18:17:23.376891+0000","last_undegraded":"2023-01-02T18:17:23.376891+0000","last_fullsized":"2023-01-02T18:17:23.376891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'4","reported_seq":114,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.324519+0000","last_change":"2023-01-02T18:17:24.324710+0000","last_active":"2023-01-02T18:17:24.324519+0000","last_peered":"2023-01-02T18:17:24.324519+0000","last_clean":"2023-01-02T18:17:24.324519+0000","last_became_active":"2023-01-02T18:16:48.329461+0000","last_became_peered":"2023-01-02T18:16:48.329461+0000","last_unstale":"2023-01-02T18:17:24.324519+0000","last_undegraded":"2023-01-02T18:17:24.324519+0000","last_fullsized":"2023-01-02T18:17:24.324519+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.c","version":"0'0","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373224+0000","last_change":"2023-01-02T18:16:49.323150+0000","last_active":"2023-01-02T18:17:22.373224+0000","last_peered":"2023-01-02T18:17:22.373224+0000","last_clean":"2023-01-02T18:17:22.373224+0000","last_became_active":"2023-01-02T18:16:48.326635+0000","last_became_peered":"2023-01-02T18:16:48.326635+0000","last_unstale":"2023-01-02T18:17:22.373224+0000","last_undegraded":"2023-01-02T18:17:22.373224+0000","last_fullsized":"2023-01-02T18:17:22.373224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366670+0000","last_change":"2023-01-02T18:16:53.345223+0000","last_active":"2023-01-02T18:17:23.366670+0000","last_peered":"2023-01-02T18:17:23.366670+0000","last_clean":"2023-01-02T18:17:23.366670+0000","last_became_active":"2023-01-02T18:16:51.341580+0000","last_became_peered":"2023-01-02T18:16:51.341580+0000","last_unstale":"2023-01-02T18:17:23.366670+0000","last_undegraded":"2023-01-02T18:17:23.366670+0000","last_fullsized":"2023-01-02T18:17:23.366670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377626+0000","last_change":"2023-01-02T18:16:57.305459+0000","last_active":"2023-01-02T18:17:23.377626+0000","last_peered":"2023-01-02T18:17:23.377626+0000","last_clean":"2023-01-02T18:17:23.377626+0000","last_became_active":"2023-01-02T18:16:55.315865+0000","last_became_peered":"2023-01-02T18:16:55.315865+0000","last_unstale":"2023-01-02T18:17:23.377626+0000","last_undegraded":"2023-01-02T18:17:23.377626+0000","last_fullsized":"2023-01-02T18:17:23.377626+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364146+0000","last_change":"2023-01-02T18:17:09.307789+0000","last_active":"2023-01-02T18:17:23.364146+0000","last_peered":"2023-01-02T18:17:23.364146+0000","last_clean":"2023-01-02T18:17:23.364146+0000","last_became_active":"2023-01-02T18:17:07.345090+0000","last_became_peered":"2023-01-02T18:17:07.345090+0000","last_unstale":"2023-01-02T18:17:23.364146+0000","last_undegraded":"2023-01-02T18:17:23.364146+0000","last_fullsized":"2023-01-02T18:17:23.364146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"72'11","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363954+0000","last_change":"2023-01-02T18:17:01.311899+0000","last_active":"2023-01-02T18:17:23.363954+0000","last_peered":"2023-01-02T18:17:23.363954+0000","last_clean":"2023-01-02T18:17:23.363954+0000","last_became_active":"2023-01-02T18:16:59.309612+0000","last_became_peered":"2023-01-02T18:16:59.309612+0000","last_unstale":"2023-01-02T18:17:23.363954+0000","last_undegraded":"2023-01-02T18:17:23.363954+0000","last_fullsized":"2023-01-02T18:17:23.363954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":64,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365321+0000","last_change":"2023-01-02T18:16:48.328829+0000","last_active":"2023-01-02T18:17:23.365321+0000","last_peered":"2023-01-02T18:17:23.365321+0000","last_clean":"2023-01-02T18:17:23.365321+0000","last_became_active":"2023-01-02T18:16:48.328372+0000","last_became_peered":"2023-01-02T18:16:48.328372+0000","last_unstale":"2023-01-02T18:17:23.365321+0000","last_undegraded":"2023-01-02T18:17:23.365321+0000","last_fullsized":"2023-01-02T18:17:23.365321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.321028+0000","last_change":"2023-01-02T18:17:24.321209+0000","last_active":"2023-01-02T18:17:24.321028+0000","last_peered":"2023-01-02T18:17:24.321028+0000","last_clean":"2023-01-02T18:17:24.321028+0000","last_became_active":"2023-01-02T18:16:37.415896+0000","last_became_peered":"2023-01-02T18:16:37.415896+0000","last_unstale":"2023-01-02T18:17:24.321028+0000","last_undegraded":"2023-01-02T18:17:24.321028+0000","last_fullsized":"2023-01-02T18:17:24.321028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.d","version":"56'3","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373942+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:17:23.373942+0000","last_peered":"2023-01-02T18:17:23.373942+0000","last_clean":"2023-01-02T18:17:23.373942+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:17:23.373942+0000","last_undegraded":"2023-01-02T18:17:23.373942+0000","last_fullsized":"2023-01-02T18:17:23.373942+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377333+0000","last_change":"2023-01-02T18:16:53.344544+0000","last_active":"2023-01-02T18:17:23.377333+0000","last_peered":"2023-01-02T18:17:23.377333+0000","last_clean":"2023-01-02T18:17:23.377333+0000","last_became_active":"2023-01-02T18:16:51.339073+0000","last_became_peered":"2023-01-02T18:16:51.339073+0000","last_unstale":"2023-01-02T18:17:23.377333+0000","last_undegraded":"2023-01-02T18:17:23.377333+0000","last_fullsized":"2023-01-02T18:17:23.377333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373781+0000","last_change":"2023-01-02T18:16:57.307483+0000","last_active":"2023-01-02T18:17:22.373781+0000","last_peered":"2023-01-02T18:17:22.373781+0000","last_clean":"2023-01-02T18:17:22.373781+0000","last_became_active":"2023-01-02T18:16:55.316680+0000","last_became_peered":"2023-01-02T18:16:55.316680+0000","last_unstale":"2023-01-02T18:17:22.373781+0000","last_undegraded":"2023-01-02T18:17:22.373781+0000","last_fullsized":"2023-01-02T18:17:22.373781+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377322+0000","last_change":"2023-01-02T18:17:09.315999+0000","last_active":"2023-01-02T18:17:23.377322+0000","last_peered":"2023-01-02T18:17:23.377322+0000","last_clean":"2023-01-02T18:17:23.377322+0000","last_became_active":"2023-01-02T18:17:07.342453+0000","last_became_peered":"2023-01-02T18:17:07.342453+0000","last_unstale":"2023-01-02T18:17:23.377322+0000","last_undegraded":"2023-01-02T18:17:23.377322+0000","last_fullsized":"2023-01-02T18:17:23.377322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365808+0000","last_change":"2023-01-02T18:17:01.310439+0000","last_active":"2023-01-02T18:17:23.365808+0000","last_peered":"2023-01-02T18:17:23.365808+0000","last_clean":"2023-01-02T18:17:23.365808+0000","last_became_active":"2023-01-02T18:16:59.315925+0000","last_became_peered":"2023-01-02T18:16:59.315925+0000","last_unstale":"2023-01-02T18:17:23.365808+0000","last_undegraded":"2023-01-02T18:17:23.365808+0000","last_fullsized":"2023-01-02T18:17:23.365808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373473+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:17:22.373473+0000","last_peered":"2023-01-02T18:17:22.373473+0000","last_clean":"2023-01-02T18:17:22.373473+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:17:22.373473+0000","last_undegraded":"2023-01-02T18:17:22.373473+0000","last_fullsized":"2023-01-02T18:17:22.373473+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'5","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.318414+0000","last_change":"2023-01-02T18:17:24.318908+0000","last_active":"2023-01-02T18:17:24.318414+0000","last_peered":"2023-01-02T18:17:24.318414+0000","last_clean":"2023-01-02T18:17:24.318414+0000","last_became_active":"2023-01-02T18:16:42.441102+0000","last_became_peered":"2023-01-02T18:16:42.441102+0000","last_unstale":"2023-01-02T18:17:24.318414+0000","last_undegraded":"2023-01-02T18:17:24.318414+0000","last_fullsized":"2023-01-02T18:17:24.318414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.a","version":"0'0","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365903+0000","last_change":"2023-01-02T18:16:49.309370+0000","last_active":"2023-01-02T18:17:23.365903+0000","last_peered":"2023-01-02T18:17:23.365903+0000","last_clean":"2023-01-02T18:17:23.365903+0000","last_became_active":"2023-01-02T18:16:48.323683+0000","last_became_peered":"2023-01-02T18:16:48.323683+0000","last_unstale":"2023-01-02T18:17:23.365903+0000","last_undegraded":"2023-01-02T18:17:23.365903+0000","last_fullsized":"2023-01-02T18:17:23.365903+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374039+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:17:23.374039+0000","last_peered":"2023-01-02T18:17:23.374039+0000","last_clean":"2023-01-02T18:17:23.374039+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:17:23.374039+0000","last_undegraded":"2023-01-02T18:17:23.374039+0000","last_fullsized":"2023-01-02T18:17:23.374039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373456+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:17:23.373456+0000","last_peered":"2023-01-02T18:17:23.373456+0000","last_clean":"2023-01-02T18:17:23.373456+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:17:23.373456+0000","last_undegraded":"2023-01-02T18:17:23.373456+0000","last_fullsized":"2023-01-02T18:17:23.373456+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375098+0000","last_change":"2023-01-02T18:17:09.324144+0000","last_active":"2023-01-02T18:17:23.375098+0000","last_peered":"2023-01-02T18:17:23.375098+0000","last_clean":"2023-01-02T18:17:23.375098+0000","last_became_active":"2023-01-02T18:17:07.346984+0000","last_became_peered":"2023-01-02T18:17:07.346984+0000","last_unstale":"2023-01-02T18:17:23.375098+0000","last_undegraded":"2023-01-02T18:17:23.375098+0000","last_fullsized":"2023-01-02T18:17:23.375098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373572+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:17:22.373572+0000","last_peered":"2023-01-02T18:17:22.373572+0000","last_clean":"2023-01-02T18:17:22.373572+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:17:22.373572+0000","last_undegraded":"2023-01-02T18:17:22.373572+0000","last_fullsized":"2023-01-02T18:17:22.373572+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370118+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:17:23.370118+0000","last_peered":"2023-01-02T18:17:23.370118+0000","last_clean":"2023-01-02T18:17:23.370118+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:17:23.370118+0000","last_undegraded":"2023-01-02T18:17:23.370118+0000","last_fullsized":"2023-01-02T18:17:23.370118+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"46'4","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.335437+0000","last_change":"2023-01-02T18:17:24.335573+0000","last_active":"2023-01-02T18:17:24.335437+0000","last_peered":"2023-01-02T18:17:24.335437+0000","last_clean":"2023-01-02T18:17:24.335437+0000","last_became_active":"2023-01-02T18:16:42.445252+0000","last_became_peered":"2023-01-02T18:16:42.445252+0000","last_unstale":"2023-01-02T18:17:24.335437+0000","last_undegraded":"2023-01-02T18:17:24.335437+0000","last_fullsized":"2023-01-02T18:17:24.335437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":30,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.b","version":"56'8","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374458+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:17:23.374458+0000","last_peered":"2023-01-02T18:17:23.374458+0000","last_clean":"2023-01-02T18:17:23.374458+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:17:23.374458+0000","last_undegraded":"2023-01-02T18:17:23.374458+0000","last_fullsized":"2023-01-02T18:17:23.374458+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373574+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:17:23.373574+0000","last_peered":"2023-01-02T18:17:23.373574+0000","last_clean":"2023-01-02T18:17:23.373574+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:17:23.373574+0000","last_undegraded":"2023-01-02T18:17:23.373574+0000","last_fullsized":"2023-01-02T18:17:23.373574+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372810+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:17:22.372810+0000","last_peered":"2023-01-02T18:17:22.372810+0000","last_clean":"2023-01-02T18:17:22.372810+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:17:22.372810+0000","last_undegraded":"2023-01-02T18:17:22.372810+0000","last_fullsized":"2023-01-02T18:17:22.372810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375211+0000","last_change":"2023-01-02T18:17:09.308354+0000","last_active":"2023-01-02T18:17:23.375211+0000","last_peered":"2023-01-02T18:17:23.375211+0000","last_clean":"2023-01-02T18:17:23.375211+0000","last_became_active":"2023-01-02T18:17:07.339211+0000","last_became_peered":"2023-01-02T18:17:07.339211+0000","last_unstale":"2023-01-02T18:17:23.375211+0000","last_undegraded":"2023-01-02T18:17:23.375211+0000","last_fullsized":"2023-01-02T18:17:23.375211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"71'2","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370881+0000","last_change":"2023-01-02T18:17:01.317443+0000","last_active":"2023-01-02T18:17:23.370881+0000","last_peered":"2023-01-02T18:17:23.370881+0000","last_clean":"2023-01-02T18:17:23.370881+0000","last_became_active":"2023-01-02T18:16:59.311550+0000","last_became_peered":"2023-01-02T18:16:59.311550+0000","last_unstale":"2023-01-02T18:17:23.370881+0000","last_undegraded":"2023-01-02T18:17:23.370881+0000","last_fullsized":"2023-01-02T18:17:23.370881+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"51'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364550+0000","last_change":"2023-01-02T18:16:48.345208+0000","last_active":"2023-01-02T18:17:23.364550+0000","last_peered":"2023-01-02T18:17:23.364550+0000","last_clean":"2023-01-02T18:17:23.364550+0000","last_became_active":"2023-01-02T18:16:48.327080+0000","last_became_peered":"2023-01-02T18:16:48.327080+0000","last_unstale":"2023-01-02T18:17:23.364550+0000","last_undegraded":"2023-01-02T18:17:23.364550+0000","last_fullsized":"2023-01-02T18:17:23.364550+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.334928+0000","last_change":"2023-01-02T18:17:24.335124+0000","last_active":"2023-01-02T18:17:24.334928+0000","last_peered":"2023-01-02T18:17:24.334928+0000","last_clean":"2023-01-02T18:17:24.334928+0000","last_became_active":"2023-01-02T18:16:48.327374+0000","last_became_peered":"2023-01-02T18:16:48.327374+0000","last_unstale":"2023-01-02T18:17:24.334928+0000","last_undegraded":"2023-01-02T18:17:24.334928+0000","last_fullsized":"2023-01-02T18:17:24.334928+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.8","version":"0'0","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372575+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:17:22.372575+0000","last_peered":"2023-01-02T18:17:22.372575+0000","last_clean":"2023-01-02T18:17:22.372575+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:17:22.372575+0000","last_undegraded":"2023-01-02T18:17:22.372575+0000","last_fullsized":"2023-01-02T18:17:22.372575+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365535+0000","last_change":"2023-01-02T18:16:53.342610+0000","last_active":"2023-01-02T18:17:23.365535+0000","last_peered":"2023-01-02T18:17:23.365535+0000","last_clean":"2023-01-02T18:17:23.365535+0000","last_became_active":"2023-01-02T18:16:51.341683+0000","last_became_peered":"2023-01-02T18:16:51.341683+0000","last_unstale":"2023-01-02T18:17:23.365535+0000","last_undegraded":"2023-01-02T18:17:23.365535+0000","last_fullsized":"2023-01-02T18:17:23.365535+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365396+0000","last_change":"2023-01-02T18:16:57.312289+0000","last_active":"2023-01-02T18:17:23.365396+0000","last_peered":"2023-01-02T18:17:23.365396+0000","last_clean":"2023-01-02T18:17:23.365396+0000","last_became_active":"2023-01-02T18:16:55.317023+0000","last_became_peered":"2023-01-02T18:16:55.317023+0000","last_unstale":"2023-01-02T18:17:23.365396+0000","last_undegraded":"2023-01-02T18:17:23.365396+0000","last_fullsized":"2023-01-02T18:17:23.365396+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374389+0000","last_change":"2023-01-02T18:17:09.324091+0000","last_active":"2023-01-02T18:17:23.374389+0000","last_peered":"2023-01-02T18:17:23.374389+0000","last_clean":"2023-01-02T18:17:23.374389+0000","last_became_active":"2023-01-02T18:17:07.346545+0000","last_became_peered":"2023-01-02T18:17:07.346545+0000","last_unstale":"2023-01-02T18:17:23.374389+0000","last_undegraded":"2023-01-02T18:17:23.374389+0000","last_fullsized":"2023-01-02T18:17:23.374389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.4","version":"72'10","reported_seq":142,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370577+0000","last_change":"2023-01-02T18:17:01.317071+0000","last_active":"2023-01-02T18:17:23.370577+0000","last_peered":"2023-01-02T18:17:23.370577+0000","last_clean":"2023-01-02T18:17:23.370577+0000","last_became_active":"2023-01-02T18:16:59.310165+0000","last_became_peered":"2023-01-02T18:16:59.310165+0000","last_unstale":"2023-01-02T18:17:23.370577+0000","last_undegraded":"2023-01-02T18:17:23.370577+0000","last_fullsized":"2023-01-02T18:17:23.370577+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"51'1","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373422+0000","last_change":"2023-01-02T18:16:44.299209+0000","last_active":"2023-01-02T18:17:23.373422+0000","last_peered":"2023-01-02T18:17:23.373422+0000","last_clean":"2023-01-02T18:17:23.373422+0000","last_became_active":"2023-01-02T18:16:42.441304+0000","last_became_peered":"2023-01-02T18:16:42.441304+0000","last_unstale":"2023-01-02T18:17:23.373422+0000","last_undegraded":"2023-01-02T18:17:23.373422+0000","last_fullsized":"2023-01-02T18:17:23.373422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"82'14","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.335586+0000","last_change":"2023-01-02T18:17:24.335749+0000","last_active":"2023-01-02T18:17:24.335586+0000","last_peered":"2023-01-02T18:17:24.335586+0000","last_clean":"2023-01-02T18:17:24.335586+0000","last_became_active":"2023-01-02T18:16:48.324242+0000","last_became_peered":"2023-01-02T18:16:48.324242+0000","last_unstale":"2023-01-02T18:17:24.335586+0000","last_undegraded":"2023-01-02T18:17:24.335586+0000","last_fullsized":"2023-01-02T18:17:24.335586+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":122,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":46,"num_keys_recovered":8,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.9","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374566+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:17:23.374566+0000","last_peered":"2023-01-02T18:17:23.374566+0000","last_clean":"2023-01-02T18:17:23.374566+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:23.374566+0000","last_undegraded":"2023-01-02T18:17:23.374566+0000","last_fullsized":"2023-01-02T18:17:23.374566+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370039+0000","last_change":"2023-01-02T18:16:53.604245+0000","last_active":"2023-01-02T18:17:23.370039+0000","last_peered":"2023-01-02T18:17:23.370039+0000","last_clean":"2023-01-02T18:17:23.370039+0000","last_became_active":"2023-01-02T18:16:51.338292+0000","last_became_peered":"2023-01-02T18:16:51.338292+0000","last_unstale":"2023-01-02T18:17:23.370039+0000","last_undegraded":"2023-01-02T18:17:23.370039+0000","last_fullsized":"2023-01-02T18:17:23.370039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374673+0000","last_change":"2023-01-02T18:16:57.317106+0000","last_active":"2023-01-02T18:17:23.374673+0000","last_peered":"2023-01-02T18:17:23.374673+0000","last_clean":"2023-01-02T18:17:23.374673+0000","last_became_active":"2023-01-02T18:16:55.308873+0000","last_became_peered":"2023-01-02T18:16:55.308873+0000","last_unstale":"2023-01-02T18:17:23.374673+0000","last_undegraded":"2023-01-02T18:17:23.374673+0000","last_fullsized":"2023-01-02T18:17:23.374673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"76'3","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364214+0000","last_change":"2023-01-02T18:17:09.308112+0000","last_active":"2023-01-02T18:17:23.364214+0000","last_peered":"2023-01-02T18:17:23.364214+0000","last_clean":"2023-01-02T18:17:23.364214+0000","last_became_active":"2023-01-02T18:17:07.336295+0000","last_became_peered":"2023-01-02T18:17:07.336295+0000","last_unstale":"2023-01-02T18:17:23.364214+0000","last_undegraded":"2023-01-02T18:17:23.364214+0000","last_fullsized":"2023-01-02T18:17:23.364214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":80,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'85","reported_seq":697,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370004+0000","last_change":"2023-01-02T18:17:01.316472+0000","last_active":"2023-01-02T18:17:23.370004+0000","last_peered":"2023-01-02T18:17:23.370004+0000","last_clean":"2023-01-02T18:17:23.370004+0000","last_became_active":"2023-01-02T18:16:59.310142+0000","last_became_peered":"2023-01-02T18:16:59.310142+0000","last_unstale":"2023-01-02T18:17:23.370004+0000","last_undegraded":"2023-01-02T18:17:23.370004+0000","last_fullsized":"2023-01-02T18:17:23.370004+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1544,"num_read_kb":1398,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366735+0000","last_change":"2023-01-02T18:16:44.308280+0000","last_active":"2023-01-02T18:17:23.366735+0000","last_peered":"2023-01-02T18:17:23.366735+0000","last_clean":"2023-01-02T18:17:23.366735+0000","last_became_active":"2023-01-02T18:16:41.446391+0000","last_became_peered":"2023-01-02T18:16:41.446391+0000","last_unstale":"2023-01-02T18:17:23.366735+0000","last_undegraded":"2023-01-02T18:17:23.366735+0000","last_fullsized":"2023-01-02T18:17:23.366735+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"80'15","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.324220+0000","last_change":"2023-01-02T18:17:24.324435+0000","last_active":"2023-01-02T18:17:24.324220+0000","last_peered":"2023-01-02T18:17:24.324220+0000","last_clean":"2023-01-02T18:17:24.324220+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:17:24.324220+0000","last_undegraded":"2023-01-02T18:17:24.324220+0000","last_fullsized":"2023-01-02T18:17:24.324220+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":151,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.16","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365289+0000","last_change":"2023-01-02T18:16:49.310953+0000","last_active":"2023-01-02T18:17:23.365289+0000","last_peered":"2023-01-02T18:17:23.365289+0000","last_clean":"2023-01-02T18:17:23.365289+0000","last_became_active":"2023-01-02T18:16:46.312067+0000","last_became_peered":"2023-01-02T18:16:46.312067+0000","last_unstale":"2023-01-02T18:17:23.365289+0000","last_undegraded":"2023-01-02T18:17:23.365289+0000","last_fullsized":"2023-01-02T18:17:23.365289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374291+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:17:23.374291+0000","last_peered":"2023-01-02T18:17:23.374291+0000","last_clean":"2023-01-02T18:17:23.374291+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:17:23.374291+0000","last_undegraded":"2023-01-02T18:17:23.374291+0000","last_fullsized":"2023-01-02T18:17:23.374291+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364991+0000","last_change":"2023-01-02T18:16:57.313875+0000","last_active":"2023-01-02T18:17:23.364991+0000","last_peered":"2023-01-02T18:17:23.364991+0000","last_clean":"2023-01-02T18:17:23.364991+0000","last_became_active":"2023-01-02T18:16:55.318719+0000","last_became_peered":"2023-01-02T18:16:55.318719+0000","last_unstale":"2023-01-02T18:17:23.364991+0000","last_undegraded":"2023-01-02T18:17:23.364991+0000","last_fullsized":"2023-01-02T18:17:23.364991+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364393+0000","last_change":"2023-01-02T18:17:09.307476+0000","last_active":"2023-01-02T18:17:23.364393+0000","last_peered":"2023-01-02T18:17:23.364393+0000","last_clean":"2023-01-02T18:17:23.364393+0000","last_became_active":"2023-01-02T18:17:07.336526+0000","last_became_peered":"2023-01-02T18:17:07.336526+0000","last_unstale":"2023-01-02T18:17:23.364393+0000","last_undegraded":"2023-01-02T18:17:23.364393+0000","last_fullsized":"2023-01-02T18:17:23.364393+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"68'2","reported_seq":145,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370517+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:17:23.370517+0000","last_peered":"2023-01-02T18:17:23.370517+0000","last_clean":"2023-01-02T18:17:23.370517+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:17:23.370517+0000","last_undegraded":"2023-01-02T18:17:23.370517+0000","last_fullsized":"2023-01-02T18:17:23.370517+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364989+0000","last_change":"2023-01-02T18:16:44.307606+0000","last_active":"2023-01-02T18:17:23.364989+0000","last_peered":"2023-01-02T18:17:23.364989+0000","last_clean":"2023-01-02T18:17:23.364989+0000","last_became_active":"2023-01-02T18:16:41.449266+0000","last_became_peered":"2023-01-02T18:16:41.449266+0000","last_unstale":"2023-01-02T18:17:23.364989+0000","last_undegraded":"2023-01-02T18:17:23.364989+0000","last_fullsized":"2023-01-02T18:17:23.364989+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.334657+0000","last_change":"2023-01-02T18:17:24.334827+0000","last_active":"2023-01-02T18:17:24.334657+0000","last_peered":"2023-01-02T18:17:24.334657+0000","last_clean":"2023-01-02T18:17:24.334657+0000","last_became_active":"2023-01-02T18:16:48.329249+0000","last_became_peered":"2023-01-02T18:16:48.329249+0000","last_unstale":"2023-01-02T18:17:24.334657+0000","last_undegraded":"2023-01-02T18:17:24.334657+0000","last_fullsized":"2023-01-02T18:17:24.334657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.17","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.367145+0000","last_change":"2023-01-02T18:16:49.311129+0000","last_active":"2023-01-02T18:17:23.367145+0000","last_peered":"2023-01-02T18:17:23.367145+0000","last_clean":"2023-01-02T18:17:23.367145+0000","last_became_active":"2023-01-02T18:16:46.312301+0000","last_became_peered":"2023-01-02T18:16:46.312301+0000","last_unstale":"2023-01-02T18:17:23.367145+0000","last_undegraded":"2023-01-02T18:17:23.367145+0000","last_fullsized":"2023-01-02T18:17:23.367145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375902+0000","last_change":"2023-01-02T18:16:53.350359+0000","last_active":"2023-01-02T18:17:23.375902+0000","last_peered":"2023-01-02T18:17:23.375902+0000","last_clean":"2023-01-02T18:17:23.375902+0000","last_became_active":"2023-01-02T18:16:51.338043+0000","last_became_peered":"2023-01-02T18:16:51.338043+0000","last_unstale":"2023-01-02T18:17:23.375902+0000","last_undegraded":"2023-01-02T18:17:23.375902+0000","last_fullsized":"2023-01-02T18:17:23.375902+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373912+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:17:23.373912+0000","last_peered":"2023-01-02T18:17:23.373912+0000","last_clean":"2023-01-02T18:17:23.373912+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:17:23.373912+0000","last_undegraded":"2023-01-02T18:17:23.373912+0000","last_fullsized":"2023-01-02T18:17:23.373912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369710+0000","last_change":"2023-01-02T18:17:09.330482+0000","last_active":"2023-01-02T18:17:23.369710+0000","last_peered":"2023-01-02T18:17:23.369710+0000","last_clean":"2023-01-02T18:17:23.369710+0000","last_became_active":"2023-01-02T18:17:07.344261+0000","last_became_peered":"2023-01-02T18:17:07.344261+0000","last_unstale":"2023-01-02T18:17:23.369710+0000","last_undegraded":"2023-01-02T18:17:23.369710+0000","last_fullsized":"2023-01-02T18:17:23.369710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"68'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369814+0000","last_change":"2023-01-02T18:17:01.316528+0000","last_active":"2023-01-02T18:17:23.369814+0000","last_peered":"2023-01-02T18:17:23.369814+0000","last_clean":"2023-01-02T18:17:23.369814+0000","last_became_active":"2023-01-02T18:16:59.324956+0000","last_became_peered":"2023-01-02T18:16:59.324956+0000","last_unstale":"2023-01-02T18:17:23.369814+0000","last_undegraded":"2023-01-02T18:17:23.369814+0000","last_fullsized":"2023-01-02T18:17:23.369814+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373760+0000","last_change":"2023-01-02T18:16:44.299509+0000","last_active":"2023-01-02T18:17:23.373760+0000","last_peered":"2023-01-02T18:17:23.373760+0000","last_clean":"2023-01-02T18:17:23.373760+0000","last_became_active":"2023-01-02T18:16:42.439600+0000","last_became_peered":"2023-01-02T18:16:42.439600+0000","last_unstale":"2023-01-02T18:17:23.373760+0000","last_undegraded":"2023-01-02T18:17:23.373760+0000","last_fullsized":"2023-01-02T18:17:23.373760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.333059+0000","last_change":"2023-01-02T18:17:24.333320+0000","last_active":"2023-01-02T18:17:24.333059+0000","last_peered":"2023-01-02T18:17:24.333059+0000","last_clean":"2023-01-02T18:17:24.333059+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:17:24.333059+0000","last_undegraded":"2023-01-02T18:17:24.333059+0000","last_fullsized":"2023-01-02T18:17:24.333059+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.14","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365124+0000","last_change":"2023-01-02T18:16:49.310391+0000","last_active":"2023-01-02T18:17:23.365124+0000","last_peered":"2023-01-02T18:17:23.365124+0000","last_clean":"2023-01-02T18:17:23.365124+0000","last_became_active":"2023-01-02T18:16:46.316328+0000","last_became_peered":"2023-01-02T18:16:46.316328+0000","last_unstale":"2023-01-02T18:17:23.365124+0000","last_undegraded":"2023-01-02T18:17:23.365124+0000","last_fullsized":"2023-01-02T18:17:23.365124+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374028+0000","last_change":"2023-01-02T18:16:53.686538+0000","last_active":"2023-01-02T18:17:22.374028+0000","last_peered":"2023-01-02T18:17:22.374028+0000","last_clean":"2023-01-02T18:17:22.374028+0000","last_became_active":"2023-01-02T18:16:51.336975+0000","last_became_peered":"2023-01-02T18:16:51.336975+0000","last_unstale":"2023-01-02T18:17:22.374028+0000","last_undegraded":"2023-01-02T18:17:22.374028+0000","last_fullsized":"2023-01-02T18:17:22.374028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373626+0000","last_change":"2023-01-02T18:16:57.306845+0000","last_active":"2023-01-02T18:17:22.373626+0000","last_peered":"2023-01-02T18:17:22.373626+0000","last_clean":"2023-01-02T18:17:22.373626+0000","last_became_active":"2023-01-02T18:16:55.318612+0000","last_became_peered":"2023-01-02T18:16:55.318612+0000","last_unstale":"2023-01-02T18:17:22.373626+0000","last_undegraded":"2023-01-02T18:17:22.373626+0000","last_fullsized":"2023-01-02T18:17:22.373626+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364049+0000","last_change":"2023-01-02T18:17:09.307508+0000","last_active":"2023-01-02T18:17:23.364049+0000","last_peered":"2023-01-02T18:17:23.364049+0000","last_clean":"2023-01-02T18:17:23.364049+0000","last_became_active":"2023-01-02T18:17:07.344914+0000","last_became_peered":"2023-01-02T18:17:07.344914+0000","last_unstale":"2023-01-02T18:17:23.364049+0000","last_undegraded":"2023-01-02T18:17:23.364049+0000","last_fullsized":"2023-01-02T18:17:23.364049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"69'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363849+0000","last_change":"2023-01-02T18:17:01.307624+0000","last_active":"2023-01-02T18:17:23.363849+0000","last_peered":"2023-01-02T18:17:23.363849+0000","last_clean":"2023-01-02T18:17:23.363849+0000","last_became_active":"2023-01-02T18:16:59.311706+0000","last_became_peered":"2023-01-02T18:16:59.311706+0000","last_unstale":"2023-01-02T18:17:23.363849+0000","last_undegraded":"2023-01-02T18:17:23.363849+0000","last_fullsized":"2023-01-02T18:17:23.363849+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365044+0000","last_change":"2023-01-02T18:16:44.307239+0000","last_active":"2023-01-02T18:17:23.365044+0000","last_peered":"2023-01-02T18:17:23.365044+0000","last_clean":"2023-01-02T18:17:23.365044+0000","last_became_active":"2023-01-02T18:16:41.447671+0000","last_became_peered":"2023-01-02T18:16:41.447671+0000","last_unstale":"2023-01-02T18:17:23.365044+0000","last_undegraded":"2023-01-02T18:17:23.365044+0000","last_fullsized":"2023-01-02T18:17:23.365044+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"91'5","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.333593+0000","last_change":"2023-01-02T18:17:24.333593+0000","last_active":"2023-01-02T18:17:24.333593+0000","last_peered":"2023-01-02T18:17:24.333593+0000","last_clean":"2023-01-02T18:17:24.333593+0000","last_became_active":"2023-01-02T18:16:48.322940+0000","last_became_peered":"2023-01-02T18:16:48.322940+0000","last_unstale":"2023-01-02T18:17:24.333593+0000","last_undegraded":"2023-01-02T18:17:24.333593+0000","last_fullsized":"2023-01-02T18:17:24.333593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.15","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.376718+0000","last_change":"2023-01-02T18:16:49.300038+0000","last_active":"2023-01-02T18:17:23.376718+0000","last_peered":"2023-01-02T18:17:23.376718+0000","last_clean":"2023-01-02T18:17:23.376718+0000","last_became_active":"2023-01-02T18:16:46.315569+0000","last_became_peered":"2023-01-02T18:16:46.315569+0000","last_unstale":"2023-01-02T18:17:23.376718+0000","last_undegraded":"2023-01-02T18:17:23.376718+0000","last_fullsized":"2023-01-02T18:17:23.376718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374191+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:17:23.374191+0000","last_peered":"2023-01-02T18:17:23.374191+0000","last_clean":"2023-01-02T18:17:23.374191+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:17:23.374191+0000","last_undegraded":"2023-01-02T18:17:23.374191+0000","last_fullsized":"2023-01-02T18:17:23.374191+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375592+0000","last_change":"2023-01-02T18:16:57.312176+0000","last_active":"2023-01-02T18:17:23.375592+0000","last_peered":"2023-01-02T18:17:23.375592+0000","last_clean":"2023-01-02T18:17:23.375592+0000","last_became_active":"2023-01-02T18:16:55.311934+0000","last_became_peered":"2023-01-02T18:16:55.311934+0000","last_unstale":"2023-01-02T18:17:23.375592+0000","last_undegraded":"2023-01-02T18:17:23.375592+0000","last_fullsized":"2023-01-02T18:17:23.375592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373476+0000","last_change":"2023-01-02T18:17:09.325339+0000","last_active":"2023-01-02T18:17:22.373476+0000","last_peered":"2023-01-02T18:17:22.373476+0000","last_clean":"2023-01-02T18:17:22.373476+0000","last_became_active":"2023-01-02T18:17:07.341155+0000","last_became_peered":"2023-01-02T18:17:07.341155+0000","last_unstale":"2023-01-02T18:17:22.373476+0000","last_undegraded":"2023-01-02T18:17:22.373476+0000","last_fullsized":"2023-01-02T18:17:22.373476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373789+0000","last_change":"2023-01-02T18:17:01.320344+0000","last_active":"2023-01-02T18:17:22.373789+0000","last_peered":"2023-01-02T18:17:22.373789+0000","last_clean":"2023-01-02T18:17:22.373789+0000","last_became_active":"2023-01-02T18:16:59.324530+0000","last_became_peered":"2023-01-02T18:16:59.324530+0000","last_unstale":"2023-01-02T18:17:22.373789+0000","last_undegraded":"2023-01-02T18:17:22.373789+0000","last_fullsized":"2023-01-02T18:17:22.373789+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370101+0000","last_change":"2023-01-02T18:16:48.329830+0000","last_active":"2023-01-02T18:17:23.370101+0000","last_peered":"2023-01-02T18:17:23.370101+0000","last_clean":"2023-01-02T18:17:23.370101+0000","last_became_active":"2023-01-02T18:16:48.329469+0000","last_became_peered":"2023-01-02T18:16:48.329469+0000","last_unstale":"2023-01-02T18:17:23.370101+0000","last_undegraded":"2023-01-02T18:17:23.370101+0000","last_fullsized":"2023-01-02T18:17:23.370101+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.334688+0000","last_change":"2023-01-02T18:17:24.334884+0000","last_active":"2023-01-02T18:17:24.334688+0000","last_peered":"2023-01-02T18:17:24.334688+0000","last_clean":"2023-01-02T18:17:24.334688+0000","last_became_active":"2023-01-02T18:16:48.326351+0000","last_became_peered":"2023-01-02T18:16:48.326351+0000","last_unstale":"2023-01-02T18:17:24.334688+0000","last_undegraded":"2023-01-02T18:17:24.334688+0000","last_fullsized":"2023-01-02T18:17:24.334688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.12","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365632+0000","last_change":"2023-01-02T18:16:49.310459+0000","last_active":"2023-01-02T18:17:23.365632+0000","last_peered":"2023-01-02T18:17:23.365632+0000","last_clean":"2023-01-02T18:17:23.365632+0000","last_became_active":"2023-01-02T18:16:46.312215+0000","last_became_peered":"2023-01-02T18:16:46.312215+0000","last_unstale":"2023-01-02T18:17:23.365632+0000","last_undegraded":"2023-01-02T18:17:23.365632+0000","last_fullsized":"2023-01-02T18:17:23.365632+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364450+0000","last_change":"2023-01-02T18:16:53.342357+0000","last_active":"2023-01-02T18:17:23.364450+0000","last_peered":"2023-01-02T18:17:23.364450+0000","last_clean":"2023-01-02T18:17:23.364450+0000","last_became_active":"2023-01-02T18:16:51.341254+0000","last_became_peered":"2023-01-02T18:16:51.341254+0000","last_unstale":"2023-01-02T18:17:23.364450+0000","last_undegraded":"2023-01-02T18:17:23.364450+0000","last_fullsized":"2023-01-02T18:17:23.364450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364067+0000","last_change":"2023-01-02T18:16:57.312710+0000","last_active":"2023-01-02T18:17:23.364067+0000","last_peered":"2023-01-02T18:17:23.364067+0000","last_clean":"2023-01-02T18:17:23.364067+0000","last_became_active":"2023-01-02T18:16:55.317525+0000","last_became_peered":"2023-01-02T18:16:55.317525+0000","last_unstale":"2023-01-02T18:17:23.364067+0000","last_undegraded":"2023-01-02T18:17:23.364067+0000","last_fullsized":"2023-01-02T18:17:23.364067+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377287+0000","last_change":"2023-01-02T18:17:09.308664+0000","last_active":"2023-01-02T18:17:23.377287+0000","last_peered":"2023-01-02T18:17:23.377287+0000","last_clean":"2023-01-02T18:17:23.377287+0000","last_became_active":"2023-01-02T18:17:07.344272+0000","last_became_peered":"2023-01-02T18:17:07.344272+0000","last_unstale":"2023-01-02T18:17:23.377287+0000","last_undegraded":"2023-01-02T18:17:23.377287+0000","last_fullsized":"2023-01-02T18:17:23.377287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364797+0000","last_change":"2023-01-02T18:17:01.311474+0000","last_active":"2023-01-02T18:17:23.364797+0000","last_peered":"2023-01-02T18:17:23.364797+0000","last_clean":"2023-01-02T18:17:23.364797+0000","last_became_active":"2023-01-02T18:16:59.314245+0000","last_became_peered":"2023-01-02T18:16:59.314245+0000","last_unstale":"2023-01-02T18:17:23.364797+0000","last_undegraded":"2023-01-02T18:17:23.364797+0000","last_fullsized":"2023-01-02T18:17:23.364797+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370443+0000","last_change":"2023-01-02T18:16:44.320516+0000","last_active":"2023-01-02T18:17:23.370443+0000","last_peered":"2023-01-02T18:17:23.370443+0000","last_clean":"2023-01-02T18:17:23.370443+0000","last_became_active":"2023-01-02T18:16:41.444704+0000","last_became_peered":"2023-01-02T18:16:41.444704+0000","last_unstale":"2023-01-02T18:17:23.370443+0000","last_undegraded":"2023-01-02T18:17:23.370443+0000","last_fullsized":"2023-01-02T18:17:23.370443+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"86'18","reported_seq":182,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.335139+0000","last_change":"2023-01-02T18:17:24.335355+0000","last_active":"2023-01-02T18:17:24.335139+0000","last_peered":"2023-01-02T18:17:24.335139+0000","last_clean":"2023-01-02T18:17:24.335139+0000","last_became_active":"2023-01-02T18:16:37.436152+0000","last_became_peered":"2023-01-02T18:16:37.436152+0000","last_unstale":"2023-01-02T18:17:24.335139+0000","last_undegraded":"2023-01-02T18:17:24.335139+0000","last_fullsized":"2023-01-02T18:17:24.335139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":192,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.13","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365129+0000","last_change":"2023-01-02T18:16:49.309763+0000","last_active":"2023-01-02T18:17:23.365129+0000","last_peered":"2023-01-02T18:17:23.365129+0000","last_clean":"2023-01-02T18:17:23.365129+0000","last_became_active":"2023-01-02T18:16:46.308336+0000","last_became_peered":"2023-01-02T18:16:46.308336+0000","last_unstale":"2023-01-02T18:17:23.365129+0000","last_undegraded":"2023-01-02T18:17:23.365129+0000","last_fullsized":"2023-01-02T18:17:23.365129+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372741+0000","last_change":"2023-01-02T18:16:53.686000+0000","last_active":"2023-01-02T18:17:22.372741+0000","last_peered":"2023-01-02T18:17:22.372741+0000","last_clean":"2023-01-02T18:17:22.372741+0000","last_became_active":"2023-01-02T18:16:51.345471+0000","last_became_peered":"2023-01-02T18:16:51.345471+0000","last_unstale":"2023-01-02T18:17:22.372741+0000","last_undegraded":"2023-01-02T18:17:22.372741+0000","last_fullsized":"2023-01-02T18:17:22.372741+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373955+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:17:23.373955+0000","last_peered":"2023-01-02T18:17:23.373955+0000","last_clean":"2023-01-02T18:17:23.373955+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:17:23.373955+0000","last_undegraded":"2023-01-02T18:17:23.373955+0000","last_fullsized":"2023-01-02T18:17:23.373955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"76'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375046+0000","last_change":"2023-01-02T18:17:09.308316+0000","last_active":"2023-01-02T18:17:23.375046+0000","last_peered":"2023-01-02T18:17:23.375046+0000","last_clean":"2023-01-02T18:17:23.375046+0000","last_became_active":"2023-01-02T18:17:07.339700+0000","last_became_peered":"2023-01-02T18:17:07.339700+0000","last_unstale":"2023-01-02T18:17:23.375046+0000","last_undegraded":"2023-01-02T18:17:23.375046+0000","last_fullsized":"2023-01-02T18:17:23.375046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374210+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:17:22.374210+0000","last_peered":"2023-01-02T18:17:22.374210+0000","last_clean":"2023-01-02T18:17:22.374210+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:17:22.374210+0000","last_undegraded":"2023-01-02T18:17:22.374210+0000","last_fullsized":"2023-01-02T18:17:22.374210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366458+0000","last_change":"2023-01-02T18:16:44.306989+0000","last_active":"2023-01-02T18:17:23.366458+0000","last_peered":"2023-01-02T18:17:23.366458+0000","last_clean":"2023-01-02T18:17:23.366458+0000","last_became_active":"2023-01-02T18:16:41.448619+0000","last_became_peered":"2023-01-02T18:16:41.448619+0000","last_unstale":"2023-01-02T18:17:23.366458+0000","last_undegraded":"2023-01-02T18:17:23.366458+0000","last_fullsized":"2023-01-02T18:17:23.366458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"46'1","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.335379+0000","last_change":"2023-01-02T18:17:24.335541+0000","last_active":"2023-01-02T18:17:24.335379+0000","last_peered":"2023-01-02T18:17:24.335379+0000","last_clean":"2023-01-02T18:17:24.335379+0000","last_became_active":"2023-01-02T18:16:42.440314+0000","last_became_peered":"2023-01-02T18:16:42.440314+0000","last_unstale":"2023-01-02T18:17:24.335379+0000","last_undegraded":"2023-01-02T18:17:24.335379+0000","last_fullsized":"2023-01-02T18:17:24.335379+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.10","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373528+0000","last_change":"2023-01-02T18:16:49.304745+0000","last_active":"2023-01-02T18:17:23.373528+0000","last_peered":"2023-01-02T18:17:23.373528+0000","last_clean":"2023-01-02T18:17:23.373528+0000","last_became_active":"2023-01-02T18:16:48.325920+0000","last_became_peered":"2023-01-02T18:16:48.325920+0000","last_unstale":"2023-01-02T18:17:23.373528+0000","last_undegraded":"2023-01-02T18:17:23.373528+0000","last_fullsized":"2023-01-02T18:17:23.373528+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365914+0000","last_change":"2023-01-02T18:16:53.342417+0000","last_active":"2023-01-02T18:17:23.365914+0000","last_peered":"2023-01-02T18:17:23.365914+0000","last_clean":"2023-01-02T18:17:23.365914+0000","last_became_active":"2023-01-02T18:16:51.341971+0000","last_became_peered":"2023-01-02T18:16:51.341971+0000","last_unstale":"2023-01-02T18:17:23.365914+0000","last_undegraded":"2023-01-02T18:17:23.365914+0000","last_fullsized":"2023-01-02T18:17:23.365914+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369851+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:17:23.369851+0000","last_peered":"2023-01-02T18:17:23.369851+0000","last_clean":"2023-01-02T18:17:23.369851+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:17:23.369851+0000","last_undegraded":"2023-01-02T18:17:23.369851+0000","last_fullsized":"2023-01-02T18:17:23.369851+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374156+0000","last_change":"2023-01-02T18:17:09.329860+0000","last_active":"2023-01-02T18:17:22.374156+0000","last_peered":"2023-01-02T18:17:22.374156+0000","last_clean":"2023-01-02T18:17:22.374156+0000","last_became_active":"2023-01-02T18:17:07.343666+0000","last_became_peered":"2023-01-02T18:17:07.343666+0000","last_unstale":"2023-01-02T18:17:22.374156+0000","last_undegraded":"2023-01-02T18:17:22.374156+0000","last_fullsized":"2023-01-02T18:17:22.374156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"71'6","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374953+0000","last_change":"2023-01-02T18:17:01.322371+0000","last_active":"2023-01-02T18:17:23.374953+0000","last_peered":"2023-01-02T18:17:23.374953+0000","last_clean":"2023-01-02T18:17:23.374953+0000","last_became_active":"2023-01-02T18:16:59.324902+0000","last_became_peered":"2023-01-02T18:16:59.324902+0000","last_unstale":"2023-01-02T18:17:23.374953+0000","last_undegraded":"2023-01-02T18:17:23.374953+0000","last_fullsized":"2023-01-02T18:17:23.374953+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364589+0000","last_change":"2023-01-02T18:16:44.306689+0000","last_active":"2023-01-02T18:17:23.364589+0000","last_peered":"2023-01-02T18:17:23.364589+0000","last_clean":"2023-01-02T18:17:23.364589+0000","last_became_active":"2023-01-02T18:16:41.448162+0000","last_became_peered":"2023-01-02T18:16:41.448162+0000","last_unstale":"2023-01-02T18:17:23.364589+0000","last_undegraded":"2023-01-02T18:17:23.364589+0000","last_fullsized":"2023-01-02T18:17:23.364589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.322276+0000","last_change":"2023-01-02T18:17:24.322498+0000","last_active":"2023-01-02T18:17:24.322276+0000","last_peered":"2023-01-02T18:17:24.322276+0000","last_clean":"2023-01-02T18:17:24.322276+0000","last_became_active":"2023-01-02T18:16:42.435382+0000","last_became_peered":"2023-01-02T18:16:42.435382+0000","last_unstale":"2023-01-02T18:17:24.322276+0000","last_undegraded":"2023-01-02T18:17:24.322276+0000","last_fullsized":"2023-01-02T18:17:24.322276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.11","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369908+0000","last_change":"2023-01-02T18:16:49.318037+0000","last_active":"2023-01-02T18:17:23.369908+0000","last_peered":"2023-01-02T18:17:23.369908+0000","last_clean":"2023-01-02T18:17:23.369908+0000","last_became_active":"2023-01-02T18:16:48.330758+0000","last_became_peered":"2023-01-02T18:16:48.330758+0000","last_unstale":"2023-01-02T18:17:23.369908+0000","last_undegraded":"2023-01-02T18:17:23.369908+0000","last_fullsized":"2023-01-02T18:17:23.369908+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":144,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373555+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:17:23.373555+0000","last_peered":"2023-01-02T18:17:23.373555+0000","last_clean":"2023-01-02T18:17:23.373555+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:17:23.373555+0000","last_undegraded":"2023-01-02T18:17:23.373555+0000","last_fullsized":"2023-01-02T18:17:23.373555+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373221+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:17:22.373221+0000","last_peered":"2023-01-02T18:17:22.373221+0000","last_clean":"2023-01-02T18:17:22.373221+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:17:22.373221+0000","last_undegraded":"2023-01-02T18:17:22.373221+0000","last_fullsized":"2023-01-02T18:17:22.373221+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372729+0000","last_change":"2023-01-02T18:17:09.322570+0000","last_active":"2023-01-02T18:17:22.372729+0000","last_peered":"2023-01-02T18:17:22.372729+0000","last_clean":"2023-01-02T18:17:22.372729+0000","last_became_active":"2023-01-02T18:17:07.342026+0000","last_became_peered":"2023-01-02T18:17:07.342026+0000","last_unstale":"2023-01-02T18:17:22.372729+0000","last_undegraded":"2023-01-02T18:17:22.372729+0000","last_fullsized":"2023-01-02T18:17:22.372729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364703+0000","last_change":"2023-01-02T18:17:01.311515+0000","last_active":"2023-01-02T18:17:23.364703+0000","last_peered":"2023-01-02T18:17:23.364703+0000","last_clean":"2023-01-02T18:17:23.364703+0000","last_became_active":"2023-01-02T18:16:59.322412+0000","last_became_peered":"2023-01-02T18:16:59.322412+0000","last_unstale":"2023-01-02T18:17:23.364703+0000","last_undegraded":"2023-01-02T18:17:23.364703+0000","last_fullsized":"2023-01-02T18:17:23.364703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371240+0000","last_change":"2023-01-02T18:16:44.320520+0000","last_active":"2023-01-02T18:17:23.371240+0000","last_peered":"2023-01-02T18:17:23.371240+0000","last_clean":"2023-01-02T18:17:23.371240+0000","last_became_active":"2023-01-02T18:16:42.441192+0000","last_became_peered":"2023-01-02T18:16:42.441192+0000","last_unstale":"2023-01-02T18:17:23.371240+0000","last_undegraded":"2023-01-02T18:17:23.371240+0000","last_fullsized":"2023-01-02T18:17:23.371240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.317179+0000","last_change":"2023-01-02T18:17:24.317549+0000","last_active":"2023-01-02T18:17:24.317179+0000","last_peered":"2023-01-02T18:17:24.317179+0000","last_clean":"2023-01-02T18:17:24.317179+0000","last_became_active":"2023-01-02T18:16:37.415177+0000","last_became_peered":"2023-01-02T18:16:37.415177+0000","last_unstale":"2023-01-02T18:17:24.317179+0000","last_undegraded":"2023-01-02T18:17:24.317179+0000","last_fullsized":"2023-01-02T18:17:24.317179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1e","version":"0'0","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374096+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:17:22.374096+0000","last_peered":"2023-01-02T18:17:22.374096+0000","last_clean":"2023-01-02T18:17:22.374096+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:17:22.374096+0000","last_undegraded":"2023-01-02T18:17:22.374096+0000","last_fullsized":"2023-01-02T18:17:22.374096+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.376817+0000","last_change":"2023-01-02T18:16:53.344508+0000","last_active":"2023-01-02T18:17:23.376817+0000","last_peered":"2023-01-02T18:17:23.376817+0000","last_clean":"2023-01-02T18:17:23.376817+0000","last_became_active":"2023-01-02T18:16:51.339305+0000","last_became_peered":"2023-01-02T18:16:51.339305+0000","last_unstale":"2023-01-02T18:17:23.376817+0000","last_undegraded":"2023-01-02T18:17:23.376817+0000","last_fullsized":"2023-01-02T18:17:23.376817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365226+0000","last_change":"2023-01-02T18:16:57.314050+0000","last_active":"2023-01-02T18:17:23.365226+0000","last_peered":"2023-01-02T18:17:23.365226+0000","last_clean":"2023-01-02T18:17:23.365226+0000","last_became_active":"2023-01-02T18:16:55.315221+0000","last_became_peered":"2023-01-02T18:16:55.315221+0000","last_unstale":"2023-01-02T18:17:23.365226+0000","last_undegraded":"2023-01-02T18:17:23.365226+0000","last_fullsized":"2023-01-02T18:17:23.365226+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373556+0000","last_change":"2023-01-02T18:17:09.323079+0000","last_active":"2023-01-02T18:17:23.373556+0000","last_peered":"2023-01-02T18:17:23.373556+0000","last_clean":"2023-01-02T18:17:23.373556+0000","last_became_active":"2023-01-02T18:17:07.344746+0000","last_became_peered":"2023-01-02T18:17:07.344746+0000","last_unstale":"2023-01-02T18:17:23.373556+0000","last_undegraded":"2023-01-02T18:17:23.373556+0000","last_fullsized":"2023-01-02T18:17:23.373556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370292+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:17:23.370292+0000","last_peered":"2023-01-02T18:17:23.370292+0000","last_clean":"2023-01-02T18:17:23.370292+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:17:23.370292+0000","last_undegraded":"2023-01-02T18:17:23.370292+0000","last_fullsized":"2023-01-02T18:17:23.370292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.376805+0000","last_change":"2023-01-02T18:16:57.317052+0000","last_active":"2023-01-02T18:17:23.376805+0000","last_peered":"2023-01-02T18:17:23.376805+0000","last_clean":"2023-01-02T18:17:23.376805+0000","last_became_active":"2023-01-02T18:16:55.310981+0000","last_became_peered":"2023-01-02T18:16:55.310981+0000","last_unstale":"2023-01-02T18:17:23.376805+0000","last_undegraded":"2023-01-02T18:17:23.376805+0000","last_fullsized":"2023-01-02T18:17:23.376805+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373932+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:17:22.373932+0000","last_peered":"2023-01-02T18:17:22.373932+0000","last_clean":"2023-01-02T18:17:22.373932+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:17:22.373932+0000","last_undegraded":"2023-01-02T18:17:22.373932+0000","last_fullsized":"2023-01-02T18:17:22.373932+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.311612+0000","last_change":"2023-01-02T18:17:24.311851+0000","last_active":"2023-01-02T18:17:24.311612+0000","last_peered":"2023-01-02T18:17:24.311612+0000","last_clean":"2023-01-02T18:17:24.311612+0000","last_became_active":"2023-01-02T18:16:37.416142+0000","last_became_peered":"2023-01-02T18:16:37.416142+0000","last_unstale":"2023-01-02T18:17:24.311612+0000","last_undegraded":"2023-01-02T18:17:24.311612+0000","last_fullsized":"2023-01-02T18:17:24.311612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1f","version":"56'15","reported_seq":117,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371234+0000","last_change":"2023-01-02T18:16:49.319188+0000","last_active":"2023-01-02T18:17:23.371234+0000","last_peered":"2023-01-02T18:17:23.371234+0000","last_clean":"2023-01-02T18:17:23.371234+0000","last_became_active":"2023-01-02T18:16:48.329016+0000","last_became_peered":"2023-01-02T18:16:48.329016+0000","last_unstale":"2023-01-02T18:17:23.371234+0000","last_undegraded":"2023-01-02T18:17:23.371234+0000","last_fullsized":"2023-01-02T18:17:23.371234+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374722+0000","last_change":"2023-01-02T18:16:53.346722+0000","last_active":"2023-01-02T18:17:23.374722+0000","last_peered":"2023-01-02T18:17:23.374722+0000","last_clean":"2023-01-02T18:17:23.374722+0000","last_became_active":"2023-01-02T18:16:51.339164+0000","last_became_peered":"2023-01-02T18:16:51.339164+0000","last_unstale":"2023-01-02T18:17:23.374722+0000","last_undegraded":"2023-01-02T18:17:23.374722+0000","last_fullsized":"2023-01-02T18:17:23.374722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373191+0000","last_change":"2023-01-02T18:17:09.322935+0000","last_active":"2023-01-02T18:17:23.373191+0000","last_peered":"2023-01-02T18:17:23.373191+0000","last_clean":"2023-01-02T18:17:23.373191+0000","last_became_active":"2023-01-02T18:17:07.346620+0000","last_became_peered":"2023-01-02T18:17:07.346620+0000","last_unstale":"2023-01-02T18:17:23.373191+0000","last_undegraded":"2023-01-02T18:17:23.373191+0000","last_fullsized":"2023-01-02T18:17:23.373191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"72'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373798+0000","last_change":"2023-01-02T18:17:01.321057+0000","last_active":"2023-01-02T18:17:23.373798+0000","last_peered":"2023-01-02T18:17:23.373798+0000","last_clean":"2023-01-02T18:17:23.373798+0000","last_became_active":"2023-01-02T18:16:59.310738+0000","last_became_peered":"2023-01-02T18:16:59.310738+0000","last_unstale":"2023-01-02T18:17:23.373798+0000","last_undegraded":"2023-01-02T18:17:23.373798+0000","last_fullsized":"2023-01-02T18:17:23.373798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377239+0000","last_change":"2023-01-02T18:16:57.317294+0000","last_active":"2023-01-02T18:17:23.377239+0000","last_peered":"2023-01-02T18:17:23.377239+0000","last_clean":"2023-01-02T18:17:23.377239+0000","last_became_active":"2023-01-02T18:16:55.316682+0000","last_became_peered":"2023-01-02T18:16:55.316682+0000","last_unstale":"2023-01-02T18:17:23.377239+0000","last_undegraded":"2023-01-02T18:17:23.377239+0000","last_fullsized":"2023-01-02T18:17:23.377239+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364476+0000","last_change":"2023-01-02T18:16:44.308144+0000","last_active":"2023-01-02T18:17:23.364476+0000","last_peered":"2023-01-02T18:17:23.364476+0000","last_clean":"2023-01-02T18:17:23.364476+0000","last_became_active":"2023-01-02T18:16:41.446839+0000","last_became_peered":"2023-01-02T18:16:41.446839+0000","last_unstale":"2023-01-02T18:17:23.364476+0000","last_undegraded":"2023-01-02T18:17:23.364476+0000","last_fullsized":"2023-01-02T18:17:23.364476+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"84'5","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.311859+0000","last_change":"2023-01-02T18:17:24.311859+0000","last_active":"2023-01-02T18:17:24.311859+0000","last_peered":"2023-01-02T18:17:24.311859+0000","last_clean":"2023-01-02T18:17:24.311859+0000","last_became_active":"2023-01-02T18:16:48.329379+0000","last_became_peered":"2023-01-02T18:16:48.329379+0000","last_unstale":"2023-01-02T18:17:24.311859+0000","last_undegraded":"2023-01-02T18:17:24.311859+0000","last_fullsized":"2023-01-02T18:17:24.311859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":30,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1c","version":"56'3","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366553+0000","last_change":"2023-01-02T18:16:49.310230+0000","last_active":"2023-01-02T18:17:23.366553+0000","last_peered":"2023-01-02T18:17:23.366553+0000","last_clean":"2023-01-02T18:17:23.366553+0000","last_became_active":"2023-01-02T18:16:48.324944+0000","last_became_peered":"2023-01-02T18:16:48.324944+0000","last_unstale":"2023-01-02T18:17:23.366553+0000","last_undegraded":"2023-01-02T18:17:23.366553+0000","last_fullsized":"2023-01-02T18:17:23.366553+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366587+0000","last_change":"2023-01-02T18:16:53.345118+0000","last_active":"2023-01-02T18:17:23.366587+0000","last_peered":"2023-01-02T18:17:23.366587+0000","last_clean":"2023-01-02T18:17:23.366587+0000","last_became_active":"2023-01-02T18:16:51.341889+0000","last_became_peered":"2023-01-02T18:16:51.341889+0000","last_unstale":"2023-01-02T18:17:23.366587+0000","last_undegraded":"2023-01-02T18:17:23.366587+0000","last_fullsized":"2023-01-02T18:17:23.366587+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":171,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1528,"num_read_kb":1379,"num_write":98,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":465,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2462,"num_read_kb":2197,"num_write":146,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":1365,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1027,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1631,"num_read_kb":1310,"num_write":203,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":422,"num_keys_recovered":94,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":2396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":104,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":70,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":109,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":1365,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7640,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":94364200,"statfs":{"total":96636764160,"available":96628940800,"internally_reserved":0,"allocated":1196032,"data_stored":568048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.69399999999999995}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.437},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73899999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7572,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":94364268,"statfs":{"total":96636764160,"available":96629010432,"internally_reserved":0,"allocated":1191936,"data_stored":576709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.58299999999999996}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.78700000000000003}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.432},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.623}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7580,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":94364260,"statfs":{"total":96636764160,"available":96629002240,"internally_reserved":0,"allocated":1200128,"data_stored":576686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.31},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.38}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.437},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.50900000000000001}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.501}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.46300000000000002}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7496,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":94364344,"statfs":{"total":96636764160,"available":96629088256,"internally_reserved":0,"allocated":1179648,"data_stored":568010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.38300000000000001}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.504}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.51300000000000001}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7132,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":6016,"kb_avail":94364708,"statfs":{"total":96636764160,"available":96629460992,"internally_reserved":0,"allocated":1134592,"data_stored":567625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6160384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.435},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.58699999999999997}]},{"osd":7,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7800,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94364040,"statfs":{"total":96636764160,"available":96628776960,"internally_reserved":0,"allocated":1228800,"data_stored":576970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.37}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.49399999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.621}]}]},{"osd":4,"up_from":0,"seq":55834574872,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":99,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":50,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:17:27.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:17:27.113 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:27.093+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:27.192 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:27.193+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:27.231 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:27.232 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:27.232 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:27.232 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:27.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:27.287 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:27.305 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:27.324 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:27.325 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:27.326+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:27.341 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:27.359 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:27.380 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:27.381 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:17:27.394 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:27.394+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:27.399 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 2 2023-01-02T18:17:27.400 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:17:27.400 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap1 2023-01-02T18:17:27.400 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap2 2023-01-02T18:17:27.400 INFO:tasks.workunit.client.0.smithi007.stdout:found snap1 with size 2097152 2023-01-02T18:17:27.400 INFO:tasks.workunit.client.0.smithi007.stdout:found snap2 with size 4194304 2023-01-02T18:17:27.401 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:27.403 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 2 2023-01-02T18:17:27.403 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:17:27.404 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap1-rename 2023-01-02T18:17:27.404 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap2 2023-01-02T18:17:27.404 INFO:tasks.workunit.client.0.smithi007.stdout:found snap1-rename with size 2097152 2023-01-02T18:17:27.404 INFO:tasks.workunit.client.0.smithi007.stdout:found snap2 with size 4194304 2023-01-02T18:17:27.414 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:27.414 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:27.420 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:27.422 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:27.423 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:27.423 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:27.423 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:27.423 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:27.423 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:27.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:27.486 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:17:27.491 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2023-01-02T18:17:27.379679+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2147,"num_objects":131,"num_object_clones":0,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":0,"num_read":8890,"num_read_kb":7829,"num_write":689,"num_write_kb":573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":492,"num_keys_recovered":102,"num_objects_omap":46,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":814,"ondisk_log_size":814,"up":466,"acting":466,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":466,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":45220,"kb_used_data":6964,"kb_used_omap":0,"kb_used_meta":38208,"kb_avail":566185820,"statfs":{"total":579820584960,"available":579774279680,"internally_reserved":0,"allocated":7131136,"data_stored":3434048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39124992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":213,"num_read_kb":176,"num_write":27,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.011377"},"pg_stats":[{"pgid":"9.15","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374531+0000","last_change":"2023-01-02T18:17:09.324265+0000","last_active":"2023-01-02T18:17:23.374531+0000","last_peered":"2023-01-02T18:17:23.374531+0000","last_clean":"2023-01-02T18:17:23.374531+0000","last_became_active":"2023-01-02T18:17:07.348058+0000","last_became_peered":"2023-01-02T18:17:07.348058+0000","last_unstale":"2023-01-02T18:17:23.374531+0000","last_undegraded":"2023-01-02T18:17:23.374531+0000","last_fullsized":"2023-01-02T18:17:23.374531+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373462+0000","last_change":"2023-01-02T18:17:01.320137+0000","last_active":"2023-01-02T18:17:22.373462+0000","last_peered":"2023-01-02T18:17:22.373462+0000","last_clean":"2023-01-02T18:17:22.373462+0000","last_became_active":"2023-01-02T18:16:59.324809+0000","last_became_peered":"2023-01-02T18:16:59.324809+0000","last_unstale":"2023-01-02T18:17:22.373462+0000","last_undegraded":"2023-01-02T18:17:22.373462+0000","last_fullsized":"2023-01-02T18:17:22.373462+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369360+0000","last_change":"2023-01-02T18:16:48.330409+0000","last_active":"2023-01-02T18:17:23.369360+0000","last_peered":"2023-01-02T18:17:23.369360+0000","last_clean":"2023-01-02T18:17:23.369360+0000","last_became_active":"2023-01-02T18:16:48.329903+0000","last_became_peered":"2023-01-02T18:16:48.329903+0000","last_unstale":"2023-01-02T18:17:23.369360+0000","last_undegraded":"2023-01-02T18:17:23.369360+0000","last_fullsized":"2023-01-02T18:17:23.369360+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":88,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365850+0000","last_change":"2023-01-02T18:17:23.366280+0000","last_active":"2023-01-02T18:17:23.365850+0000","last_peered":"2023-01-02T18:17:23.365850+0000","last_clean":"2023-01-02T18:17:23.365850+0000","last_became_active":"2023-01-02T18:16:42.460433+0000","last_became_peered":"2023-01-02T18:16:42.460433+0000","last_unstale":"2023-01-02T18:17:23.365850+0000","last_undegraded":"2023-01-02T18:17:23.365850+0000","last_fullsized":"2023-01-02T18:17:23.365850+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"2"},{"start":"e","length":"1"}]},{"pgid":"5.19","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374188+0000","last_change":"2023-01-02T18:16:49.304700+0000","last_active":"2023-01-02T18:17:23.374188+0000","last_peered":"2023-01-02T18:17:23.374188+0000","last_clean":"2023-01-02T18:17:23.374188+0000","last_became_active":"2023-01-02T18:16:46.314227+0000","last_became_peered":"2023-01-02T18:16:46.314227+0000","last_unstale":"2023-01-02T18:17:23.374188+0000","last_undegraded":"2023-01-02T18:17:23.374188+0000","last_fullsized":"2023-01-02T18:17:23.374188+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373646+0000","last_change":"2023-01-02T18:16:53.346444+0000","last_active":"2023-01-02T18:17:23.373646+0000","last_peered":"2023-01-02T18:17:23.373646+0000","last_clean":"2023-01-02T18:17:23.373646+0000","last_became_active":"2023-01-02T18:16:51.340482+0000","last_became_peered":"2023-01-02T18:16:51.340482+0000","last_unstale":"2023-01-02T18:17:23.373646+0000","last_undegraded":"2023-01-02T18:17:23.373646+0000","last_fullsized":"2023-01-02T18:17:23.373646+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":87,"num_read_kb":80,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":139,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373181+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:17:22.373181+0000","last_peered":"2023-01-02T18:17:22.373181+0000","last_clean":"2023-01-02T18:17:22.373181+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:17:22.373181+0000","last_undegraded":"2023-01-02T18:17:22.373181+0000","last_fullsized":"2023-01-02T18:17:22.373181+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375132+0000","last_change":"2023-01-02T18:17:09.308994+0000","last_active":"2023-01-02T18:17:23.375132+0000","last_peered":"2023-01-02T18:17:23.375132+0000","last_clean":"2023-01-02T18:17:23.375132+0000","last_became_active":"2023-01-02T18:17:07.339263+0000","last_became_peered":"2023-01-02T18:17:07.339263+0000","last_unstale":"2023-01-02T18:17:23.375132+0000","last_undegraded":"2023-01-02T18:17:23.375132+0000","last_fullsized":"2023-01-02T18:17:23.375132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'22","reported_seq":260,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374385+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:17:23.374385+0000","last_peered":"2023-01-02T18:17:23.374385+0000","last_clean":"2023-01-02T18:17:23.374385+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:17:23.374385+0000","last_undegraded":"2023-01-02T18:17:23.374385+0000","last_fullsized":"2023-01-02T18:17:23.374385+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":276,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364807+0000","last_change":"2023-01-02T18:16:44.306676+0000","last_active":"2023-01-02T18:17:23.364807+0000","last_peered":"2023-01-02T18:17:23.364807+0000","last_clean":"2023-01-02T18:17:23.364807+0000","last_became_active":"2023-01-02T18:16:41.446794+0000","last_became_peered":"2023-01-02T18:16:41.446794+0000","last_unstale":"2023-01-02T18:17:23.364807+0000","last_undegraded":"2023-01-02T18:17:23.364807+0000","last_fullsized":"2023-01-02T18:17:23.364807+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"91'21","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.329406+0000","last_change":"2023-01-02T18:17:24.322097+0000","last_active":"2023-01-02T18:17:24.329406+0000","last_peered":"2023-01-02T18:17:24.329406+0000","last_clean":"2023-01-02T18:17:24.329406+0000","last_became_active":"2023-01-02T18:16:37.427175+0000","last_became_peered":"2023-01-02T18:16:37.427175+0000","last_unstale":"2023-01-02T18:17:24.329406+0000","last_undegraded":"2023-01-02T18:17:24.329406+0000","last_fullsized":"2023-01-02T18:17:24.329406+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":205,"num_write":31,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.18","version":"0'0","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369625+0000","last_change":"2023-01-02T18:16:49.318455+0000","last_active":"2023-01-02T18:17:23.369625+0000","last_peered":"2023-01-02T18:17:23.369625+0000","last_clean":"2023-01-02T18:17:23.369625+0000","last_became_active":"2023-01-02T18:16:48.329597+0000","last_became_peered":"2023-01-02T18:16:48.329597+0000","last_unstale":"2023-01-02T18:17:23.369625+0000","last_undegraded":"2023-01-02T18:17:23.369625+0000","last_fullsized":"2023-01-02T18:17:23.369625+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366367+0000","last_change":"2023-01-02T18:16:53.344973+0000","last_active":"2023-01-02T18:17:23.366367+0000","last_peered":"2023-01-02T18:17:23.366367+0000","last_clean":"2023-01-02T18:17:23.366367+0000","last_became_active":"2023-01-02T18:16:51.341196+0000","last_became_peered":"2023-01-02T18:16:51.341196+0000","last_unstale":"2023-01-02T18:17:23.366367+0000","last_undegraded":"2023-01-02T18:17:23.366367+0000","last_fullsized":"2023-01-02T18:17:23.366367+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":122,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369943+0000","last_change":"2023-01-02T18:16:57.306888+0000","last_active":"2023-01-02T18:17:23.369943+0000","last_peered":"2023-01-02T18:17:23.369943+0000","last_clean":"2023-01-02T18:17:23.369943+0000","last_became_active":"2023-01-02T18:16:55.307841+0000","last_became_peered":"2023-01-02T18:16:55.307841+0000","last_unstale":"2023-01-02T18:17:23.369943+0000","last_undegraded":"2023-01-02T18:17:23.369943+0000","last_fullsized":"2023-01-02T18:17:23.369943+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.17","version":"76'1","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374966+0000","last_change":"2023-01-02T18:17:09.324016+0000","last_active":"2023-01-02T18:17:23.374966+0000","last_peered":"2023-01-02T18:17:23.374966+0000","last_clean":"2023-01-02T18:17:23.374966+0000","last_became_active":"2023-01-02T18:17:07.347854+0000","last_became_peered":"2023-01-02T18:17:07.347854+0000","last_unstale":"2023-01-02T18:17:23.374966+0000","last_undegraded":"2023-01-02T18:17:23.374966+0000","last_fullsized":"2023-01-02T18:17:23.374966+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"72'4","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364897+0000","last_change":"2023-01-02T18:17:01.311706+0000","last_active":"2023-01-02T18:17:23.364897+0000","last_peered":"2023-01-02T18:17:23.364897+0000","last_clean":"2023-01-02T18:17:23.364897+0000","last_became_active":"2023-01-02T18:16:59.313908+0000","last_became_peered":"2023-01-02T18:16:59.313908+0000","last_unstale":"2023-01-02T18:17:23.364897+0000","last_undegraded":"2023-01-02T18:17:23.364897+0000","last_fullsized":"2023-01-02T18:17:23.364897+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"51'2","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365523+0000","last_change":"2023-01-02T18:16:48.343757+0000","last_active":"2023-01-02T18:17:23.365523+0000","last_peered":"2023-01-02T18:17:23.365523+0000","last_clean":"2023-01-02T18:17:23.365523+0000","last_became_active":"2023-01-02T18:16:48.326121+0000","last_became_peered":"2023-01-02T18:16:48.326121+0000","last_unstale":"2023-01-02T18:17:23.365523+0000","last_undegraded":"2023-01-02T18:17:23.365523+0000","last_fullsized":"2023-01-02T18:17:23.365523+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"86'2","reported_seq":96,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.325567+0000","last_change":"2023-01-02T18:17:24.325723+0000","last_active":"2023-01-02T18:17:24.325567+0000","last_peered":"2023-01-02T18:17:24.325567+0000","last_clean":"2023-01-02T18:17:24.325567+0000","last_became_active":"2023-01-02T18:16:48.329613+0000","last_became_peered":"2023-01-02T18:16:48.329613+0000","last_unstale":"2023-01-02T18:17:24.325567+0000","last_undegraded":"2023-01-02T18:17:24.325567+0000","last_fullsized":"2023-01-02T18:17:24.325567+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1b","version":"56'1","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373664+0000","last_change":"2023-01-02T18:16:49.324862+0000","last_active":"2023-01-02T18:17:22.373664+0000","last_peered":"2023-01-02T18:17:22.373664+0000","last_clean":"2023-01-02T18:17:22.373664+0000","last_became_active":"2023-01-02T18:16:46.315844+0000","last_became_peered":"2023-01-02T18:16:46.315844+0000","last_unstale":"2023-01-02T18:17:22.373664+0000","last_undegraded":"2023-01-02T18:17:22.373664+0000","last_fullsized":"2023-01-02T18:17:22.373664+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372526+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:17:22.372526+0000","last_peered":"2023-01-02T18:17:22.372526+0000","last_clean":"2023-01-02T18:17:22.372526+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:17:22.372526+0000","last_undegraded":"2023-01-02T18:17:22.372526+0000","last_fullsized":"2023-01-02T18:17:22.372526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370465+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:17:23.370465+0000","last_peered":"2023-01-02T18:17:23.370465+0000","last_clean":"2023-01-02T18:17:23.370465+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:17:23.370465+0000","last_undegraded":"2023-01-02T18:17:23.370465+0000","last_fullsized":"2023-01-02T18:17:23.370465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.16","version":"76'1","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377142+0000","last_change":"2023-01-02T18:17:09.308912+0000","last_active":"2023-01-02T18:17:23.377142+0000","last_peered":"2023-01-02T18:17:23.377142+0000","last_clean":"2023-01-02T18:17:23.377142+0000","last_became_active":"2023-01-02T18:17:07.339397+0000","last_became_peered":"2023-01-02T18:17:07.339397+0000","last_unstale":"2023-01-02T18:17:23.377142+0000","last_undegraded":"2023-01-02T18:17:23.377142+0000","last_fullsized":"2023-01-02T18:17:23.377142+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375069+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:17:23.375069+0000","last_peered":"2023-01-02T18:17:23.375069+0000","last_clean":"2023-01-02T18:17:23.375069+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:17:23.375069+0000","last_undegraded":"2023-01-02T18:17:23.375069+0000","last_fullsized":"2023-01-02T18:17:23.375069+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364928+0000","last_change":"2023-01-02T18:16:48.330072+0000","last_active":"2023-01-02T18:17:23.364928+0000","last_peered":"2023-01-02T18:17:23.364928+0000","last_clean":"2023-01-02T18:17:23.364928+0000","last_became_active":"2023-01-02T18:16:48.329697+0000","last_became_peered":"2023-01-02T18:16:48.329697+0000","last_unstale":"2023-01-02T18:17:23.364928+0000","last_undegraded":"2023-01-02T18:17:23.364928+0000","last_fullsized":"2023-01-02T18:17:23.364928+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"86'25","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.325147+0000","last_change":"2023-01-02T18:17:24.325502+0000","last_active":"2023-01-02T18:17:24.325147+0000","last_peered":"2023-01-02T18:17:24.325147+0000","last_clean":"2023-01-02T18:17:24.325147+0000","last_became_active":"2023-01-02T18:16:48.325842+0000","last_became_peered":"2023-01-02T18:16:48.325842+0000","last_unstale":"2023-01-02T18:17:24.325147+0000","last_undegraded":"2023-01-02T18:17:24.325147+0000","last_fullsized":"2023-01-02T18:17:24.325147+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":47,"num_write":25,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":51,"num_keys_recovered":30,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1a","version":"56'2","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373350+0000","last_change":"2023-01-02T18:16:49.305216+0000","last_active":"2023-01-02T18:17:23.373350+0000","last_peered":"2023-01-02T18:17:23.373350+0000","last_clean":"2023-01-02T18:17:23.373350+0000","last_became_active":"2023-01-02T18:16:48.327069+0000","last_became_peered":"2023-01-02T18:16:48.327069+0000","last_unstale":"2023-01-02T18:17:23.373350+0000","last_undegraded":"2023-01-02T18:17:23.373350+0000","last_fullsized":"2023-01-02T18:17:23.373350+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373914+0000","last_change":"2023-01-02T18:16:53.344282+0000","last_active":"2023-01-02T18:17:23.373914+0000","last_peered":"2023-01-02T18:17:23.373914+0000","last_clean":"2023-01-02T18:17:23.373914+0000","last_became_active":"2023-01-02T18:16:51.342864+0000","last_became_peered":"2023-01-02T18:16:51.342864+0000","last_unstale":"2023-01-02T18:17:23.373914+0000","last_undegraded":"2023-01-02T18:17:23.373914+0000","last_fullsized":"2023-01-02T18:17:23.373914+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":560,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369717+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:17:23.369717+0000","last_peered":"2023-01-02T18:17:23.369717+0000","last_clean":"2023-01-02T18:17:23.369717+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:17:23.369717+0000","last_undegraded":"2023-01-02T18:17:23.369717+0000","last_fullsized":"2023-01-02T18:17:23.369717+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"76'79","reported_seq":552,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373349+0000","last_change":"2023-01-02T18:17:09.321800+0000","last_active":"2023-01-02T18:17:23.373349+0000","last_peered":"2023-01-02T18:17:23.373349+0000","last_clean":"2023-01-02T18:17:23.373349+0000","last_became_active":"2023-01-02T18:17:07.340907+0000","last_became_peered":"2023-01-02T18:17:07.340907+0000","last_unstale":"2023-01-02T18:17:23.373349+0000","last_undegraded":"2023-01-02T18:17:23.373349+0000","last_fullsized":"2023-01-02T18:17:23.373349+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1144,"num_read_kb":1037,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'17","reported_seq":163,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373355+0000","last_change":"2023-01-02T18:17:01.321350+0000","last_active":"2023-01-02T18:17:23.373355+0000","last_peered":"2023-01-02T18:17:23.373355+0000","last_clean":"2023-01-02T18:17:23.373355+0000","last_became_active":"2023-01-02T18:16:59.310618+0000","last_became_peered":"2023-01-02T18:16:59.310618+0000","last_unstale":"2023-01-02T18:17:23.373355+0000","last_undegraded":"2023-01-02T18:17:23.373355+0000","last_fullsized":"2023-01-02T18:17:23.373355+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370998+0000","last_change":"2023-01-02T18:16:57.307585+0000","last_active":"2023-01-02T18:17:23.370998+0000","last_peered":"2023-01-02T18:17:23.370998+0000","last_clean":"2023-01-02T18:17:23.370998+0000","last_became_active":"2023-01-02T18:16:55.315726+0000","last_became_peered":"2023-01-02T18:16:55.315726+0000","last_unstale":"2023-01-02T18:17:23.370998+0000","last_undegraded":"2023-01-02T18:17:23.370998+0000","last_fullsized":"2023-01-02T18:17:23.370998+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":70,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375711+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:17:23.375711+0000","last_peered":"2023-01-02T18:17:23.375711+0000","last_clean":"2023-01-02T18:17:23.375711+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:17:23.375711+0000","last_undegraded":"2023-01-02T18:17:23.375711+0000","last_fullsized":"2023-01-02T18:17:23.375711+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":95,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.362867+0000","last_change":"2023-01-02T18:17:23.363161+0000","last_active":"2023-01-02T18:17:23.362867+0000","last_peered":"2023-01-02T18:17:23.362867+0000","last_clean":"2023-01-02T18:17:23.362867+0000","last_became_active":"2023-01-02T18:16:48.331845+0000","last_became_peered":"2023-01-02T18:16:48.331845+0000","last_unstale":"2023-01-02T18:17:23.362867+0000","last_undegraded":"2023-01-02T18:17:23.362867+0000","last_fullsized":"2023-01-02T18:17:23.362867+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"2"},{"start":"e","length":"1"}]},{"pgid":"5.1d","version":"0'0","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374255+0000","last_change":"2023-01-02T18:16:49.324534+0000","last_active":"2023-01-02T18:17:22.374255+0000","last_peered":"2023-01-02T18:17:22.374255+0000","last_clean":"2023-01-02T18:17:22.374255+0000","last_became_active":"2023-01-02T18:16:48.327014+0000","last_became_peered":"2023-01-02T18:16:48.327014+0000","last_unstale":"2023-01-02T18:17:22.374255+0000","last_undegraded":"2023-01-02T18:17:22.374255+0000","last_fullsized":"2023-01-02T18:17:22.374255+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371166+0000","last_change":"2023-01-02T18:16:53.604464+0000","last_active":"2023-01-02T18:17:23.371166+0000","last_peered":"2023-01-02T18:17:23.371166+0000","last_clean":"2023-01-02T18:17:23.371166+0000","last_became_active":"2023-01-02T18:16:51.343193+0000","last_became_peered":"2023-01-02T18:16:51.343193+0000","last_unstale":"2023-01-02T18:17:23.371166+0000","last_undegraded":"2023-01-02T18:17:23.371166+0000","last_fullsized":"2023-01-02T18:17:23.371166+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364770+0000","last_change":"2023-01-02T18:17:09.310675+0000","last_active":"2023-01-02T18:17:23.364770+0000","last_peered":"2023-01-02T18:17:23.364770+0000","last_clean":"2023-01-02T18:17:23.364770+0000","last_became_active":"2023-01-02T18:17:07.345963+0000","last_became_peered":"2023-01-02T18:17:07.345963+0000","last_unstale":"2023-01-02T18:17:23.364770+0000","last_undegraded":"2023-01-02T18:17:23.364770+0000","last_fullsized":"2023-01-02T18:17:23.364770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374003+0000","last_change":"2023-01-02T18:17:01.322905+0000","last_active":"2023-01-02T18:17:23.374003+0000","last_peered":"2023-01-02T18:17:23.374003+0000","last_clean":"2023-01-02T18:17:23.374003+0000","last_became_active":"2023-01-02T18:16:59.312747+0000","last_became_peered":"2023-01-02T18:16:59.312747+0000","last_unstale":"2023-01-02T18:17:23.374003+0000","last_undegraded":"2023-01-02T18:17:23.374003+0000","last_fullsized":"2023-01-02T18:17:23.374003+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364690+0000","last_change":"2023-01-02T18:16:49.309259+0000","last_active":"2023-01-02T18:17:23.364690+0000","last_peered":"2023-01-02T18:17:23.364690+0000","last_clean":"2023-01-02T18:17:23.364690+0000","last_became_active":"2023-01-02T18:16:46.313760+0000","last_became_peered":"2023-01-02T18:16:46.313760+0000","last_unstale":"2023-01-02T18:17:23.364690+0000","last_undegraded":"2023-01-02T18:17:23.364690+0000","last_fullsized":"2023-01-02T18:17:23.364690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370067+0000","last_change":"2023-01-02T18:16:48.358986+0000","last_active":"2023-01-02T18:17:23.370067+0000","last_peered":"2023-01-02T18:17:23.370067+0000","last_clean":"2023-01-02T18:17:23.370067+0000","last_became_active":"2023-01-02T18:16:48.336041+0000","last_became_peered":"2023-01-02T18:16:48.336041+0000","last_unstale":"2023-01-02T18:17:23.370067+0000","last_undegraded":"2023-01-02T18:17:23.370067+0000","last_fullsized":"2023-01-02T18:17:23.370067+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":90,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363770+0000","last_change":"2023-01-02T18:17:23.364273+0000","last_active":"2023-01-02T18:17:23.363770+0000","last_peered":"2023-01-02T18:17:23.363770+0000","last_clean":"2023-01-02T18:17:23.363770+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:17:23.363770+0000","last_undegraded":"2023-01-02T18:17:23.363770+0000","last_fullsized":"2023-01-02T18:17:23.363770+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":80,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371141+0000","last_change":"2023-01-02T18:15:42.582591+0000","last_active":"2023-01-02T18:17:23.371141+0000","last_peered":"2023-01-02T18:17:23.371141+0000","last_clean":"2023-01-02T18:17:23.371141+0000","last_became_active":"2023-01-02T18:15:42.582328+0000","last_became_peered":"2023-01-02T18:15:42.582328+0000","last_unstale":"2023-01-02T18:17:23.371141+0000","last_undegraded":"2023-01-02T18:17:23.371141+0000","last_fullsized":"2023-01-02T18:17:23.371141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374181+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:17:23.374181+0000","last_peered":"2023-01-02T18:17:23.374181+0000","last_clean":"2023-01-02T18:17:23.374181+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:17:23.374181+0000","last_undegraded":"2023-01-02T18:17:23.374181+0000","last_fullsized":"2023-01-02T18:17:23.374181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366068+0000","last_change":"2023-01-02T18:16:57.312949+0000","last_active":"2023-01-02T18:17:23.366068+0000","last_peered":"2023-01-02T18:17:23.366068+0000","last_clean":"2023-01-02T18:17:23.366068+0000","last_became_active":"2023-01-02T18:16:55.315334+0000","last_became_peered":"2023-01-02T18:16:55.315334+0000","last_unstale":"2023-01-02T18:17:23.366068+0000","last_undegraded":"2023-01-02T18:17:23.366068+0000","last_fullsized":"2023-01-02T18:17:23.366068+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374488+0000","last_change":"2023-01-02T18:17:09.324343+0000","last_active":"2023-01-02T18:17:23.374488+0000","last_peered":"2023-01-02T18:17:23.374488+0000","last_clean":"2023-01-02T18:17:23.374488+0000","last_became_active":"2023-01-02T18:17:07.347667+0000","last_became_peered":"2023-01-02T18:17:07.347667+0000","last_unstale":"2023-01-02T18:17:23.374488+0000","last_undegraded":"2023-01-02T18:17:23.374488+0000","last_fullsized":"2023-01-02T18:17:23.374488+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373431+0000","last_change":"2023-01-02T18:17:01.319510+0000","last_active":"2023-01-02T18:17:22.373431+0000","last_peered":"2023-01-02T18:17:22.373431+0000","last_clean":"2023-01-02T18:17:22.373431+0000","last_became_active":"2023-01-02T18:16:59.327716+0000","last_became_peered":"2023-01-02T18:16:59.327716+0000","last_unstale":"2023-01-02T18:17:22.373431+0000","last_undegraded":"2023-01-02T18:17:22.373431+0000","last_fullsized":"2023-01-02T18:17:22.373431+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365558+0000","last_change":"2023-01-02T18:16:49.310704+0000","last_active":"2023-01-02T18:17:23.365558+0000","last_peered":"2023-01-02T18:17:23.365558+0000","last_clean":"2023-01-02T18:17:23.365558+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:23.365558+0000","last_undegraded":"2023-01-02T18:17:23.365558+0000","last_fullsized":"2023-01-02T18:17:23.365558+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364238+0000","last_change":"2023-01-02T18:16:44.307480+0000","last_active":"2023-01-02T18:17:23.364238+0000","last_peered":"2023-01-02T18:17:23.364238+0000","last_clean":"2023-01-02T18:17:23.364238+0000","last_became_active":"2023-01-02T18:16:41.447912+0000","last_became_peered":"2023-01-02T18:16:41.447912+0000","last_unstale":"2023-01-02T18:17:23.364238+0000","last_undegraded":"2023-01-02T18:17:23.364238+0000","last_fullsized":"2023-01-02T18:17:23.364238+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377611+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:17:23.377611+0000","last_peered":"2023-01-02T18:17:23.377611+0000","last_clean":"2023-01-02T18:17:23.377611+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:17:23.377611+0000","last_undegraded":"2023-01-02T18:17:23.377611+0000","last_fullsized":"2023-01-02T18:17:23.377611+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"91'12","reported_seq":111,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.322433+0000","last_change":"2023-01-02T18:17:24.322433+0000","last_active":"2023-01-02T18:17:24.322433+0000","last_peered":"2023-01-02T18:17:24.322433+0000","last_clean":"2023-01-02T18:17:24.322433+0000","last_became_active":"2023-01-02T18:16:37.431863+0000","last_became_peered":"2023-01-02T18:16:37.431863+0000","last_unstale":"2023-01-02T18:17:24.322433+0000","last_undegraded":"2023-01-02T18:17:24.322433+0000","last_fullsized":"2023-01-02T18:17:24.322433+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":46,"num_read_kb":35,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"6.2","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365986+0000","last_change":"2023-01-02T18:16:53.344851+0000","last_active":"2023-01-02T18:17:23.365986+0000","last_peered":"2023-01-02T18:17:23.365986+0000","last_clean":"2023-01-02T18:17:23.365986+0000","last_became_active":"2023-01-02T18:16:51.341804+0000","last_became_peered":"2023-01-02T18:16:51.341804+0000","last_unstale":"2023-01-02T18:17:23.365986+0000","last_undegraded":"2023-01-02T18:17:23.365986+0000","last_fullsized":"2023-01-02T18:17:23.365986+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365742+0000","last_change":"2023-01-02T18:16:57.313134+0000","last_active":"2023-01-02T18:17:23.365742+0000","last_peered":"2023-01-02T18:17:23.365742+0000","last_clean":"2023-01-02T18:17:23.365742+0000","last_became_active":"2023-01-02T18:16:55.311645+0000","last_became_peered":"2023-01-02T18:16:55.311645+0000","last_unstale":"2023-01-02T18:17:23.365742+0000","last_undegraded":"2023-01-02T18:17:23.365742+0000","last_fullsized":"2023-01-02T18:17:23.365742+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373922+0000","last_change":"2023-01-02T18:17:09.323298+0000","last_active":"2023-01-02T18:17:23.373922+0000","last_peered":"2023-01-02T18:17:23.373922+0000","last_clean":"2023-01-02T18:17:23.373922+0000","last_became_active":"2023-01-02T18:17:07.342742+0000","last_became_peered":"2023-01-02T18:17:07.342742+0000","last_unstale":"2023-01-02T18:17:23.373922+0000","last_undegraded":"2023-01-02T18:17:23.373922+0000","last_fullsized":"2023-01-02T18:17:23.373922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366253+0000","last_change":"2023-01-02T18:17:01.310492+0000","last_active":"2023-01-02T18:17:23.366253+0000","last_peered":"2023-01-02T18:17:23.366253+0000","last_clean":"2023-01-02T18:17:23.366253+0000","last_became_active":"2023-01-02T18:16:59.313793+0000","last_became_peered":"2023-01-02T18:16:59.313793+0000","last_unstale":"2023-01-02T18:17:23.366253+0000","last_undegraded":"2023-01-02T18:17:23.366253+0000","last_fullsized":"2023-01-02T18:17:23.366253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"56'1","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370249+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:17:23.370249+0000","last_peered":"2023-01-02T18:17:23.370249+0000","last_clean":"2023-01-02T18:17:23.370249+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:17:23.370249+0000","last_undegraded":"2023-01-02T18:17:23.370249+0000","last_fullsized":"2023-01-02T18:17:23.370249+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":123,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374923+0000","last_change":"2023-01-02T18:16:44.300067+0000","last_active":"2023-01-02T18:17:23.374923+0000","last_peered":"2023-01-02T18:17:23.374923+0000","last_clean":"2023-01-02T18:17:23.374923+0000","last_became_active":"2023-01-02T18:16:42.450970+0000","last_became_peered":"2023-01-02T18:16:42.450970+0000","last_unstale":"2023-01-02T18:17:23.374923+0000","last_undegraded":"2023-01-02T18:17:23.374923+0000","last_fullsized":"2023-01-02T18:17:23.374923+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":94,"num_read_kb":83,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"46'2","reported_seq":92,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.311347+0000","last_change":"2023-01-02T18:17:24.311593+0000","last_active":"2023-01-02T18:17:24.311347+0000","last_peered":"2023-01-02T18:17:24.311347+0000","last_clean":"2023-01-02T18:17:24.311347+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:17:24.311347+0000","last_undegraded":"2023-01-02T18:17:24.311347+0000","last_fullsized":"2023-01-02T18:17:24.311347+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374063+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:17:23.374063+0000","last_peered":"2023-01-02T18:17:23.374063+0000","last_clean":"2023-01-02T18:17:23.374063+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:17:23.374063+0000","last_undegraded":"2023-01-02T18:17:23.374063+0000","last_fullsized":"2023-01-02T18:17:23.374063+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370381+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:17:23.370381+0000","last_peered":"2023-01-02T18:17:23.370381+0000","last_clean":"2023-01-02T18:17:23.370381+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:17:23.370381+0000","last_undegraded":"2023-01-02T18:17:23.370381+0000","last_fullsized":"2023-01-02T18:17:23.370381+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364052+0000","last_change":"2023-01-02T18:16:57.312360+0000","last_active":"2023-01-02T18:17:23.364052+0000","last_peered":"2023-01-02T18:17:23.364052+0000","last_clean":"2023-01-02T18:17:23.364052+0000","last_became_active":"2023-01-02T18:16:55.317478+0000","last_became_peered":"2023-01-02T18:16:55.317478+0000","last_unstale":"2023-01-02T18:17:23.364052+0000","last_undegraded":"2023-01-02T18:17:23.364052+0000","last_fullsized":"2023-01-02T18:17:23.364052+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373139+0000","last_change":"2023-01-02T18:17:09.321395+0000","last_active":"2023-01-02T18:17:22.373139+0000","last_peered":"2023-01-02T18:17:22.373139+0000","last_clean":"2023-01-02T18:17:22.373139+0000","last_became_active":"2023-01-02T18:17:07.344789+0000","last_became_peered":"2023-01-02T18:17:07.344789+0000","last_unstale":"2023-01-02T18:17:22.373139+0000","last_undegraded":"2023-01-02T18:17:22.373139+0000","last_fullsized":"2023-01-02T18:17:22.373139+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"71'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373590+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:17:23.373590+0000","last_peered":"2023-01-02T18:17:23.373590+0000","last_clean":"2023-01-02T18:17:23.373590+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:17:23.373590+0000","last_undegraded":"2023-01-02T18:17:23.373590+0000","last_fullsized":"2023-01-02T18:17:23.373590+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'2","reported_seq":57,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373729+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:17:22.373729+0000","last_peered":"2023-01-02T18:17:22.373729+0000","last_clean":"2023-01-02T18:17:22.373729+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:17:22.373729+0000","last_undegraded":"2023-01-02T18:17:22.373729+0000","last_fullsized":"2023-01-02T18:17:22.373729+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"46'13","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.362124+0000","last_change":"2023-01-02T18:17:23.362426+0000","last_active":"2023-01-02T18:17:23.362124+0000","last_peered":"2023-01-02T18:17:23.362124+0000","last_clean":"2023-01-02T18:17:23.362124+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:23.362124+0000","last_undegraded":"2023-01-02T18:17:23.362124+0000","last_fullsized":"2023-01-02T18:17:23.362124+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":108,"num_read_kb":92,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a","length":"2"},{"start":"e","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":74,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.367326+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:17:23.367326+0000","last_peered":"2023-01-02T18:17:23.367326+0000","last_clean":"2023-01-02T18:17:23.367326+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:17:23.367326+0000","last_undegraded":"2023-01-02T18:17:23.367326+0000","last_fullsized":"2023-01-02T18:17:23.367326+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377645+0000","last_change":"2023-01-02T18:16:49.298888+0000","last_active":"2023-01-02T18:17:23.377645+0000","last_peered":"2023-01-02T18:17:23.377645+0000","last_clean":"2023-01-02T18:17:23.377645+0000","last_became_active":"2023-01-02T18:16:46.314689+0000","last_became_peered":"2023-01-02T18:16:46.314689+0000","last_unstale":"2023-01-02T18:17:23.377645+0000","last_undegraded":"2023-01-02T18:17:23.377645+0000","last_fullsized":"2023-01-02T18:17:23.377645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375415+0000","last_change":"2023-01-02T18:16:53.344265+0000","last_active":"2023-01-02T18:17:23.375415+0000","last_peered":"2023-01-02T18:17:23.375415+0000","last_clean":"2023-01-02T18:17:23.375415+0000","last_became_active":"2023-01-02T18:16:51.342951+0000","last_became_peered":"2023-01-02T18:16:51.342951+0000","last_unstale":"2023-01-02T18:17:23.375415+0000","last_undegraded":"2023-01-02T18:17:23.375415+0000","last_fullsized":"2023-01-02T18:17:23.375415+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374300+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:17:23.374300+0000","last_peered":"2023-01-02T18:17:23.374300+0000","last_clean":"2023-01-02T18:17:23.374300+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:17:23.374300+0000","last_undegraded":"2023-01-02T18:17:23.374300+0000","last_fullsized":"2023-01-02T18:17:23.374300+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363837+0000","last_change":"2023-01-02T18:17:09.306719+0000","last_active":"2023-01-02T18:17:23.363837+0000","last_peered":"2023-01-02T18:17:23.363837+0000","last_clean":"2023-01-02T18:17:23.363837+0000","last_became_active":"2023-01-02T18:17:07.336185+0000","last_became_peered":"2023-01-02T18:17:07.336185+0000","last_unstale":"2023-01-02T18:17:23.363837+0000","last_undegraded":"2023-01-02T18:17:23.363837+0000","last_fullsized":"2023-01-02T18:17:23.363837+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370225+0000","last_change":"2023-01-02T18:17:01.316849+0000","last_active":"2023-01-02T18:17:23.370225+0000","last_peered":"2023-01-02T18:17:23.370225+0000","last_clean":"2023-01-02T18:17:23.370225+0000","last_became_active":"2023-01-02T18:16:59.320366+0000","last_became_peered":"2023-01-02T18:16:59.320366+0000","last_unstale":"2023-01-02T18:17:23.370225+0000","last_undegraded":"2023-01-02T18:17:23.370225+0000","last_fullsized":"2023-01-02T18:17:23.370225+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374915+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:17:23.374915+0000","last_peered":"2023-01-02T18:17:23.374915+0000","last_clean":"2023-01-02T18:17:23.374915+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:17:23.374915+0000","last_undegraded":"2023-01-02T18:17:23.374915+0000","last_fullsized":"2023-01-02T18:17:23.374915+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":69,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370857+0000","last_change":"2023-01-02T18:16:48.345373+0000","last_active":"2023-01-02T18:17:23.370857+0000","last_peered":"2023-01-02T18:17:23.370857+0000","last_clean":"2023-01-02T18:17:23.370857+0000","last_became_active":"2023-01-02T18:16:48.328041+0000","last_became_peered":"2023-01-02T18:16:48.328041+0000","last_unstale":"2023-01-02T18:17:23.370857+0000","last_undegraded":"2023-01-02T18:17:23.370857+0000","last_fullsized":"2023-01-02T18:17:23.370857+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'6","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.317654+0000","last_change":"2023-01-02T18:17:24.317942+0000","last_active":"2023-01-02T18:17:24.317654+0000","last_peered":"2023-01-02T18:17:24.317654+0000","last_clean":"2023-01-02T18:17:24.317654+0000","last_became_active":"2023-01-02T18:16:42.441589+0000","last_became_peered":"2023-01-02T18:16:42.441589+0000","last_unstale":"2023-01-02T18:17:24.317654+0000","last_undegraded":"2023-01-02T18:17:24.317654+0000","last_fullsized":"2023-01-02T18:17:24.317654+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373410+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:17:23.373410+0000","last_peered":"2023-01-02T18:17:23.373410+0000","last_clean":"2023-01-02T18:17:23.373410+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:17:23.373410+0000","last_undegraded":"2023-01-02T18:17:23.373410+0000","last_fullsized":"2023-01-02T18:17:23.373410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374695+0000","last_change":"2023-01-02T18:16:42.460481+0000","last_active":"2023-01-02T18:17:23.374695+0000","last_peered":"2023-01-02T18:17:23.374695+0000","last_clean":"2023-01-02T18:17:23.374695+0000","last_became_active":"2023-01-02T18:16:42.460130+0000","last_became_peered":"2023-01-02T18:16:42.460130+0000","last_unstale":"2023-01-02T18:17:23.374695+0000","last_undegraded":"2023-01-02T18:17:23.374695+0000","last_fullsized":"2023-01-02T18:17:23.374695+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":562,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.367208+0000","last_change":"2023-01-02T18:16:53.345442+0000","last_active":"2023-01-02T18:17:23.367208+0000","last_peered":"2023-01-02T18:17:23.367208+0000","last_clean":"2023-01-02T18:17:23.367208+0000","last_became_active":"2023-01-02T18:16:51.341121+0000","last_became_peered":"2023-01-02T18:16:51.341121+0000","last_unstale":"2023-01-02T18:17:23.367208+0000","last_undegraded":"2023-01-02T18:17:23.367208+0000","last_fullsized":"2023-01-02T18:17:23.367208+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373984+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:17:22.373984+0000","last_peered":"2023-01-02T18:17:22.373984+0000","last_clean":"2023-01-02T18:17:22.373984+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:17:22.373984+0000","last_undegraded":"2023-01-02T18:17:22.373984+0000","last_fullsized":"2023-01-02T18:17:22.373984+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"76'9","reported_seq":133,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373452+0000","last_change":"2023-01-02T18:17:09.322846+0000","last_active":"2023-01-02T18:17:23.373452+0000","last_peered":"2023-01-02T18:17:23.373452+0000","last_clean":"2023-01-02T18:17:23.373452+0000","last_became_active":"2023-01-02T18:17:07.342985+0000","last_became_peered":"2023-01-02T18:17:07.342985+0000","last_unstale":"2023-01-02T18:17:23.373452+0000","last_undegraded":"2023-01-02T18:17:23.373452+0000","last_fullsized":"2023-01-02T18:17:23.373452+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"72'1","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364813+0000","last_change":"2023-01-02T18:17:01.311985+0000","last_active":"2023-01-02T18:17:23.364813+0000","last_peered":"2023-01-02T18:17:23.364813+0000","last_clean":"2023-01-02T18:17:23.364813+0000","last_became_active":"2023-01-02T18:16:59.316880+0000","last_became_peered":"2023-01-02T18:16:59.316880+0000","last_unstale":"2023-01-02T18:17:23.364813+0000","last_undegraded":"2023-01-02T18:17:23.364813+0000","last_fullsized":"2023-01-02T18:17:23.364813+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377506+0000","last_change":"2023-01-02T18:16:44.298099+0000","last_active":"2023-01-02T18:17:23.377506+0000","last_peered":"2023-01-02T18:17:23.377506+0000","last_clean":"2023-01-02T18:17:23.377506+0000","last_became_active":"2023-01-02T18:16:42.439207+0000","last_became_peered":"2023-01-02T18:16:42.439207+0000","last_unstale":"2023-01-02T18:17:23.377506+0000","last_undegraded":"2023-01-02T18:17:23.377506+0000","last_fullsized":"2023-01-02T18:17:23.377506+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"90'10","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.311297+0000","last_change":"2023-01-02T18:17:24.311558+0000","last_active":"2023-01-02T18:17:24.311297+0000","last_peered":"2023-01-02T18:17:24.311297+0000","last_clean":"2023-01-02T18:17:24.311297+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:17:24.311297+0000","last_undegraded":"2023-01-02T18:17:24.311297+0000","last_fullsized":"2023-01-02T18:17:24.311297+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":84,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"2.1","version":"0'0","reported_seq":80,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364725+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:17:23.364725+0000","last_peered":"2023-01-02T18:17:23.364725+0000","last_clean":"2023-01-02T18:17:23.364725+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:17:23.364725+0000","last_undegraded":"2023-01-02T18:17:23.364725+0000","last_fullsized":"2023-01-02T18:17:23.364725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377430+0000","last_change":"2023-01-02T18:16:49.298954+0000","last_active":"2023-01-02T18:17:23.377430+0000","last_peered":"2023-01-02T18:17:23.377430+0000","last_clean":"2023-01-02T18:17:23.377430+0000","last_became_active":"2023-01-02T18:16:46.316378+0000","last_became_peered":"2023-01-02T18:16:46.316378+0000","last_unstale":"2023-01-02T18:17:23.377430+0000","last_undegraded":"2023-01-02T18:17:23.377430+0000","last_fullsized":"2023-01-02T18:17:23.377430+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374202+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:17:23.374202+0000","last_peered":"2023-01-02T18:17:23.374202+0000","last_clean":"2023-01-02T18:17:23.374202+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:17:23.374202+0000","last_undegraded":"2023-01-02T18:17:23.374202+0000","last_fullsized":"2023-01-02T18:17:23.374202+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373328+0000","last_change":"2023-01-02T18:16:57.306312+0000","last_active":"2023-01-02T18:17:22.373328+0000","last_peered":"2023-01-02T18:17:22.373328+0000","last_clean":"2023-01-02T18:17:22.373328+0000","last_became_active":"2023-01-02T18:16:55.314537+0000","last_became_peered":"2023-01-02T18:16:55.314537+0000","last_unstale":"2023-01-02T18:17:22.373328+0000","last_undegraded":"2023-01-02T18:17:22.373328+0000","last_fullsized":"2023-01-02T18:17:22.373328+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.9","version":"76'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373453+0000","last_change":"2023-01-02T18:17:09.322082+0000","last_active":"2023-01-02T18:17:23.373453+0000","last_peered":"2023-01-02T18:17:23.373453+0000","last_clean":"2023-01-02T18:17:23.373453+0000","last_became_active":"2023-01-02T18:17:07.340751+0000","last_became_peered":"2023-01-02T18:17:07.340751+0000","last_unstale":"2023-01-02T18:17:23.373453+0000","last_undegraded":"2023-01-02T18:17:23.373453+0000","last_fullsized":"2023-01-02T18:17:23.373453+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363949+0000","last_change":"2023-01-02T18:17:01.311731+0000","last_active":"2023-01-02T18:17:23.363949+0000","last_peered":"2023-01-02T18:17:23.363949+0000","last_clean":"2023-01-02T18:17:23.363949+0000","last_became_active":"2023-01-02T18:16:59.312608+0000","last_became_peered":"2023-01-02T18:16:59.312608+0000","last_unstale":"2023-01-02T18:17:23.363949+0000","last_undegraded":"2023-01-02T18:17:23.363949+0000","last_fullsized":"2023-01-02T18:17:23.363949+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375557+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:17:23.375557+0000","last_peered":"2023-01-02T18:17:23.375557+0000","last_clean":"2023-01-02T18:17:23.375557+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:17:23.375557+0000","last_undegraded":"2023-01-02T18:17:23.375557+0000","last_fullsized":"2023-01-02T18:17:23.375557+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"85'12","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.325049+0000","last_change":"2023-01-02T18:17:24.325499+0000","last_active":"2023-01-02T18:17:24.325049+0000","last_peered":"2023-01-02T18:17:24.325049+0000","last_clean":"2023-01-02T18:17:24.325049+0000","last_became_active":"2023-01-02T18:16:48.335418+0000","last_became_peered":"2023-01-02T18:16:48.335418+0000","last_unstale":"2023-01-02T18:17:24.325049+0000","last_undegraded":"2023-01-02T18:17:24.325049+0000","last_fullsized":"2023-01-02T18:17:24.325049+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"2.2","version":"0'0","reported_seq":53,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374708+0000","last_change":"2023-01-02T18:16:42.442424+0000","last_active":"2023-01-02T18:17:23.374708+0000","last_peered":"2023-01-02T18:17:23.374708+0000","last_clean":"2023-01-02T18:17:23.374708+0000","last_became_active":"2023-01-02T18:16:42.442110+0000","last_became_peered":"2023-01-02T18:16:42.442110+0000","last_unstale":"2023-01-02T18:17:23.374708+0000","last_undegraded":"2023-01-02T18:17:23.374708+0000","last_fullsized":"2023-01-02T18:17:23.374708+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374162+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:17:22.374162+0000","last_peered":"2023-01-02T18:17:22.374162+0000","last_clean":"2023-01-02T18:17:22.374162+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:17:22.374162+0000","last_undegraded":"2023-01-02T18:17:22.374162+0000","last_fullsized":"2023-01-02T18:17:22.374162+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365380+0000","last_change":"2023-01-02T18:16:53.345663+0000","last_active":"2023-01-02T18:17:23.365380+0000","last_peered":"2023-01-02T18:17:23.365380+0000","last_clean":"2023-01-02T18:17:23.365380+0000","last_became_active":"2023-01-02T18:16:51.341075+0000","last_became_peered":"2023-01-02T18:16:51.341075+0000","last_unstale":"2023-01-02T18:17:23.365380+0000","last_undegraded":"2023-01-02T18:17:23.365380+0000","last_fullsized":"2023-01-02T18:17:23.365380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371402+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:17:23.371402+0000","last_peered":"2023-01-02T18:17:23.371402+0000","last_clean":"2023-01-02T18:17:23.371402+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:17:23.371402+0000","last_undegraded":"2023-01-02T18:17:23.371402+0000","last_fullsized":"2023-01-02T18:17:23.371402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365700+0000","last_change":"2023-01-02T18:17:09.315581+0000","last_active":"2023-01-02T18:17:23.365700+0000","last_peered":"2023-01-02T18:17:23.365700+0000","last_clean":"2023-01-02T18:17:23.365700+0000","last_became_active":"2023-01-02T18:17:07.337862+0000","last_became_peered":"2023-01-02T18:17:07.337862+0000","last_unstale":"2023-01-02T18:17:23.365700+0000","last_undegraded":"2023-01-02T18:17:23.365700+0000","last_fullsized":"2023-01-02T18:17:23.365700+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373526+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:17:22.373526+0000","last_peered":"2023-01-02T18:17:22.373526+0000","last_clean":"2023-01-02T18:17:22.373526+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:17:22.373526+0000","last_undegraded":"2023-01-02T18:17:22.373526+0000","last_fullsized":"2023-01-02T18:17:22.373526+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'4","reported_seq":60,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370531+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:17:23.370531+0000","last_peered":"2023-01-02T18:17:23.370531+0000","last_clean":"2023-01-02T18:17:23.370531+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:23.370531+0000","last_undegraded":"2023-01-02T18:17:23.370531+0000","last_fullsized":"2023-01-02T18:17:23.370531+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375238+0000","last_change":"2023-01-02T18:16:48.336174+0000","last_active":"2023-01-02T18:17:23.375238+0000","last_peered":"2023-01-02T18:17:23.375238+0000","last_clean":"2023-01-02T18:17:23.375238+0000","last_became_active":"2023-01-02T18:16:48.335738+0000","last_became_peered":"2023-01-02T18:16:48.335738+0000","last_unstale":"2023-01-02T18:17:23.375238+0000","last_undegraded":"2023-01-02T18:17:23.375238+0000","last_fullsized":"2023-01-02T18:17:23.375238+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"82'2","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.319986+0000","last_change":"2023-01-02T18:17:24.320205+0000","last_active":"2023-01-02T18:17:24.319986+0000","last_peered":"2023-01-02T18:17:24.319986+0000","last_clean":"2023-01-02T18:17:24.319986+0000","last_became_active":"2023-01-02T18:16:42.461031+0000","last_became_peered":"2023-01-02T18:16:42.461031+0000","last_unstale":"2023-01-02T18:17:24.319986+0000","last_undegraded":"2023-01-02T18:17:24.319986+0000","last_fullsized":"2023-01-02T18:17:24.319986+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":1,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"2.4","version":"0'0","reported_seq":81,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375633+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:17:23.375633+0000","last_peered":"2023-01-02T18:17:23.375633+0000","last_clean":"2023-01-02T18:17:23.375633+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:17:23.375633+0000","last_undegraded":"2023-01-02T18:17:23.375633+0000","last_fullsized":"2023-01-02T18:17:23.375633+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372622+0000","last_change":"2023-01-02T18:16:53.685845+0000","last_active":"2023-01-02T18:17:22.372622+0000","last_peered":"2023-01-02T18:17:22.372622+0000","last_clean":"2023-01-02T18:17:22.372622+0000","last_became_active":"2023-01-02T18:16:51.345111+0000","last_became_peered":"2023-01-02T18:16:51.345111+0000","last_unstale":"2023-01-02T18:17:22.372622+0000","last_undegraded":"2023-01-02T18:17:22.372622+0000","last_fullsized":"2023-01-02T18:17:22.372622+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364338+0000","last_change":"2023-01-02T18:16:57.312915+0000","last_active":"2023-01-02T18:17:23.364338+0000","last_peered":"2023-01-02T18:17:23.364338+0000","last_clean":"2023-01-02T18:17:23.364338+0000","last_became_active":"2023-01-02T18:16:55.310046+0000","last_became_peered":"2023-01-02T18:16:55.310046+0000","last_unstale":"2023-01-02T18:17:23.364338+0000","last_undegraded":"2023-01-02T18:17:23.364338+0000","last_fullsized":"2023-01-02T18:17:23.364338+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2","version":"76'12","reported_seq":140,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364321+0000","last_change":"2023-01-02T18:17:09.308235+0000","last_active":"2023-01-02T18:17:23.364321+0000","last_peered":"2023-01-02T18:17:23.364321+0000","last_clean":"2023-01-02T18:17:23.364321+0000","last_became_active":"2023-01-02T18:17:07.340498+0000","last_became_peered":"2023-01-02T18:17:07.340498+0000","last_unstale":"2023-01-02T18:17:23.364321+0000","last_undegraded":"2023-01-02T18:17:23.364321+0000","last_fullsized":"2023-01-02T18:17:23.364321+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"69'1","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370475+0000","last_change":"2023-01-02T18:17:01.317345+0000","last_active":"2023-01-02T18:17:23.370475+0000","last_peered":"2023-01-02T18:17:23.370475+0000","last_clean":"2023-01-02T18:17:23.370475+0000","last_became_active":"2023-01-02T18:16:59.309565+0000","last_became_peered":"2023-01-02T18:16:59.309565+0000","last_unstale":"2023-01-02T18:17:23.370475+0000","last_undegraded":"2023-01-02T18:17:23.370475+0000","last_fullsized":"2023-01-02T18:17:23.370475+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":11,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377418+0000","last_change":"2023-01-02T18:16:44.298243+0000","last_active":"2023-01-02T18:17:23.377418+0000","last_peered":"2023-01-02T18:17:23.377418+0000","last_clean":"2023-01-02T18:17:23.377418+0000","last_became_active":"2023-01-02T18:16:41.448643+0000","last_became_peered":"2023-01-02T18:16:41.448643+0000","last_unstale":"2023-01-02T18:17:23.377418+0000","last_undegraded":"2023-01-02T18:17:23.377418+0000","last_fullsized":"2023-01-02T18:17:23.377418+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"76'8","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.317126+0000","last_change":"2023-01-02T18:17:24.317864+0000","last_active":"2023-01-02T18:17:24.317126+0000","last_peered":"2023-01-02T18:17:24.317126+0000","last_clean":"2023-01-02T18:17:24.317126+0000","last_became_active":"2023-01-02T18:16:37.414106+0000","last_became_peered":"2023-01-02T18:16:37.414106+0000","last_unstale":"2023-01-02T18:17:24.317126+0000","last_undegraded":"2023-01-02T18:17:24.317126+0000","last_fullsized":"2023-01-02T18:17:24.317126+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.e","version":"0'0","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374055+0000","last_change":"2023-01-02T18:16:49.324748+0000","last_active":"2023-01-02T18:17:22.374055+0000","last_peered":"2023-01-02T18:17:22.374055+0000","last_clean":"2023-01-02T18:17:22.374055+0000","last_became_active":"2023-01-02T18:16:48.317958+0000","last_became_peered":"2023-01-02T18:16:48.317958+0000","last_unstale":"2023-01-02T18:17:22.374055+0000","last_undegraded":"2023-01-02T18:17:22.374055+0000","last_fullsized":"2023-01-02T18:17:22.374055+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374268+0000","last_change":"2023-01-02T18:16:53.686661+0000","last_active":"2023-01-02T18:17:22.374268+0000","last_peered":"2023-01-02T18:17:22.374268+0000","last_clean":"2023-01-02T18:17:22.374268+0000","last_became_active":"2023-01-02T18:16:51.345330+0000","last_became_peered":"2023-01-02T18:16:51.345330+0000","last_unstale":"2023-01-02T18:17:22.374268+0000","last_undegraded":"2023-01-02T18:17:22.374268+0000","last_fullsized":"2023-01-02T18:17:22.374268+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370786+0000","last_change":"2023-01-02T18:16:57.307540+0000","last_active":"2023-01-02T18:17:23.370786+0000","last_peered":"2023-01-02T18:17:23.370786+0000","last_clean":"2023-01-02T18:17:23.370786+0000","last_became_active":"2023-01-02T18:16:55.319082+0000","last_became_peered":"2023-01-02T18:16:55.319082+0000","last_unstale":"2023-01-02T18:17:23.370786+0000","last_undegraded":"2023-01-02T18:17:23.370786+0000","last_fullsized":"2023-01-02T18:17:23.370786+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"76'4","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374824+0000","last_change":"2023-01-02T18:17:09.323147+0000","last_active":"2023-01-02T18:17:23.374824+0000","last_peered":"2023-01-02T18:17:23.374824+0000","last_clean":"2023-01-02T18:17:23.374824+0000","last_became_active":"2023-01-02T18:17:07.341052+0000","last_became_peered":"2023-01-02T18:17:07.341052+0000","last_unstale":"2023-01-02T18:17:23.374824+0000","last_undegraded":"2023-01-02T18:17:23.374824+0000","last_fullsized":"2023-01-02T18:17:23.374824+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372809+0000","last_change":"2023-01-02T18:17:01.318897+0000","last_active":"2023-01-02T18:17:22.372809+0000","last_peered":"2023-01-02T18:17:22.372809+0000","last_clean":"2023-01-02T18:17:22.372809+0000","last_became_active":"2023-01-02T18:16:59.321009+0000","last_became_peered":"2023-01-02T18:16:59.321009+0000","last_unstale":"2023-01-02T18:17:22.372809+0000","last_undegraded":"2023-01-02T18:17:22.372809+0000","last_fullsized":"2023-01-02T18:17:22.372809+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"51'1","reported_seq":66,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371082+0000","last_change":"2023-01-02T18:16:48.352507+0000","last_active":"2023-01-02T18:17:23.371082+0000","last_peered":"2023-01-02T18:17:23.371082+0000","last_clean":"2023-01-02T18:17:23.371082+0000","last_became_active":"2023-01-02T18:16:48.330483+0000","last_became_peered":"2023-01-02T18:16:48.330483+0000","last_unstale":"2023-01-02T18:17:23.371082+0000","last_undegraded":"2023-01-02T18:17:23.371082+0000","last_fullsized":"2023-01-02T18:17:23.371082+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":71,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.334862+0000","last_change":"2023-01-02T18:17:24.335074+0000","last_active":"2023-01-02T18:17:24.334862+0000","last_peered":"2023-01-02T18:17:24.334862+0000","last_clean":"2023-01-02T18:17:24.334862+0000","last_became_active":"2023-01-02T18:16:48.322710+0000","last_became_peered":"2023-01-02T18:16:48.322710+0000","last_unstale":"2023-01-02T18:17:24.334862+0000","last_undegraded":"2023-01-02T18:17:24.334862+0000","last_fullsized":"2023-01-02T18:17:24.334862+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.f","version":"0'0","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371320+0000","last_change":"2023-01-02T18:16:49.319064+0000","last_active":"2023-01-02T18:17:23.371320+0000","last_peered":"2023-01-02T18:17:23.371320+0000","last_clean":"2023-01-02T18:17:23.371320+0000","last_became_active":"2023-01-02T18:16:48.324476+0000","last_became_peered":"2023-01-02T18:16:48.324476+0000","last_unstale":"2023-01-02T18:17:23.371320+0000","last_undegraded":"2023-01-02T18:17:23.371320+0000","last_fullsized":"2023-01-02T18:17:23.371320+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365275+0000","last_change":"2023-01-02T18:16:53.345390+0000","last_active":"2023-01-02T18:17:23.365275+0000","last_peered":"2023-01-02T18:17:23.365275+0000","last_clean":"2023-01-02T18:17:23.365275+0000","last_became_active":"2023-01-02T18:16:51.339020+0000","last_became_peered":"2023-01-02T18:16:51.339020+0000","last_unstale":"2023-01-02T18:17:23.365275+0000","last_undegraded":"2023-01-02T18:17:23.365275+0000","last_fullsized":"2023-01-02T18:17:23.365275+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371193+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:17:23.371193+0000","last_peered":"2023-01-02T18:17:23.371193+0000","last_clean":"2023-01-02T18:17:23.371193+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:17:23.371193+0000","last_undegraded":"2023-01-02T18:17:23.371193+0000","last_fullsized":"2023-01-02T18:17:23.371193+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369215+0000","last_change":"2023-01-02T18:17:09.330500+0000","last_active":"2023-01-02T18:17:23.369215+0000","last_peered":"2023-01-02T18:17:23.369215+0000","last_clean":"2023-01-02T18:17:23.369215+0000","last_became_active":"2023-01-02T18:17:07.345902+0000","last_became_peered":"2023-01-02T18:17:07.345902+0000","last_unstale":"2023-01-02T18:17:23.369215+0000","last_undegraded":"2023-01-02T18:17:23.369215+0000","last_fullsized":"2023-01-02T18:17:23.369215+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373529+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:17:23.373529+0000","last_peered":"2023-01-02T18:17:23.373529+0000","last_clean":"2023-01-02T18:17:23.373529+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:17:23.373529+0000","last_undegraded":"2023-01-02T18:17:23.373529+0000","last_fullsized":"2023-01-02T18:17:23.373529+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.376891+0000","last_change":"2023-01-02T18:16:48.329052+0000","last_active":"2023-01-02T18:17:23.376891+0000","last_peered":"2023-01-02T18:17:23.376891+0000","last_clean":"2023-01-02T18:17:23.376891+0000","last_became_active":"2023-01-02T18:16:48.327662+0000","last_became_peered":"2023-01-02T18:16:48.327662+0000","last_unstale":"2023-01-02T18:17:23.376891+0000","last_undegraded":"2023-01-02T18:17:23.376891+0000","last_fullsized":"2023-01-02T18:17:23.376891+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'4","reported_seq":114,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.324519+0000","last_change":"2023-01-02T18:17:24.324710+0000","last_active":"2023-01-02T18:17:24.324519+0000","last_peered":"2023-01-02T18:17:24.324519+0000","last_clean":"2023-01-02T18:17:24.324519+0000","last_became_active":"2023-01-02T18:16:48.329461+0000","last_became_peered":"2023-01-02T18:16:48.329461+0000","last_unstale":"2023-01-02T18:17:24.324519+0000","last_undegraded":"2023-01-02T18:17:24.324519+0000","last_fullsized":"2023-01-02T18:17:24.324519+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.c","version":"0'0","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373224+0000","last_change":"2023-01-02T18:16:49.323150+0000","last_active":"2023-01-02T18:17:22.373224+0000","last_peered":"2023-01-02T18:17:22.373224+0000","last_clean":"2023-01-02T18:17:22.373224+0000","last_became_active":"2023-01-02T18:16:48.326635+0000","last_became_peered":"2023-01-02T18:16:48.326635+0000","last_unstale":"2023-01-02T18:17:22.373224+0000","last_undegraded":"2023-01-02T18:17:22.373224+0000","last_fullsized":"2023-01-02T18:17:22.373224+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366670+0000","last_change":"2023-01-02T18:16:53.345223+0000","last_active":"2023-01-02T18:17:23.366670+0000","last_peered":"2023-01-02T18:17:23.366670+0000","last_clean":"2023-01-02T18:17:23.366670+0000","last_became_active":"2023-01-02T18:16:51.341580+0000","last_became_peered":"2023-01-02T18:16:51.341580+0000","last_unstale":"2023-01-02T18:17:23.366670+0000","last_undegraded":"2023-01-02T18:17:23.366670+0000","last_fullsized":"2023-01-02T18:17:23.366670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377626+0000","last_change":"2023-01-02T18:16:57.305459+0000","last_active":"2023-01-02T18:17:23.377626+0000","last_peered":"2023-01-02T18:17:23.377626+0000","last_clean":"2023-01-02T18:17:23.377626+0000","last_became_active":"2023-01-02T18:16:55.315865+0000","last_became_peered":"2023-01-02T18:16:55.315865+0000","last_unstale":"2023-01-02T18:17:23.377626+0000","last_undegraded":"2023-01-02T18:17:23.377626+0000","last_fullsized":"2023-01-02T18:17:23.377626+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364146+0000","last_change":"2023-01-02T18:17:09.307789+0000","last_active":"2023-01-02T18:17:23.364146+0000","last_peered":"2023-01-02T18:17:23.364146+0000","last_clean":"2023-01-02T18:17:23.364146+0000","last_became_active":"2023-01-02T18:17:07.345090+0000","last_became_peered":"2023-01-02T18:17:07.345090+0000","last_unstale":"2023-01-02T18:17:23.364146+0000","last_undegraded":"2023-01-02T18:17:23.364146+0000","last_fullsized":"2023-01-02T18:17:23.364146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"72'11","reported_seq":87,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363954+0000","last_change":"2023-01-02T18:17:01.311899+0000","last_active":"2023-01-02T18:17:23.363954+0000","last_peered":"2023-01-02T18:17:23.363954+0000","last_clean":"2023-01-02T18:17:23.363954+0000","last_became_active":"2023-01-02T18:16:59.309612+0000","last_became_peered":"2023-01-02T18:16:59.309612+0000","last_unstale":"2023-01-02T18:17:23.363954+0000","last_undegraded":"2023-01-02T18:17:23.363954+0000","last_fullsized":"2023-01-02T18:17:23.363954+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":64,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365321+0000","last_change":"2023-01-02T18:16:48.328829+0000","last_active":"2023-01-02T18:17:23.365321+0000","last_peered":"2023-01-02T18:17:23.365321+0000","last_clean":"2023-01-02T18:17:23.365321+0000","last_became_active":"2023-01-02T18:16:48.328372+0000","last_became_peered":"2023-01-02T18:16:48.328372+0000","last_unstale":"2023-01-02T18:17:23.365321+0000","last_undegraded":"2023-01-02T18:17:23.365321+0000","last_fullsized":"2023-01-02T18:17:23.365321+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":99,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.321028+0000","last_change":"2023-01-02T18:17:24.321209+0000","last_active":"2023-01-02T18:17:24.321028+0000","last_peered":"2023-01-02T18:17:24.321028+0000","last_clean":"2023-01-02T18:17:24.321028+0000","last_became_active":"2023-01-02T18:16:37.415896+0000","last_became_peered":"2023-01-02T18:16:37.415896+0000","last_unstale":"2023-01-02T18:17:24.321028+0000","last_undegraded":"2023-01-02T18:17:24.321028+0000","last_fullsized":"2023-01-02T18:17:24.321028+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.d","version":"56'3","reported_seq":54,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373942+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:17:23.373942+0000","last_peered":"2023-01-02T18:17:23.373942+0000","last_clean":"2023-01-02T18:17:23.373942+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:17:23.373942+0000","last_undegraded":"2023-01-02T18:17:23.373942+0000","last_fullsized":"2023-01-02T18:17:23.373942+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377333+0000","last_change":"2023-01-02T18:16:53.344544+0000","last_active":"2023-01-02T18:17:23.377333+0000","last_peered":"2023-01-02T18:17:23.377333+0000","last_clean":"2023-01-02T18:17:23.377333+0000","last_became_active":"2023-01-02T18:16:51.339073+0000","last_became_peered":"2023-01-02T18:16:51.339073+0000","last_unstale":"2023-01-02T18:17:23.377333+0000","last_undegraded":"2023-01-02T18:17:23.377333+0000","last_fullsized":"2023-01-02T18:17:23.377333+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":136,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373781+0000","last_change":"2023-01-02T18:16:57.307483+0000","last_active":"2023-01-02T18:17:22.373781+0000","last_peered":"2023-01-02T18:17:22.373781+0000","last_clean":"2023-01-02T18:17:22.373781+0000","last_became_active":"2023-01-02T18:16:55.316680+0000","last_became_peered":"2023-01-02T18:16:55.316680+0000","last_unstale":"2023-01-02T18:17:22.373781+0000","last_undegraded":"2023-01-02T18:17:22.373781+0000","last_fullsized":"2023-01-02T18:17:22.373781+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377322+0000","last_change":"2023-01-02T18:17:09.315999+0000","last_active":"2023-01-02T18:17:23.377322+0000","last_peered":"2023-01-02T18:17:23.377322+0000","last_clean":"2023-01-02T18:17:23.377322+0000","last_became_active":"2023-01-02T18:17:07.342453+0000","last_became_peered":"2023-01-02T18:17:07.342453+0000","last_unstale":"2023-01-02T18:17:23.377322+0000","last_undegraded":"2023-01-02T18:17:23.377322+0000","last_fullsized":"2023-01-02T18:17:23.377322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365808+0000","last_change":"2023-01-02T18:17:01.310439+0000","last_active":"2023-01-02T18:17:23.365808+0000","last_peered":"2023-01-02T18:17:23.365808+0000","last_clean":"2023-01-02T18:17:23.365808+0000","last_became_active":"2023-01-02T18:16:59.315925+0000","last_became_peered":"2023-01-02T18:16:59.315925+0000","last_unstale":"2023-01-02T18:17:23.365808+0000","last_undegraded":"2023-01-02T18:17:23.365808+0000","last_fullsized":"2023-01-02T18:17:23.365808+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373473+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:17:22.373473+0000","last_peered":"2023-01-02T18:17:22.373473+0000","last_clean":"2023-01-02T18:17:22.373473+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:17:22.373473+0000","last_undegraded":"2023-01-02T18:17:22.373473+0000","last_fullsized":"2023-01-02T18:17:22.373473+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'5","reported_seq":102,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.318414+0000","last_change":"2023-01-02T18:17:24.318908+0000","last_active":"2023-01-02T18:17:24.318414+0000","last_peered":"2023-01-02T18:17:24.318414+0000","last_clean":"2023-01-02T18:17:24.318414+0000","last_became_active":"2023-01-02T18:16:42.441102+0000","last_became_peered":"2023-01-02T18:16:42.441102+0000","last_unstale":"2023-01-02T18:17:24.318414+0000","last_undegraded":"2023-01-02T18:17:24.318414+0000","last_fullsized":"2023-01-02T18:17:24.318414+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.a","version":"0'0","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365903+0000","last_change":"2023-01-02T18:16:49.309370+0000","last_active":"2023-01-02T18:17:23.365903+0000","last_peered":"2023-01-02T18:17:23.365903+0000","last_clean":"2023-01-02T18:17:23.365903+0000","last_became_active":"2023-01-02T18:16:48.323683+0000","last_became_peered":"2023-01-02T18:16:48.323683+0000","last_unstale":"2023-01-02T18:17:23.365903+0000","last_undegraded":"2023-01-02T18:17:23.365903+0000","last_fullsized":"2023-01-02T18:17:23.365903+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374039+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:17:23.374039+0000","last_peered":"2023-01-02T18:17:23.374039+0000","last_clean":"2023-01-02T18:17:23.374039+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:17:23.374039+0000","last_undegraded":"2023-01-02T18:17:23.374039+0000","last_fullsized":"2023-01-02T18:17:23.374039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373456+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:17:23.373456+0000","last_peered":"2023-01-02T18:17:23.373456+0000","last_clean":"2023-01-02T18:17:23.373456+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:17:23.373456+0000","last_undegraded":"2023-01-02T18:17:23.373456+0000","last_fullsized":"2023-01-02T18:17:23.373456+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375098+0000","last_change":"2023-01-02T18:17:09.324144+0000","last_active":"2023-01-02T18:17:23.375098+0000","last_peered":"2023-01-02T18:17:23.375098+0000","last_clean":"2023-01-02T18:17:23.375098+0000","last_became_active":"2023-01-02T18:17:07.346984+0000","last_became_peered":"2023-01-02T18:17:07.346984+0000","last_unstale":"2023-01-02T18:17:23.375098+0000","last_undegraded":"2023-01-02T18:17:23.375098+0000","last_fullsized":"2023-01-02T18:17:23.375098+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373572+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:17:22.373572+0000","last_peered":"2023-01-02T18:17:22.373572+0000","last_clean":"2023-01-02T18:17:22.373572+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:17:22.373572+0000","last_undegraded":"2023-01-02T18:17:22.373572+0000","last_fullsized":"2023-01-02T18:17:22.373572+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370118+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:17:23.370118+0000","last_peered":"2023-01-02T18:17:23.370118+0000","last_clean":"2023-01-02T18:17:23.370118+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:17:23.370118+0000","last_undegraded":"2023-01-02T18:17:23.370118+0000","last_fullsized":"2023-01-02T18:17:23.370118+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"46'4","reported_seq":112,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.335437+0000","last_change":"2023-01-02T18:17:24.335573+0000","last_active":"2023-01-02T18:17:24.335437+0000","last_peered":"2023-01-02T18:17:24.335437+0000","last_clean":"2023-01-02T18:17:24.335437+0000","last_became_active":"2023-01-02T18:16:42.445252+0000","last_became_peered":"2023-01-02T18:16:42.445252+0000","last_unstale":"2023-01-02T18:17:24.335437+0000","last_undegraded":"2023-01-02T18:17:24.335437+0000","last_fullsized":"2023-01-02T18:17:24.335437+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":30,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.b","version":"56'8","reported_seq":62,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374458+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:17:23.374458+0000","last_peered":"2023-01-02T18:17:23.374458+0000","last_clean":"2023-01-02T18:17:23.374458+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:17:23.374458+0000","last_undegraded":"2023-01-02T18:17:23.374458+0000","last_fullsized":"2023-01-02T18:17:23.374458+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373574+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:17:23.373574+0000","last_peered":"2023-01-02T18:17:23.373574+0000","last_clean":"2023-01-02T18:17:23.373574+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:17:23.373574+0000","last_undegraded":"2023-01-02T18:17:23.373574+0000","last_fullsized":"2023-01-02T18:17:23.373574+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":42,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372810+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:17:22.372810+0000","last_peered":"2023-01-02T18:17:22.372810+0000","last_clean":"2023-01-02T18:17:22.372810+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:17:22.372810+0000","last_undegraded":"2023-01-02T18:17:22.372810+0000","last_fullsized":"2023-01-02T18:17:22.372810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375211+0000","last_change":"2023-01-02T18:17:09.308354+0000","last_active":"2023-01-02T18:17:23.375211+0000","last_peered":"2023-01-02T18:17:23.375211+0000","last_clean":"2023-01-02T18:17:23.375211+0000","last_became_active":"2023-01-02T18:17:07.339211+0000","last_became_peered":"2023-01-02T18:17:07.339211+0000","last_unstale":"2023-01-02T18:17:23.375211+0000","last_undegraded":"2023-01-02T18:17:23.375211+0000","last_fullsized":"2023-01-02T18:17:23.375211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"71'2","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370881+0000","last_change":"2023-01-02T18:17:01.317443+0000","last_active":"2023-01-02T18:17:23.370881+0000","last_peered":"2023-01-02T18:17:23.370881+0000","last_clean":"2023-01-02T18:17:23.370881+0000","last_became_active":"2023-01-02T18:16:59.311550+0000","last_became_peered":"2023-01-02T18:16:59.311550+0000","last_unstale":"2023-01-02T18:17:23.370881+0000","last_undegraded":"2023-01-02T18:17:23.370881+0000","last_fullsized":"2023-01-02T18:17:23.370881+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"51'3","reported_seq":50,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364550+0000","last_change":"2023-01-02T18:16:48.345208+0000","last_active":"2023-01-02T18:17:23.364550+0000","last_peered":"2023-01-02T18:17:23.364550+0000","last_clean":"2023-01-02T18:17:23.364550+0000","last_became_active":"2023-01-02T18:16:48.327080+0000","last_became_peered":"2023-01-02T18:16:48.327080+0000","last_unstale":"2023-01-02T18:17:23.364550+0000","last_undegraded":"2023-01-02T18:17:23.364550+0000","last_fullsized":"2023-01-02T18:17:23.364550+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":130,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.334928+0000","last_change":"2023-01-02T18:17:24.335124+0000","last_active":"2023-01-02T18:17:24.334928+0000","last_peered":"2023-01-02T18:17:24.334928+0000","last_clean":"2023-01-02T18:17:24.334928+0000","last_became_active":"2023-01-02T18:16:48.327374+0000","last_became_peered":"2023-01-02T18:16:48.327374+0000","last_unstale":"2023-01-02T18:17:24.334928+0000","last_undegraded":"2023-01-02T18:17:24.334928+0000","last_fullsized":"2023-01-02T18:17:24.334928+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.8","version":"0'0","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372575+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:17:22.372575+0000","last_peered":"2023-01-02T18:17:22.372575+0000","last_clean":"2023-01-02T18:17:22.372575+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:17:22.372575+0000","last_undegraded":"2023-01-02T18:17:22.372575+0000","last_fullsized":"2023-01-02T18:17:22.372575+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365535+0000","last_change":"2023-01-02T18:16:53.342610+0000","last_active":"2023-01-02T18:17:23.365535+0000","last_peered":"2023-01-02T18:17:23.365535+0000","last_clean":"2023-01-02T18:17:23.365535+0000","last_became_active":"2023-01-02T18:16:51.341683+0000","last_became_peered":"2023-01-02T18:16:51.341683+0000","last_unstale":"2023-01-02T18:17:23.365535+0000","last_undegraded":"2023-01-02T18:17:23.365535+0000","last_fullsized":"2023-01-02T18:17:23.365535+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365396+0000","last_change":"2023-01-02T18:16:57.312289+0000","last_active":"2023-01-02T18:17:23.365396+0000","last_peered":"2023-01-02T18:17:23.365396+0000","last_clean":"2023-01-02T18:17:23.365396+0000","last_became_active":"2023-01-02T18:16:55.317023+0000","last_became_peered":"2023-01-02T18:16:55.317023+0000","last_unstale":"2023-01-02T18:17:23.365396+0000","last_undegraded":"2023-01-02T18:17:23.365396+0000","last_fullsized":"2023-01-02T18:17:23.365396+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374389+0000","last_change":"2023-01-02T18:17:09.324091+0000","last_active":"2023-01-02T18:17:23.374389+0000","last_peered":"2023-01-02T18:17:23.374389+0000","last_clean":"2023-01-02T18:17:23.374389+0000","last_became_active":"2023-01-02T18:17:07.346545+0000","last_became_peered":"2023-01-02T18:17:07.346545+0000","last_unstale":"2023-01-02T18:17:23.374389+0000","last_undegraded":"2023-01-02T18:17:23.374389+0000","last_fullsized":"2023-01-02T18:17:23.374389+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.4","version":"72'10","reported_seq":142,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370577+0000","last_change":"2023-01-02T18:17:01.317071+0000","last_active":"2023-01-02T18:17:23.370577+0000","last_peered":"2023-01-02T18:17:23.370577+0000","last_clean":"2023-01-02T18:17:23.370577+0000","last_became_active":"2023-01-02T18:16:59.310165+0000","last_became_peered":"2023-01-02T18:16:59.310165+0000","last_unstale":"2023-01-02T18:17:23.370577+0000","last_undegraded":"2023-01-02T18:17:23.370577+0000","last_fullsized":"2023-01-02T18:17:23.370577+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"51'1","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373422+0000","last_change":"2023-01-02T18:16:44.299209+0000","last_active":"2023-01-02T18:17:23.373422+0000","last_peered":"2023-01-02T18:17:23.373422+0000","last_clean":"2023-01-02T18:17:23.373422+0000","last_became_active":"2023-01-02T18:16:42.441304+0000","last_became_peered":"2023-01-02T18:16:42.441304+0000","last_unstale":"2023-01-02T18:17:23.373422+0000","last_undegraded":"2023-01-02T18:17:23.373422+0000","last_fullsized":"2023-01-02T18:17:23.373422+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"82'14","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.335586+0000","last_change":"2023-01-02T18:17:24.335749+0000","last_active":"2023-01-02T18:17:24.335586+0000","last_peered":"2023-01-02T18:17:24.335586+0000","last_clean":"2023-01-02T18:17:24.335586+0000","last_became_active":"2023-01-02T18:16:48.324242+0000","last_became_peered":"2023-01-02T18:16:48.324242+0000","last_unstale":"2023-01-02T18:17:24.335586+0000","last_undegraded":"2023-01-02T18:17:24.335586+0000","last_fullsized":"2023-01-02T18:17:24.335586+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":122,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":46,"num_keys_recovered":8,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.9","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374566+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:17:23.374566+0000","last_peered":"2023-01-02T18:17:23.374566+0000","last_clean":"2023-01-02T18:17:23.374566+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:23.374566+0000","last_undegraded":"2023-01-02T18:17:23.374566+0000","last_fullsized":"2023-01-02T18:17:23.374566+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370039+0000","last_change":"2023-01-02T18:16:53.604245+0000","last_active":"2023-01-02T18:17:23.370039+0000","last_peered":"2023-01-02T18:17:23.370039+0000","last_clean":"2023-01-02T18:17:23.370039+0000","last_became_active":"2023-01-02T18:16:51.338292+0000","last_became_peered":"2023-01-02T18:16:51.338292+0000","last_unstale":"2023-01-02T18:17:23.370039+0000","last_undegraded":"2023-01-02T18:17:23.370039+0000","last_fullsized":"2023-01-02T18:17:23.370039+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374673+0000","last_change":"2023-01-02T18:16:57.317106+0000","last_active":"2023-01-02T18:17:23.374673+0000","last_peered":"2023-01-02T18:17:23.374673+0000","last_clean":"2023-01-02T18:17:23.374673+0000","last_became_active":"2023-01-02T18:16:55.308873+0000","last_became_peered":"2023-01-02T18:16:55.308873+0000","last_unstale":"2023-01-02T18:17:23.374673+0000","last_undegraded":"2023-01-02T18:17:23.374673+0000","last_fullsized":"2023-01-02T18:17:23.374673+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"76'3","reported_seq":115,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364214+0000","last_change":"2023-01-02T18:17:09.308112+0000","last_active":"2023-01-02T18:17:23.364214+0000","last_peered":"2023-01-02T18:17:23.364214+0000","last_clean":"2023-01-02T18:17:23.364214+0000","last_became_active":"2023-01-02T18:17:07.336295+0000","last_became_peered":"2023-01-02T18:17:07.336295+0000","last_unstale":"2023-01-02T18:17:23.364214+0000","last_undegraded":"2023-01-02T18:17:23.364214+0000","last_fullsized":"2023-01-02T18:17:23.364214+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":80,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'85","reported_seq":697,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370004+0000","last_change":"2023-01-02T18:17:01.316472+0000","last_active":"2023-01-02T18:17:23.370004+0000","last_peered":"2023-01-02T18:17:23.370004+0000","last_clean":"2023-01-02T18:17:23.370004+0000","last_became_active":"2023-01-02T18:16:59.310142+0000","last_became_peered":"2023-01-02T18:16:59.310142+0000","last_unstale":"2023-01-02T18:17:23.370004+0000","last_undegraded":"2023-01-02T18:17:23.370004+0000","last_fullsized":"2023-01-02T18:17:23.370004+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1544,"num_read_kb":1398,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366735+0000","last_change":"2023-01-02T18:16:44.308280+0000","last_active":"2023-01-02T18:17:23.366735+0000","last_peered":"2023-01-02T18:17:23.366735+0000","last_clean":"2023-01-02T18:17:23.366735+0000","last_became_active":"2023-01-02T18:16:41.446391+0000","last_became_peered":"2023-01-02T18:16:41.446391+0000","last_unstale":"2023-01-02T18:17:23.366735+0000","last_undegraded":"2023-01-02T18:17:23.366735+0000","last_fullsized":"2023-01-02T18:17:23.366735+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"80'15","reported_seq":163,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.324220+0000","last_change":"2023-01-02T18:17:24.324435+0000","last_active":"2023-01-02T18:17:24.324220+0000","last_peered":"2023-01-02T18:17:24.324220+0000","last_clean":"2023-01-02T18:17:24.324220+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:17:24.324220+0000","last_undegraded":"2023-01-02T18:17:24.324220+0000","last_fullsized":"2023-01-02T18:17:24.324220+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":151,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.16","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365289+0000","last_change":"2023-01-02T18:16:49.310953+0000","last_active":"2023-01-02T18:17:23.365289+0000","last_peered":"2023-01-02T18:17:23.365289+0000","last_clean":"2023-01-02T18:17:23.365289+0000","last_became_active":"2023-01-02T18:16:46.312067+0000","last_became_peered":"2023-01-02T18:16:46.312067+0000","last_unstale":"2023-01-02T18:17:23.365289+0000","last_undegraded":"2023-01-02T18:17:23.365289+0000","last_fullsized":"2023-01-02T18:17:23.365289+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374291+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:17:23.374291+0000","last_peered":"2023-01-02T18:17:23.374291+0000","last_clean":"2023-01-02T18:17:23.374291+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:17:23.374291+0000","last_undegraded":"2023-01-02T18:17:23.374291+0000","last_fullsized":"2023-01-02T18:17:23.374291+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364991+0000","last_change":"2023-01-02T18:16:57.313875+0000","last_active":"2023-01-02T18:17:23.364991+0000","last_peered":"2023-01-02T18:17:23.364991+0000","last_clean":"2023-01-02T18:17:23.364991+0000","last_became_active":"2023-01-02T18:16:55.318719+0000","last_became_peered":"2023-01-02T18:16:55.318719+0000","last_unstale":"2023-01-02T18:17:23.364991+0000","last_undegraded":"2023-01-02T18:17:23.364991+0000","last_fullsized":"2023-01-02T18:17:23.364991+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364393+0000","last_change":"2023-01-02T18:17:09.307476+0000","last_active":"2023-01-02T18:17:23.364393+0000","last_peered":"2023-01-02T18:17:23.364393+0000","last_clean":"2023-01-02T18:17:23.364393+0000","last_became_active":"2023-01-02T18:17:07.336526+0000","last_became_peered":"2023-01-02T18:17:07.336526+0000","last_unstale":"2023-01-02T18:17:23.364393+0000","last_undegraded":"2023-01-02T18:17:23.364393+0000","last_fullsized":"2023-01-02T18:17:23.364393+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"68'2","reported_seq":145,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370517+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:17:23.370517+0000","last_peered":"2023-01-02T18:17:23.370517+0000","last_clean":"2023-01-02T18:17:23.370517+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:17:23.370517+0000","last_undegraded":"2023-01-02T18:17:23.370517+0000","last_fullsized":"2023-01-02T18:17:23.370517+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364989+0000","last_change":"2023-01-02T18:16:44.307606+0000","last_active":"2023-01-02T18:17:23.364989+0000","last_peered":"2023-01-02T18:17:23.364989+0000","last_clean":"2023-01-02T18:17:23.364989+0000","last_became_active":"2023-01-02T18:16:41.449266+0000","last_became_peered":"2023-01-02T18:16:41.449266+0000","last_unstale":"2023-01-02T18:17:23.364989+0000","last_undegraded":"2023-01-02T18:17:23.364989+0000","last_fullsized":"2023-01-02T18:17:23.364989+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.334657+0000","last_change":"2023-01-02T18:17:24.334827+0000","last_active":"2023-01-02T18:17:24.334657+0000","last_peered":"2023-01-02T18:17:24.334657+0000","last_clean":"2023-01-02T18:17:24.334657+0000","last_became_active":"2023-01-02T18:16:48.329249+0000","last_became_peered":"2023-01-02T18:16:48.329249+0000","last_unstale":"2023-01-02T18:17:24.334657+0000","last_undegraded":"2023-01-02T18:17:24.334657+0000","last_fullsized":"2023-01-02T18:17:24.334657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.17","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.367145+0000","last_change":"2023-01-02T18:16:49.311129+0000","last_active":"2023-01-02T18:17:23.367145+0000","last_peered":"2023-01-02T18:17:23.367145+0000","last_clean":"2023-01-02T18:17:23.367145+0000","last_became_active":"2023-01-02T18:16:46.312301+0000","last_became_peered":"2023-01-02T18:16:46.312301+0000","last_unstale":"2023-01-02T18:17:23.367145+0000","last_undegraded":"2023-01-02T18:17:23.367145+0000","last_fullsized":"2023-01-02T18:17:23.367145+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375902+0000","last_change":"2023-01-02T18:16:53.350359+0000","last_active":"2023-01-02T18:17:23.375902+0000","last_peered":"2023-01-02T18:17:23.375902+0000","last_clean":"2023-01-02T18:17:23.375902+0000","last_became_active":"2023-01-02T18:16:51.338043+0000","last_became_peered":"2023-01-02T18:16:51.338043+0000","last_unstale":"2023-01-02T18:17:23.375902+0000","last_undegraded":"2023-01-02T18:17:23.375902+0000","last_fullsized":"2023-01-02T18:17:23.375902+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373912+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:17:23.373912+0000","last_peered":"2023-01-02T18:17:23.373912+0000","last_clean":"2023-01-02T18:17:23.373912+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:17:23.373912+0000","last_undegraded":"2023-01-02T18:17:23.373912+0000","last_fullsized":"2023-01-02T18:17:23.373912+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369710+0000","last_change":"2023-01-02T18:17:09.330482+0000","last_active":"2023-01-02T18:17:23.369710+0000","last_peered":"2023-01-02T18:17:23.369710+0000","last_clean":"2023-01-02T18:17:23.369710+0000","last_became_active":"2023-01-02T18:17:07.344261+0000","last_became_peered":"2023-01-02T18:17:07.344261+0000","last_unstale":"2023-01-02T18:17:23.369710+0000","last_undegraded":"2023-01-02T18:17:23.369710+0000","last_fullsized":"2023-01-02T18:17:23.369710+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"68'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369814+0000","last_change":"2023-01-02T18:17:01.316528+0000","last_active":"2023-01-02T18:17:23.369814+0000","last_peered":"2023-01-02T18:17:23.369814+0000","last_clean":"2023-01-02T18:17:23.369814+0000","last_became_active":"2023-01-02T18:16:59.324956+0000","last_became_peered":"2023-01-02T18:16:59.324956+0000","last_unstale":"2023-01-02T18:17:23.369814+0000","last_undegraded":"2023-01-02T18:17:23.369814+0000","last_fullsized":"2023-01-02T18:17:23.369814+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":55,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373760+0000","last_change":"2023-01-02T18:16:44.299509+0000","last_active":"2023-01-02T18:17:23.373760+0000","last_peered":"2023-01-02T18:17:23.373760+0000","last_clean":"2023-01-02T18:17:23.373760+0000","last_became_active":"2023-01-02T18:16:42.439600+0000","last_became_peered":"2023-01-02T18:16:42.439600+0000","last_unstale":"2023-01-02T18:17:23.373760+0000","last_undegraded":"2023-01-02T18:17:23.373760+0000","last_fullsized":"2023-01-02T18:17:23.373760+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":89,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.333059+0000","last_change":"2023-01-02T18:17:24.333320+0000","last_active":"2023-01-02T18:17:24.333059+0000","last_peered":"2023-01-02T18:17:24.333059+0000","last_clean":"2023-01-02T18:17:24.333059+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:17:24.333059+0000","last_undegraded":"2023-01-02T18:17:24.333059+0000","last_fullsized":"2023-01-02T18:17:24.333059+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.14","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365124+0000","last_change":"2023-01-02T18:16:49.310391+0000","last_active":"2023-01-02T18:17:23.365124+0000","last_peered":"2023-01-02T18:17:23.365124+0000","last_clean":"2023-01-02T18:17:23.365124+0000","last_became_active":"2023-01-02T18:16:46.316328+0000","last_became_peered":"2023-01-02T18:16:46.316328+0000","last_unstale":"2023-01-02T18:17:23.365124+0000","last_undegraded":"2023-01-02T18:17:23.365124+0000","last_fullsized":"2023-01-02T18:17:23.365124+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374028+0000","last_change":"2023-01-02T18:16:53.686538+0000","last_active":"2023-01-02T18:17:22.374028+0000","last_peered":"2023-01-02T18:17:22.374028+0000","last_clean":"2023-01-02T18:17:22.374028+0000","last_became_active":"2023-01-02T18:16:51.336975+0000","last_became_peered":"2023-01-02T18:16:51.336975+0000","last_unstale":"2023-01-02T18:17:22.374028+0000","last_undegraded":"2023-01-02T18:17:22.374028+0000","last_fullsized":"2023-01-02T18:17:22.374028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373626+0000","last_change":"2023-01-02T18:16:57.306845+0000","last_active":"2023-01-02T18:17:22.373626+0000","last_peered":"2023-01-02T18:17:22.373626+0000","last_clean":"2023-01-02T18:17:22.373626+0000","last_became_active":"2023-01-02T18:16:55.318612+0000","last_became_peered":"2023-01-02T18:16:55.318612+0000","last_unstale":"2023-01-02T18:17:22.373626+0000","last_undegraded":"2023-01-02T18:17:22.373626+0000","last_fullsized":"2023-01-02T18:17:22.373626+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364049+0000","last_change":"2023-01-02T18:17:09.307508+0000","last_active":"2023-01-02T18:17:23.364049+0000","last_peered":"2023-01-02T18:17:23.364049+0000","last_clean":"2023-01-02T18:17:23.364049+0000","last_became_active":"2023-01-02T18:17:07.344914+0000","last_became_peered":"2023-01-02T18:17:07.344914+0000","last_unstale":"2023-01-02T18:17:23.364049+0000","last_undegraded":"2023-01-02T18:17:23.364049+0000","last_fullsized":"2023-01-02T18:17:23.364049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"69'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.363849+0000","last_change":"2023-01-02T18:17:01.307624+0000","last_active":"2023-01-02T18:17:23.363849+0000","last_peered":"2023-01-02T18:17:23.363849+0000","last_clean":"2023-01-02T18:17:23.363849+0000","last_became_active":"2023-01-02T18:16:59.311706+0000","last_became_peered":"2023-01-02T18:16:59.311706+0000","last_unstale":"2023-01-02T18:17:23.363849+0000","last_undegraded":"2023-01-02T18:17:23.363849+0000","last_fullsized":"2023-01-02T18:17:23.363849+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365044+0000","last_change":"2023-01-02T18:16:44.307239+0000","last_active":"2023-01-02T18:17:23.365044+0000","last_peered":"2023-01-02T18:17:23.365044+0000","last_clean":"2023-01-02T18:17:23.365044+0000","last_became_active":"2023-01-02T18:16:41.447671+0000","last_became_peered":"2023-01-02T18:16:41.447671+0000","last_unstale":"2023-01-02T18:17:23.365044+0000","last_undegraded":"2023-01-02T18:17:23.365044+0000","last_fullsized":"2023-01-02T18:17:23.365044+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"91'5","reported_seq":101,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.333593+0000","last_change":"2023-01-02T18:17:24.333593+0000","last_active":"2023-01-02T18:17:24.333593+0000","last_peered":"2023-01-02T18:17:24.333593+0000","last_clean":"2023-01-02T18:17:24.333593+0000","last_became_active":"2023-01-02T18:16:48.322940+0000","last_became_peered":"2023-01-02T18:16:48.322940+0000","last_unstale":"2023-01-02T18:17:24.333593+0000","last_undegraded":"2023-01-02T18:17:24.333593+0000","last_fullsized":"2023-01-02T18:17:24.333593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.15","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.376718+0000","last_change":"2023-01-02T18:16:49.300038+0000","last_active":"2023-01-02T18:17:23.376718+0000","last_peered":"2023-01-02T18:17:23.376718+0000","last_clean":"2023-01-02T18:17:23.376718+0000","last_became_active":"2023-01-02T18:16:46.315569+0000","last_became_peered":"2023-01-02T18:16:46.315569+0000","last_unstale":"2023-01-02T18:17:23.376718+0000","last_undegraded":"2023-01-02T18:17:23.376718+0000","last_fullsized":"2023-01-02T18:17:23.376718+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374191+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:17:23.374191+0000","last_peered":"2023-01-02T18:17:23.374191+0000","last_clean":"2023-01-02T18:17:23.374191+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:17:23.374191+0000","last_undegraded":"2023-01-02T18:17:23.374191+0000","last_fullsized":"2023-01-02T18:17:23.374191+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375592+0000","last_change":"2023-01-02T18:16:57.312176+0000","last_active":"2023-01-02T18:17:23.375592+0000","last_peered":"2023-01-02T18:17:23.375592+0000","last_clean":"2023-01-02T18:17:23.375592+0000","last_became_active":"2023-01-02T18:16:55.311934+0000","last_became_peered":"2023-01-02T18:16:55.311934+0000","last_unstale":"2023-01-02T18:17:23.375592+0000","last_undegraded":"2023-01-02T18:17:23.375592+0000","last_fullsized":"2023-01-02T18:17:23.375592+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373476+0000","last_change":"2023-01-02T18:17:09.325339+0000","last_active":"2023-01-02T18:17:22.373476+0000","last_peered":"2023-01-02T18:17:22.373476+0000","last_clean":"2023-01-02T18:17:22.373476+0000","last_became_active":"2023-01-02T18:17:07.341155+0000","last_became_peered":"2023-01-02T18:17:07.341155+0000","last_unstale":"2023-01-02T18:17:22.373476+0000","last_undegraded":"2023-01-02T18:17:22.373476+0000","last_fullsized":"2023-01-02T18:17:22.373476+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373789+0000","last_change":"2023-01-02T18:17:01.320344+0000","last_active":"2023-01-02T18:17:22.373789+0000","last_peered":"2023-01-02T18:17:22.373789+0000","last_clean":"2023-01-02T18:17:22.373789+0000","last_became_active":"2023-01-02T18:16:59.324530+0000","last_became_peered":"2023-01-02T18:16:59.324530+0000","last_unstale":"2023-01-02T18:17:22.373789+0000","last_undegraded":"2023-01-02T18:17:22.373789+0000","last_fullsized":"2023-01-02T18:17:22.373789+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370101+0000","last_change":"2023-01-02T18:16:48.329830+0000","last_active":"2023-01-02T18:17:23.370101+0000","last_peered":"2023-01-02T18:17:23.370101+0000","last_clean":"2023-01-02T18:17:23.370101+0000","last_became_active":"2023-01-02T18:16:48.329469+0000","last_became_peered":"2023-01-02T18:16:48.329469+0000","last_unstale":"2023-01-02T18:17:23.370101+0000","last_undegraded":"2023-01-02T18:17:23.370101+0000","last_fullsized":"2023-01-02T18:17:23.370101+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.334688+0000","last_change":"2023-01-02T18:17:24.334884+0000","last_active":"2023-01-02T18:17:24.334688+0000","last_peered":"2023-01-02T18:17:24.334688+0000","last_clean":"2023-01-02T18:17:24.334688+0000","last_became_active":"2023-01-02T18:16:48.326351+0000","last_became_peered":"2023-01-02T18:16:48.326351+0000","last_unstale":"2023-01-02T18:17:24.334688+0000","last_undegraded":"2023-01-02T18:17:24.334688+0000","last_fullsized":"2023-01-02T18:17:24.334688+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.12","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365632+0000","last_change":"2023-01-02T18:16:49.310459+0000","last_active":"2023-01-02T18:17:23.365632+0000","last_peered":"2023-01-02T18:17:23.365632+0000","last_clean":"2023-01-02T18:17:23.365632+0000","last_became_active":"2023-01-02T18:16:46.312215+0000","last_became_peered":"2023-01-02T18:16:46.312215+0000","last_unstale":"2023-01-02T18:17:23.365632+0000","last_undegraded":"2023-01-02T18:17:23.365632+0000","last_fullsized":"2023-01-02T18:17:23.365632+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364450+0000","last_change":"2023-01-02T18:16:53.342357+0000","last_active":"2023-01-02T18:17:23.364450+0000","last_peered":"2023-01-02T18:17:23.364450+0000","last_clean":"2023-01-02T18:17:23.364450+0000","last_became_active":"2023-01-02T18:16:51.341254+0000","last_became_peered":"2023-01-02T18:16:51.341254+0000","last_unstale":"2023-01-02T18:17:23.364450+0000","last_undegraded":"2023-01-02T18:17:23.364450+0000","last_fullsized":"2023-01-02T18:17:23.364450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364067+0000","last_change":"2023-01-02T18:16:57.312710+0000","last_active":"2023-01-02T18:17:23.364067+0000","last_peered":"2023-01-02T18:17:23.364067+0000","last_clean":"2023-01-02T18:17:23.364067+0000","last_became_active":"2023-01-02T18:16:55.317525+0000","last_became_peered":"2023-01-02T18:16:55.317525+0000","last_unstale":"2023-01-02T18:17:23.364067+0000","last_undegraded":"2023-01-02T18:17:23.364067+0000","last_fullsized":"2023-01-02T18:17:23.364067+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377287+0000","last_change":"2023-01-02T18:17:09.308664+0000","last_active":"2023-01-02T18:17:23.377287+0000","last_peered":"2023-01-02T18:17:23.377287+0000","last_clean":"2023-01-02T18:17:23.377287+0000","last_became_active":"2023-01-02T18:17:07.344272+0000","last_became_peered":"2023-01-02T18:17:07.344272+0000","last_unstale":"2023-01-02T18:17:23.377287+0000","last_undegraded":"2023-01-02T18:17:23.377287+0000","last_fullsized":"2023-01-02T18:17:23.377287+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364797+0000","last_change":"2023-01-02T18:17:01.311474+0000","last_active":"2023-01-02T18:17:23.364797+0000","last_peered":"2023-01-02T18:17:23.364797+0000","last_clean":"2023-01-02T18:17:23.364797+0000","last_became_active":"2023-01-02T18:16:59.314245+0000","last_became_peered":"2023-01-02T18:16:59.314245+0000","last_unstale":"2023-01-02T18:17:23.364797+0000","last_undegraded":"2023-01-02T18:17:23.364797+0000","last_fullsized":"2023-01-02T18:17:23.364797+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370443+0000","last_change":"2023-01-02T18:16:44.320516+0000","last_active":"2023-01-02T18:17:23.370443+0000","last_peered":"2023-01-02T18:17:23.370443+0000","last_clean":"2023-01-02T18:17:23.370443+0000","last_became_active":"2023-01-02T18:16:41.444704+0000","last_became_peered":"2023-01-02T18:16:41.444704+0000","last_unstale":"2023-01-02T18:17:23.370443+0000","last_undegraded":"2023-01-02T18:17:23.370443+0000","last_fullsized":"2023-01-02T18:17:23.370443+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"86'18","reported_seq":182,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.335139+0000","last_change":"2023-01-02T18:17:24.335355+0000","last_active":"2023-01-02T18:17:24.335139+0000","last_peered":"2023-01-02T18:17:24.335139+0000","last_clean":"2023-01-02T18:17:24.335139+0000","last_became_active":"2023-01-02T18:16:37.436152+0000","last_became_peered":"2023-01-02T18:16:37.436152+0000","last_unstale":"2023-01-02T18:17:24.335139+0000","last_undegraded":"2023-01-02T18:17:24.335139+0000","last_fullsized":"2023-01-02T18:17:24.335139+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":192,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.13","version":"0'0","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365129+0000","last_change":"2023-01-02T18:16:49.309763+0000","last_active":"2023-01-02T18:17:23.365129+0000","last_peered":"2023-01-02T18:17:23.365129+0000","last_clean":"2023-01-02T18:17:23.365129+0000","last_became_active":"2023-01-02T18:16:46.308336+0000","last_became_peered":"2023-01-02T18:16:46.308336+0000","last_unstale":"2023-01-02T18:17:23.365129+0000","last_undegraded":"2023-01-02T18:17:23.365129+0000","last_fullsized":"2023-01-02T18:17:23.365129+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372741+0000","last_change":"2023-01-02T18:16:53.686000+0000","last_active":"2023-01-02T18:17:22.372741+0000","last_peered":"2023-01-02T18:17:22.372741+0000","last_clean":"2023-01-02T18:17:22.372741+0000","last_became_active":"2023-01-02T18:16:51.345471+0000","last_became_peered":"2023-01-02T18:16:51.345471+0000","last_unstale":"2023-01-02T18:17:22.372741+0000","last_undegraded":"2023-01-02T18:17:22.372741+0000","last_fullsized":"2023-01-02T18:17:22.372741+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373955+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:17:23.373955+0000","last_peered":"2023-01-02T18:17:23.373955+0000","last_clean":"2023-01-02T18:17:23.373955+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:17:23.373955+0000","last_undegraded":"2023-01-02T18:17:23.373955+0000","last_fullsized":"2023-01-02T18:17:23.373955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"76'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.375046+0000","last_change":"2023-01-02T18:17:09.308316+0000","last_active":"2023-01-02T18:17:23.375046+0000","last_peered":"2023-01-02T18:17:23.375046+0000","last_clean":"2023-01-02T18:17:23.375046+0000","last_became_active":"2023-01-02T18:17:07.339700+0000","last_became_peered":"2023-01-02T18:17:07.339700+0000","last_unstale":"2023-01-02T18:17:23.375046+0000","last_undegraded":"2023-01-02T18:17:23.375046+0000","last_fullsized":"2023-01-02T18:17:23.375046+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":43,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374210+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:17:22.374210+0000","last_peered":"2023-01-02T18:17:22.374210+0000","last_clean":"2023-01-02T18:17:22.374210+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:17:22.374210+0000","last_undegraded":"2023-01-02T18:17:22.374210+0000","last_fullsized":"2023-01-02T18:17:22.374210+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366458+0000","last_change":"2023-01-02T18:16:44.306989+0000","last_active":"2023-01-02T18:17:23.366458+0000","last_peered":"2023-01-02T18:17:23.366458+0000","last_clean":"2023-01-02T18:17:23.366458+0000","last_became_active":"2023-01-02T18:16:41.448619+0000","last_became_peered":"2023-01-02T18:16:41.448619+0000","last_unstale":"2023-01-02T18:17:23.366458+0000","last_undegraded":"2023-01-02T18:17:23.366458+0000","last_fullsized":"2023-01-02T18:17:23.366458+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"46'1","reported_seq":97,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.335379+0000","last_change":"2023-01-02T18:17:24.335541+0000","last_active":"2023-01-02T18:17:24.335379+0000","last_peered":"2023-01-02T18:17:24.335379+0000","last_clean":"2023-01-02T18:17:24.335379+0000","last_became_active":"2023-01-02T18:16:42.440314+0000","last_became_peered":"2023-01-02T18:16:42.440314+0000","last_unstale":"2023-01-02T18:17:24.335379+0000","last_undegraded":"2023-01-02T18:17:24.335379+0000","last_fullsized":"2023-01-02T18:17:24.335379+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.10","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373528+0000","last_change":"2023-01-02T18:16:49.304745+0000","last_active":"2023-01-02T18:17:23.373528+0000","last_peered":"2023-01-02T18:17:23.373528+0000","last_clean":"2023-01-02T18:17:23.373528+0000","last_became_active":"2023-01-02T18:16:48.325920+0000","last_became_peered":"2023-01-02T18:16:48.325920+0000","last_unstale":"2023-01-02T18:17:23.373528+0000","last_undegraded":"2023-01-02T18:17:23.373528+0000","last_fullsized":"2023-01-02T18:17:23.373528+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365914+0000","last_change":"2023-01-02T18:16:53.342417+0000","last_active":"2023-01-02T18:17:23.365914+0000","last_peered":"2023-01-02T18:17:23.365914+0000","last_clean":"2023-01-02T18:17:23.365914+0000","last_became_active":"2023-01-02T18:16:51.341971+0000","last_became_peered":"2023-01-02T18:16:51.341971+0000","last_unstale":"2023-01-02T18:17:23.365914+0000","last_undegraded":"2023-01-02T18:17:23.365914+0000","last_fullsized":"2023-01-02T18:17:23.365914+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369851+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:17:23.369851+0000","last_peered":"2023-01-02T18:17:23.369851+0000","last_clean":"2023-01-02T18:17:23.369851+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:17:23.369851+0000","last_undegraded":"2023-01-02T18:17:23.369851+0000","last_fullsized":"2023-01-02T18:17:23.369851+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374156+0000","last_change":"2023-01-02T18:17:09.329860+0000","last_active":"2023-01-02T18:17:22.374156+0000","last_peered":"2023-01-02T18:17:22.374156+0000","last_clean":"2023-01-02T18:17:22.374156+0000","last_became_active":"2023-01-02T18:17:07.343666+0000","last_became_peered":"2023-01-02T18:17:07.343666+0000","last_unstale":"2023-01-02T18:17:22.374156+0000","last_undegraded":"2023-01-02T18:17:22.374156+0000","last_fullsized":"2023-01-02T18:17:22.374156+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"71'6","reported_seq":65,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374953+0000","last_change":"2023-01-02T18:17:01.322371+0000","last_active":"2023-01-02T18:17:23.374953+0000","last_peered":"2023-01-02T18:17:23.374953+0000","last_clean":"2023-01-02T18:17:23.374953+0000","last_became_active":"2023-01-02T18:16:59.324902+0000","last_became_peered":"2023-01-02T18:16:59.324902+0000","last_unstale":"2023-01-02T18:17:23.374953+0000","last_undegraded":"2023-01-02T18:17:23.374953+0000","last_fullsized":"2023-01-02T18:17:23.374953+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":56,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364589+0000","last_change":"2023-01-02T18:16:44.306689+0000","last_active":"2023-01-02T18:17:23.364589+0000","last_peered":"2023-01-02T18:17:23.364589+0000","last_clean":"2023-01-02T18:17:23.364589+0000","last_became_active":"2023-01-02T18:16:41.448162+0000","last_became_peered":"2023-01-02T18:16:41.448162+0000","last_unstale":"2023-01-02T18:17:23.364589+0000","last_undegraded":"2023-01-02T18:17:23.364589+0000","last_fullsized":"2023-01-02T18:17:23.364589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":82,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.322276+0000","last_change":"2023-01-02T18:17:24.322498+0000","last_active":"2023-01-02T18:17:24.322276+0000","last_peered":"2023-01-02T18:17:24.322276+0000","last_clean":"2023-01-02T18:17:24.322276+0000","last_became_active":"2023-01-02T18:16:42.435382+0000","last_became_peered":"2023-01-02T18:16:42.435382+0000","last_unstale":"2023-01-02T18:17:24.322276+0000","last_undegraded":"2023-01-02T18:17:24.322276+0000","last_fullsized":"2023-01-02T18:17:24.322276+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.11","version":"0'0","reported_seq":59,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.369908+0000","last_change":"2023-01-02T18:16:49.318037+0000","last_active":"2023-01-02T18:17:23.369908+0000","last_peered":"2023-01-02T18:17:23.369908+0000","last_clean":"2023-01-02T18:17:23.369908+0000","last_became_active":"2023-01-02T18:16:48.330758+0000","last_became_peered":"2023-01-02T18:16:48.330758+0000","last_unstale":"2023-01-02T18:17:23.369908+0000","last_undegraded":"2023-01-02T18:17:23.369908+0000","last_fullsized":"2023-01-02T18:17:23.369908+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":144,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373555+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:17:23.373555+0000","last_peered":"2023-01-02T18:17:23.373555+0000","last_clean":"2023-01-02T18:17:23.373555+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:17:23.373555+0000","last_undegraded":"2023-01-02T18:17:23.373555+0000","last_fullsized":"2023-01-02T18:17:23.373555+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":41,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373221+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:17:22.373221+0000","last_peered":"2023-01-02T18:17:22.373221+0000","last_clean":"2023-01-02T18:17:22.373221+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:17:22.373221+0000","last_undegraded":"2023-01-02T18:17:22.373221+0000","last_fullsized":"2023-01-02T18:17:22.373221+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.372729+0000","last_change":"2023-01-02T18:17:09.322570+0000","last_active":"2023-01-02T18:17:22.372729+0000","last_peered":"2023-01-02T18:17:22.372729+0000","last_clean":"2023-01-02T18:17:22.372729+0000","last_became_active":"2023-01-02T18:17:07.342026+0000","last_became_peered":"2023-01-02T18:17:07.342026+0000","last_unstale":"2023-01-02T18:17:22.372729+0000","last_undegraded":"2023-01-02T18:17:22.372729+0000","last_fullsized":"2023-01-02T18:17:22.372729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364703+0000","last_change":"2023-01-02T18:17:01.311515+0000","last_active":"2023-01-02T18:17:23.364703+0000","last_peered":"2023-01-02T18:17:23.364703+0000","last_clean":"2023-01-02T18:17:23.364703+0000","last_became_active":"2023-01-02T18:16:59.322412+0000","last_became_peered":"2023-01-02T18:16:59.322412+0000","last_unstale":"2023-01-02T18:17:23.364703+0000","last_undegraded":"2023-01-02T18:17:23.364703+0000","last_fullsized":"2023-01-02T18:17:23.364703+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":57,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371240+0000","last_change":"2023-01-02T18:16:44.320520+0000","last_active":"2023-01-02T18:17:23.371240+0000","last_peered":"2023-01-02T18:17:23.371240+0000","last_clean":"2023-01-02T18:17:23.371240+0000","last_became_active":"2023-01-02T18:16:42.441192+0000","last_became_peered":"2023-01-02T18:16:42.441192+0000","last_unstale":"2023-01-02T18:17:23.371240+0000","last_undegraded":"2023-01-02T18:17:23.371240+0000","last_fullsized":"2023-01-02T18:17:23.371240+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":128,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.317179+0000","last_change":"2023-01-02T18:17:24.317549+0000","last_active":"2023-01-02T18:17:24.317179+0000","last_peered":"2023-01-02T18:17:24.317179+0000","last_clean":"2023-01-02T18:17:24.317179+0000","last_became_active":"2023-01-02T18:16:37.415177+0000","last_became_peered":"2023-01-02T18:16:37.415177+0000","last_unstale":"2023-01-02T18:17:24.317179+0000","last_undegraded":"2023-01-02T18:17:24.317179+0000","last_fullsized":"2023-01-02T18:17:24.317179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1e","version":"0'0","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.374096+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:17:22.374096+0000","last_peered":"2023-01-02T18:17:22.374096+0000","last_clean":"2023-01-02T18:17:22.374096+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:17:22.374096+0000","last_undegraded":"2023-01-02T18:17:22.374096+0000","last_fullsized":"2023-01-02T18:17:22.374096+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.376817+0000","last_change":"2023-01-02T18:16:53.344508+0000","last_active":"2023-01-02T18:17:23.376817+0000","last_peered":"2023-01-02T18:17:23.376817+0000","last_clean":"2023-01-02T18:17:23.376817+0000","last_became_active":"2023-01-02T18:16:51.339305+0000","last_became_peered":"2023-01-02T18:16:51.339305+0000","last_unstale":"2023-01-02T18:17:23.376817+0000","last_undegraded":"2023-01-02T18:17:23.376817+0000","last_fullsized":"2023-01-02T18:17:23.376817+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":51,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.365226+0000","last_change":"2023-01-02T18:16:57.314050+0000","last_active":"2023-01-02T18:17:23.365226+0000","last_peered":"2023-01-02T18:17:23.365226+0000","last_clean":"2023-01-02T18:17:23.365226+0000","last_became_active":"2023-01-02T18:16:55.315221+0000","last_became_peered":"2023-01-02T18:16:55.315221+0000","last_unstale":"2023-01-02T18:17:23.365226+0000","last_undegraded":"2023-01-02T18:17:23.365226+0000","last_fullsized":"2023-01-02T18:17:23.365226+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373556+0000","last_change":"2023-01-02T18:17:09.323079+0000","last_active":"2023-01-02T18:17:23.373556+0000","last_peered":"2023-01-02T18:17:23.373556+0000","last_clean":"2023-01-02T18:17:23.373556+0000","last_became_active":"2023-01-02T18:17:07.344746+0000","last_became_peered":"2023-01-02T18:17:07.344746+0000","last_unstale":"2023-01-02T18:17:23.373556+0000","last_undegraded":"2023-01-02T18:17:23.373556+0000","last_fullsized":"2023-01-02T18:17:23.373556+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.370292+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:17:23.370292+0000","last_peered":"2023-01-02T18:17:23.370292+0000","last_clean":"2023-01-02T18:17:23.370292+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:17:23.370292+0000","last_undegraded":"2023-01-02T18:17:23.370292+0000","last_fullsized":"2023-01-02T18:17:23.370292+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.376805+0000","last_change":"2023-01-02T18:16:57.317052+0000","last_active":"2023-01-02T18:17:23.376805+0000","last_peered":"2023-01-02T18:17:23.376805+0000","last_clean":"2023-01-02T18:17:23.376805+0000","last_became_active":"2023-01-02T18:16:55.310981+0000","last_became_peered":"2023-01-02T18:16:55.310981+0000","last_unstale":"2023-01-02T18:17:23.376805+0000","last_undegraded":"2023-01-02T18:17:23.376805+0000","last_fullsized":"2023-01-02T18:17:23.376805+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2023-01-02T18:17:22.373932+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:17:22.373932+0000","last_peered":"2023-01-02T18:17:22.373932+0000","last_clean":"2023-01-02T18:17:22.373932+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:17:22.373932+0000","last_undegraded":"2023-01-02T18:17:22.373932+0000","last_fullsized":"2023-01-02T18:17:22.373932+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":109,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.311612+0000","last_change":"2023-01-02T18:17:24.311851+0000","last_active":"2023-01-02T18:17:24.311612+0000","last_peered":"2023-01-02T18:17:24.311612+0000","last_clean":"2023-01-02T18:17:24.311612+0000","last_became_active":"2023-01-02T18:16:37.416142+0000","last_became_peered":"2023-01-02T18:16:37.416142+0000","last_unstale":"2023-01-02T18:17:24.311612+0000","last_undegraded":"2023-01-02T18:17:24.311612+0000","last_fullsized":"2023-01-02T18:17:24.311612+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1f","version":"56'15","reported_seq":117,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.371234+0000","last_change":"2023-01-02T18:16:49.319188+0000","last_active":"2023-01-02T18:17:23.371234+0000","last_peered":"2023-01-02T18:17:23.371234+0000","last_clean":"2023-01-02T18:17:23.371234+0000","last_became_active":"2023-01-02T18:16:48.329016+0000","last_became_peered":"2023-01-02T18:16:48.329016+0000","last_unstale":"2023-01-02T18:17:23.371234+0000","last_undegraded":"2023-01-02T18:17:23.371234+0000","last_fullsized":"2023-01-02T18:17:23.371234+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":150,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.374722+0000","last_change":"2023-01-02T18:16:53.346722+0000","last_active":"2023-01-02T18:17:23.374722+0000","last_peered":"2023-01-02T18:17:23.374722+0000","last_clean":"2023-01-02T18:17:23.374722+0000","last_became_active":"2023-01-02T18:16:51.339164+0000","last_became_peered":"2023-01-02T18:16:51.339164+0000","last_unstale":"2023-01-02T18:17:23.374722+0000","last_undegraded":"2023-01-02T18:17:23.374722+0000","last_fullsized":"2023-01-02T18:17:23.374722+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373191+0000","last_change":"2023-01-02T18:17:09.322935+0000","last_active":"2023-01-02T18:17:23.373191+0000","last_peered":"2023-01-02T18:17:23.373191+0000","last_clean":"2023-01-02T18:17:23.373191+0000","last_became_active":"2023-01-02T18:17:07.346620+0000","last_became_peered":"2023-01-02T18:17:07.346620+0000","last_unstale":"2023-01-02T18:17:23.373191+0000","last_undegraded":"2023-01-02T18:17:23.373191+0000","last_fullsized":"2023-01-02T18:17:23.373191+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"72'4","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.373798+0000","last_change":"2023-01-02T18:17:01.321057+0000","last_active":"2023-01-02T18:17:23.373798+0000","last_peered":"2023-01-02T18:17:23.373798+0000","last_clean":"2023-01-02T18:17:23.373798+0000","last_became_active":"2023-01-02T18:16:59.310738+0000","last_became_peered":"2023-01-02T18:16:59.310738+0000","last_unstale":"2023-01-02T18:17:23.373798+0000","last_undegraded":"2023-01-02T18:17:23.373798+0000","last_fullsized":"2023-01-02T18:17:23.373798+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.377239+0000","last_change":"2023-01-02T18:16:57.317294+0000","last_active":"2023-01-02T18:17:23.377239+0000","last_peered":"2023-01-02T18:17:23.377239+0000","last_clean":"2023-01-02T18:17:23.377239+0000","last_became_active":"2023-01-02T18:16:55.316682+0000","last_became_peered":"2023-01-02T18:16:55.316682+0000","last_unstale":"2023-01-02T18:17:23.377239+0000","last_undegraded":"2023-01-02T18:17:23.377239+0000","last_fullsized":"2023-01-02T18:17:23.377239+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":67,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.364476+0000","last_change":"2023-01-02T18:16:44.308144+0000","last_active":"2023-01-02T18:17:23.364476+0000","last_peered":"2023-01-02T18:17:23.364476+0000","last_clean":"2023-01-02T18:17:23.364476+0000","last_became_active":"2023-01-02T18:16:41.446839+0000","last_became_peered":"2023-01-02T18:16:41.446839+0000","last_unstale":"2023-01-02T18:17:23.364476+0000","last_undegraded":"2023-01-02T18:17:23.364476+0000","last_fullsized":"2023-01-02T18:17:23.364476+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"84'5","reported_seq":143,"reported_epoch":91,"state":"active+clean","last_fresh":"2023-01-02T18:17:24.311859+0000","last_change":"2023-01-02T18:17:24.311859+0000","last_active":"2023-01-02T18:17:24.311859+0000","last_peered":"2023-01-02T18:17:24.311859+0000","last_clean":"2023-01-02T18:17:24.311859+0000","last_became_active":"2023-01-02T18:16:48.329379+0000","last_became_peered":"2023-01-02T18:16:48.329379+0000","last_unstale":"2023-01-02T18:17:24.311859+0000","last_undegraded":"2023-01-02T18:17:24.311859+0000","last_fullsized":"2023-01-02T18:17:24.311859+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":30,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"e","length":"2"}]},{"pgid":"5.1c","version":"56'3","reported_seq":64,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366553+0000","last_change":"2023-01-02T18:16:49.310230+0000","last_active":"2023-01-02T18:17:23.366553+0000","last_peered":"2023-01-02T18:17:23.366553+0000","last_clean":"2023-01-02T18:17:23.366553+0000","last_became_active":"2023-01-02T18:16:48.324944+0000","last_became_peered":"2023-01-02T18:16:48.324944+0000","last_unstale":"2023-01-02T18:17:23.366553+0000","last_undegraded":"2023-01-02T18:17:23.366553+0000","last_fullsized":"2023-01-02T18:17:23.366553+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2023-01-02T18:17:23.366587+0000","last_change":"2023-01-02T18:16:53.345118+0000","last_active":"2023-01-02T18:17:23.366587+0000","last_peered":"2023-01-02T18:17:23.366587+0000","last_clean":"2023-01-02T18:17:23.366587+0000","last_became_active":"2023-01-02T18:16:51.341889+0000","last_became_peered":"2023-01-02T18:16:51.341889+0000","last_unstale":"2023-01-02T18:17:23.366587+0000","last_undegraded":"2023-01-02T18:17:23.366587+0000","last_fullsized":"2023-01-02T18:17:23.366587+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":171,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1528,"num_read_kb":1379,"num_write":98,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":6},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":465,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2462,"num_read_kb":2197,"num_write":146,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":6},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":1365,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":6},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1027,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":1631,"num_read_kb":1310,"num_write":203,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":422,"num_keys_recovered":94,"num_objects_omap":20,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":397312,"data_stored":2396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":104,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":70,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":7},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":109,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":6},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1504,"num_read_kb":1365,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":6}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":89,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7640,"kb_used_data":1168,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":94364200,"statfs":{"total":96636764160,"available":96628940800,"internally_reserved":0,"allocated":1196032,"data_stored":568048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.69399999999999995}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.65200000000000002}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.52400000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.67200000000000004}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.437},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.56799999999999995}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.73899999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.63700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7572,"kb_used_data":1164,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":94364268,"statfs":{"total":96636764160,"available":96629010432,"internally_reserved":0,"allocated":1191936,"data_stored":576709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.64400000000000002}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.58299999999999996}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.78700000000000003}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.432},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.623}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7580,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":94364260,"statfs":{"total":96636764160,"available":96629002240,"internally_reserved":0,"allocated":1200128,"data_stored":576686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.31},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.38}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.437},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.50900000000000001}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.501}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.46300000000000002}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.54100000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7496,"kb_used_data":1152,"kb_used_omap":0,"kb_used_meta":6336,"kb_avail":94364344,"statfs":{"total":96636764160,"available":96629088256,"internally_reserved":0,"allocated":1179648,"data_stored":568010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6488064},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.38300000000000001}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.44400000000000001}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.504}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.51300000000000001}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7132,"kb_used_data":1108,"kb_used_omap":0,"kb_used_meta":6016,"kb_avail":94364708,"statfs":{"total":96636764160,"available":96629460992,"internally_reserved":0,"allocated":1134592,"data_stored":567625,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6160384},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":2.665,"5min":2.665,"15min":2.665},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.5249999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":2.6890000000000001,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.40200000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.435},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.42299999999999999}]},{"osd":4,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.601,"5min":2.601,"15min":2.601},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.637,"5min":2.637,"15min":2.637},"last":0.51900000000000002}]},{"osd":6,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.58699999999999997}]},{"osd":7,"last update":"Mon Jan 2 18:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.53000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7800,"kb_used_data":1200,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94364040,"statfs":{"total":96636764160,"available":96628776960,"internally_reserved":0,"allocated":1228800,"data_stored":576970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.37}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.58799999999999997}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.49399999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.65700000000000003}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.621}]}]},{"osd":4,"up_from":0,"seq":55834574872,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":0,"seq":55834574871,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":99,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":50,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:17:27.503 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-01-02T18:17:27.503 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:17:27.503 INFO:tasks.thrashosds.thrasher:Adding osd 5 2023-01-02T18:17:27.504 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 5 2023-01-02T18:17:27.532 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:27.532+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:27.590 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:27.590 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:27.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:27.645 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:27.645+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:27.707 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:27.707+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:27.725 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:27.725 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:27.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:27.819 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:27.820+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:27.842 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-01-02T18:17:27.843+0000 7fe18f96e700 -1 mon.a@0(leader).osd e94 definitely_dead 0 2023-01-02T18:17:27.900 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:27.901 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:27.909 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:27.910+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:27.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:28.010 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:28.011+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:28.076 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:28.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:28.129 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:28.130+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:28.212 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:28.212 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:28.213 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:28.213+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:28.222 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:28.313 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:28.314+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:28.399 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:28.400 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:28.402 INFO:teuthology.orchestra.run.smithi007.stderr:marked in osd.5. 2023-01-02T18:17:28.412 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:28.414 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:28.415+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:28.416 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 1 2023-01-02T18:17:28.416 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:17:28.417 INFO:tasks.workunit.client.0.smithi007.stdout:snap: snap2-rename 2023-01-02T18:17:28.417 INFO:tasks.workunit.client.0.smithi007.stdout:found snap2-rename with size 4194304 2023-01-02T18:17:28.419 INFO:tasks.thrashosds.thrasher:Added osd 5 2023-01-02T18:17:28.515 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:28.516+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:28.538 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:28.538 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:28.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:28.616 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:28.617+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:28.673 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:28.674 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:28.683 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:28.717 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:28.717+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:28.808 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:28.808 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:28.818 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:28.819 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:28.818+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:28.919 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:28.919+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:28.983 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:28.984 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:28.994 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:29.038 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:29.039+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:29.121 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:29.121+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:29.132 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:29.133 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:29.143 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:29.227 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:29.228+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:29.320 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:29.320 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:29.323 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:29.323+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:29.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:29.399 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:17:29.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:29.457 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:29.458+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:29.502 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:29.503 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:29.513 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:29.557 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:29.558+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:29.605 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:29.623 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:29.624 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:29.624+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:29.640 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:29.646 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:29.646 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:29.646 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:29.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:29.658 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:29.677 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:29.696 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:29.713 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:29.725 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:29.725+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:29.731 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:29.733 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:29.733 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:29.733 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:29.734 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:29.785 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:29.785 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:29.785 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:29.786 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:29.786 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:29.795 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:29.839 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:29.840+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:29.922 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:29.922 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:29.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:29.923 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:29.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.923 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:29.923 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:29.923 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.497837298999997, 2023-01-02T18:17:29.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:29.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:29.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:29.924 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:29.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:29.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:29.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:29.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:29.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:29.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:29.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:29.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:29.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:29.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:29.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:29.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:29.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:29.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:29.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:29.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:29.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:29.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:29.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:29.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:29.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:29.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:29.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:29.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:29.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:29.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:29.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:29.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:29.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:29.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:29.933 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.934 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:29.934 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.934 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:29.934 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:29.935 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.438637591000003, 2023-01-02T18:17:29.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:29.935 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:29.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:29.935 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:29.935 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:29.936 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:29.936 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:29.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.936 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:29.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:29.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:29.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:29.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:29.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:29.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:29.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:29.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:29.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:29.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:29.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:29.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:29.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:29.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:29.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:29.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:29.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:29.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:29.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:29.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:29.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:29.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:29.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:29.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:29.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:29.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:29.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:29.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:29.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:29.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:29.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:29.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:29.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:29.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:29.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:29.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:29.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:29.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:29.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:29.948 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.948 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:29.948 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.949 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:29.949 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:29.949 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.593276750000001, 2023-01-02T18:17:29.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:29.950 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:29.950 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:29.950 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:29.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:29.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:29.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:29.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:29.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:29.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:29.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:29.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:29.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:29.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:29.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:29.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:29.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:29.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:29.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:29.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:29.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:29.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:29.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:29.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:29.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:29.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:29.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:29.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:29.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:29.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:29.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:29.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:29.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.959 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:29.959 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.960 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:17:29.960 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:29.960 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.580840948000002, 2023-01-02T18:17:29.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:17:29.960 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:29.960 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:29.961 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:29.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:29.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:29.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:29.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:29.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:29.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:29.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:29.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:29.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:17:29.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:29.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:17:29.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:17:29.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:29.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:17:29.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:17:29.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:29.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:17:29.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:17:29.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:29.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:17:29.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:17:29.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:29.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:17:29.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:17:29.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:29.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:17:29.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:17:29.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:29.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:17:29.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:17:29.970 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.970 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:29.970 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.970 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:29.971 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:29.971 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.546168209999998, 2023-01-02T18:17:29.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:29.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:29.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:29.971 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:29.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:29.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:29.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:29.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:29.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:29.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:29.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:29.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:29.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:29.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:29.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:29.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:29.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:29.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:29.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:29.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:29.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:29.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:29.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:29.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:29.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:29.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:29.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:29.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:29.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:29.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:29.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:29.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:29.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:29.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:29.980 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.980 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:29.980 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.981 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:29.981 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:29.981 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.535891190999997, 2023-01-02T18:17:29.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:29.981 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:29.982 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:29.982 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:29.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:29.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:29.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:29.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:29.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:29.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:29.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:29.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:29.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:29.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:29.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:29.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:29.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:29.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:29.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:29.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:29.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:29.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:29.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:29.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:29.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:29.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:29.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:29.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:29.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:29.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:29.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:29.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:29.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:29.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:29.990 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.991 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:29.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:29.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.991 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:369 7.1c e64/61 7:3831950c:::rbd_directory:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:29.991 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:29.992 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.608201803999997, 2023-01-02T18:17:29.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004, 2023-01-02T18:17:29.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:29.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:29.992 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:29.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:29.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:29.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:29.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:29.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313603+0000", 2023-01-02T18:17:29.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:29.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:29.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313602+0000", 2023-01-02T18:17:29.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2730000000000002e-06 2023-01-02T18:17:29.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:29.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313607+0000", 2023-01-02T18:17:29.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1277999999999999e-05 2023-01-02T18:17:29.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:29.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313619+0000", 2023-01-02T18:17:29.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4730000000000003e-06 2023-01-02T18:17:29.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:29.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313626+0000", 2023-01-02T18:17:29.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8665999999999998e-05 2023-01-02T18:17:29.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:29.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313675+0000", 2023-01-02T18:17:29.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8902e-05 2023-01-02T18:17:29.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:29.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:29.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:29.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313694+0000", 2023-01-02T18:17:29.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079486599999999998 2023-01-02T18:17:30.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314489+0000", 2023-01-02T18:17:30.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7184999999999997e-05 2023-01-02T18:17:30.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314526+0000", 2023-01-02T18:17:30.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00092323700000000004 2023-01-02T18:17:30.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.001 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.002 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.002 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:30.002 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:30.002 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.227542772, 2023-01-02T18:17:30.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:30.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.003 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.003 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:30.003 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:30.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:30.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.004 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:30.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:30.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:30.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:30.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:30.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:30.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:30.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:30.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:30.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:30.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:30.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:30.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:30.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:30.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:30.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:30.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:30.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:30.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:30.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:30.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:30.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:30.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:30.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:30.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:30.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:30.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:30.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:30.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.017 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.017 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.018 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2084 8.3 e69/65 8:c28f5e81:::rbd_object_map.12a230fb06bc.0000000000000004:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:30.018 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:30.018 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.337068946999999, 2023-01-02T18:17:30.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003, 2023-01-02T18:17:30.019 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.019 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.019 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:30.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:30.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584735+0000", 2023-01-02T18:17:30.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9859999999999997e-06 2023-01-02T18:17:30.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584742+0000", 2023-01-02T18:17:30.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4059999999999999e-05 2023-01-02T18:17:30.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584756+0000", 2023-01-02T18:17:30.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1331999999999999e-05 2023-01-02T18:17:30.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584767+0000", 2023-01-02T18:17:30.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2049000000000002e-05 2023-01-02T18:17:30.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584829+0000", 2023-01-02T18:17:30.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5982e-05 2023-01-02T18:17:30.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.584845+0000", 2023-01-02T18:17:30.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080091699999999995 2023-01-02T18:17:30.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585646+0000", 2023-01-02T18:17:30.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8123000000000002e-05 2023-01-02T18:17:30.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.585674+0000", 2023-01-02T18:17:30.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093901200000000003 2023-01-02T18:17:30.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.028 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.029 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:30.029 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:30.029 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.292227881999999, 2023-01-02T18:17:30.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:30.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:30.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:30.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:30.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.031 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:30.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:30.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:30.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:30.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:30.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:30.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:30.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:30.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:30.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:30.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:30.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:30.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:30.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:30.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:30.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:30.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:30.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:30.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:30.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:30.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:30.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:30.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:30.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:30.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:30.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:30.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:30.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:30.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.042 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2487 8.b e72/65 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head v 72'1, mlcod=0'0)", 2023-01-02T18:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.588286244999999, 2023-01-02T18:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001, 2023-01-02T18:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:30.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:30.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333518+0000", 2023-01-02T18:17:30.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4989999999999999e-06 2023-01-02T18:17:30.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333524+0000", 2023-01-02T18:17:30.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5179999999999993e-06 2023-01-02T18:17:30.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333534+0000", 2023-01-02T18:17:30.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9309999999999996e-06 2023-01-02T18:17:30.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333540+0000", 2023-01-02T18:17:30.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4733e-05 2023-01-02T18:17:30.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333584+0000", 2023-01-02T18:17:30.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3536e-05 2023-01-02T18:17:30.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333608+0000", 2023-01-02T18:17:30.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00076285800000000005 2023-01-02T18:17:30.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334371+0000", 2023-01-02T18:17:30.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4526000000000001e-05 2023-01-02T18:17:30.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334405+0000", 2023-01-02T18:17:30.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088721500000000001 2023-01-02T18:17:30.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.053 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.053 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2494 8.15 e72/65 8:af65fa5d:::rbd_header.12a2b157d0cc:head v 72'17, mlcod=71'15)", 2023-01-02T18:17:30.054 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:30.054 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.581899961000001, 2023-01-02T18:17:30.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997, 2023-01-02T18:17:30.054 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.054 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.054 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:30.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:30.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:30.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339904+0000", 2023-01-02T18:17:30.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.456e-06 2023-01-02T18:17:30.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339912+0000", 2023-01-02T18:17:30.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0529e-05 2023-01-02T18:17:30.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339922+0000", 2023-01-02T18:17:30.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4649999999999996e-06 2023-01-02T18:17:30.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339927+0000", 2023-01-02T18:17:30.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8563999999999999e-05 2023-01-02T18:17:30.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339966+0000", 2023-01-02T18:17:30.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7017e-05 2023-01-02T18:17:30.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.339983+0000", 2023-01-02T18:17:30.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077748699999999999 2023-01-02T18:17:30.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340760+0000", 2023-01-02T18:17:30.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2043999999999999e-05 2023-01-02T18:17:30.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.340802+0000", 2023-01-02T18:17:30.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089769999999999997 2023-01-02T18:17:30.064 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.064 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.064 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.065 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:30.065 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:30.065 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.288323025, 2023-01-02T18:17:30.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:30.065 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:30.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:30.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:30.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:30.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:30.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:30.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:30.076 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.077 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.583781354999999, 2023-01-02T18:17:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.079 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2057 3.6 e82/43 3:6334c7d3:::rbd_object_map.11d574d0a887:head v 82'1, mlcod=0'0)", 2023-01-02T18:17:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.565538635999999, 2023-01-02T18:17:30.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091887800000000003, 2023-01-02T18:17:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356266+0000", 2023-01-02T18:17:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356265+0000", 2023-01-02T18:17:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5269999999999999e-06 2023-01-02T18:17:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356269+0000", 2023-01-02T18:17:30.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7110000000000007e-06 2023-01-02T18:17:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356279+0000", 2023-01-02T18:17:30.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3370000000000001e-06 2023-01-02T18:17:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356283+0000", 2023-01-02T18:17:30.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9932999999999998e-05 2023-01-02T18:17:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356333+0000", 2023-01-02T18:17:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2926999999999999e-05 2023-01-02T18:17:30.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356356+0000", 2023-01-02T18:17:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078956299999999996 2023-01-02T18:17:30.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357145+0000", 2023-01-02T18:17:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9088999999999998e-05 2023-01-02T18:17:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357185+0000", 2023-01-02T18:17:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091887800000000003 2023-01-02T18:17:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.101 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:30.102 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.594049619, 2023-01-02T18:17:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.104 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:30.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:30.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:30.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:30.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.5707237640000002, 2023-01-02T18:17:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:30.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:30.118 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:30.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:30.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:30.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:30.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:30.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:30.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:30.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.129 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:30.130 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.5606485340000003, 2023-01-02T18:17:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:17:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:30.131 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:17:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:30.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:17:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:17:30.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:17:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:17:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:17:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:17:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:17:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:17:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:17:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:17:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:17:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:17:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:17:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:17:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:17:30.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:17:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:17:30.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:17:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:17:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:17:30.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:17:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:17:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:17:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:17:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:17:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:17:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.145 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2241 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [call rbd.object_map_snap_remove in=25b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:30.146 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.5427300979999998, 2023-01-02T18:17:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652, 2023-01-02T18:17:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.147 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2241 2023-01-02T18:17:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379073+0000", 2023-01-02T18:17:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379080+0000", 2023-01-02T18:17:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1620999999999999e-05 2023-01-02T18:17:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379091+0000", 2023-01-02T18:17:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0440000000000003e-06 2023-01-02T18:17:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379097+0000", 2023-01-02T18:17:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4477999999999997e-05 2023-01-02T18:17:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379141+0000", 2023-01-02T18:17:30.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9756999999999997e-05 2023-01-02T18:17:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379201+0000", 2023-01-02T18:17:30.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010401239999999999 2023-01-02T18:17:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.380241+0000", 2023-01-02T18:17:30.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652 2023-01-02T18:17:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.5974987499999997, 2023-01-02T18:17:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:17:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:17:30.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:17:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:17:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:17:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:17:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:17:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:17:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:17:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:17:30.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:17:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:17:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:17:30.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:17:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:17:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:17:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:17:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:17:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:17:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.170 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.170 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:30.171 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:30.172 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:30.172+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:30.272 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:30.273+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:30.329 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:17:30.338 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 0 2023-01-02T18:17:30.338 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 0 2023-01-02T18:17:30.342 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestCreateLsRenameSnapPP (5010 ms) 2023-01-02T18:17:30.343 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.ConcurrentCreatesUnvalidatedPool 2023-01-02T18:17:30.348 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:30.348 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:30.349 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:30.349 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:30.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:30.373 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:30.373+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:30.473 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:30.474+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:30.530 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:30.530 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:30.530 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:30.530 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:30.531 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:30.540 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:30.574 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:30.575+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:30.666 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:30.667 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:30.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:30.667 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:30.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.667 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:30.667 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:30.668 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.182721882000003, 2023-01-02T18:17:30.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:30.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.668 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:30.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:30.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:30.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:30.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:30.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:30.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:30.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:30.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:30.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:30.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:30.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:30.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:30.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:30.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:30.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:30.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:30.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:30.678 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.678 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.678 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.679 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:30.679 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:30.679 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.318655352, 2023-01-02T18:17:30.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:30.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.680 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.680 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:30.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:30.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:30.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:30.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:30.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:30.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:30.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:30.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:30.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:30.689 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:30.690 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:30.691 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.316975739, 2023-01-02T18:17:30.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:30.691 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.691 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.691 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:30.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:30.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:30.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:30.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:30.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:30.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:30.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:30.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:30.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:30.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:30.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:30.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:30.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:30.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:30.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:30.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:30.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:30.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:30.701 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.701 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.701 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.701 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:30.702 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:30.702 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.350147855000003, 2023-01-02T18:17:30.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:30.702 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.702 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.702 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:30.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:30.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:30.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:30.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:30.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:30.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:30.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:30.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:30.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:30.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:30.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:30.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:30.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:30.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:30.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:30.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:30.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:30.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.712 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.713 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:30.713 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:30.713 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.020010311, 2023-01-02T18:17:30.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:30.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.713 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.714 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:30.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:30.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:30.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:30.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:30.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:30.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:30.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:30.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:30.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:30.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:30.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:30.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:30.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:30.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:30.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:30.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:30.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:30.723 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.723 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.723 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.724 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:981 7.1b e64/61 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head v 64'4, mlcod=64'2)", 2023-01-02T18:17:30.724 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:30.724 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.007670613999998, 2023-01-02T18:17:30.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003, 2023-01-02T18:17:30.724 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.725 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:30.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658716+0000", 2023-01-02T18:17:30.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:30.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658715+0000", 2023-01-02T18:17:30.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2509999999999997e-06 2023-01-02T18:17:30.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658723+0000", 2023-01-02T18:17:30.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6970000000000005e-06 2023-01-02T18:17:30.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658732+0000", 2023-01-02T18:17:30.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3159999999999998e-06 2023-01-02T18:17:30.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658737+0000", 2023-01-02T18:17:30.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2293000000000003e-05 2023-01-02T18:17:30.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658779+0000", 2023-01-02T18:17:30.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2996000000000001e-05 2023-01-02T18:17:30.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658802+0000", 2023-01-02T18:17:30.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00066023399999999999 2023-01-02T18:17:30.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659462+0000", 2023-01-02T18:17:30.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4413000000000002e-05 2023-01-02T18:17:30.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659487+0000", 2023-01-02T18:17:30.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077047300000000003 2023-01-02T18:17:30.734 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.735 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.735 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.735 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:30.736 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:30.736 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.342657608, 2023-01-02T18:17:30.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:30.736 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.736 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.736 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:30.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:30.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:30.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:30.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:30.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:30.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:30.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:30.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:30.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:30.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:30.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:30.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:30.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:30.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:30.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:30.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:30.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:30.746 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.746 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.746 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.747 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:30.747 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:30.747 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.340864523, 2023-01-02T18:17:30.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:30.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.747 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.748 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:30.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:30.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:30.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:30.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:30.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:30.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:30.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:30.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:30.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:30.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:30.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:30.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:30.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:30.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:30.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:30.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:30.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:30.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:30.757 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.757 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.757 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.758 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:30.758 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:30.758 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.330026739000001, 2023-01-02T18:17:30.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:30.759 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.759 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.759 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:30.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:30.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:30.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:30.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:30.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:30.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:30.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:30.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:30.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:30.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:30.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:30.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:30.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:30.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:30.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:30.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:30.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:30.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:30.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.769 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.769 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1774 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'72, mlcod=68'70)", 2023-01-02T18:17:30.770 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:30.770 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.090752377000001, 2023-01-02T18:17:30.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004, 2023-01-02T18:17:30.770 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.770 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.771 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:30.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575634+0000", 2023-01-02T18:17:30.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:30.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575633+0000", 2023-01-02T18:17:30.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1912999999999999e-05 2023-01-02T18:17:30.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575645+0000", 2023-01-02T18:17:30.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5690000000000001e-05 2023-01-02T18:17:30.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575660+0000", 2023-01-02T18:17:30.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1430000000000001e-06 2023-01-02T18:17:30.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575668+0000", 2023-01-02T18:17:30.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9123000000000003e-05 2023-01-02T18:17:30.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575727+0000", 2023-01-02T18:17:30.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0632000000000001e-05 2023-01-02T18:17:30.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.575757+0000", 2023-01-02T18:17:30.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057452100000000004 2023-01-02T18:17:30.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576332+0000", 2023-01-02T18:17:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8958999999999998e-05 2023-01-02T18:17:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.576361+0000", 2023-01-02T18:17:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072647900000000004 2023-01-02T18:17:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1842 8.4 e68/65 8:24c831c0:::rbd_header.12a2b9663ff5:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.053490847999999, 2023-01-02T18:17:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997, 2023-01-02T18:17:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612896+0000", 2023-01-02T18:17:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612894+0000", 2023-01-02T18:17:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612908+0000", 2023-01-02T18:17:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6006000000000001e-05 2023-01-02T18:17:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612934+0000", 2023-01-02T18:17:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.509e-05 2023-01-02T18:17:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.612949+0000", 2023-01-02T18:17:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7535999999999998e-05 2023-01-02T18:17:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613027+0000", 2023-01-02T18:17:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0413000000000001e-05 2023-01-02T18:17:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613067+0000", 2023-01-02T18:17:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00056083499999999998 2023-01-02T18:17:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613628+0000", 2023-01-02T18:17:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0998000000000001e-05 2023-01-02T18:17:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.613649+0000", 2023-01-02T18:17:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075325399999999997 2023-01-02T18:17:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2136 8.16 e69/65 8:6e7fbf55:::rbd_object_map.12a27aa439c7:head v 69'1, mlcod=0'0)", 2023-01-02T18:17:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.045409374999998, 2023-01-02T18:17:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995, 2023-01-02T18:17:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620977+0000", 2023-01-02T18:17:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8340000000000001e-06 2023-01-02T18:17:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620984+0000", 2023-01-02T18:17:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5201000000000001e-05 2023-01-02T18:17:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.620999+0000", 2023-01-02T18:17:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9990000000000008e-06 2023-01-02T18:17:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621007+0000", 2023-01-02T18:17:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9780999999999997e-05 2023-01-02T18:17:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621047+0000", 2023-01-02T18:17:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2869e-05 2023-01-02T18:17:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621060+0000", 2023-01-02T18:17:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061950799999999995 2023-01-02T18:17:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621679+0000", 2023-01-02T18:17:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2191999999999999e-05 2023-01-02T18:17:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.621711+0000", 2023-01-02T18:17:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00073399299999999995 2023-01-02T18:17:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.337973179, 2023-01-02T18:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.323774639, 2023-01-02T18:17:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:17:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.3016923649999992, 2023-01-02T18:17:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:17:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:17:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:17:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:17:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:17:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:17:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:17:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:17:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:17:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:17:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:17:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:17:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:17:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:17:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:17:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:17:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2226 3.13 e89/54 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head v 89'2, mlcod=0'0)", 2023-01-02T18:17:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.299272255, 2023-01-02T18:17:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005, 2023-01-02T18:17:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0959999999999997e-06 2023-01-02T18:17:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367120+0000", 2023-01-02T18:17:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4494e-05 2023-01-02T18:17:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367135+0000", 2023-01-02T18:17:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5700000000000004e-06 2023-01-02T18:17:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367142+0000", 2023-01-02T18:17:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9985000000000003e-05 2023-01-02T18:17:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367192+0000", 2023-01-02T18:17:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8598e-05 2023-01-02T18:17:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367211+0000", 2023-01-02T18:17:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072699899999999998 2023-01-02T18:17:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367938+0000", 2023-01-02T18:17:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8569999999999998e-05 2023-01-02T18:17:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367977+0000", 2023-01-02T18:17:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005 2023-01-02T18:17:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:17:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.3260575000000001, 2023-01-02T18:17:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:17:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:17:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:17:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:17:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:17:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:17:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:17:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:17:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:17:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:17:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:17:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:17:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:17:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:17:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:17:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:17:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:17:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.3243186509999996, 2023-01-02T18:17:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:17:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:17:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:17:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:17:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:17:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:17:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:17:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:17:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:17:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:17:30.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:17:30.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:17:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:17:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:17:30.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:17:30.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:17:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:17:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:17:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.33199339700000002, 2023-01-02T18:17:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:17:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:17:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:17:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:17:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:17:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:17:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:17:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:17:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:17:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:17:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:17:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:17:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:17:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:17:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:17:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:17:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2406 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'19, mlcod=95'17)", 2023-01-02T18:17:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.341586+0000", 2023-01-02T18:17:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.32480100699999997, 2023-01-02T18:17:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075372700000000004, 2023-01-02T18:17:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.341586+0000", 2023-01-02T18:17:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.341586+0000", 2023-01-02T18:17:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.341585+0000", 2023-01-02T18:17:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6500000000000002e-06 2023-01-02T18:17:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.341593+0000", 2023-01-02T18:17:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2099999999999999e-05 2023-01-02T18:17:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:30.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.341605+0000", 2023-01-02T18:17:30.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4689999999999996e-06 2023-01-02T18:17:30.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.341611+0000", 2023-01-02T18:17:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0615999999999999e-05 2023-01-02T18:17:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.341652+0000", 2023-01-02T18:17:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7348000000000001e-05 2023-01-02T18:17:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.341669+0000", 2023-01-02T18:17:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063204600000000004 2023-01-02T18:17:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.342301+0000", 2023-01-02T18:17:30.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8504000000000003e-05 2023-01-02T18:17:30.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:30.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:30.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:30.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.342339+0000", 2023-01-02T18:17:30.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075372700000000004 2023-01-02T18:17:30.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.894 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:30.894 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:30.894 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:30.896 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:30.897 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:30.897+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:30.997 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:30.998+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:31.023 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:31.023 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:31.023 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:31.023 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:31.033 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:31.098 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:31.098+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:31.199 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:31.199 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:31.199 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:31.199 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:31.199 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:31.200 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:31.200+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:31.209 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:31.299 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:31.300+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:31.384 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:31.384 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.947779523999998, 2023-01-02T18:17:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:7 3.1e 3:7e46e63b:::rbd_header.11d585d3810a:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.898394531000001, 2023-01-02T18:17:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886, 2023-01-02T18:17:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 7 2023-01-02T18:17:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485234+0000", 2023-01-02T18:17:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485232+0000", 2023-01-02T18:17:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:17:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485241+0000", 2023-01-02T18:17:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2227e-05 2023-01-02T18:17:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485253+0000", 2023-01-02T18:17:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0791999999999999e-05 2023-01-02T18:17:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485264+0000", 2023-01-02T18:17:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4029000000000006e-05 2023-01-02T18:17:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485328+0000", 2023-01-02T18:17:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017353799999999999 2023-01-02T18:17:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485502+0000", 2023-01-02T18:17:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033990700000000002 2023-01-02T18:17:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.485842+0000", 2023-01-02T18:17:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000732502 2023-01-02T18:17:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486574+0000", 2023-01-02T18:17:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000309938 2023-01-02T18:17:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486884+0000", 2023-01-02T18:17:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0832999999999998e-05 2023-01-02T18:17:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486945+0000", 2023-01-02T18:17:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1898999999999999e-05 2023-01-02T18:17:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.486997+0000", 2023-01-02T18:17:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001762886 2023-01-02T18:17:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:444 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.008378297999997, 2023-01-02T18:17:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489, 2023-01-02T18:17:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 444 2023-01-02T18:17:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375250+0000", 2023-01-02T18:17:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375249+0000", 2023-01-02T18:17:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9409999999999998e-06 2023-01-02T18:17:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375254+0000", 2023-01-02T18:17:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5210000000000008e-06 2023-01-02T18:17:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375264+0000", 2023-01-02T18:17:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9629999999999997e-06 2023-01-02T18:17:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375269+0000", 2023-01-02T18:17:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.333e-05 2023-01-02T18:17:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375312+0000", 2023-01-02T18:17:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6695999999999998e-05 2023-01-02T18:17:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375399+0000", 2023-01-02T18:17:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016210000000000001 2023-01-02T18:17:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375561+0000", 2023-01-02T18:17:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087961699999999996 2023-01-02T18:17:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376440+0000", 2023-01-02T18:17:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055437200000000002 2023-01-02T18:17:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376995+0000", 2023-01-02T18:17:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6236999999999997e-05 2023-01-02T18:17:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377051+0000", 2023-01-02T18:17:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0509e-05 2023-01-02T18:17:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.377102+0000", 2023-01-02T18:17:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001851489 2023-01-02T18:17:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.998071056999997, 2023-01-02T18:17:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:17:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:17:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:17:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:17:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:17:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:17:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:17:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:17:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:17:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:17:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:17:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:17:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:17:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:17:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:17:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:17:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:17:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:17:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:17:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:17:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:17:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:17:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:17:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:17:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.074239415000001, 2023-01-02T18:17:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:372 7.1 7:83feba0f:::rbd_object_map.11d56649889d:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.064300351999997, 2023-01-02T18:17:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479, 2023-01-02T18:17:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 372 2023-01-02T18:17:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319328+0000", 2023-01-02T18:17:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319326+0000", 2023-01-02T18:17:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1199999999999996e-06 2023-01-02T18:17:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319334+0000", 2023-01-02T18:17:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2170999999999999e-05 2023-01-02T18:17:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319346+0000", 2023-01-02T18:17:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7789999999999996e-06 2023-01-02T18:17:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319353+0000", 2023-01-02T18:17:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8445999999999997e-05 2023-01-02T18:17:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319392+0000", 2023-01-02T18:17:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010474700000000001 2023-01-02T18:17:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319497+0000", 2023-01-02T18:17:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000138159 2023-01-02T18:17:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.319635+0000", 2023-01-02T18:17:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071603699999999999 2023-01-02T18:17:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320351+0000", 2023-01-02T18:17:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063369800000000003 2023-01-02T18:17:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.320985+0000", 2023-01-02T18:17:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5822000000000002e-05 2023-01-02T18:17:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321040+0000", 2023-01-02T18:17:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4125999999999997e-05 2023-01-02T18:17:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.321085+0000", 2023-01-02T18:17:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001756479 2023-01-02T18:17:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.768279459999999, 2023-01-02T18:17:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.053807645999999, 2023-01-02T18:17:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.044706245, 2023-01-02T18:17:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.773349953, 2023-01-02T18:17:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2643 3.7 3:e026f164:::rbd_object_map.12a23fc13ef0.0000000000000004:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.768836425, 2023-01-02T18:17:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001, 2023-01-02T18:17:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2643 2023-01-02T18:17:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614790+0000", 2023-01-02T18:17:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3409999999999992e-06 2023-01-02T18:17:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614799+0000", 2023-01-02T18:17:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0420000000000008e-06 2023-01-02T18:17:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614808+0000", 2023-01-02T18:17:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1370000000000001e-06 2023-01-02T18:17:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614814+0000", 2023-01-02T18:17:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064692000000000005 2023-01-02T18:17:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615460+0000", 2023-01-02T18:17:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012489599999999999 2023-01-02T18:17:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615585+0000", 2023-01-02T18:17:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015799100000000001 2023-01-02T18:17:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615743+0000", 2023-01-02T18:17:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097339900000000001 2023-01-02T18:17:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.616717+0000", 2023-01-02T18:17:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045439800000000001 2023-01-02T18:17:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617171+0000", 2023-01-02T18:17:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8190999999999999e-05 2023-01-02T18:17:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617229+0000", 2023-01-02T18:17:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5250000000000002e-05 2023-01-02T18:17:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617275+0000", 2023-01-02T18:17:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001 2023-01-02T18:17:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.764160297, 2023-01-02T18:17:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.055980629, 2023-01-02T18:17:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:31.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:31.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:31.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:31.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:31.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:31.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:31.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:31.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.582 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.583 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2189 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:17:31.583 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:31.583 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.046092907, 2023-01-02T18:17:31.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021348589999999998, 2023-01-02T18:17:31.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.584 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.584 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.584 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.584 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2189 2023-01-02T18:17:31.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.585 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:31.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337535+0000", 2023-01-02T18:17:31.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:31.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337532+0000", 2023-01-02T18:17:31.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4099e-05 2023-01-02T18:17:31.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337547+0000", 2023-01-02T18:17:31.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5758000000000001e-05 2023-01-02T18:17:31.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337562+0000", 2023-01-02T18:17:31.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6670000000000002e-06 2023-01-02T18:17:31.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337571+0000", 2023-01-02T18:17:31.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3940999999999998e-05 2023-01-02T18:17:31.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337615+0000", 2023-01-02T18:17:31.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5260999999999997e-05 2023-01-02T18:17:31.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337680+0000", 2023-01-02T18:17:31.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000237376 2023-01-02T18:17:31.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.337918+0000", 2023-01-02T18:17:31.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069068199999999997 2023-01-02T18:17:31.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.338608+0000", 2023-01-02T18:17:31.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009849049999999999 2023-01-02T18:17:31.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339593+0000", 2023-01-02T18:17:31.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4521999999999999e-05 2023-01-02T18:17:31.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339628+0000", 2023-01-02T18:17:31.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2684e-05 2023-01-02T18:17:31.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.339670+0000", 2023-01-02T18:17:31.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021348589999999998 2023-01-02T18:17:31.596 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.597 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.597 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.597 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:31.598 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:31.598 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.029244387, 2023-01-02T18:17:31.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:31.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.598 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.599 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:31.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.599 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:31.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:31.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:31.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:31.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:31.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:31.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:31.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:31.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:31.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:31.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:31.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:31.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:31.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:31.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:31.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:31.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:31.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:31.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:31.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:31.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:31.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:31.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:31.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.613 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.614 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:31.614 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:31.614 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.0291967910000004, 2023-01-02T18:17:31.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:17:31.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.615 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.615 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.615 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:17:31.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.616 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:31.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:31.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:31.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:17:31.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:17:31.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:17:31.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:17:31.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:17:31.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:17:31.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:17:31.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:17:31.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:17:31.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:17:31.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:17:31.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:17:31.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:17:31.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:17:31.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:17:31.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:17:31.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:17:31.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:17:31.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:17:31.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:17:31.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:17:31.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:17:31.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:17:31.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:17:31.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:17:31.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:17:31.629 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.629 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.630 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.630 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2238 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_trash_add in=21b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:31.630 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:31.630 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.0090021960000009, 2023-01-02T18:17:31.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002, 2023-01-02T18:17:31.631 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.631 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.631 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.632 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2238 2023-01-02T18:17:31.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.632 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:31.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:31.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:31.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374625+0000", 2023-01-02T18:17:31.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9540000000000003e-06 2023-01-02T18:17:31.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374630+0000", 2023-01-02T18:17:31.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0295000000000001e-05 2023-01-02T18:17:31.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374641+0000", 2023-01-02T18:17:31.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3980000000000001e-06 2023-01-02T18:17:31.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374645+0000", 2023-01-02T18:17:31.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0728999999999997e-05 2023-01-02T18:17:31.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374676+0000", 2023-01-02T18:17:31.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8452000000000003e-05 2023-01-02T18:17:31.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374724+0000", 2023-01-02T18:17:31.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019847300000000001 2023-01-02T18:17:31.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374923+0000", 2023-01-02T18:17:31.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054292499999999998 2023-01-02T18:17:31.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.375466+0000", 2023-01-02T18:17:31.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025375240000000002 2023-01-02T18:17:31.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378003+0000", 2023-01-02T18:17:31.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1505e-05 2023-01-02T18:17:31.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378085+0000", 2023-01-02T18:17:31.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2633000000000002e-05 2023-01-02T18:17:31.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378107+0000", 2023-01-02T18:17:31.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002 2023-01-02T18:17:31.643 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.643 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.644 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.644 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:31.644 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:31.645 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.0661277050000004, 2023-01-02T18:17:31.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:17:31.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.645 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.645 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.645 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:17:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:17:31.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:17:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:17:31.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:17:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:17:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:17:31.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:17:31.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:17:31.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:17:31.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:17:31.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:31.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:17:31.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:17:31.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:17:31.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:17:31.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:17:31.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:17:31.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:17:31.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:17:31.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:17:31.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:17:31.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:17:31.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:17:31.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:17:31.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:17:31.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:17:31.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:17:31.659 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.659 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.659 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.660 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2285 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [watch unwatch cookie 140114919434064] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:31.660 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:31.660 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.0518416720000001, 2023-01-02T18:17:31.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022783640000000002, 2023-01-02T18:17:31.661 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.661 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:31.661 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.661 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.661 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.661 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2285 2023-01-02T18:17:31.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.662 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:31.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:31.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:31.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331786+0000", 2023-01-02T18:17:31.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0419999999999998e-06 2023-01-02T18:17:31.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331789+0000", 2023-01-02T18:17:31.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8580000000000002e-06 2023-01-02T18:17:31.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331796+0000", 2023-01-02T18:17:31.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8789999999999996e-06 2023-01-02T18:17:31.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331800+0000", 2023-01-02T18:17:31.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016221000000000001 2023-01-02T18:17:31.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331962+0000", 2023-01-02T18:17:31.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6188999999999998e-05 2023-01-02T18:17:31.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332038+0000", 2023-01-02T18:17:31.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101796 2023-01-02T18:17:31.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:31.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332140+0000", 2023-01-02T18:17:31.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046557400000000001 2023-01-02T18:17:31.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:31.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332606+0000", 2023-01-02T18:17:31.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001331734 2023-01-02T18:17:31.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:31.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.333938+0000", 2023-01-02T18:17:31.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1469e-05 2023-01-02T18:17:31.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:31.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.333969+0000", 2023-01-02T18:17:31.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6107000000000007e-05 2023-01-02T18:17:31.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334065+0000", 2023-01-02T18:17:31.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022783640000000002 2023-01-02T18:17:31.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.673 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.674 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2286 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:31.674 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:31.674 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.0516250449999998, 2023-01-02T18:17:31.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00219163, 2023-01-02T18:17:31.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:31.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:31.675 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:31.675 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:31.675 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:31.675 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2286 2023-01-02T18:17:31.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.676 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:31.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:31.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:31.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:31.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:31.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:31.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:31.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:31.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332002+0000", 2023-01-02T18:17:31.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:31.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:31.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332008+0000", 2023-01-02T18:17:31.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.995e-06 2023-01-02T18:17:31.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:31.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332018+0000", 2023-01-02T18:17:31.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4619999999999996e-06 2023-01-02T18:17:31.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:31.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332027+0000", 2023-01-02T18:17:31.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031803400000000003 2023-01-02T18:17:31.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332345+0000", 2023-01-02T18:17:31.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1441999999999997e-05 2023-01-02T18:17:31.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:17:31.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332426+0000", 2023-01-02T18:17:31.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001672378 2023-01-02T18:17:31.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:31.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334098+0000", 2023-01-02T18:17:31.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.731e-05 2023-01-02T18:17:31.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:31.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334136+0000", 2023-01-02T18:17:31.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9179999999999999e-05 2023-01-02T18:17:31.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:31.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:31.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:31.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334195+0000", 2023-01-02T18:17:31.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00219163 2023-01-02T18:17:31.685 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.685 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.686 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.686 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:31.686 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:31.686 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:31.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:31.688 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:31.688+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:31.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:31.788 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:31.789+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:31.827 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:31.827 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:31.827 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:31.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:31.889 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:31.907 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:31.921 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:31.922+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:31.924 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:31.941 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:31.959 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:31.977 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:31.989 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:31.990+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:31.995 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:32.004 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:32.004 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:32.013 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:32.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:32.015 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:32.016 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:32.017 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:32.097 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:32.098+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:32.180 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:32.180 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:32.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:32.231 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:32.232+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:32.292 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:32.292+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:32.338 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:32.338 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:32.338 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:32.338 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:32.342 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:17:32.364 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:32.364 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:32.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:32.393 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:32.394+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:32.494 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:32.495+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:32.540 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:32.540 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:32.550 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:32.595 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:32.595+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:32.675 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:32.676 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:32.685 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:32.696 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:32.697+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:32.796 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:32.797+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:32.811 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:32.811 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:32.821 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:32.904 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:32.905+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:32.986 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:32.986 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:32.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:33.036 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:33.037+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:33.099 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:33.099+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:33.160 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:33.160 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:33.170 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:33.199 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:33.200+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:33.300 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:33.301+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:33.331 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:17:33.338 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:33.339 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:33.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:33.400 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:33.401+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:33.420 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7, 5] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:17:33.420 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:17:33.420 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2023-01-02T18:17:33.421 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 1.0 2023-01-02T18:17:33.501 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:33.501+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:33.516 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:33.516 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:33.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:33.610 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:33.611+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:33.690 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:33.691 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:33.700 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:33.729 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 530 (0%) 2023-01-02T18:17:33.729 INFO:teuthology.orchestra.run.smithi007.stdout:avg 75.7143 2023-01-02T18:17:33.729 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 10.8853 -> 10.8853 (expected baseline 8.05593) 2023-01-02T18:17:33.730 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 54 -> 54 pgs (0.713208 -> 0.713208 * mean) 2023-01-02T18:17:33.730 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 89 -> 89 pgs (1.17547 -> 1.17547 * mean) 2023-01-02T18:17:33.730 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:33.730 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:17:33.730 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 1 2023-01-02T18:17:33.731 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:33.731 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:33.731 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0009 2023-01-02T18:17:33.732 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:17:33.741 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:33.742+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:33.743 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2023-01-02T18:17:33.743 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2023-01-02T18:17:33.827 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:33.828+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:33.828 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:33.829 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:33.839 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:33.924 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:33.925+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:34.005 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:34.006+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:34.007 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:34.007 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:34.018 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:34.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:34.090 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 530 (0%) 2023-01-02T18:17:34.091 INFO:teuthology.orchestra.run.smithi007.stdout:avg 75.7143 2023-01-02T18:17:34.091 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 10.8853 -> 10.8853 (expected baseline 8.05593) 2023-01-02T18:17:34.091 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 54 -> 54 pgs (0.713208 -> 0.713208 * mean) 2023-01-02T18:17:34.091 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 89 -> 89 pgs (1.17547 -> 1.17547 * mean) 2023-01-02T18:17:34.091 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:34.092 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:17:34.092 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 3 2023-01-02T18:17:34.092 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:34.092 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:34.092 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0009 2023-01-02T18:17:34.093 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:17:34.105 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2023-01-02T18:17:34.105 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 3.0 2023-01-02T18:17:34.107 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:34.108+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:34.189 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:34.189 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:34.199 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:34.205 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:34.207 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:34.208+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:34.222 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:34.240 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:34.258 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:34.276 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:34.300 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:34.308 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:34.308+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:34.326 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:34.354 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:34.354 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:34.354 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:34.355 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:34.355 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:34.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:34.358 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:34.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:34.412 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:34.413+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:34.499 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 530 (0%) 2023-01-02T18:17:34.499 INFO:teuthology.orchestra.run.smithi007.stdout:avg 75.7143 2023-01-02T18:17:34.500 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 10.8853 -> 10.8853 (expected baseline 8.05593) 2023-01-02T18:17:34.500 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 54 -> 54 pgs (0.713208 -> 0.713208 * mean) 2023-01-02T18:17:34.500 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 89 -> 89 pgs (1.17547 -> 1.17547 * mean) 2023-01-02T18:17:34.500 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:34.500 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:17:34.501 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 3 2023-01-02T18:17:34.501 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:34.501 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:34.501 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0009 2023-01-02T18:17:34.503 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:17:34.509 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:34.510+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:34.519 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '1000', 'type': 'reweight-by-utilization'} 2023-01-02T18:17:34.520 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 0.05 2023-01-02T18:17:34.560 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:34.560 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:34.561 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:34.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:34.610 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.ConcurrentCreatesUnvalidatedPool (4267 ms) 2023-01-02T18:17:34.610 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.RemoveFullTry 2023-01-02T18:17:34.611 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:34.611+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:34.711 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:34.712+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:34.744 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:34.744 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:34.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:34.745 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:34.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.745 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:34.745 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:34.745 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.318593393999997, 2023-01-02T18:17:34.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:34.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.746 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:34.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:34.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:34.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:34.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:34.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:34.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:34.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:34.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:34.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:34.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:34.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:34.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:34.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:34.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:34.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:34.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:34.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:34.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:34.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.755 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.756 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:34.756 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:34.757 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.259393686000003, 2023-01-02T18:17:34.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:34.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.758 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:34.758 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:34.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:34.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.758 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:34.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:34.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:34.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:34.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:34.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:34.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:34.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:34.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:34.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:34.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:34.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:34.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:34.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:34.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:34.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:34.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:34.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:34.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:34.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:34.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:34.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:34.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:34.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:34.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:34.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:34.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:34.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:34.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.770 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.771 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:34.771 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:34.771 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.414032845000001, 2023-01-02T18:17:34.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:34.771 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.771 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.772 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:34.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:34.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:34.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:34.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:34.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:34.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:34.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:34.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:34.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:34.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:34.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:34.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:34.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:34.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:34.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:34.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:34.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:34.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:34.780 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.781 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.781 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.781 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:17:34.781 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:34.782 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.401597043000002, 2023-01-02T18:17:34.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:17:34.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.782 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:34.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:34.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:34.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:34.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:17:34.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:17:34.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:17:34.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:17:34.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:17:34.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:17:34.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:17:34.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:17:34.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:17:34.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:17:34.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:17:34.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:17:34.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:17:34.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:17:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:17:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.791 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.366924304999998, 2023-01-02T18:17:34.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:34.793 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.793 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.793 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:34.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:34.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:34.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:34.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:34.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:34.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:34.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:34.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:34.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:34.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:34.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:34.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:34.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:34.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:34.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:34.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:34.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:34.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:34.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.802 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.803 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:34.803 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:34.803 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.356647285999998, 2023-01-02T18:17:34.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:34.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.804 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.804 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:34.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:34.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:34.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:34.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:34.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:34.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:34.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:34.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:34.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:34.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:34.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:34.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:34.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:34.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:34.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:34.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:34.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:34.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:34.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.817 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.817 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:34.818 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:34.818 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.048298867, 2023-01-02T18:17:34.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:34.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.818 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:34.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:34.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:34.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.819 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:34.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:34.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:34.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:34.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:34.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:34.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:34.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:34.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:34.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:34.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:34.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:34.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:34.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:34.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:34.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:34.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:34.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:34.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:34.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:34.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:34.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:34.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:34.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:34.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:34.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:34.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:34.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:34.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.832 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.833 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:34.833 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:34.834 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.112983976999999, 2023-01-02T18:17:34.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:34.834 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:34.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:34.835 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:34.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.835 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:34.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:34.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:34.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:34.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:34.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:34.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:34.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:34.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:34.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:34.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:34.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:34.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:34.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:34.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:34.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:34.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:34.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:34.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:34.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:34.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:34.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:34.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:34.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:34.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:34.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:34.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:34.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:34.848 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.848 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.848 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.849 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:34.849 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:34.849 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.109079120000001, 2023-01-02T18:17:34.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:34.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:34.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:34.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:34.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:34.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.404537449999999, 2023-01-02T18:17:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:34.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:34.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:34.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:34.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:34.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:34.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:34.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:34.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:34.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:34.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:34.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:34.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:34.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.414805714, 2023-01-02T18:17:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.391479859, 2023-01-02T18:17:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:34.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:34.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.893 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:34.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:34.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:34.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:34.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:34.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:34.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:34.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:34.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:34.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:34.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.381404629, 2023-01-02T18:17:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:17:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:17:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:17:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:17:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:17:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:17:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:17:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:17:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:17:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:17:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:17:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:17:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:17:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:17:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:17:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:17:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:17:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:17:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:17:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:17:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:17:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:17:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:17:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:17:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:17:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:17:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:17:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:17:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2241 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [call rbd.object_map_snap_remove in=25b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.363486193, 2023-01-02T18:17:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652, 2023-01-02T18:17:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2241 2023-01-02T18:17:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379073+0000", 2023-01-02T18:17:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379080+0000", 2023-01-02T18:17:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1620999999999999e-05 2023-01-02T18:17:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379091+0000", 2023-01-02T18:17:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0440000000000003e-06 2023-01-02T18:17:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379097+0000", 2023-01-02T18:17:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4477999999999997e-05 2023-01-02T18:17:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379141+0000", 2023-01-02T18:17:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9756999999999997e-05 2023-01-02T18:17:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379201+0000", 2023-01-02T18:17:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010401239999999999 2023-01-02T18:17:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.380241+0000", 2023-01-02T18:17:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652 2023-01-02T18:17:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.4182548449999999, 2023-01-02T18:17:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:17:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:17:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:17:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:17:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:17:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:17:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:17:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:17:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:17:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:17:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:17:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:17:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:17:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:17:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:17:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:17:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:17:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:17:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:17:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.41349138000000002, 2023-01-02T18:17:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:17:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:17:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:17:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:17:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:17:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:17:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:17:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:17:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:17:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:17:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:17:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:17:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:17:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:17:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:17:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:17:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:17:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:17:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.41295815499999999, 2023-01-02T18:17:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:17:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:17:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:17:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:17:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:17:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:17:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:17:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:17:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:17:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:17:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:17:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:17:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:17:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:17:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:17:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:17:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.401939881, 2023-01-02T18:17:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:17:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:17:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:17:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:17:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:17:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:17:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:17:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:17:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:17:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:17:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:17:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:17:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:17:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:17:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:17:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:17:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:17:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:17:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.397595327, 2023-01-02T18:17:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:17:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:17:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:17:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:17:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:17:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:17:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:17:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:17:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:17:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:17:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:17:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:17:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:17:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:17:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:17:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:17:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:17:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2828 10.1d e101/98 10:bf37f79e:::rbd_object_map.12a2779686d1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.39339869599999999, 2023-01-02T18:17:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010281450000000001, 2023-01-02T18:17:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349161+0000", 2023-01-02T18:17:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4200000000000007e-06 2023-01-02T18:17:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349169+0000", 2023-01-02T18:17:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5036e-05 2023-01-02T18:17:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349184+0000", 2023-01-02T18:17:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8539999999999999e-06 2023-01-02T18:17:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349191+0000", 2023-01-02T18:17:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4647000000000001e-05 2023-01-02T18:17:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349236+0000", 2023-01-02T18:17:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3459999999999999e-05 2023-01-02T18:17:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349259+0000", 2023-01-02T18:17:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000900318 2023-01-02T18:17:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350159+0000", 2023-01-02T18:17:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0460999999999999e-05 2023-01-02T18:17:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350190+0000", 2023-01-02T18:17:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010281450000000001 2023-01-02T18:17:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.001 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.001 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:35.002 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:35.003 INFO:teuthology.orchestra.run.smithi007.stdout:moved 0 / 530 (0%) 2023-01-02T18:17:35.003 INFO:teuthology.orchestra.run.smithi007.stdout:avg 75.7143 2023-01-02T18:17:35.003 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 10.8853 -> 10.8853 (expected baseline 8.05593) 2023-01-02T18:17:35.004 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 54 -> 54 pgs (0.713208 -> 0.713208 * mean) 2023-01-02T18:17:35.004 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 89 -> 89 pgs (1.17547 -> 1.17547 * mean) 2023-01-02T18:17:35.004 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:35.004 INFO:teuthology.orchestra.run.smithi007.stdout:oload 1000 2023-01-02T18:17:35.004 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 0.05 2023-01-02T18:17:35.005 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:35.005 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:35.005 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0010 2023-01-02T18:17:35.006 INFO:teuthology.orchestra.run.smithi007.stderr:no change 2023-01-02T18:17:35.006 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'reweight-by-utilization'} 2023-01-02T18:17:35.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 0.05 2023-01-02T18:17:35.010 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:35.003+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:35.103 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:35.103+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:35.174 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:35.174 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:35.175 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:35.175 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:35.185 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:35.229 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:35.230+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:35.304 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:35.305+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:35.311 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:35.311 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:35.312 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:35.312 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:35.312 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:35.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:35.347 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:17:35.405 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:35.405+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:35.427 INFO:teuthology.orchestra.run.smithi007.stdout:moved 12 / 530 (2.26415%) 2023-01-02T18:17:35.428 INFO:teuthology.orchestra.run.smithi007.stdout:avg 75.7143 2023-01-02T18:17:35.428 INFO:teuthology.orchestra.run.smithi007.stdout:stddev 10.8853 -> 8.71311 (expected baseline 8.05593) 2023-01-02T18:17:35.428 INFO:teuthology.orchestra.run.smithi007.stdout:min osd.2 with 54 -> 57 pgs (0.713208 -> 0.75283 * mean) 2023-01-02T18:17:35.428 INFO:teuthology.orchestra.run.smithi007.stdout:max osd.1 with 89 -> 83 pgs (1.17547 -> 1.09623 * mean) 2023-01-02T18:17:35.428 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:35.429 INFO:teuthology.orchestra.run.smithi007.stdout:oload 110 2023-01-02T18:17:35.429 INFO:teuthology.orchestra.run.smithi007.stdout:max_change 0.05 2023-01-02T18:17:35.429 INFO:teuthology.orchestra.run.smithi007.stdout:max_change_osds 4 2023-01-02T18:17:35.429 INFO:teuthology.orchestra.run.smithi007.stdout:average_utilization 0.0001 2023-01-02T18:17:35.429 INFO:teuthology.orchestra.run.smithi007.stdout:overload_utilization 0.0001 2023-01-02T18:17:35.430 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3 weight 1.0000 -> 0.9500 2023-01-02T18:17:35.430 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 weight 1.0000 -> 0.9500 2023-01-02T18:17:35.430 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7 weight 1.0000 -> 0.9500 2023-01-02T18:17:35.503 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:35.504 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:35.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:35.504 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:35.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.504 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:35.505 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:35.505 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.019569683, 2023-01-02T18:17:35.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:35.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:35.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:35.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.155503152999998, 2023-01-02T18:17:35.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:35.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:35.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:35.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:35.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:35.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:35.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:35.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:35.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:35.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:35.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:35.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:35.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:35.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:35.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:35.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:35.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:35.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:35.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.526 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.527 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:35.527 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:35.527 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.153823539999998, 2023-01-02T18:17:35.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:35.528 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.528 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.528 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:35.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:35.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:35.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:35.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:35.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:35.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:35.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:35.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:35.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:35.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:35.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:35.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:35.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:35.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:35.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:35.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:35.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:35.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:35.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.537 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.538 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:35.538 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:35.538 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.186995656000001, 2023-01-02T18:17:35.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:35.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.539 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:35.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:35.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:35.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:35.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:35.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:35.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:35.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:35.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:35.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:35.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:35.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:35.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:35.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:35.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:35.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:35.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:35.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:35.548 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.549 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.549 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.549 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:35.550 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:35.550 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.856858111999998, 2023-01-02T18:17:35.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:35.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.550 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:35.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:35.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:35.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:35.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:35.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:35.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:35.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:35.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:35.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:35.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:35.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:35.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:35.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:35.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:35.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:35.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:35.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:35.559 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.560 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.560 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.560 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:35.561 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:35.561 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.179505409000001, 2023-01-02T18:17:35.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:35.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.562 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:35.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:35.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:35.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:35.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:35.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:35.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:35.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:35.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:35.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:35.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:35.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:35.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:35.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:35.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:35.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:35.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:35.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:35.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.571 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.572 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:35.572 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:35.572 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.177712323999998, 2023-01-02T18:17:35.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:35.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.573 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.573 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:35.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:35.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:35.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:35.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:35.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:35.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:35.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:35.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:35.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:35.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:35.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:35.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:35.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.582 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.583 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:35.583 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:35.583 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.166874540000002, 2023-01-02T18:17:35.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:35.583 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.584 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:35.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:35.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:35.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:35.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:35.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:35.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:35.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:35.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:35.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:35.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:35.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:35.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:35.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:35.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:35.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:35.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:35.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:35.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:35.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.593 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.594 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:35.594 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:35.594 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.17482098, 2023-01-02T18:17:35.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:35.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.595 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:35.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:35.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:35.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:35.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:35.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:35.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:35.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:35.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:35.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:35.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:35.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:35.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:35.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:35.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:35.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:35.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:35.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:35.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.604 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.604 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:35.605 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:35.605 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.160622439999999, 2023-01-02T18:17:35.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:35.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.606 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:35.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:35.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:35.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:17:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.138540166, 2023-01-02T18:17:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:17:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:17:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:17:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:17:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:17:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:17:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:17:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:17:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:17:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:17:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:17:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:17:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:17:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:17:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:17:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:17:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2226 3.13 e89/54 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head v 89'2, mlcod=0'0)", 2023-01-02T18:17:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.136120055999999, 2023-01-02T18:17:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005, 2023-01-02T18:17:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0959999999999997e-06 2023-01-02T18:17:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367120+0000", 2023-01-02T18:17:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4494e-05 2023-01-02T18:17:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367135+0000", 2023-01-02T18:17:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5700000000000004e-06 2023-01-02T18:17:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367142+0000", 2023-01-02T18:17:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9985000000000003e-05 2023-01-02T18:17:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367192+0000", 2023-01-02T18:17:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8598e-05 2023-01-02T18:17:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367211+0000", 2023-01-02T18:17:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072699899999999998 2023-01-02T18:17:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367938+0000", 2023-01-02T18:17:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8569999999999998e-05 2023-01-02T18:17:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367977+0000", 2023-01-02T18:17:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005 2023-01-02T18:17:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:17:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.162905301, 2023-01-02T18:17:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:17:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:17:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:17:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:17:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:17:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:17:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:17:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:17:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:17:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:17:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:17:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:17:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:17:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:17:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:17:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:17:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:17:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.161166452, 2023-01-02T18:17:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:17:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:17:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:17:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:17:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:17:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:17:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:17:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:17:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:17:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:17:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:17:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:17:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:17:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:17:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:17:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:17:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:17:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:17:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.168841198, 2023-01-02T18:17:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:17:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:17:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:17:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:17:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:17:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:17:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:17:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:17:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:17:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:17:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:17:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:17:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:17:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:17:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:17:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:17:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.167698355, 2023-01-02T18:17:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:17:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:17:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:17:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:17:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:17:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:17:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:17:35.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:17:35.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:17:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:17:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:17:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:17:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:17:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:17:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:17:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:17:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.155144561, 2023-01-02T18:17:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:17:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:17:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:17:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:17:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:17:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:17:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:17:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:17:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:17:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:17:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:17:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:17:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:17:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:17:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:17:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:17:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2827 10.1e e101/98 10:7803159c:::rbd_object_map.12a2d48fcbc5:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.1542076459999999, 2023-01-02T18:17:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004, 2023-01-02T18:17:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349026+0000", 2023-01-02T18:17:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5660000000000001e-06 2023-01-02T18:17:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349034+0000", 2023-01-02T18:17:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0851e-05 2023-01-02T18:17:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349044+0000", 2023-01-02T18:17:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5415000000000001e-05 2023-01-02T18:17:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349060+0000", 2023-01-02T18:17:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7527000000000002e-05 2023-01-02T18:17:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349097+0000", 2023-01-02T18:17:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3733999999999999e-05 2023-01-02T18:17:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349111+0000", 2023-01-02T18:17:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075968200000000002 2023-01-02T18:17:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349871+0000", 2023-01-02T18:17:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3843000000000001e-05 2023-01-02T18:17:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349905+0000", 2023-01-02T18:17:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004 2023-01-02T18:17:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.137742252, 2023-01-02T18:17:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:17:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:17:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:17:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:17:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:17:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:17:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:17:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:17:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:17:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:17:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:17:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:17:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:17:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:17:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:17:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:17:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:17:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:17:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.087688706, 2023-01-02T18:17:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:17:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:17:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:17:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:17:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:17:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:17:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:17:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:17:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:17:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:17:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:17:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:17:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:17:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:17:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:17:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:17:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:17:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:35.725 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:35.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:35.728 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:35.728+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:35.827 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:35.828+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:35.893 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:35.893 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:35.894 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:35.894 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:35.903 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:35.944 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:35.945+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:36.029 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:36.030+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:36.068 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:36.068 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:36.069 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:36.069 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:36.069 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:36.078 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:36.162 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:36.163+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:36.230 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:36.231+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:36.246 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:36.246 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:36.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:36.247 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:36.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.247 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:36.247 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:36.248 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.809765722999998, 2023-01-02T18:17:36.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:36.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.249 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.250 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:36.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.250 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:36.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:36.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:36.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:36.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:36.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:36.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:36.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:36.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:36.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:36.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:36.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:36.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:36.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:36.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:36.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:36.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:36.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:36.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:36.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:36.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:36.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:36.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:36.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:36.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:36.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:36.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:36.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:36.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:36.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.266 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.267 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:460 6.7 6:e7d57d29:::rbd_header.12a269152854:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e60)", 2023-01-02T18:17:36.267 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:36.267 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.860057255999997, 2023-01-02T18:17:36.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998, 2023-01-02T18:17:36.268 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.268 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.268 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.268 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.269 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.269 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 460 2023-01-02T18:17:36.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.270 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:36.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385557+0000", 2023-01-02T18:17:36.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:36.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385556+0000", 2023-01-02T18:17:36.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3119999999999996e-06 2023-01-02T18:17:36.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385563+0000", 2023-01-02T18:17:36.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4738e-05 2023-01-02T18:17:36.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385578+0000", 2023-01-02T18:17:36.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8410000000000002e-06 2023-01-02T18:17:36.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385585+0000", 2023-01-02T18:17:36.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0281000000000003e-05 2023-01-02T18:17:36.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385625+0000", 2023-01-02T18:17:36.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8379000000000003e-05 2023-01-02T18:17:36.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385704+0000", 2023-01-02T18:17:36.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012519899999999999 2023-01-02T18:17:36.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:36.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385829+0000", 2023-01-02T18:17:36.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019574900000000001 2023-01-02T18:17:36.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387786+0000", 2023-01-02T18:17:36.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8936999999999997e-05 2023-01-02T18:17:36.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387825+0000", 2023-01-02T18:17:36.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3502000000000003e-05 2023-01-02T18:17:36.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387889+0000", 2023-01-02T18:17:36.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9567999999999997e-05 2023-01-02T18:17:36.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387938+0000", 2023-01-02T18:17:36.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023810659999999998 2023-01-02T18:17:36.283 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.284 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.284 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.284 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.936225614000001, 2023-01-02T18:17:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:36.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.630265659000003, 2023-01-02T18:17:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.915793845, 2023-01-02T18:17:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.906692444000001, 2023-01-02T18:17:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.635336152000001, 2023-01-02T18:17:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2643 3.7 3:e026f164:::rbd_object_map.12a23fc13ef0.0000000000000004:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.630822624, 2023-01-02T18:17:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001, 2023-01-02T18:17:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2643 2023-01-02T18:17:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614790+0000", 2023-01-02T18:17:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3409999999999992e-06 2023-01-02T18:17:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614799+0000", 2023-01-02T18:17:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0420000000000008e-06 2023-01-02T18:17:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614808+0000", 2023-01-02T18:17:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1370000000000001e-06 2023-01-02T18:17:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614814+0000", 2023-01-02T18:17:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064692000000000005 2023-01-02T18:17:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615460+0000", 2023-01-02T18:17:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012489599999999999 2023-01-02T18:17:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615585+0000", 2023-01-02T18:17:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015799100000000001 2023-01-02T18:17:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615743+0000", 2023-01-02T18:17:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097339900000000001 2023-01-02T18:17:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.616717+0000", 2023-01-02T18:17:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045439800000000001 2023-01-02T18:17:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617171+0000", 2023-01-02T18:17:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8190999999999999e-05 2023-01-02T18:17:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617229+0000", 2023-01-02T18:17:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5250000000000002e-05 2023-01-02T18:17:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617275+0000", 2023-01-02T18:17:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001 2023-01-02T18:17:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.626146496, 2023-01-02T18:17:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.917966828000001, 2023-01-02T18:17:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.891230586000001, 2023-01-02T18:17:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.891182990000001, 2023-01-02T18:17:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:17:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:17:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:17:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:17:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:17:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:17:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:17:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:17:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:17:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:17:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:17:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:17:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:17:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:17:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:17:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:17:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:17:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:17:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:17:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:17:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:17:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:17:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:17:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:17:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:17:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:17:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:17:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:17:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2238 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_trash_add in=21b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.870988394999999, 2023-01-02T18:17:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002, 2023-01-02T18:17:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2238 2023-01-02T18:17:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374625+0000", 2023-01-02T18:17:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9540000000000003e-06 2023-01-02T18:17:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374630+0000", 2023-01-02T18:17:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0295000000000001e-05 2023-01-02T18:17:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374641+0000", 2023-01-02T18:17:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3980000000000001e-06 2023-01-02T18:17:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374645+0000", 2023-01-02T18:17:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0728999999999997e-05 2023-01-02T18:17:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374676+0000", 2023-01-02T18:17:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8452000000000003e-05 2023-01-02T18:17:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374724+0000", 2023-01-02T18:17:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019847300000000001 2023-01-02T18:17:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374923+0000", 2023-01-02T18:17:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054292499999999998 2023-01-02T18:17:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.375466+0000", 2023-01-02T18:17:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025375240000000002 2023-01-02T18:17:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378003+0000", 2023-01-02T18:17:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1505e-05 2023-01-02T18:17:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378085+0000", 2023-01-02T18:17:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2633000000000002e-05 2023-01-02T18:17:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378107+0000", 2023-01-02T18:17:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002 2023-01-02T18:17:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.928113904, 2023-01-02T18:17:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:17:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:17:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:17:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:17:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:17:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:17:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:17:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:17:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:17:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:17:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:17:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:17:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:17:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:17:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:17:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:17:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:17:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:17:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:17:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:17:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:17:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:17:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:17:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:17:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:17:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:17:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:17:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:17:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2285 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [watch unwatch cookie 140114919434064] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.913827871000001, 2023-01-02T18:17:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022783640000000002, 2023-01-02T18:17:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2285 2023-01-02T18:17:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331787+0000", 2023-01-02T18:17:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331786+0000", 2023-01-02T18:17:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0419999999999998e-06 2023-01-02T18:17:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331789+0000", 2023-01-02T18:17:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8580000000000002e-06 2023-01-02T18:17:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331796+0000", 2023-01-02T18:17:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8789999999999996e-06 2023-01-02T18:17:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331800+0000", 2023-01-02T18:17:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016221000000000001 2023-01-02T18:17:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.331962+0000", 2023-01-02T18:17:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6188999999999998e-05 2023-01-02T18:17:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332038+0000", 2023-01-02T18:17:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101796 2023-01-02T18:17:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332140+0000", 2023-01-02T18:17:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046557400000000001 2023-01-02T18:17:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332606+0000", 2023-01-02T18:17:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001331734 2023-01-02T18:17:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.333938+0000", 2023-01-02T18:17:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1469e-05 2023-01-02T18:17:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.333969+0000", 2023-01-02T18:17:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6107000000000007e-05 2023-01-02T18:17:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334065+0000", 2023-01-02T18:17:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022783640000000002 2023-01-02T18:17:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2286 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.913611244, 2023-01-02T18:17:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00219163, 2023-01-02T18:17:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2286 2023-01-02T18:17:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332003+0000", 2023-01-02T18:17:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332002+0000", 2023-01-02T18:17:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332008+0000", 2023-01-02T18:17:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.995e-06 2023-01-02T18:17:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332018+0000", 2023-01-02T18:17:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4619999999999996e-06 2023-01-02T18:17:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332027+0000", 2023-01-02T18:17:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00031803400000000003 2023-01-02T18:17:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332345+0000", 2023-01-02T18:17:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1441999999999997e-05 2023-01-02T18:17:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:17:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.332426+0000", 2023-01-02T18:17:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001672378 2023-01-02T18:17:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334098+0000", 2023-01-02T18:17:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.731e-05 2023-01-02T18:17:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334136+0000", 2023-01-02T18:17:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9179999999999999e-05 2023-01-02T18:17:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.334195+0000", 2023-01-02T18:17:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00219163 2023-01-02T18:17:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.912007641, 2023-01-02T18:17:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:17:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:17:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:17:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:17:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:17:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:17:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:17:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:17:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:17:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:17:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:17:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:17:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:17:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:17:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:17:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:17:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:17:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:17:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:17:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:17:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:17:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:17:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:17:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:17:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:17:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:17:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:17:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:17:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.906685457, 2023-01-02T18:17:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:17:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:17:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:17:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:17:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:17:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:17:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:17:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:17:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:17:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:17:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:17:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:17:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:17:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:17:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:17:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:17:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:17:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:17:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:17:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:17:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:17:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:17:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:17:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:17:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:17:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:17:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.9031323920000001, 2023-01-02T18:17:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:17:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:17:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:17:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:17:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:17:36.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:17:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:17:36.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:17:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:17:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:17:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:17:36.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:17:36.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:17:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:17:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:17:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:36.586 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.9015003479999999, 2023-01-02T18:17:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:17:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:36.587 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:17:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:36.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:17:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:17:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:36.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:17:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:17:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:17:36.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:17:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:36.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:17:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:17:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:17:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:17:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:17:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:17:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:17:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:17:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:17:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:17:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:17:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:17:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:17:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:17:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:36.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:17:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:17:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:36.602 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:36.602 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:36.603 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:36.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:36.606 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:17:36.606 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:36.607 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:36.604+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:36.704 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:36.705+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:36.746 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:36.746 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:36.746 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:36.747 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:36.756 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:36.786 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:36.804 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:36.804 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:36.805+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:36.820 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:36.838 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:36.855 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:36.874 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:36.883 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:36.884 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:36.893 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:36.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:36.906 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:36.907+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:36.910 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:36.912 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:36.913 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:37.007 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:37.006+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:37.019 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:37.019 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:37.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:37.114 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:37.114+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:37.196 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:37.196 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:37.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:37.246 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:37.246+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:37.310 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:37.309+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:37.372 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:37.373 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:37.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:37.411 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:37.412+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:37.512 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:37.513+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:37.550 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:37.551 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:37.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:37.612 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:37.612+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:37.686 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:37.686 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:37.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:37.713 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:37.714+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:37.814 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:37.813+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:37.861 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:37.861 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:37.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:37.914 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:37.915+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:38.015 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:38.016+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:38.036 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:38.037 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:38.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:38.115 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:38.115+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:38.172 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:38.172 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:38.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:38.222 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:38.222+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:38.317 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:38.318+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:38.346 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:38.347 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:38.356 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:38.418 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:38.419+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:38.487 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:38.487 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:38.498 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:38.518 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:38.518+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:38.541 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:38.607 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:17:38.619 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:38.619+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:38.635 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:38.635 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:38.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:38.720 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:38.719+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:38.814 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:38.814 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:38.820 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:38.821+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:38.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:38.921 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:38.922+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:38.923 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:38.990 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:38.991 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:39.001 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:39.022 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:39.022+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:39.066 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:39.084 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:39.101 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:39.119 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:39.123 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:39.123+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:39.130 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:39.130 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:39.130 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:39.130 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:39.137 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:39.140 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:39.156 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:39.175 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:39.193 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:39.194 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:39.195 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:39.195 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:39.195 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:39.195 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:39.195 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:39.196 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:39.246 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:39.247+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:39.266 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:39.267 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:39.267 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:39.267 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:39.267 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:39.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:39.316 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:17:39.332 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:39.333+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:39.427 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:39.428+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:39.451 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:39.451 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:39.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:39.451 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:39.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.452 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:39.452 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:39.453 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.026410018999997, 2023-01-02T18:17:39.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:39.453 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.453 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.454 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:39.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:39.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:39.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:39.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:39.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:39.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:39.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:39.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:39.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:39.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:39.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:39.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:39.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:39.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:39.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:39.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:39.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:39.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:39.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.464 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.465 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:39.465 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:39.465 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.967210311000002, 2023-01-02T18:17:39.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:39.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.466 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.466 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.466 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:39.466 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:39.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:39.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.467 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:39.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:39.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:39.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:39.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:39.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:39.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:39.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:39.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:39.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:39.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:39.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:39.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:39.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:39.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:39.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:39.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:39.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:39.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:39.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:39.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:39.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:39.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:39.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:39.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:39.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:39.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:39.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:39.481 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.481 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.481 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.482 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:39.482 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:39.482 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.121849470000001, 2023-01-02T18:17:39.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:39.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.483 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:39.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:39.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:39.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:39.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:39.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:39.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:39.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:39.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:39.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:39.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:39.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:39.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:39.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:39.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:39.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:39.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:39.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:39.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:39.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.492 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.492 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.493 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:17:39.493 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:39.493 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.109413668000002, 2023-01-02T18:17:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:17:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:39.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:39.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:39.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:17:39.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:17:39.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:17:39.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:17:39.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:17:39.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:17:39.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:17:39.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:17:39.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:17:39.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:17:39.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:17:39.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:17:39.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:17:39.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:17:39.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:17:39.503 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.503 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.503 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.504 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:39.504 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:39.504 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.074740929999997, 2023-01-02T18:17:39.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:39.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.505 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:39.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:39.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:39.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:39.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:39.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:39.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:39.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:39.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:39.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:39.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:39.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:39.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:39.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:39.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:39.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:39.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:39.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:39.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:39.514 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.514 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.514 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.515 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:39.515 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:39.515 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.064463910999997, 2023-01-02T18:17:39.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:39.516 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.516 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.516 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:39.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:39.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:39.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:39.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:39.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:39.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:39.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:39.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:39.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:39.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:39.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:39.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:39.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:39.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:39.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:39.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:39.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:39.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:39.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.525 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.526 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:39.526 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:39.526 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.756115491999999, 2023-01-02T18:17:39.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:39.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.527 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.527 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:39.527 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:39.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:39.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.528 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:39.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:39.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:39.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:39.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:39.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:39.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:39.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:39.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:39.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:39.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:39.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:39.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:39.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:39.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:39.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:39.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:39.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:39.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:39.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:39.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:39.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:39.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:39.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:39.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:39.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:39.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:39.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:39.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.540 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.540 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:39.541 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:39.541 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.820800601999998, 2023-01-02T18:17:39.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:39.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.542 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:39.542 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:39.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:39.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.542 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:39.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:39.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:39.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:39.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:39.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:39.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:39.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:39.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:39.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:39.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:39.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:39.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:39.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:39.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:39.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:39.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:39.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:39.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:39.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:39.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:39.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:39.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:39.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:39.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:39.554 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.554 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.554 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.555 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:39.555 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:39.555 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.816895745, 2023-01-02T18:17:39.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:39.555 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:39.556 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.556 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:39.556 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:39.556 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:39.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.557 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:39.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:39.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:39.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:39.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:39.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:39.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:39.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:39.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:39.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:39.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:39.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:39.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:39.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:39.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:39.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:39.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:39.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:39.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:39.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:39.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:39.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:39.567 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.567 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.567 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.568 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:39.568 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:39.568 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.112354074999999, 2023-01-02T18:17:39.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:39.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:39.569 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.569 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:39.569 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:39.569 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:39.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.570 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:39.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:39.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:39.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:39.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:39.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:39.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:39.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:39.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:39.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:39.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:39.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:39.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:39.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:39.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:39.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:39.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:39.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:39.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:39.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:39.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:39.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:39.579 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.580 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.580 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:39.580 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:39.581 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.122622338999999, 2023-01-02T18:17:39.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:39.581 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.581 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.581 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.582 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:39.582 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:39.582 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:39.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.582 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:39.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:39.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:39.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:39.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:39.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:39.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:39.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:39.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:39.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:39.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:39.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:39.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:39.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:39.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:39.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:39.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:39.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:39.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:39.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:39.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:39.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:39.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:39.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:39.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:39.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:39.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:39.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:39.594 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.594 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.594 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.595 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:39.595 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:39.595 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.099296484, 2023-01-02T18:17:39.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:39.596 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.596 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:39.596 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.596 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:39.597 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:39.597 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:39.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.597 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:39.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:39.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:39.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:39.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:39.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:39.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:39.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:39.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:39.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:39.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:39.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:39.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:39.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:39.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:39.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:39.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:39.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:39.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:39.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:39.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:39.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:39.607 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.607 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.608 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.608 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:39.608 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:39.608 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.089221254000002, 2023-01-02T18:17:39.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:17:39.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.609 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.609 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:39.610 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:39.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:17:39.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.610 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:39.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:39.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:39.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:17:39.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:17:39.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:17:39.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:17:39.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:17:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:17:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:17:39.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:17:39.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:17:39.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:17:39.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:39.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:17:39.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:17:39.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:17:39.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:17:39.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:17:39.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:17:39.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:39.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:17:39.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:17:39.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:39.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:17:39.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:17:39.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:39.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:17:39.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:17:39.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:17:39.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:17:39.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:17:39.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:17:39.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.624 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.624 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2241 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [call rbd.object_map_snap_remove in=25b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:39.625 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:39.625 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.071302817999999, 2023-01-02T18:17:39.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652, 2023-01-02T18:17:39.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:39.626 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.626 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:39.626 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:39.626 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2241 2023-01-02T18:17:39.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.626 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:39.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:39.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:39.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379073+0000", 2023-01-02T18:17:39.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:39.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379080+0000", 2023-01-02T18:17:39.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1620999999999999e-05 2023-01-02T18:17:39.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379091+0000", 2023-01-02T18:17:39.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0440000000000003e-06 2023-01-02T18:17:39.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379097+0000", 2023-01-02T18:17:39.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4477999999999997e-05 2023-01-02T18:17:39.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379141+0000", 2023-01-02T18:17:39.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9756999999999997e-05 2023-01-02T18:17:39.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379201+0000", 2023-01-02T18:17:39.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010401239999999999 2023-01-02T18:17:39.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.380241+0000", 2023-01-02T18:17:39.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652 2023-01-02T18:17:39.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.635 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.635 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:39.636 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:39.636 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.126071469999999, 2023-01-02T18:17:39.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:17:39.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:39.637 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:39.637 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:39.637 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:39.637 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:17:39.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.638 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:39.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:39.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:39.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:17:39.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:17:39.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:17:39.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:39.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:17:39.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:17:39.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:17:39.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:17:39.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:17:39.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:17:39.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:39.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:17:39.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:17:39.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:17:39.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:17:39.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:17:39.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:17:39.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:17:39.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:17:39.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.648 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.649 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:39.649 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:39.649 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.1213080050000004, 2023-01-02T18:17:39.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:17:39.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.650 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:39.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:39.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:39.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:17:39.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:17:39.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:17:39.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:17:39.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:17:39.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:17:39.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:17:39.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:17:39.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:17:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:17:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:17:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:17:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:17:39.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:17:39.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:17:39.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:17:39.659 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.659 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.660 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:17:39.660 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:39.661 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.1207747799999996, 2023-01-02T18:17:39.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:17:39.661 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.661 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.661 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:39.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:39.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:39.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:39.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:17:39.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:17:39.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:17:39.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:17:39.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:17:39.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:17:39.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:17:39.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:17:39.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:17:39.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:17:39.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:17:39.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:17:39.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:17:39.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:17:39.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:17:39.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.671 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.671 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.671 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:39.671 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:39.672 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.1097565060000001, 2023-01-02T18:17:39.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:17:39.672 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.672 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.672 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:39.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:39.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:39.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:17:39.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:17:39.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:17:39.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:17:39.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:17:39.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:17:39.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:17:39.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:17:39.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:17:39.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:17:39.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:17:39.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:17:39.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:17:39.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:17:39.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:17:39.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:17:39.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.682 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.683 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:17:39.683 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:39.683 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.1054119519999999, 2023-01-02T18:17:39.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:17:39.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.684 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:39.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:39.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:39.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:17:39.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:17:39.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:17:39.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:17:39.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:17:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:17:39.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:17:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:17:39.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:17:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:17:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:17:39.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:17:39.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:17:39.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:17:39.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:17:39.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:17:39.693 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.693 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.693 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.694 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2828 10.1d e101/98 10:bf37f79e:::rbd_object_map.12a2779686d1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:39.694 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:39.694 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.1012153209999997, 2023-01-02T18:17:39.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010281450000000001, 2023-01-02T18:17:39.695 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:39.695 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:39.695 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:39.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:39.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:39.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:39.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:39.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:39.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:39.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:39.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349161+0000", 2023-01-02T18:17:39.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4200000000000007e-06 2023-01-02T18:17:39.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:39.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349169+0000", 2023-01-02T18:17:39.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5036e-05 2023-01-02T18:17:39.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:39.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349184+0000", 2023-01-02T18:17:39.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8539999999999999e-06 2023-01-02T18:17:39.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:39.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349191+0000", 2023-01-02T18:17:39.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4647000000000001e-05 2023-01-02T18:17:39.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:39.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349236+0000", 2023-01-02T18:17:39.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3459999999999999e-05 2023-01-02T18:17:39.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:39.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349259+0000", 2023-01-02T18:17:39.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000900318 2023-01-02T18:17:39.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:39.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350159+0000", 2023-01-02T18:17:39.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0460999999999999e-05 2023-01-02T18:17:39.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:39.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:39.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:39.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350190+0000", 2023-01-02T18:17:39.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010281450000000001 2023-01-02T18:17:39.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.705 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.705 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:39.705 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:39.705 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:39.707 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:39.707 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:39.706+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:39.807 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:39.808+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:39.874 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:39.874 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:39.874 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:39.874 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:39.884 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:39.925 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:39.926+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:40.011 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:40.009+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:40.049 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:40.049 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:40.050 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:40.050 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:40.050 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:40.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:40.111 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:40.111+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:40.185 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:40.186 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:40.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:40.186 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:40.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.186 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:40.187 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:40.187 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.701499685999998, 2023-01-02T18:17:40.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:40.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:40.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:40.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:40.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:40.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:40.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:40.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:40.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:40.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:40.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:40.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:40.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:40.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:40.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:40.197 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.197 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.197 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.198 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:40.198 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:40.198 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.837433156000003, 2023-01-02T18:17:40.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:40.198 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.199 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:40.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:40.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:40.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:40.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:40.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:40.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:40.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:40.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:40.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:40.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:40.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:40.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:40.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:40.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:40.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:40.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:40.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:40.208 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.208 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.208 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.208 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:40.209 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:40.209 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.835753543000003, 2023-01-02T18:17:40.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:40.209 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.210 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:40.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:40.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:40.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:40.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:40.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:40.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:40.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:40.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:40.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:40.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:40.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:40.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:40.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:40.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:40.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:40.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:40.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:40.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:40.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.219 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.220 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:40.220 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:40.220 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.868925658999999, 2023-01-02T18:17:40.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:40.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:40.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:40.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:40.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:40.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:40.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:40.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:40.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:40.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:40.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:40.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:40.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:40.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:40.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:40.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:40.230 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.230 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.230 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.231 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:40.231 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:40.231 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.538788115000003, 2023-01-02T18:17:40.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:40.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.232 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:40.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:40.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:40.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:40.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:40.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:40.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:40.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:40.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:40.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:40.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:40.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:40.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:40.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:40.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:40.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:40.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:40.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:40.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.241 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.861435411999999, 2023-01-02T18:17:40.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:40.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:40.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:40.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:40.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:40.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:40.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:40.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:40.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:40.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:40.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:40.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:40.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:40.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:40.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:40.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.252 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.253 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:40.253 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:40.253 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.859642327000003, 2023-01-02T18:17:40.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:40.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.254 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:40.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:40.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:40.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:40.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:40.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:40.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:40.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:40.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:40.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:40.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:40.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:40.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:40.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:40.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:40.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:40.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:40.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:40.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:40.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.264 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.264 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:40.264 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:40.265 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.848804543, 2023-01-02T18:17:40.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:40.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.265 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:40.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:40.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:40.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:40.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:40.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:40.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:40.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:40.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:40.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:40.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:40.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:40.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:40.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:40.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:40.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:40.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:40.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:40.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:40.275 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.275 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.275 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.276 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:40.276 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:40.276 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.856750983000001, 2023-01-02T18:17:40.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:40.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.277 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:40.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:40.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:40.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:40.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:40.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:40.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:40.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:40.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:40.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:40.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:40.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:40.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:40.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:40.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:40.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:40.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:40.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:40.286 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.286 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.286 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.287 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:40.287 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:40.287 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.842552442999999, 2023-01-02T18:17:40.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:40.287 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.287 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.288 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:40.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:40.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:40.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:40.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:40.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:40.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:40.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:40.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:40.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:40.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:40.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:40.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:40.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:40.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:40.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:40.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:40.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:40.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:40.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.297 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.297 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:17:40.298 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:40.298 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.820470169, 2023-01-02T18:17:40.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:17:40.298 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.298 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.298 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:40.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:40.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:40.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:17:40.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:17:40.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:17:40.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:17:40.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:17:40.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:17:40.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:17:40.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:17:40.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:17:40.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:17:40.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:17:40.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:17:40.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:17:40.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:17:40.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:17:40.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.308 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.308 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.308 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2226 3.13 e89/54 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head v 89'2, mlcod=0'0)", 2023-01-02T18:17:40.308 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:40.309 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.818050059000001, 2023-01-02T18:17:40.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005, 2023-01-02T18:17:40.309 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.309 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.309 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:40.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:40.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:40.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:40.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0959999999999997e-06 2023-01-02T18:17:40.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367120+0000", 2023-01-02T18:17:40.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4494e-05 2023-01-02T18:17:40.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367135+0000", 2023-01-02T18:17:40.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5700000000000004e-06 2023-01-02T18:17:40.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367142+0000", 2023-01-02T18:17:40.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9985000000000003e-05 2023-01-02T18:17:40.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367192+0000", 2023-01-02T18:17:40.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8598e-05 2023-01-02T18:17:40.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367211+0000", 2023-01-02T18:17:40.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072699899999999998 2023-01-02T18:17:40.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367938+0000", 2023-01-02T18:17:40.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8569999999999998e-05 2023-01-02T18:17:40.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367977+0000", 2023-01-02T18:17:40.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005 2023-01-02T18:17:40.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.319 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.319 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.319 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:17:40.319 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:40.320 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.844835304, 2023-01-02T18:17:40.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:17:40.320 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.320 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.320 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:40.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:40.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:40.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:40.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:17:40.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:17:40.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:17:40.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:17:40.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:17:40.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:17:40.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:17:40.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:17:40.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:17:40.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:17:40.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:17:40.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:17:40.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:17:40.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:17:40.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:17:40.330 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.330 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.330 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.330 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:17:40.331 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:40.331 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.843096455, 2023-01-02T18:17:40.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:17:40.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.332 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:40.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:40.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:40.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:17:40.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:17:40.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:17:40.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:17:40.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:17:40.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:17:40.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:17:40.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:17:40.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:17:40.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:17:40.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:17:40.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:17:40.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:17:40.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:17:40.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:17:40.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:17:40.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.341 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.342 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:17:40.342 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:40.342 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.8507712010000006, 2023-01-02T18:17:40.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:17:40.342 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.343 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:40.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:40.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:40.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:40.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:17:40.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:17:40.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:17:40.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:17:40.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:17:40.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:17:40.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:17:40.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:17:40.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:17:40.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:17:40.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:17:40.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:17:40.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:17:40.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:17:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:17:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.353 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:40.353 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:40.353 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.8496283580000004, 2023-01-02T18:17:40.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:17:40.354 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.354 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.354 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:40.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:40.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:40.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:17:40.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:17:40.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:17:40.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:17:40.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:17:40.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:17:40.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:17:40.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:17:40.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:17:40.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:17:40.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:17:40.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:17:40.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:17:40.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:17:40.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:17:40.363 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.363 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.363 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.364 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:40.364 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:40.364 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.8370745639999999, 2023-01-02T18:17:40.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:17:40.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.365 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.365 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:40.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:40.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:40.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:40.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:17:40.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:17:40.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:17:40.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:17:40.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:17:40.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:17:40.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:17:40.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:17:40.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:17:40.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:17:40.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:17:40.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:17:40.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:17:40.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:17:40.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:17:40.374 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.374 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.374 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.374 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2827 10.1e e101/98 10:7803159c:::rbd_object_map.12a2d48fcbc5:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:40.375 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:40.375 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.8361376490000003, 2023-01-02T18:17:40.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004, 2023-01-02T18:17:40.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.375 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:40.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349026+0000", 2023-01-02T18:17:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5660000000000001e-06 2023-01-02T18:17:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349034+0000", 2023-01-02T18:17:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0851e-05 2023-01-02T18:17:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349044+0000", 2023-01-02T18:17:40.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5415000000000001e-05 2023-01-02T18:17:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349060+0000", 2023-01-02T18:17:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7527000000000002e-05 2023-01-02T18:17:40.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349097+0000", 2023-01-02T18:17:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3733999999999999e-05 2023-01-02T18:17:40.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349111+0000", 2023-01-02T18:17:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075968200000000002 2023-01-02T18:17:40.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349871+0000", 2023-01-02T18:17:40.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3843000000000001e-05 2023-01-02T18:17:40.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349905+0000", 2023-01-02T18:17:40.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004 2023-01-02T18:17:40.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.385 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.385 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:40.386 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:40.386 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.8196722550000004, 2023-01-02T18:17:40.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:17:40.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.387 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:40.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:40.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:40.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:17:40.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:17:40.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:17:40.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:17:40.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:17:40.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:17:40.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:17:40.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:17:40.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:17:40.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:17:40.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:17:40.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:17:40.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:17:40.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:17:40.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:17:40.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:17:40.396 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.396 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.396 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.397 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:17:40.397 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:40.397 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.7696187090000004, 2023-01-02T18:17:40.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:17:40.398 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.398 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.398 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:40.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:40.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:40.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:17:40.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:17:40.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:17:40.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:17:40.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:17:40.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:17:40.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:17:40.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:17:40.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:17:40.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:17:40.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:17:40.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:17:40.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:17:40.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:17:40.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:17:40.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:17:40.407 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.407 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.407 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.407 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.408 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.408 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:40.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:40.410 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:40.409+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:40.454 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7, 5] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:17:40.454 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:17:40.455 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:17:40.510 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:40.511+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:40.537 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:40.538 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:40.538 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:40.538 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:40.548 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:40.631 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:40.632+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:40.712 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:40.713+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:40.715 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:40.715 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:40.716 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:40.716 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:40.716 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:40.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:40.786 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:40.793 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:17:40.795 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-01-02T18:17:40.540940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1050866,"num_objects":144,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":0,"num_read":9694,"num_read_kb":8504,"num_write":867,"num_write_kb":1668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":75,"num_bytes_recovered":1264,"num_keys_recovered":662,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1026,"ondisk_log_size":1026,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":572,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":78876,"kb_used_data":10532,"kb_used_omap":0,"kb_used_meta":68288,"kb_avail":660524004,"statfs":{"total":676457349120,"available":676376580096,"internally_reserved":0,"allocated":10784768,"data_stored":5981622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":69926912},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1048563,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":289,"num_read_kb":241,"num_write":64,"num_write_kb":1042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":140,"num_keys_recovered":8,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.115276"},"pg_stats":[{"pgid":"11.17","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.460472+0000","last_change":"2023-01-02T18:17:38.460472+0000","last_active":"2023-01-02T18:17:38.460472+0000","last_peered":"2023-01-02T18:17:38.460472+0000","last_clean":"2023-01-02T18:17:38.460472+0000","last_became_active":"2023-01-02T18:17:36.439954+0000","last_became_peered":"2023-01-02T18:17:36.439954+0000","last_unstale":"2023-01-02T18:17:38.460472+0000","last_undegraded":"2023-01-02T18:17:38.460472+0000","last_fullsized":"2023-01-02T18:17:38.460472+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.16","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.339917+0000","last_change":"2023-01-02T18:17:34.327371+0000","last_active":"2023-01-02T18:17:39.339917+0000","last_peered":"2023-01-02T18:17:39.339917+0000","last_clean":"2023-01-02T18:17:39.339917+0000","last_became_active":"2023-01-02T18:17:32.345158+0000","last_became_peered":"2023-01-02T18:17:32.345158+0000","last_unstale":"2023-01-02T18:17:39.339917+0000","last_undegraded":"2023-01-02T18:17:39.339917+0000","last_fullsized":"2023-01-02T18:17:39.339917+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464398+0000","last_change":"2023-01-02T18:17:09.324265+0000","last_active":"2023-01-02T18:17:38.464398+0000","last_peered":"2023-01-02T18:17:38.464398+0000","last_clean":"2023-01-02T18:17:38.464398+0000","last_became_active":"2023-01-02T18:17:07.348058+0000","last_became_peered":"2023-01-02T18:17:07.348058+0000","last_unstale":"2023-01-02T18:17:38.464398+0000","last_undegraded":"2023-01-02T18:17:38.464398+0000","last_fullsized":"2023-01-02T18:17:38.464398+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444908+0000","last_change":"2023-01-02T18:17:01.320137+0000","last_active":"2023-01-02T18:17:38.444908+0000","last_peered":"2023-01-02T18:17:38.444908+0000","last_clean":"2023-01-02T18:17:38.444908+0000","last_became_active":"2023-01-02T18:16:59.324809+0000","last_became_peered":"2023-01-02T18:16:59.324809+0000","last_unstale":"2023-01-02T18:17:38.444908+0000","last_undegraded":"2023-01-02T18:17:38.444908+0000","last_fullsized":"2023-01-02T18:17:38.444908+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":63,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458043+0000","last_change":"2023-01-02T18:16:48.330409+0000","last_active":"2023-01-02T18:17:38.458043+0000","last_peered":"2023-01-02T18:17:38.458043+0000","last_clean":"2023-01-02T18:17:38.458043+0000","last_became_active":"2023-01-02T18:16:48.329903+0000","last_became_peered":"2023-01-02T18:16:48.329903+0000","last_unstale":"2023-01-02T18:17:38.458043+0000","last_undegraded":"2023-01-02T18:17:38.458043+0000","last_fullsized":"2023-01-02T18:17:38.458043+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":131,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.316233+0000","last_change":"2023-01-02T18:17:30.328135+0000","last_active":"2023-01-02T18:17:39.316233+0000","last_peered":"2023-01-02T18:17:39.316233+0000","last_clean":"2023-01-02T18:17:39.316233+0000","last_became_active":"2023-01-02T18:17:29.335258+0000","last_became_peered":"2023-01-02T18:17:29.335258+0000","last_unstale":"2023-01-02T18:17:39.316233+0000","last_undegraded":"2023-01-02T18:17:39.316233+0000","last_fullsized":"2023-01-02T18:17:39.316233+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444967+0000","last_change":"2023-01-02T18:17:29.327043+0000","last_active":"2023-01-02T18:17:38.444967+0000","last_peered":"2023-01-02T18:17:38.444967+0000","last_clean":"2023-01-02T18:17:38.444967+0000","last_became_active":"2023-01-02T18:17:29.326459+0000","last_became_peered":"2023-01-02T18:17:29.326459+0000","last_unstale":"2023-01-02T18:17:38.444967+0000","last_undegraded":"2023-01-02T18:17:38.444967+0000","last_fullsized":"2023-01-02T18:17:38.444967+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":27,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445082+0000","last_change":"2023-01-02T18:17:29.370303+0000","last_active":"2023-01-02T18:17:38.445082+0000","last_peered":"2023-01-02T18:17:38.445082+0000","last_clean":"2023-01-02T18:17:38.445082+0000","last_became_active":"2023-01-02T18:17:29.329505+0000","last_became_peered":"2023-01-02T18:17:29.329505+0000","last_unstale":"2023-01-02T18:17:38.445082+0000","last_undegraded":"2023-01-02T18:17:38.445082+0000","last_fullsized":"2023-01-02T18:17:38.445082+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":76,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":155,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444409+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:17:38.444409+0000","last_peered":"2023-01-02T18:17:38.444409+0000","last_clean":"2023-01-02T18:17:38.444409+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:17:38.444409+0000","last_undegraded":"2023-01-02T18:17:38.444409+0000","last_fullsized":"2023-01-02T18:17:38.444409+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446984+0000","last_change":"2023-01-02T18:17:38.446984+0000","last_active":"2023-01-02T18:17:38.446984+0000","last_peered":"2023-01-02T18:17:38.446984+0000","last_clean":"2023-01-02T18:17:38.446984+0000","last_became_active":"2023-01-02T18:17:36.442630+0000","last_became_peered":"2023-01-02T18:17:36.442630+0000","last_unstale":"2023-01-02T18:17:38.446984+0000","last_undegraded":"2023-01-02T18:17:38.446984+0000","last_fullsized":"2023-01-02T18:17:38.446984+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.17","version":"101'15","reported_seq":90,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.333748+0000","last_change":"2023-01-02T18:17:34.347463+0000","last_active":"2023-01-02T18:17:39.333748+0000","last_peered":"2023-01-02T18:17:39.333748+0000","last_clean":"2023-01-02T18:17:39.333748+0000","last_became_active":"2023-01-02T18:17:32.344665+0000","last_became_peered":"2023-01-02T18:17:32.344665+0000","last_unstale":"2023-01-02T18:17:39.333748+0000","last_undegraded":"2023-01-02T18:17:39.333748+0000","last_fullsized":"2023-01-02T18:17:39.333748+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468032+0000","last_change":"2023-01-02T18:17:09.308994+0000","last_active":"2023-01-02T18:17:38.468032+0000","last_peered":"2023-01-02T18:17:38.468032+0000","last_clean":"2023-01-02T18:17:38.468032+0000","last_became_active":"2023-01-02T18:17:07.339263+0000","last_became_peered":"2023-01-02T18:17:07.339263+0000","last_unstale":"2023-01-02T18:17:38.468032+0000","last_undegraded":"2023-01-02T18:17:38.468032+0000","last_fullsized":"2023-01-02T18:17:38.468032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'22","reported_seq":275,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464200+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:17:38.464200+0000","last_peered":"2023-01-02T18:17:38.464200+0000","last_clean":"2023-01-02T18:17:38.464200+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:17:38.464200+0000","last_undegraded":"2023-01-02T18:17:38.464200+0000","last_fullsized":"2023-01-02T18:17:38.464200+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":276,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448817+0000","last_change":"2023-01-02T18:16:44.306676+0000","last_active":"2023-01-02T18:17:38.448817+0000","last_peered":"2023-01-02T18:17:38.448817+0000","last_clean":"2023-01-02T18:17:38.448817+0000","last_became_active":"2023-01-02T18:16:41.446794+0000","last_became_peered":"2023-01-02T18:16:41.446794+0000","last_unstale":"2023-01-02T18:17:38.448817+0000","last_undegraded":"2023-01-02T18:17:38.448817+0000","last_fullsized":"2023-01-02T18:17:38.448817+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"92'24","reported_seq":219,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.332841+0000","last_change":"2023-01-02T18:17:30.435534+0000","last_active":"2023-01-02T18:17:39.332841+0000","last_peered":"2023-01-02T18:17:39.332841+0000","last_clean":"2023-01-02T18:17:39.332841+0000","last_became_active":"2023-01-02T18:16:37.427175+0000","last_became_peered":"2023-01-02T18:16:37.427175+0000","last_unstale":"2023-01-02T18:17:39.332841+0000","last_undegraded":"2023-01-02T18:17:39.332841+0000","last_fullsized":"2023-01-02T18:17:39.332841+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":270,"num_read_kb":225,"num_write":35,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":67,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458664+0000","last_change":"2023-01-02T18:16:49.318455+0000","last_active":"2023-01-02T18:17:38.458664+0000","last_peered":"2023-01-02T18:17:38.458664+0000","last_clean":"2023-01-02T18:17:38.458664+0000","last_became_active":"2023-01-02T18:16:48.329597+0000","last_became_peered":"2023-01-02T18:16:48.329597+0000","last_unstale":"2023-01-02T18:17:38.458664+0000","last_undegraded":"2023-01-02T18:17:38.458664+0000","last_fullsized":"2023-01-02T18:17:38.458664+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449364+0000","last_change":"2023-01-02T18:16:53.344973+0000","last_active":"2023-01-02T18:17:38.449364+0000","last_peered":"2023-01-02T18:17:38.449364+0000","last_clean":"2023-01-02T18:17:38.449364+0000","last_became_active":"2023-01-02T18:16:51.341196+0000","last_became_peered":"2023-01-02T18:16:51.341196+0000","last_unstale":"2023-01-02T18:17:38.449364+0000","last_undegraded":"2023-01-02T18:17:38.449364+0000","last_fullsized":"2023-01-02T18:17:38.449364+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":149,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.457937+0000","last_change":"2023-01-02T18:17:29.345837+0000","last_active":"2023-01-02T18:17:38.457937+0000","last_peered":"2023-01-02T18:17:38.457937+0000","last_clean":"2023-01-02T18:17:38.457937+0000","last_became_active":"2023-01-02T18:17:29.339458+0000","last_became_peered":"2023-01-02T18:17:29.339458+0000","last_unstale":"2023-01-02T18:17:38.457937+0000","last_undegraded":"2023-01-02T18:17:38.457937+0000","last_fullsized":"2023-01-02T18:17:38.457937+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.542677+0000","last_change":"2023-01-02T18:17:38.542677+0000","last_active":"2023-01-02T18:17:38.542677+0000","last_peered":"2023-01-02T18:17:38.542677+0000","last_clean":"2023-01-02T18:17:38.542677+0000","last_became_active":"2023-01-02T18:17:36.441682+0000","last_became_peered":"2023-01-02T18:17:36.441682+0000","last_unstale":"2023-01-02T18:17:38.542677+0000","last_undegraded":"2023-01-02T18:17:38.542677+0000","last_fullsized":"2023-01-02T18:17:38.542677+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.14","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.312955+0000","last_change":"2023-01-02T18:17:34.333930+0000","last_active":"2023-01-02T18:17:39.312955+0000","last_peered":"2023-01-02T18:17:39.312955+0000","last_clean":"2023-01-02T18:17:39.312955+0000","last_became_active":"2023-01-02T18:17:32.340028+0000","last_became_peered":"2023-01-02T18:17:32.340028+0000","last_unstale":"2023-01-02T18:17:39.312955+0000","last_undegraded":"2023-01-02T18:17:39.312955+0000","last_fullsized":"2023-01-02T18:17:39.312955+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"76'1","reported_seq":48,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463695+0000","last_change":"2023-01-02T18:17:09.324016+0000","last_active":"2023-01-02T18:17:38.463695+0000","last_peered":"2023-01-02T18:17:38.463695+0000","last_clean":"2023-01-02T18:17:38.463695+0000","last_became_active":"2023-01-02T18:17:07.347854+0000","last_became_peered":"2023-01-02T18:17:07.347854+0000","last_unstale":"2023-01-02T18:17:38.463695+0000","last_undegraded":"2023-01-02T18:17:38.463695+0000","last_fullsized":"2023-01-02T18:17:38.463695+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"72'4","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450166+0000","last_change":"2023-01-02T18:17:01.311706+0000","last_active":"2023-01-02T18:17:38.450166+0000","last_peered":"2023-01-02T18:17:38.450166+0000","last_clean":"2023-01-02T18:17:38.450166+0000","last_became_active":"2023-01-02T18:16:59.313908+0000","last_became_peered":"2023-01-02T18:16:59.313908+0000","last_unstale":"2023-01-02T18:17:38.450166+0000","last_undegraded":"2023-01-02T18:17:38.450166+0000","last_fullsized":"2023-01-02T18:17:38.450166+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"51'2","reported_seq":79,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449112+0000","last_change":"2023-01-02T18:16:48.343757+0000","last_active":"2023-01-02T18:17:38.449112+0000","last_peered":"2023-01-02T18:17:38.449112+0000","last_clean":"2023-01-02T18:17:38.449112+0000","last_became_active":"2023-01-02T18:16:48.326121+0000","last_became_peered":"2023-01-02T18:16:48.326121+0000","last_unstale":"2023-01-02T18:17:38.449112+0000","last_undegraded":"2023-01-02T18:17:38.449112+0000","last_fullsized":"2023-01-02T18:17:38.449112+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"86'2","reported_seq":35,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.327770+0000","last_change":"2023-01-02T18:17:30.331220+0000","last_active":"2023-01-02T18:17:39.327770+0000","last_peered":"2023-01-02T18:17:39.327770+0000","last_clean":"2023-01-02T18:17:39.327770+0000","last_became_active":"2023-01-02T18:17:29.331135+0000","last_became_peered":"2023-01-02T18:17:29.331135+0000","last_unstale":"2023-01-02T18:17:39.327770+0000","last_undegraded":"2023-01-02T18:17:39.327770+0000","last_fullsized":"2023-01-02T18:17:39.327770+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":86,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"56'1","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445424+0000","last_change":"2023-01-02T18:17:29.356376+0000","last_active":"2023-01-02T18:17:38.445424+0000","last_peered":"2023-01-02T18:17:38.445424+0000","last_clean":"2023-01-02T18:17:38.445424+0000","last_became_active":"2023-01-02T18:17:29.327003+0000","last_became_peered":"2023-01-02T18:17:29.327003+0000","last_unstale":"2023-01-02T18:17:38.445424+0000","last_undegraded":"2023-01-02T18:17:38.445424+0000","last_fullsized":"2023-01-02T18:17:38.445424+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.443495+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:17:38.443495+0000","last_peered":"2023-01-02T18:17:38.443495+0000","last_clean":"2023-01-02T18:17:38.443495+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:17:38.443495+0000","last_undegraded":"2023-01-02T18:17:38.443495+0000","last_fullsized":"2023-01-02T18:17:38.443495+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458457+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:17:38.458457+0000","last_peered":"2023-01-02T18:17:38.458457+0000","last_clean":"2023-01-02T18:17:38.458457+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:17:38.458457+0000","last_undegraded":"2023-01-02T18:17:38.458457+0000","last_fullsized":"2023-01-02T18:17:38.458457+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.459353+0000","last_change":"2023-01-02T18:17:38.459353+0000","last_active":"2023-01-02T18:17:38.459353+0000","last_peered":"2023-01-02T18:17:38.459353+0000","last_clean":"2023-01-02T18:17:38.459353+0000","last_became_active":"2023-01-02T18:17:36.439601+0000","last_became_peered":"2023-01-02T18:17:36.439601+0000","last_unstale":"2023-01-02T18:17:38.459353+0000","last_undegraded":"2023-01-02T18:17:38.459353+0000","last_fullsized":"2023-01-02T18:17:38.459353+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.15","version":"101'8","reported_seq":43,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.332245+0000","last_change":"2023-01-02T18:17:34.347450+0000","last_active":"2023-01-02T18:17:39.332245+0000","last_peered":"2023-01-02T18:17:39.332245+0000","last_clean":"2023-01-02T18:17:39.332245+0000","last_became_active":"2023-01-02T18:17:32.337265+0000","last_became_peered":"2023-01-02T18:17:32.337265+0000","last_unstale":"2023-01-02T18:17:39.332245+0000","last_undegraded":"2023-01-02T18:17:39.332245+0000","last_fullsized":"2023-01-02T18:17:39.332245+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"76'1","reported_seq":50,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468519+0000","last_change":"2023-01-02T18:17:09.308912+0000","last_active":"2023-01-02T18:17:38.468519+0000","last_peered":"2023-01-02T18:17:38.468519+0000","last_clean":"2023-01-02T18:17:38.468519+0000","last_became_active":"2023-01-02T18:17:07.339397+0000","last_became_peered":"2023-01-02T18:17:07.339397+0000","last_unstale":"2023-01-02T18:17:38.468519+0000","last_undegraded":"2023-01-02T18:17:38.468519+0000","last_fullsized":"2023-01-02T18:17:38.468519+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464603+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:17:38.464603+0000","last_peered":"2023-01-02T18:17:38.464603+0000","last_clean":"2023-01-02T18:17:38.464603+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:17:38.464603+0000","last_undegraded":"2023-01-02T18:17:38.464603+0000","last_fullsized":"2023-01-02T18:17:38.464603+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1","reported_seq":63,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449092+0000","last_change":"2023-01-02T18:16:48.330072+0000","last_active":"2023-01-02T18:17:38.449092+0000","last_peered":"2023-01-02T18:17:38.449092+0000","last_clean":"2023-01-02T18:17:38.449092+0000","last_became_active":"2023-01-02T18:16:48.329697+0000","last_became_peered":"2023-01-02T18:16:48.329697+0000","last_unstale":"2023-01-02T18:17:38.449092+0000","last_undegraded":"2023-01-02T18:17:38.449092+0000","last_fullsized":"2023-01-02T18:17:38.449092+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"97'33","reported_seq":41,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.327776+0000","last_change":"2023-01-02T18:17:30.331571+0000","last_active":"2023-01-02T18:17:39.327776+0000","last_peered":"2023-01-02T18:17:39.327776+0000","last_clean":"2023-01-02T18:17:39.327776+0000","last_became_active":"2023-01-02T18:17:29.326006+0000","last_became_peered":"2023-01-02T18:17:29.326006+0000","last_unstale":"2023-01-02T18:17:39.327776+0000","last_undegraded":"2023-01-02T18:17:39.327776+0000","last_fullsized":"2023-01-02T18:17:39.327776+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":86,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":58,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":137,"num_keys_recovered":70,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"56'2","reported_seq":82,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462475+0000","last_change":"2023-01-02T18:16:49.305216+0000","last_active":"2023-01-02T18:17:38.462475+0000","last_peered":"2023-01-02T18:17:38.462475+0000","last_clean":"2023-01-02T18:17:38.462475+0000","last_became_active":"2023-01-02T18:16:48.327069+0000","last_became_peered":"2023-01-02T18:16:48.327069+0000","last_unstale":"2023-01-02T18:17:38.462475+0000","last_undegraded":"2023-01-02T18:17:38.462475+0000","last_fullsized":"2023-01-02T18:17:38.462475+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445060+0000","last_change":"2023-01-02T18:17:29.326893+0000","last_active":"2023-01-02T18:17:38.445060+0000","last_peered":"2023-01-02T18:17:38.445060+0000","last_clean":"2023-01-02T18:17:38.445060+0000","last_became_active":"2023-01-02T18:17:29.326037+0000","last_became_peered":"2023-01-02T18:17:29.326037+0000","last_unstale":"2023-01-02T18:17:38.445060+0000","last_undegraded":"2023-01-02T18:17:38.445060+0000","last_fullsized":"2023-01-02T18:17:38.445060+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":575,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458757+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:17:38.458757+0000","last_peered":"2023-01-02T18:17:38.458757+0000","last_clean":"2023-01-02T18:17:38.458757+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:17:38.458757+0000","last_undegraded":"2023-01-02T18:17:38.458757+0000","last_fullsized":"2023-01-02T18:17:38.458757+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445785+0000","last_change":"2023-01-02T18:17:38.445785+0000","last_active":"2023-01-02T18:17:38.445785+0000","last_peered":"2023-01-02T18:17:38.445785+0000","last_clean":"2023-01-02T18:17:38.445785+0000","last_became_active":"2023-01-02T18:17:36.435481+0000","last_became_peered":"2023-01-02T18:17:36.435481+0000","last_unstale":"2023-01-02T18:17:38.445785+0000","last_undegraded":"2023-01-02T18:17:38.445785+0000","last_fullsized":"2023-01-02T18:17:38.445785+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.12","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.340643+0000","last_change":"2023-01-02T18:17:34.326763+0000","last_active":"2023-01-02T18:17:39.340643+0000","last_peered":"2023-01-02T18:17:39.340643+0000","last_clean":"2023-01-02T18:17:39.340643+0000","last_became_active":"2023-01-02T18:17:32.347186+0000","last_became_peered":"2023-01-02T18:17:32.347186+0000","last_unstale":"2023-01-02T18:17:39.340643+0000","last_undegraded":"2023-01-02T18:17:39.340643+0000","last_fullsized":"2023-01-02T18:17:39.340643+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"76'79","reported_seq":567,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462211+0000","last_change":"2023-01-02T18:17:09.321800+0000","last_active":"2023-01-02T18:17:38.462211+0000","last_peered":"2023-01-02T18:17:38.462211+0000","last_clean":"2023-01-02T18:17:38.462211+0000","last_became_active":"2023-01-02T18:17:07.340907+0000","last_became_peered":"2023-01-02T18:17:07.340907+0000","last_unstale":"2023-01-02T18:17:38.462211+0000","last_undegraded":"2023-01-02T18:17:38.462211+0000","last_fullsized":"2023-01-02T18:17:38.462211+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1144,"num_read_kb":1037,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'17","reported_seq":192,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462203+0000","last_change":"2023-01-02T18:17:29.368980+0000","last_active":"2023-01-02T18:17:38.462203+0000","last_peered":"2023-01-02T18:17:38.462203+0000","last_clean":"2023-01-02T18:17:38.462203+0000","last_became_active":"2023-01-02T18:17:29.341397+0000","last_became_peered":"2023-01-02T18:17:29.341397+0000","last_unstale":"2023-01-02T18:17:38.462203+0000","last_undegraded":"2023-01-02T18:17:38.462203+0000","last_fullsized":"2023-01-02T18:17:38.462203+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.460126+0000","last_change":"2023-01-02T18:16:57.307585+0000","last_active":"2023-01-02T18:17:38.460126+0000","last_peered":"2023-01-02T18:17:38.460126+0000","last_clean":"2023-01-02T18:17:38.460126+0000","last_became_active":"2023-01-02T18:16:55.315726+0000","last_became_peered":"2023-01-02T18:16:55.315726+0000","last_unstale":"2023-01-02T18:17:38.460126+0000","last_undegraded":"2023-01-02T18:17:38.460126+0000","last_fullsized":"2023-01-02T18:17:38.460126+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":85,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.542231+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:17:38.542231+0000","last_peered":"2023-01-02T18:17:38.542231+0000","last_clean":"2023-01-02T18:17:38.542231+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:17:38.542231+0000","last_undegraded":"2023-01-02T18:17:38.542231+0000","last_fullsized":"2023-01-02T18:17:38.542231+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":131,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.315239+0000","last_change":"2023-01-02T18:17:30.328445+0000","last_active":"2023-01-02T18:17:39.315239+0000","last_peered":"2023-01-02T18:17:39.315239+0000","last_clean":"2023-01-02T18:17:39.315239+0000","last_became_active":"2023-01-02T18:16:48.331845+0000","last_became_peered":"2023-01-02T18:16:48.331845+0000","last_unstale":"2023-01-02T18:17:39.315239+0000","last_undegraded":"2023-01-02T18:17:39.315239+0000","last_fullsized":"2023-01-02T18:17:39.315239+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445377+0000","last_change":"2023-01-02T18:16:49.324534+0000","last_active":"2023-01-02T18:17:38.445377+0000","last_peered":"2023-01-02T18:17:38.445377+0000","last_clean":"2023-01-02T18:17:38.445377+0000","last_became_active":"2023-01-02T18:16:48.327014+0000","last_became_peered":"2023-01-02T18:16:48.327014+0000","last_unstale":"2023-01-02T18:17:38.445377+0000","last_undegraded":"2023-01-02T18:17:38.445377+0000","last_fullsized":"2023-01-02T18:17:38.445377+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":69,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.459034+0000","last_change":"2023-01-02T18:17:29.338016+0000","last_active":"2023-01-02T18:17:38.459034+0000","last_peered":"2023-01-02T18:17:38.459034+0000","last_clean":"2023-01-02T18:17:38.459034+0000","last_became_active":"2023-01-02T18:17:29.337654+0000","last_became_peered":"2023-01-02T18:17:29.337654+0000","last_unstale":"2023-01-02T18:17:38.459034+0000","last_undegraded":"2023-01-02T18:17:38.459034+0000","last_fullsized":"2023-01-02T18:17:38.459034+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.469074+0000","last_change":"2023-01-02T18:17:38.469074+0000","last_active":"2023-01-02T18:17:38.469074+0000","last_peered":"2023-01-02T18:17:38.469074+0000","last_clean":"2023-01-02T18:17:38.469074+0000","last_became_active":"2023-01-02T18:17:36.439327+0000","last_became_peered":"2023-01-02T18:17:36.439327+0000","last_unstale":"2023-01-02T18:17:38.469074+0000","last_undegraded":"2023-01-02T18:17:38.469074+0000","last_fullsized":"2023-01-02T18:17:38.469074+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.f","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.341213+0000","last_change":"2023-01-02T18:17:34.327801+0000","last_active":"2023-01-02T18:17:39.341213+0000","last_peered":"2023-01-02T18:17:39.341213+0000","last_clean":"2023-01-02T18:17:39.341213+0000","last_became_active":"2023-01-02T18:17:32.346998+0000","last_became_peered":"2023-01-02T18:17:32.346998+0000","last_unstale":"2023-01-02T18:17:39.341213+0000","last_undegraded":"2023-01-02T18:17:39.341213+0000","last_fullsized":"2023-01-02T18:17:39.341213+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449908+0000","last_change":"2023-01-02T18:17:09.310675+0000","last_active":"2023-01-02T18:17:38.449908+0000","last_peered":"2023-01-02T18:17:38.449908+0000","last_clean":"2023-01-02T18:17:38.449908+0000","last_became_active":"2023-01-02T18:17:07.345963+0000","last_became_peered":"2023-01-02T18:17:07.345963+0000","last_unstale":"2023-01-02T18:17:38.449908+0000","last_undegraded":"2023-01-02T18:17:38.449908+0000","last_fullsized":"2023-01-02T18:17:38.449908+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446498+0000","last_change":"2023-01-02T18:17:29.335050+0000","last_active":"2023-01-02T18:17:38.446498+0000","last_peered":"2023-01-02T18:17:38.446498+0000","last_clean":"2023-01-02T18:17:38.446498+0000","last_became_active":"2023-01-02T18:17:29.333986+0000","last_became_peered":"2023-01-02T18:17:29.333986+0000","last_unstale":"2023-01-02T18:17:38.446498+0000","last_undegraded":"2023-01-02T18:17:38.446498+0000","last_fullsized":"2023-01-02T18:17:38.446498+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449001+0000","last_change":"2023-01-02T18:16:49.309259+0000","last_active":"2023-01-02T18:17:38.449001+0000","last_peered":"2023-01-02T18:17:38.449001+0000","last_clean":"2023-01-02T18:17:38.449001+0000","last_became_active":"2023-01-02T18:16:46.313760+0000","last_became_peered":"2023-01-02T18:16:46.313760+0000","last_unstale":"2023-01-02T18:17:38.449001+0000","last_undegraded":"2023-01-02T18:17:38.449001+0000","last_fullsized":"2023-01-02T18:17:38.449001+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445147+0000","last_change":"2023-01-02T18:17:29.372464+0000","last_active":"2023-01-02T18:17:38.445147+0000","last_peered":"2023-01-02T18:17:38.445147+0000","last_clean":"2023-01-02T18:17:38.445147+0000","last_became_active":"2023-01-02T18:17:29.332091+0000","last_became_peered":"2023-01-02T18:17:29.332091+0000","last_unstale":"2023-01-02T18:17:38.445147+0000","last_undegraded":"2023-01-02T18:17:38.445147+0000","last_fullsized":"2023-01-02T18:17:38.445147+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":126,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.316026+0000","last_change":"2023-01-02T18:17:30.328637+0000","last_active":"2023-01-02T18:17:39.316026+0000","last_peered":"2023-01-02T18:17:39.316026+0000","last_clean":"2023-01-02T18:17:39.316026+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:17:39.316026+0000","last_undegraded":"2023-01-02T18:17:39.316026+0000","last_fullsized":"2023-01-02T18:17:39.316026+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":103,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.459468+0000","last_change":"2023-01-02T18:17:36.450224+0000","last_active":"2023-01-02T18:17:38.459468+0000","last_peered":"2023-01-02T18:17:38.459468+0000","last_clean":"2023-01-02T18:17:38.459468+0000","last_became_active":"2023-01-02T18:17:36.449891+0000","last_became_peered":"2023-01-02T18:17:36.449891+0000","last_unstale":"2023-01-02T18:17:38.459468+0000","last_undegraded":"2023-01-02T18:17:38.459468+0000","last_fullsized":"2023-01-02T18:17:38.459468+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463182+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:17:38.463182+0000","last_peered":"2023-01-02T18:17:38.463182+0000","last_clean":"2023-01-02T18:17:38.463182+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:17:38.463182+0000","last_undegraded":"2023-01-02T18:17:38.463182+0000","last_fullsized":"2023-01-02T18:17:38.463182+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449323+0000","last_change":"2023-01-02T18:16:57.312949+0000","last_active":"2023-01-02T18:17:38.449323+0000","last_peered":"2023-01-02T18:17:38.449323+0000","last_clean":"2023-01-02T18:17:38.449323+0000","last_became_active":"2023-01-02T18:16:55.315334+0000","last_became_peered":"2023-01-02T18:16:55.315334+0000","last_unstale":"2023-01-02T18:17:38.449323+0000","last_undegraded":"2023-01-02T18:17:38.449323+0000","last_fullsized":"2023-01-02T18:17:38.449323+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.465060+0000","last_change":"2023-01-02T18:17:38.465060+0000","last_active":"2023-01-02T18:17:38.465060+0000","last_peered":"2023-01-02T18:17:38.465060+0000","last_clean":"2023-01-02T18:17:38.465060+0000","last_became_active":"2023-01-02T18:17:36.442117+0000","last_became_peered":"2023-01-02T18:17:36.442117+0000","last_unstale":"2023-01-02T18:17:38.465060+0000","last_undegraded":"2023-01-02T18:17:38.465060+0000","last_fullsized":"2023-01-02T18:17:38.465060+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.e","version":"101'15","reported_seq":90,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.340376+0000","last_change":"2023-01-02T18:17:34.328115+0000","last_active":"2023-01-02T18:17:39.340376+0000","last_peered":"2023-01-02T18:17:39.340376+0000","last_clean":"2023-01-02T18:17:39.340376+0000","last_became_active":"2023-01-02T18:17:32.347252+0000","last_became_peered":"2023-01-02T18:17:32.347252+0000","last_unstale":"2023-01-02T18:17:39.340376+0000","last_undegraded":"2023-01-02T18:17:39.340376+0000","last_fullsized":"2023-01-02T18:17:39.340376+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464325+0000","last_change":"2023-01-02T18:17:36.440543+0000","last_active":"2023-01-02T18:17:38.464325+0000","last_peered":"2023-01-02T18:17:38.464325+0000","last_clean":"2023-01-02T18:17:38.464325+0000","last_became_active":"2023-01-02T18:17:36.440213+0000","last_became_peered":"2023-01-02T18:17:36.440213+0000","last_unstale":"2023-01-02T18:17:38.464325+0000","last_undegraded":"2023-01-02T18:17:38.464325+0000","last_fullsized":"2023-01-02T18:17:38.464325+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444901+0000","last_change":"2023-01-02T18:17:01.319510+0000","last_active":"2023-01-02T18:17:38.444901+0000","last_peered":"2023-01-02T18:17:38.444901+0000","last_clean":"2023-01-02T18:17:38.444901+0000","last_became_active":"2023-01-02T18:16:59.327716+0000","last_became_peered":"2023-01-02T18:16:59.327716+0000","last_unstale":"2023-01-02T18:17:38.444901+0000","last_undegraded":"2023-01-02T18:17:38.444901+0000","last_fullsized":"2023-01-02T18:17:38.444901+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":67,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449086+0000","last_change":"2023-01-02T18:16:49.310704+0000","last_active":"2023-01-02T18:17:38.449086+0000","last_peered":"2023-01-02T18:17:38.449086+0000","last_clean":"2023-01-02T18:17:38.449086+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:38.449086+0000","last_undegraded":"2023-01-02T18:17:38.449086+0000","last_fullsized":"2023-01-02T18:17:38.449086+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448497+0000","last_change":"2023-01-02T18:16:44.307480+0000","last_active":"2023-01-02T18:17:38.448497+0000","last_peered":"2023-01-02T18:17:38.448497+0000","last_clean":"2023-01-02T18:17:38.448497+0000","last_became_active":"2023-01-02T18:16:41.447912+0000","last_became_peered":"2023-01-02T18:16:41.447912+0000","last_unstale":"2023-01-02T18:17:38.448497+0000","last_undegraded":"2023-01-02T18:17:38.448497+0000","last_fullsized":"2023-01-02T18:17:38.448497+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":96,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468832+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:17:38.468832+0000","last_peered":"2023-01-02T18:17:38.468832+0000","last_clean":"2023-01-02T18:17:38.468832+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:17:38.468832+0000","last_undegraded":"2023-01-02T18:17:38.468832+0000","last_fullsized":"2023-01-02T18:17:38.468832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"92'13","reported_seq":142,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.334077+0000","last_change":"2023-01-02T18:17:30.435879+0000","last_active":"2023-01-02T18:17:39.334077+0000","last_peered":"2023-01-02T18:17:39.334077+0000","last_clean":"2023-01-02T18:17:39.334077+0000","last_became_active":"2023-01-02T18:16:37.431863+0000","last_became_peered":"2023-01-02T18:16:37.431863+0000","last_unstale":"2023-01-02T18:17:39.334077+0000","last_undegraded":"2023-01-02T18:17:39.334077+0000","last_fullsized":"2023-01-02T18:17:39.334077+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449279+0000","last_change":"2023-01-02T18:16:53.344851+0000","last_active":"2023-01-02T18:17:38.449279+0000","last_peered":"2023-01-02T18:17:38.449279+0000","last_clean":"2023-01-02T18:17:38.449279+0000","last_became_active":"2023-01-02T18:16:51.341804+0000","last_became_peered":"2023-01-02T18:16:51.341804+0000","last_unstale":"2023-01-02T18:17:38.449279+0000","last_undegraded":"2023-01-02T18:17:38.449279+0000","last_fullsized":"2023-01-02T18:17:38.449279+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449578+0000","last_change":"2023-01-02T18:16:57.313134+0000","last_active":"2023-01-02T18:17:38.449578+0000","last_peered":"2023-01-02T18:17:38.449578+0000","last_clean":"2023-01-02T18:17:38.449578+0000","last_became_active":"2023-01-02T18:16:55.311645+0000","last_became_peered":"2023-01-02T18:16:55.311645+0000","last_unstale":"2023-01-02T18:17:38.449578+0000","last_undegraded":"2023-01-02T18:17:38.449578+0000","last_fullsized":"2023-01-02T18:17:38.449578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.469077+0000","last_change":"2023-01-02T18:17:38.469077+0000","last_active":"2023-01-02T18:17:38.469077+0000","last_peered":"2023-01-02T18:17:38.469077+0000","last_clean":"2023-01-02T18:17:38.469077+0000","last_became_active":"2023-01-02T18:17:36.436242+0000","last_became_peered":"2023-01-02T18:17:36.436242+0000","last_unstale":"2023-01-02T18:17:38.469077+0000","last_undegraded":"2023-01-02T18:17:38.469077+0000","last_fullsized":"2023-01-02T18:17:38.469077+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.d","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.340399+0000","last_change":"2023-01-02T18:17:34.327358+0000","last_active":"2023-01-02T18:17:39.340399+0000","last_peered":"2023-01-02T18:17:39.340399+0000","last_clean":"2023-01-02T18:17:39.340399+0000","last_became_active":"2023-01-02T18:17:32.339808+0000","last_became_peered":"2023-01-02T18:17:32.339808+0000","last_unstale":"2023-01-02T18:17:39.340399+0000","last_undegraded":"2023-01-02T18:17:39.340399+0000","last_fullsized":"2023-01-02T18:17:39.340399+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463729+0000","last_change":"2023-01-02T18:17:09.323298+0000","last_active":"2023-01-02T18:17:38.463729+0000","last_peered":"2023-01-02T18:17:38.463729+0000","last_clean":"2023-01-02T18:17:38.463729+0000","last_became_active":"2023-01-02T18:17:07.342742+0000","last_became_peered":"2023-01-02T18:17:07.342742+0000","last_unstale":"2023-01-02T18:17:38.463729+0000","last_undegraded":"2023-01-02T18:17:38.463729+0000","last_fullsized":"2023-01-02T18:17:38.463729+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":56,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.451042+0000","last_change":"2023-01-02T18:17:01.310492+0000","last_active":"2023-01-02T18:17:38.451042+0000","last_peered":"2023-01-02T18:17:38.451042+0000","last_clean":"2023-01-02T18:17:38.451042+0000","last_became_active":"2023-01-02T18:16:59.313793+0000","last_became_peered":"2023-01-02T18:16:59.313793+0000","last_unstale":"2023-01-02T18:17:38.451042+0000","last_undegraded":"2023-01-02T18:17:38.451042+0000","last_fullsized":"2023-01-02T18:17:38.451042+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"56'1","reported_seq":67,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458245+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:17:38.458245+0000","last_peered":"2023-01-02T18:17:38.458245+0000","last_clean":"2023-01-02T18:17:38.458245+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:17:38.458245+0000","last_undegraded":"2023-01-02T18:17:38.458245+0000","last_fullsized":"2023-01-02T18:17:38.458245+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":25,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445554+0000","last_change":"2023-01-02T18:17:29.344997+0000","last_active":"2023-01-02T18:17:38.445554+0000","last_peered":"2023-01-02T18:17:38.445554+0000","last_clean":"2023-01-02T18:17:38.445554+0000","last_became_active":"2023-01-02T18:17:29.323459+0000","last_became_peered":"2023-01-02T18:17:29.323459+0000","last_unstale":"2023-01-02T18:17:38.445554+0000","last_undegraded":"2023-01-02T18:17:38.445554+0000","last_fullsized":"2023-01-02T18:17:38.445554+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":81,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"46'2","reported_seq":122,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.313654+0000","last_change":"2023-01-02T18:17:30.330076+0000","last_active":"2023-01-02T18:17:39.313654+0000","last_peered":"2023-01-02T18:17:39.313654+0000","last_clean":"2023-01-02T18:17:39.313654+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:17:39.313654+0000","last_undegraded":"2023-01-02T18:17:39.313654+0000","last_fullsized":"2023-01-02T18:17:39.313654+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":96,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463795+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:17:38.463795+0000","last_peered":"2023-01-02T18:17:38.463795+0000","last_clean":"2023-01-02T18:17:38.463795+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:17:38.463795+0000","last_undegraded":"2023-01-02T18:17:38.463795+0000","last_fullsized":"2023-01-02T18:17:38.463795+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458366+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:17:38.458366+0000","last_peered":"2023-01-02T18:17:38.458366+0000","last_clean":"2023-01-02T18:17:38.458366+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:17:38.458366+0000","last_undegraded":"2023-01-02T18:17:38.458366+0000","last_fullsized":"2023-01-02T18:17:38.458366+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444946+0000","last_change":"2023-01-02T18:17:29.326283+0000","last_active":"2023-01-02T18:17:38.444946+0000","last_peered":"2023-01-02T18:17:38.444946+0000","last_clean":"2023-01-02T18:17:38.444946+0000","last_became_active":"2023-01-02T18:17:29.325965+0000","last_became_peered":"2023-01-02T18:17:29.325965+0000","last_unstale":"2023-01-02T18:17:38.444946+0000","last_undegraded":"2023-01-02T18:17:38.444946+0000","last_fullsized":"2023-01-02T18:17:38.444946+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"106'1","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.331814+0000","last_change":"2023-01-02T18:17:38.450921+0000","last_active":"2023-01-02T18:17:39.331814+0000","last_peered":"2023-01-02T18:17:39.331814+0000","last_clean":"2023-01-02T18:17:39.331814+0000","last_became_active":"2023-01-02T18:17:36.444808+0000","last_became_peered":"2023-01-02T18:17:36.444808+0000","last_unstale":"2023-01-02T18:17:39.331814+0000","last_undegraded":"2023-01-02T18:17:39.331814+0000","last_fullsized":"2023-01-02T18:17:39.331814+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.8","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.312221+0000","last_change":"2023-01-02T18:17:34.316738+0000","last_active":"2023-01-02T18:17:39.312221+0000","last_peered":"2023-01-02T18:17:39.312221+0000","last_clean":"2023-01-02T18:17:39.312221+0000","last_became_active":"2023-01-02T18:17:32.340483+0000","last_became_peered":"2023-01-02T18:17:32.340483+0000","last_unstale":"2023-01-02T18:17:39.312221+0000","last_undegraded":"2023-01-02T18:17:39.312221+0000","last_fullsized":"2023-01-02T18:17:39.312221+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444329+0000","last_change":"2023-01-02T18:17:09.321395+0000","last_active":"2023-01-02T18:17:38.444329+0000","last_peered":"2023-01-02T18:17:38.444329+0000","last_clean":"2023-01-02T18:17:38.444329+0000","last_became_active":"2023-01-02T18:17:07.344789+0000","last_became_peered":"2023-01-02T18:17:07.344789+0000","last_unstale":"2023-01-02T18:17:38.444329+0000","last_undegraded":"2023-01-02T18:17:38.444329+0000","last_fullsized":"2023-01-02T18:17:38.444329+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"71'3","reported_seq":56,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.467477+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:17:38.467477+0000","last_peered":"2023-01-02T18:17:38.467477+0000","last_clean":"2023-01-02T18:17:38.467477+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:17:38.467477+0000","last_undegraded":"2023-01-02T18:17:38.467477+0000","last_fullsized":"2023-01-02T18:17:38.467477+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'2","reported_seq":73,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445598+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:17:38.445598+0000","last_peered":"2023-01-02T18:17:38.445598+0000","last_clean":"2023-01-02T18:17:38.445598+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:17:38.445598+0000","last_undegraded":"2023-01-02T18:17:38.445598+0000","last_fullsized":"2023-01-02T18:17:38.445598+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"94'15","reported_seq":189,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.312881+0000","last_change":"2023-01-02T18:17:30.328344+0000","last_active":"2023-01-02T18:17:39.312881+0000","last_peered":"2023-01-02T18:17:39.312881+0000","last_clean":"2023-01-02T18:17:39.312881+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:39.312881+0000","last_undegraded":"2023-01-02T18:17:39.312881+0000","last_fullsized":"2023-01-02T18:17:39.312881+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":93,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":89,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448600+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:17:38.448600+0000","last_peered":"2023-01-02T18:17:38.448600+0000","last_clean":"2023-01-02T18:17:38.448600+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:17:38.448600+0000","last_undegraded":"2023-01-02T18:17:38.448600+0000","last_fullsized":"2023-01-02T18:17:38.448600+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.447431+0000","last_change":"2023-01-02T18:17:29.326478+0000","last_active":"2023-01-02T18:17:38.447431+0000","last_peered":"2023-01-02T18:17:38.447431+0000","last_clean":"2023-01-02T18:17:38.447431+0000","last_became_active":"2023-01-02T18:17:29.325843+0000","last_became_peered":"2023-01-02T18:17:29.325843+0000","last_unstale":"2023-01-02T18:17:38.447431+0000","last_undegraded":"2023-01-02T18:17:38.447431+0000","last_fullsized":"2023-01-02T18:17:38.447431+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":69,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468300+0000","last_change":"2023-01-02T18:17:29.318734+0000","last_active":"2023-01-02T18:17:38.468300+0000","last_peered":"2023-01-02T18:17:38.468300+0000","last_clean":"2023-01-02T18:17:38.468300+0000","last_became_active":"2023-01-02T18:17:29.318419+0000","last_became_peered":"2023-01-02T18:17:29.318419+0000","last_unstale":"2023-01-02T18:17:38.468300+0000","last_undegraded":"2023-01-02T18:17:38.468300+0000","last_fullsized":"2023-01-02T18:17:38.468300+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464150+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:17:38.464150+0000","last_peered":"2023-01-02T18:17:38.464150+0000","last_clean":"2023-01-02T18:17:38.464150+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:17:38.464150+0000","last_undegraded":"2023-01-02T18:17:38.464150+0000","last_fullsized":"2023-01-02T18:17:38.464150+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450765+0000","last_change":"2023-01-02T18:17:38.450765+0000","last_active":"2023-01-02T18:17:38.450765+0000","last_peered":"2023-01-02T18:17:38.450765+0000","last_clean":"2023-01-02T18:17:38.450765+0000","last_became_active":"2023-01-02T18:17:36.444834+0000","last_became_peered":"2023-01-02T18:17:36.444834+0000","last_unstale":"2023-01-02T18:17:38.450765+0000","last_undegraded":"2023-01-02T18:17:38.450765+0000","last_fullsized":"2023-01-02T18:17:38.450765+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.b","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.339663+0000","last_change":"2023-01-02T18:17:34.327117+0000","last_active":"2023-01-02T18:17:39.339663+0000","last_peered":"2023-01-02T18:17:39.339663+0000","last_clean":"2023-01-02T18:17:39.339663+0000","last_became_active":"2023-01-02T18:17:32.340616+0000","last_became_peered":"2023-01-02T18:17:32.340616+0000","last_unstale":"2023-01-02T18:17:39.339663+0000","last_undegraded":"2023-01-02T18:17:39.339663+0000","last_fullsized":"2023-01-02T18:17:39.339663+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":14,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.443616+0000","last_change":"2023-01-02T18:17:36.433551+0000","last_active":"2023-01-02T18:17:38.443616+0000","last_peered":"2023-01-02T18:17:38.443616+0000","last_clean":"2023-01-02T18:17:38.443616+0000","last_became_active":"2023-01-02T18:17:36.433227+0000","last_became_peered":"2023-01-02T18:17:36.433227+0000","last_unstale":"2023-01-02T18:17:38.443616+0000","last_undegraded":"2023-01-02T18:17:38.443616+0000","last_fullsized":"2023-01-02T18:17:38.443616+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458027+0000","last_change":"2023-01-02T18:17:29.338386+0000","last_active":"2023-01-02T18:17:38.458027+0000","last_peered":"2023-01-02T18:17:38.458027+0000","last_clean":"2023-01-02T18:17:38.458027+0000","last_became_active":"2023-01-02T18:17:29.337596+0000","last_became_peered":"2023-01-02T18:17:29.337596+0000","last_unstale":"2023-01-02T18:17:38.458027+0000","last_undegraded":"2023-01-02T18:17:38.458027+0000","last_fullsized":"2023-01-02T18:17:38.458027+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463435+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:17:38.463435+0000","last_peered":"2023-01-02T18:17:38.463435+0000","last_clean":"2023-01-02T18:17:38.463435+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:17:38.463435+0000","last_undegraded":"2023-01-02T18:17:38.463435+0000","last_fullsized":"2023-01-02T18:17:38.463435+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":84,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458449+0000","last_change":"2023-01-02T18:16:48.345373+0000","last_active":"2023-01-02T18:17:38.458449+0000","last_peered":"2023-01-02T18:17:38.458449+0000","last_clean":"2023-01-02T18:17:38.458449+0000","last_became_active":"2023-01-02T18:16:48.328041+0000","last_became_peered":"2023-01-02T18:16:48.328041+0000","last_unstale":"2023-01-02T18:17:38.458449+0000","last_undegraded":"2023-01-02T18:17:38.458449+0000","last_fullsized":"2023-01-02T18:17:38.458449+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"96'9","reported_seq":169,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.331710+0000","last_change":"2023-01-02T18:17:30.434525+0000","last_active":"2023-01-02T18:17:39.331710+0000","last_peered":"2023-01-02T18:17:39.331710+0000","last_clean":"2023-01-02T18:17:39.331710+0000","last_became_active":"2023-01-02T18:17:29.334562+0000","last_became_peered":"2023-01-02T18:17:29.334562+0000","last_unstale":"2023-01-02T18:17:39.331710+0000","last_undegraded":"2023-01-02T18:17:39.331710+0000","last_fullsized":"2023-01-02T18:17:39.331710+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":70,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":98,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462261+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:17:38.462261+0000","last_peered":"2023-01-02T18:17:38.462261+0000","last_clean":"2023-01-02T18:17:38.462261+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:17:38.462261+0000","last_undegraded":"2023-01-02T18:17:38.462261+0000","last_fullsized":"2023-01-02T18:17:38.462261+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445374+0000","last_change":"2023-01-02T18:17:29.323754+0000","last_active":"2023-01-02T18:17:38.445374+0000","last_peered":"2023-01-02T18:17:38.445374+0000","last_clean":"2023-01-02T18:17:38.445374+0000","last_became_active":"2023-01-02T18:17:29.320497+0000","last_became_peered":"2023-01-02T18:17:29.320497+0000","last_unstale":"2023-01-02T18:17:38.445374+0000","last_undegraded":"2023-01-02T18:17:38.445374+0000","last_fullsized":"2023-01-02T18:17:38.445374+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.447062+0000","last_change":"2023-01-02T18:17:29.389087+0000","last_active":"2023-01-02T18:17:38.447062+0000","last_peered":"2023-01-02T18:17:38.447062+0000","last_clean":"2023-01-02T18:17:38.447062+0000","last_became_active":"2023-01-02T18:17:29.337136+0000","last_became_peered":"2023-01-02T18:17:29.337136+0000","last_unstale":"2023-01-02T18:17:38.447062+0000","last_undegraded":"2023-01-02T18:17:38.447062+0000","last_fullsized":"2023-01-02T18:17:38.447062+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445706+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:17:38.445706+0000","last_peered":"2023-01-02T18:17:38.445706+0000","last_clean":"2023-01-02T18:17:38.445706+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:17:38.445706+0000","last_undegraded":"2023-01-02T18:17:38.445706+0000","last_fullsized":"2023-01-02T18:17:38.445706+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450620+0000","last_change":"2023-01-02T18:17:38.450620+0000","last_active":"2023-01-02T18:17:38.450620+0000","last_peered":"2023-01-02T18:17:38.450620+0000","last_clean":"2023-01-02T18:17:38.450620+0000","last_became_active":"2023-01-02T18:17:36.443497+0000","last_became_peered":"2023-01-02T18:17:36.443497+0000","last_unstale":"2023-01-02T18:17:38.450620+0000","last_undegraded":"2023-01-02T18:17:38.450620+0000","last_fullsized":"2023-01-02T18:17:38.450620+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.9","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.326520+0000","last_change":"2023-01-02T18:17:34.316527+0000","last_active":"2023-01-02T18:17:39.326520+0000","last_peered":"2023-01-02T18:17:39.326520+0000","last_clean":"2023-01-02T18:17:39.326520+0000","last_became_active":"2023-01-02T18:17:32.342303+0000","last_became_peered":"2023-01-02T18:17:32.342303+0000","last_unstale":"2023-01-02T18:17:39.326520+0000","last_undegraded":"2023-01-02T18:17:39.326520+0000","last_fullsized":"2023-01-02T18:17:39.326520+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"76'9","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445032+0000","last_change":"2023-01-02T18:17:29.361212+0000","last_active":"2023-01-02T18:17:38.445032+0000","last_peered":"2023-01-02T18:17:38.445032+0000","last_clean":"2023-01-02T18:17:38.445032+0000","last_became_active":"2023-01-02T18:17:29.328070+0000","last_became_peered":"2023-01-02T18:17:29.328070+0000","last_unstale":"2023-01-02T18:17:38.445032+0000","last_undegraded":"2023-01-02T18:17:38.445032+0000","last_fullsized":"2023-01-02T18:17:38.445032+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"72'1","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449022+0000","last_change":"2023-01-02T18:17:36.456119+0000","last_active":"2023-01-02T18:17:38.449022+0000","last_peered":"2023-01-02T18:17:38.449022+0000","last_clean":"2023-01-02T18:17:38.449022+0000","last_became_active":"2023-01-02T18:17:36.450570+0000","last_became_peered":"2023-01-02T18:17:36.450570+0000","last_unstale":"2023-01-02T18:17:38.449022+0000","last_undegraded":"2023-01-02T18:17:38.449022+0000","last_fullsized":"2023-01-02T18:17:38.449022+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":76,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.447242+0000","last_change":"2023-01-02T18:17:36.436442+0000","last_active":"2023-01-02T18:17:38.447242+0000","last_peered":"2023-01-02T18:17:38.447242+0000","last_clean":"2023-01-02T18:17:38.447242+0000","last_became_active":"2023-01-02T18:17:36.436103+0000","last_became_peered":"2023-01-02T18:17:36.436103+0000","last_unstale":"2023-01-02T18:17:38.447242+0000","last_undegraded":"2023-01-02T18:17:38.447242+0000","last_fullsized":"2023-01-02T18:17:38.447242+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"90'10","reported_seq":160,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.311424+0000","last_change":"2023-01-02T18:17:30.324702+0000","last_active":"2023-01-02T18:17:39.311424+0000","last_peered":"2023-01-02T18:17:39.311424+0000","last_clean":"2023-01-02T18:17:39.311424+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:17:39.311424+0000","last_undegraded":"2023-01-02T18:17:39.311424+0000","last_fullsized":"2023-01-02T18:17:39.311424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":84,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":95,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448757+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:17:38.448757+0000","last_peered":"2023-01-02T18:17:38.448757+0000","last_clean":"2023-01-02T18:17:38.448757+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:17:38.448757+0000","last_undegraded":"2023-01-02T18:17:38.448757+0000","last_fullsized":"2023-01-02T18:17:38.448757+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":75,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.542769+0000","last_change":"2023-01-02T18:17:29.328315+0000","last_active":"2023-01-02T18:17:38.542769+0000","last_peered":"2023-01-02T18:17:38.542769+0000","last_clean":"2023-01-02T18:17:38.542769+0000","last_became_active":"2023-01-02T18:17:29.328011+0000","last_became_peered":"2023-01-02T18:17:29.328011+0000","last_unstale":"2023-01-02T18:17:38.542769+0000","last_undegraded":"2023-01-02T18:17:38.542769+0000","last_fullsized":"2023-01-02T18:17:38.542769+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464070+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:17:38.464070+0000","last_peered":"2023-01-02T18:17:38.464070+0000","last_clean":"2023-01-02T18:17:38.464070+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:17:38.464070+0000","last_undegraded":"2023-01-02T18:17:38.464070+0000","last_fullsized":"2023-01-02T18:17:38.464070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444773+0000","last_change":"2023-01-02T18:16:57.306312+0000","last_active":"2023-01-02T18:17:38.444773+0000","last_peered":"2023-01-02T18:17:38.444773+0000","last_clean":"2023-01-02T18:17:38.444773+0000","last_became_active":"2023-01-02T18:16:55.314537+0000","last_became_peered":"2023-01-02T18:16:55.314537+0000","last_unstale":"2023-01-02T18:17:38.444773+0000","last_undegraded":"2023-01-02T18:17:38.444773+0000","last_fullsized":"2023-01-02T18:17:38.444773+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449874+0000","last_change":"2023-01-02T18:17:38.449874+0000","last_active":"2023-01-02T18:17:38.449874+0000","last_peered":"2023-01-02T18:17:38.449874+0000","last_clean":"2023-01-02T18:17:38.449874+0000","last_became_active":"2023-01-02T18:17:36.445029+0000","last_became_peered":"2023-01-02T18:17:36.445029+0000","last_unstale":"2023-01-02T18:17:38.449874+0000","last_undegraded":"2023-01-02T18:17:38.449874+0000","last_fullsized":"2023-01-02T18:17:38.449874+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.a","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.339389+0000","last_change":"2023-01-02T18:17:34.326569+0000","last_active":"2023-01-02T18:17:39.339389+0000","last_peered":"2023-01-02T18:17:39.339389+0000","last_clean":"2023-01-02T18:17:39.339389+0000","last_became_active":"2023-01-02T18:17:32.341143+0000","last_became_peered":"2023-01-02T18:17:32.341143+0000","last_unstale":"2023-01-02T18:17:39.339389+0000","last_undegraded":"2023-01-02T18:17:39.339389+0000","last_fullsized":"2023-01-02T18:17:39.339389+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"76'4","reported_seq":51,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462247+0000","last_change":"2023-01-02T18:17:09.322082+0000","last_active":"2023-01-02T18:17:38.462247+0000","last_peered":"2023-01-02T18:17:38.462247+0000","last_clean":"2023-01-02T18:17:38.462247+0000","last_became_active":"2023-01-02T18:17:07.340751+0000","last_became_peered":"2023-01-02T18:17:07.340751+0000","last_unstale":"2023-01-02T18:17:38.462247+0000","last_undegraded":"2023-01-02T18:17:38.462247+0000","last_fullsized":"2023-01-02T18:17:38.462247+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444866+0000","last_change":"2023-01-02T18:17:29.386698+0000","last_active":"2023-01-02T18:17:38.444866+0000","last_peered":"2023-01-02T18:17:38.444866+0000","last_clean":"2023-01-02T18:17:38.444866+0000","last_became_active":"2023-01-02T18:17:29.336976+0000","last_became_peered":"2023-01-02T18:17:29.336976+0000","last_unstale":"2023-01-02T18:17:38.444866+0000","last_undegraded":"2023-01-02T18:17:38.444866+0000","last_fullsized":"2023-01-02T18:17:38.444866+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468432+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:17:38.468432+0000","last_peered":"2023-01-02T18:17:38.468432+0000","last_clean":"2023-01-02T18:17:38.468432+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:17:38.468432+0000","last_undegraded":"2023-01-02T18:17:38.468432+0000","last_fullsized":"2023-01-02T18:17:38.468432+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"85'12","reported_seq":121,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.340546+0000","last_change":"2023-01-02T18:17:30.503301+0000","last_active":"2023-01-02T18:17:39.340546+0000","last_peered":"2023-01-02T18:17:39.340546+0000","last_clean":"2023-01-02T18:17:39.340546+0000","last_became_active":"2023-01-02T18:16:48.335418+0000","last_became_peered":"2023-01-02T18:16:48.335418+0000","last_unstale":"2023-01-02T18:17:39.340546+0000","last_undegraded":"2023-01-02T18:17:39.340546+0000","last_fullsized":"2023-01-02T18:17:39.340546+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445279+0000","last_change":"2023-01-02T18:17:29.331000+0000","last_active":"2023-01-02T18:17:38.445279+0000","last_peered":"2023-01-02T18:17:38.445279+0000","last_clean":"2023-01-02T18:17:38.445279+0000","last_became_active":"2023-01-02T18:17:29.329297+0000","last_became_peered":"2023-01-02T18:17:29.329297+0000","last_unstale":"2023-01-02T18:17:38.445279+0000","last_undegraded":"2023-01-02T18:17:38.445279+0000","last_fullsized":"2023-01-02T18:17:38.445279+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445132+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:17:38.445132+0000","last_peered":"2023-01-02T18:17:38.445132+0000","last_clean":"2023-01-02T18:17:38.445132+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:17:38.445132+0000","last_undegraded":"2023-01-02T18:17:38.445132+0000","last_fullsized":"2023-01-02T18:17:38.445132+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450516+0000","last_change":"2023-01-02T18:16:53.345663+0000","last_active":"2023-01-02T18:17:38.450516+0000","last_peered":"2023-01-02T18:17:38.450516+0000","last_clean":"2023-01-02T18:17:38.450516+0000","last_became_active":"2023-01-02T18:16:51.341075+0000","last_became_peered":"2023-01-02T18:16:51.341075+0000","last_unstale":"2023-01-02T18:17:38.450516+0000","last_undegraded":"2023-01-02T18:17:38.450516+0000","last_fullsized":"2023-01-02T18:17:38.450516+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.460308+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:17:38.460308+0000","last_peered":"2023-01-02T18:17:38.460308+0000","last_clean":"2023-01-02T18:17:38.460308+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:17:38.460308+0000","last_undegraded":"2023-01-02T18:17:38.460308+0000","last_fullsized":"2023-01-02T18:17:38.460308+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.459459+0000","last_change":"2023-01-02T18:17:38.459459+0000","last_active":"2023-01-02T18:17:38.459459+0000","last_peered":"2023-01-02T18:17:38.459459+0000","last_clean":"2023-01-02T18:17:38.459459+0000","last_became_active":"2023-01-02T18:17:36.442021+0000","last_became_peered":"2023-01-02T18:17:36.442021+0000","last_unstale":"2023-01-02T18:17:38.459459+0000","last_undegraded":"2023-01-02T18:17:38.459459+0000","last_fullsized":"2023-01-02T18:17:38.459459+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.c","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.318196+0000","last_change":"2023-01-02T18:17:34.343439+0000","last_active":"2023-01-02T18:17:39.318196+0000","last_peered":"2023-01-02T18:17:39.318196+0000","last_clean":"2023-01-02T18:17:39.318196+0000","last_became_active":"2023-01-02T18:17:32.344028+0000","last_became_peered":"2023-01-02T18:17:32.344028+0000","last_unstale":"2023-01-02T18:17:39.318196+0000","last_undegraded":"2023-01-02T18:17:39.318196+0000","last_fullsized":"2023-01-02T18:17:39.318196+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.447355+0000","last_change":"2023-01-02T18:17:29.326591+0000","last_active":"2023-01-02T18:17:38.447355+0000","last_peered":"2023-01-02T18:17:38.447355+0000","last_clean":"2023-01-02T18:17:38.447355+0000","last_became_active":"2023-01-02T18:17:29.326222+0000","last_became_peered":"2023-01-02T18:17:29.326222+0000","last_unstale":"2023-01-02T18:17:38.447355+0000","last_undegraded":"2023-01-02T18:17:38.447355+0000","last_fullsized":"2023-01-02T18:17:38.447355+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445351+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:17:38.445351+0000","last_peered":"2023-01-02T18:17:38.445351+0000","last_clean":"2023-01-02T18:17:38.445351+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:17:38.445351+0000","last_undegraded":"2023-01-02T18:17:38.445351+0000","last_fullsized":"2023-01-02T18:17:38.445351+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'4","reported_seq":75,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458884+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:17:38.458884+0000","last_peered":"2023-01-02T18:17:38.458884+0000","last_clean":"2023-01-02T18:17:38.458884+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:38.458884+0000","last_undegraded":"2023-01-02T18:17:38.458884+0000","last_fullsized":"2023-01-02T18:17:38.458884+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":88,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468004+0000","last_change":"2023-01-02T18:17:29.319612+0000","last_active":"2023-01-02T18:17:38.468004+0000","last_peered":"2023-01-02T18:17:38.468004+0000","last_clean":"2023-01-02T18:17:38.468004+0000","last_became_active":"2023-01-02T18:17:29.319276+0000","last_became_peered":"2023-01-02T18:17:29.319276+0000","last_unstale":"2023-01-02T18:17:38.468004+0000","last_undegraded":"2023-01-02T18:17:38.468004+0000","last_fullsized":"2023-01-02T18:17:38.468004+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"82'2","reported_seq":35,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.328405+0000","last_change":"2023-01-02T18:17:30.331827+0000","last_active":"2023-01-02T18:17:39.328405+0000","last_peered":"2023-01-02T18:17:39.328405+0000","last_clean":"2023-01-02T18:17:39.328405+0000","last_became_active":"2023-01-02T18:17:29.335527+0000","last_became_peered":"2023-01-02T18:17:29.335527+0000","last_unstale":"2023-01-02T18:17:39.328405+0000","last_undegraded":"2023-01-02T18:17:39.328405+0000","last_fullsized":"2023-01-02T18:17:39.328405+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":48,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":96,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468582+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:17:38.468582+0000","last_peered":"2023-01-02T18:17:38.468582+0000","last_clean":"2023-01-02T18:17:38.468582+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:17:38.468582+0000","last_undegraded":"2023-01-02T18:17:38.468582+0000","last_fullsized":"2023-01-02T18:17:38.468582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.443565+0000","last_change":"2023-01-02T18:16:53.685845+0000","last_active":"2023-01-02T18:17:38.443565+0000","last_peered":"2023-01-02T18:17:38.443565+0000","last_clean":"2023-01-02T18:17:38.443565+0000","last_became_active":"2023-01-02T18:16:51.345111+0000","last_became_peered":"2023-01-02T18:16:51.345111+0000","last_unstale":"2023-01-02T18:17:38.443565+0000","last_undegraded":"2023-01-02T18:17:38.443565+0000","last_fullsized":"2023-01-02T18:17:38.443565+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":34,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.457749+0000","last_change":"2023-01-02T18:17:36.453036+0000","last_active":"2023-01-02T18:17:38.457749+0000","last_peered":"2023-01-02T18:17:38.457749+0000","last_clean":"2023-01-02T18:17:38.457749+0000","last_became_active":"2023-01-02T18:17:36.447351+0000","last_became_peered":"2023-01-02T18:17:36.447351+0000","last_unstale":"2023-01-02T18:17:38.457749+0000","last_undegraded":"2023-01-02T18:17:38.457749+0000","last_fullsized":"2023-01-02T18:17:38.457749+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449421+0000","last_change":"2023-01-02T18:17:38.449421+0000","last_active":"2023-01-02T18:17:38.449421+0000","last_peered":"2023-01-02T18:17:38.449421+0000","last_clean":"2023-01-02T18:17:38.449421+0000","last_became_active":"2023-01-02T18:17:36.446175+0000","last_became_peered":"2023-01-02T18:17:36.446175+0000","last_unstale":"2023-01-02T18:17:38.449421+0000","last_undegraded":"2023-01-02T18:17:38.449421+0000","last_fullsized":"2023-01-02T18:17:38.449421+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.1","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.317263+0000","last_change":"2023-01-02T18:17:34.343264+0000","last_active":"2023-01-02T18:17:39.317263+0000","last_peered":"2023-01-02T18:17:39.317263+0000","last_clean":"2023-01-02T18:17:39.317263+0000","last_became_active":"2023-01-02T18:17:32.345763+0000","last_became_peered":"2023-01-02T18:17:32.345763+0000","last_unstale":"2023-01-02T18:17:39.317263+0000","last_undegraded":"2023-01-02T18:17:39.317263+0000","last_fullsized":"2023-01-02T18:17:39.317263+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2","version":"76'12","reported_seq":155,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448691+0000","last_change":"2023-01-02T18:17:09.308235+0000","last_active":"2023-01-02T18:17:38.448691+0000","last_peered":"2023-01-02T18:17:38.448691+0000","last_clean":"2023-01-02T18:17:38.448691+0000","last_became_active":"2023-01-02T18:17:07.340498+0000","last_became_peered":"2023-01-02T18:17:07.340498+0000","last_unstale":"2023-01-02T18:17:38.448691+0000","last_undegraded":"2023-01-02T18:17:38.448691+0000","last_fullsized":"2023-01-02T18:17:38.448691+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"69'1","reported_seq":35,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445328+0000","last_change":"2023-01-02T18:17:36.448358+0000","last_active":"2023-01-02T18:17:38.445328+0000","last_peered":"2023-01-02T18:17:38.445328+0000","last_clean":"2023-01-02T18:17:38.445328+0000","last_became_active":"2023-01-02T18:17:36.441277+0000","last_became_peered":"2023-01-02T18:17:36.441277+0000","last_unstale":"2023-01-02T18:17:38.445328+0000","last_undegraded":"2023-01-02T18:17:38.445328+0000","last_fullsized":"2023-01-02T18:17:38.445328+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468902+0000","last_change":"2023-01-02T18:16:44.298243+0000","last_active":"2023-01-02T18:17:38.468902+0000","last_peered":"2023-01-02T18:17:38.468902+0000","last_clean":"2023-01-02T18:17:38.468902+0000","last_became_active":"2023-01-02T18:16:41.448643+0000","last_became_peered":"2023-01-02T18:16:41.448643+0000","last_unstale":"2023-01-02T18:17:38.468902+0000","last_undegraded":"2023-01-02T18:17:38.468902+0000","last_fullsized":"2023-01-02T18:17:38.468902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"76'8","reported_seq":129,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.330904+0000","last_change":"2023-01-02T18:17:30.433551+0000","last_active":"2023-01-02T18:17:39.330904+0000","last_peered":"2023-01-02T18:17:39.330904+0000","last_clean":"2023-01-02T18:17:39.330904+0000","last_became_active":"2023-01-02T18:16:37.414106+0000","last_became_peered":"2023-01-02T18:16:37.414106+0000","last_unstale":"2023-01-02T18:17:39.330904+0000","last_undegraded":"2023-01-02T18:17:39.330904+0000","last_fullsized":"2023-01-02T18:17:39.330904+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446807+0000","last_change":"2023-01-02T18:17:29.325726+0000","last_active":"2023-01-02T18:17:38.446807+0000","last_peered":"2023-01-02T18:17:38.446807+0000","last_clean":"2023-01-02T18:17:38.446807+0000","last_became_active":"2023-01-02T18:17:29.325418+0000","last_became_peered":"2023-01-02T18:17:29.325418+0000","last_unstale":"2023-01-02T18:17:38.446807+0000","last_undegraded":"2023-01-02T18:17:38.446807+0000","last_fullsized":"2023-01-02T18:17:38.446807+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446351+0000","last_change":"2023-01-02T18:17:29.329378+0000","last_active":"2023-01-02T18:17:38.446351+0000","last_peered":"2023-01-02T18:17:38.446351+0000","last_clean":"2023-01-02T18:17:38.446351+0000","last_became_active":"2023-01-02T18:17:29.327709+0000","last_became_peered":"2023-01-02T18:17:29.327709+0000","last_unstale":"2023-01-02T18:17:38.446351+0000","last_undegraded":"2023-01-02T18:17:38.446351+0000","last_fullsized":"2023-01-02T18:17:38.446351+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458614+0000","last_change":"2023-01-02T18:16:57.307540+0000","last_active":"2023-01-02T18:17:38.458614+0000","last_peered":"2023-01-02T18:17:38.458614+0000","last_clean":"2023-01-02T18:17:38.458614+0000","last_became_active":"2023-01-02T18:16:55.319082+0000","last_became_peered":"2023-01-02T18:16:55.319082+0000","last_unstale":"2023-01-02T18:17:38.458614+0000","last_undegraded":"2023-01-02T18:17:38.458614+0000","last_fullsized":"2023-01-02T18:17:38.458614+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"106'3","reported_seq":19,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.342372+0000","last_change":"2023-01-02T18:17:38.459021+0000","last_active":"2023-01-02T18:17:39.342372+0000","last_peered":"2023-01-02T18:17:39.342372+0000","last_clean":"2023-01-02T18:17:39.342372+0000","last_became_active":"2023-01-02T18:17:36.440780+0000","last_became_peered":"2023-01-02T18:17:36.440780+0000","last_unstale":"2023-01-02T18:17:39.342372+0000","last_undegraded":"2023-01-02T18:17:39.342372+0000","last_fullsized":"2023-01-02T18:17:39.342372+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":6,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.0","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.339041+0000","last_change":"2023-01-02T18:17:34.324670+0000","last_active":"2023-01-02T18:17:39.339041+0000","last_peered":"2023-01-02T18:17:39.339041+0000","last_clean":"2023-01-02T18:17:39.339041+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:17:39.339041+0000","last_undegraded":"2023-01-02T18:17:39.339041+0000","last_fullsized":"2023-01-02T18:17:39.339041+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"76'4","reported_seq":51,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463081+0000","last_change":"2023-01-02T18:17:09.323147+0000","last_active":"2023-01-02T18:17:38.463081+0000","last_peered":"2023-01-02T18:17:38.463081+0000","last_clean":"2023-01-02T18:17:38.463081+0000","last_became_active":"2023-01-02T18:17:07.341052+0000","last_became_peered":"2023-01-02T18:17:07.341052+0000","last_unstale":"2023-01-02T18:17:38.463081+0000","last_undegraded":"2023-01-02T18:17:38.463081+0000","last_fullsized":"2023-01-02T18:17:38.463081+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444280+0000","last_change":"2023-01-02T18:17:29.319986+0000","last_active":"2023-01-02T18:17:38.444280+0000","last_peered":"2023-01-02T18:17:38.444280+0000","last_clean":"2023-01-02T18:17:38.444280+0000","last_became_active":"2023-01-02T18:17:29.319682+0000","last_became_peered":"2023-01-02T18:17:29.319682+0000","last_unstale":"2023-01-02T18:17:38.444280+0000","last_undegraded":"2023-01-02T18:17:38.444280+0000","last_fullsized":"2023-01-02T18:17:38.444280+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"51'1","reported_seq":93,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458986+0000","last_change":"2023-01-02T18:17:36.455251+0000","last_active":"2023-01-02T18:17:38.458986+0000","last_peered":"2023-01-02T18:17:38.458986+0000","last_clean":"2023-01-02T18:17:38.458986+0000","last_became_active":"2023-01-02T18:17:36.449035+0000","last_became_peered":"2023-01-02T18:17:36.449035+0000","last_unstale":"2023-01-02T18:17:38.458986+0000","last_undegraded":"2023-01-02T18:17:38.458986+0000","last_fullsized":"2023-01-02T18:17:38.458986+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":101,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.318251+0000","last_change":"2023-01-02T18:17:30.333300+0000","last_active":"2023-01-02T18:17:39.318251+0000","last_peered":"2023-01-02T18:17:39.318251+0000","last_clean":"2023-01-02T18:17:39.318251+0000","last_became_active":"2023-01-02T18:16:48.322710+0000","last_became_peered":"2023-01-02T18:16:48.322710+0000","last_unstale":"2023-01-02T18:17:39.318251+0000","last_undegraded":"2023-01-02T18:17:39.318251+0000","last_fullsized":"2023-01-02T18:17:39.318251+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.447164+0000","last_change":"2023-01-02T18:17:29.333377+0000","last_active":"2023-01-02T18:17:38.447164+0000","last_peered":"2023-01-02T18:17:38.447164+0000","last_clean":"2023-01-02T18:17:38.447164+0000","last_became_active":"2023-01-02T18:17:29.332106+0000","last_became_peered":"2023-01-02T18:17:29.332106+0000","last_unstale":"2023-01-02T18:17:38.447164+0000","last_undegraded":"2023-01-02T18:17:38.447164+0000","last_fullsized":"2023-01-02T18:17:38.447164+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450494+0000","last_change":"2023-01-02T18:16:53.345390+0000","last_active":"2023-01-02T18:17:38.450494+0000","last_peered":"2023-01-02T18:17:38.450494+0000","last_clean":"2023-01-02T18:17:38.450494+0000","last_became_active":"2023-01-02T18:16:51.339020+0000","last_became_peered":"2023-01-02T18:16:51.339020+0000","last_unstale":"2023-01-02T18:17:38.450494+0000","last_undegraded":"2023-01-02T18:17:38.450494+0000","last_fullsized":"2023-01-02T18:17:38.450494+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458858+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:17:38.458858+0000","last_peered":"2023-01-02T18:17:38.458858+0000","last_clean":"2023-01-02T18:17:38.458858+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:17:38.458858+0000","last_undegraded":"2023-01-02T18:17:38.458858+0000","last_fullsized":"2023-01-02T18:17:38.458858+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449658+0000","last_change":"2023-01-02T18:17:38.449658+0000","last_active":"2023-01-02T18:17:38.449658+0000","last_peered":"2023-01-02T18:17:38.449658+0000","last_clean":"2023-01-02T18:17:38.449658+0000","last_became_active":"2023-01-02T18:17:36.450509+0000","last_became_peered":"2023-01-02T18:17:36.450509+0000","last_unstale":"2023-01-02T18:17:38.449658+0000","last_undegraded":"2023-01-02T18:17:38.449658+0000","last_fullsized":"2023-01-02T18:17:38.449658+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.3","version":"101'31","reported_seq":122,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.327086+0000","last_change":"2023-01-02T18:17:34.318218+0000","last_active":"2023-01-02T18:17:39.327086+0000","last_peered":"2023-01-02T18:17:39.327086+0000","last_clean":"2023-01-02T18:17:39.327086+0000","last_became_active":"2023-01-02T18:17:32.342244+0000","last_became_peered":"2023-01-02T18:17:32.342244+0000","last_unstale":"2023-01-02T18:17:39.327086+0000","last_undegraded":"2023-01-02T18:17:39.327086+0000","last_fullsized":"2023-01-02T18:17:39.327086+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":99,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.457958+0000","last_change":"2023-01-02T18:17:09.330500+0000","last_active":"2023-01-02T18:17:38.457958+0000","last_peered":"2023-01-02T18:17:38.457958+0000","last_clean":"2023-01-02T18:17:38.457958+0000","last_became_active":"2023-01-02T18:17:07.345902+0000","last_became_peered":"2023-01-02T18:17:07.345902+0000","last_unstale":"2023-01-02T18:17:38.457958+0000","last_undegraded":"2023-01-02T18:17:38.457958+0000","last_fullsized":"2023-01-02T18:17:38.457958+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.467294+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:17:38.467294+0000","last_peered":"2023-01-02T18:17:38.467294+0000","last_clean":"2023-01-02T18:17:38.467294+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:17:38.467294+0000","last_undegraded":"2023-01-02T18:17:38.467294+0000","last_fullsized":"2023-01-02T18:17:38.467294+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468623+0000","last_change":"2023-01-02T18:16:48.329052+0000","last_active":"2023-01-02T18:17:38.468623+0000","last_peered":"2023-01-02T18:17:38.468623+0000","last_clean":"2023-01-02T18:17:38.468623+0000","last_became_active":"2023-01-02T18:16:48.327662+0000","last_became_peered":"2023-01-02T18:16:48.327662+0000","last_unstale":"2023-01-02T18:17:38.468623+0000","last_undegraded":"2023-01-02T18:17:38.468623+0000","last_fullsized":"2023-01-02T18:17:38.468623+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'4","reported_seq":144,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.340605+0000","last_change":"2023-01-02T18:17:30.503114+0000","last_active":"2023-01-02T18:17:39.340605+0000","last_peered":"2023-01-02T18:17:39.340605+0000","last_clean":"2023-01-02T18:17:39.340605+0000","last_became_active":"2023-01-02T18:16:48.329461+0000","last_became_peered":"2023-01-02T18:16:48.329461+0000","last_unstale":"2023-01-02T18:17:39.340605+0000","last_undegraded":"2023-01-02T18:17:39.340605+0000","last_fullsized":"2023-01-02T18:17:39.340605+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444600+0000","last_change":"2023-01-02T18:16:49.323150+0000","last_active":"2023-01-02T18:17:38.444600+0000","last_peered":"2023-01-02T18:17:38.444600+0000","last_clean":"2023-01-02T18:17:38.444600+0000","last_became_active":"2023-01-02T18:16:48.326635+0000","last_became_peered":"2023-01-02T18:16:48.326635+0000","last_unstale":"2023-01-02T18:17:38.444600+0000","last_undegraded":"2023-01-02T18:17:38.444600+0000","last_fullsized":"2023-01-02T18:17:38.444600+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.451249+0000","last_change":"2023-01-02T18:16:53.345223+0000","last_active":"2023-01-02T18:17:38.451249+0000","last_peered":"2023-01-02T18:17:38.451249+0000","last_clean":"2023-01-02T18:17:38.451249+0000","last_became_active":"2023-01-02T18:16:51.341580+0000","last_became_peered":"2023-01-02T18:16:51.341580+0000","last_unstale":"2023-01-02T18:17:38.451249+0000","last_undegraded":"2023-01-02T18:17:38.451249+0000","last_fullsized":"2023-01-02T18:17:38.451249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.542855+0000","last_change":"2023-01-02T18:17:29.325884+0000","last_active":"2023-01-02T18:17:38.542855+0000","last_peered":"2023-01-02T18:17:38.542855+0000","last_clean":"2023-01-02T18:17:38.542855+0000","last_became_active":"2023-01-02T18:17:29.325539+0000","last_became_peered":"2023-01-02T18:17:29.325539+0000","last_unstale":"2023-01-02T18:17:38.542855+0000","last_undegraded":"2023-01-02T18:17:38.542855+0000","last_fullsized":"2023-01-02T18:17:38.542855+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"105'7","reported_seq":28,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.316528+0000","last_change":"2023-01-02T18:17:38.459018+0000","last_active":"2023-01-02T18:17:39.316528+0000","last_peered":"2023-01-02T18:17:39.316528+0000","last_clean":"2023-01-02T18:17:39.316528+0000","last_became_active":"2023-01-02T18:17:36.442139+0000","last_became_peered":"2023-01-02T18:17:36.442139+0000","last_unstale":"2023-01-02T18:17:39.316528+0000","last_undegraded":"2023-01-02T18:17:39.316528+0000","last_fullsized":"2023-01-02T18:17:39.316528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.2","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.311518+0000","last_change":"2023-01-02T18:17:34.332222+0000","last_active":"2023-01-02T18:17:39.311518+0000","last_peered":"2023-01-02T18:17:39.311518+0000","last_clean":"2023-01-02T18:17:39.311518+0000","last_became_active":"2023-01-02T18:17:32.337498+0000","last_became_peered":"2023-01-02T18:17:32.337498+0000","last_unstale":"2023-01-02T18:17:39.311518+0000","last_undegraded":"2023-01-02T18:17:39.311518+0000","last_fullsized":"2023-01-02T18:17:39.311518+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448330+0000","last_change":"2023-01-02T18:17:09.307789+0000","last_active":"2023-01-02T18:17:38.448330+0000","last_peered":"2023-01-02T18:17:38.448330+0000","last_clean":"2023-01-02T18:17:38.448330+0000","last_became_active":"2023-01-02T18:17:07.345090+0000","last_became_peered":"2023-01-02T18:17:07.345090+0000","last_unstale":"2023-01-02T18:17:38.448330+0000","last_undegraded":"2023-01-02T18:17:38.448330+0000","last_fullsized":"2023-01-02T18:17:38.448330+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"72'11","reported_seq":116,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448100+0000","last_change":"2023-01-02T18:17:29.350765+0000","last_active":"2023-01-02T18:17:38.448100+0000","last_peered":"2023-01-02T18:17:38.448100+0000","last_clean":"2023-01-02T18:17:38.448100+0000","last_became_active":"2023-01-02T18:17:29.334376+0000","last_became_peered":"2023-01-02T18:17:29.334376+0000","last_unstale":"2023-01-02T18:17:38.448100+0000","last_undegraded":"2023-01-02T18:17:38.448100+0000","last_fullsized":"2023-01-02T18:17:38.448100+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":64,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":63,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450558+0000","last_change":"2023-01-02T18:16:48.328829+0000","last_active":"2023-01-02T18:17:38.450558+0000","last_peered":"2023-01-02T18:17:38.450558+0000","last_clean":"2023-01-02T18:17:38.450558+0000","last_became_active":"2023-01-02T18:16:48.328372+0000","last_became_peered":"2023-01-02T18:16:48.328372+0000","last_unstale":"2023-01-02T18:17:38.450558+0000","last_undegraded":"2023-01-02T18:17:38.450558+0000","last_fullsized":"2023-01-02T18:17:38.450558+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":129,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.331706+0000","last_change":"2023-01-02T18:17:30.434777+0000","last_active":"2023-01-02T18:17:39.331706+0000","last_peered":"2023-01-02T18:17:39.331706+0000","last_clean":"2023-01-02T18:17:39.331706+0000","last_became_active":"2023-01-02T18:16:37.415896+0000","last_became_peered":"2023-01-02T18:16:37.415896+0000","last_unstale":"2023-01-02T18:17:39.331706+0000","last_undegraded":"2023-01-02T18:17:39.331706+0000","last_fullsized":"2023-01-02T18:17:39.331706+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'3","reported_seq":69,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463384+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:17:38.463384+0000","last_peered":"2023-01-02T18:17:38.463384+0000","last_clean":"2023-01-02T18:17:38.463384+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:17:38.463384+0000","last_undegraded":"2023-01-02T18:17:38.463384+0000","last_fullsized":"2023-01-02T18:17:38.463384+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468510+0000","last_change":"2023-01-02T18:16:53.344544+0000","last_active":"2023-01-02T18:17:38.468510+0000","last_peered":"2023-01-02T18:17:38.468510+0000","last_clean":"2023-01-02T18:17:38.468510+0000","last_became_active":"2023-01-02T18:16:51.339073+0000","last_became_peered":"2023-01-02T18:16:51.339073+0000","last_unstale":"2023-01-02T18:17:38.468510+0000","last_undegraded":"2023-01-02T18:17:38.468510+0000","last_fullsized":"2023-01-02T18:17:38.468510+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":152,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445259+0000","last_change":"2023-01-02T18:16:57.307483+0000","last_active":"2023-01-02T18:17:38.445259+0000","last_peered":"2023-01-02T18:17:38.445259+0000","last_clean":"2023-01-02T18:17:38.445259+0000","last_became_active":"2023-01-02T18:16:55.316680+0000","last_became_peered":"2023-01-02T18:16:55.316680+0000","last_unstale":"2023-01-02T18:17:38.445259+0000","last_undegraded":"2023-01-02T18:17:38.445259+0000","last_fullsized":"2023-01-02T18:17:38.445259+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463731+0000","last_change":"2023-01-02T18:17:38.463731+0000","last_active":"2023-01-02T18:17:38.463731+0000","last_peered":"2023-01-02T18:17:38.463731+0000","last_clean":"2023-01-02T18:17:38.463731+0000","last_became_active":"2023-01-02T18:17:36.444543+0000","last_became_peered":"2023-01-02T18:17:36.444543+0000","last_unstale":"2023-01-02T18:17:38.463731+0000","last_undegraded":"2023-01-02T18:17:38.463731+0000","last_fullsized":"2023-01-02T18:17:38.463731+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.5","version":"101'2","reported_seq":34,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.314306+0000","last_change":"2023-01-02T18:17:34.316134+0000","last_active":"2023-01-02T18:17:39.314306+0000","last_peered":"2023-01-02T18:17:39.314306+0000","last_clean":"2023-01-02T18:17:39.314306+0000","last_became_active":"2023-01-02T18:17:32.340596+0000","last_became_peered":"2023-01-02T18:17:32.340596+0000","last_unstale":"2023-01-02T18:17:39.314306+0000","last_undegraded":"2023-01-02T18:17:39.314306+0000","last_fullsized":"2023-01-02T18:17:39.314306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446677+0000","last_change":"2023-01-02T18:17:29.323882+0000","last_active":"2023-01-02T18:17:38.446677+0000","last_peered":"2023-01-02T18:17:38.446677+0000","last_clean":"2023-01-02T18:17:38.446677+0000","last_became_active":"2023-01-02T18:17:29.323226+0000","last_became_peered":"2023-01-02T18:17:29.323226+0000","last_unstale":"2023-01-02T18:17:38.446677+0000","last_undegraded":"2023-01-02T18:17:38.446677+0000","last_fullsized":"2023-01-02T18:17:38.446677+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450966+0000","last_change":"2023-01-02T18:17:01.310439+0000","last_active":"2023-01-02T18:17:38.450966+0000","last_peered":"2023-01-02T18:17:38.450966+0000","last_clean":"2023-01-02T18:17:38.450966+0000","last_became_active":"2023-01-02T18:16:59.315925+0000","last_became_peered":"2023-01-02T18:16:59.315925+0000","last_unstale":"2023-01-02T18:17:38.450966+0000","last_undegraded":"2023-01-02T18:17:38.450966+0000","last_fullsized":"2023-01-02T18:17:38.450966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444988+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:17:38.444988+0000","last_peered":"2023-01-02T18:17:38.444988+0000","last_clean":"2023-01-02T18:17:38.444988+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:17:38.444988+0000","last_undegraded":"2023-01-02T18:17:38.444988+0000","last_fullsized":"2023-01-02T18:17:38.444988+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'5","reported_seq":33,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.327619+0000","last_change":"2023-01-02T18:17:30.331199+0000","last_active":"2023-01-02T18:17:39.327619+0000","last_peered":"2023-01-02T18:17:39.327619+0000","last_clean":"2023-01-02T18:17:39.327619+0000","last_became_active":"2023-01-02T18:17:29.337008+0000","last_became_peered":"2023-01-02T18:17:29.337008+0000","last_unstale":"2023-01-02T18:17:39.327619+0000","last_undegraded":"2023-01-02T18:17:39.327619+0000","last_fullsized":"2023-01-02T18:17:39.327619+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449226+0000","last_change":"2023-01-02T18:16:49.309370+0000","last_active":"2023-01-02T18:17:38.449226+0000","last_peered":"2023-01-02T18:17:38.449226+0000","last_clean":"2023-01-02T18:17:38.449226+0000","last_became_active":"2023-01-02T18:16:48.323683+0000","last_became_peered":"2023-01-02T18:16:48.323683+0000","last_unstale":"2023-01-02T18:17:38.449226+0000","last_undegraded":"2023-01-02T18:17:38.449226+0000","last_fullsized":"2023-01-02T18:17:38.449226+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462394+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:17:38.462394+0000","last_peered":"2023-01-02T18:17:38.462394+0000","last_clean":"2023-01-02T18:17:38.462394+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:17:38.462394+0000","last_undegraded":"2023-01-02T18:17:38.462394+0000","last_fullsized":"2023-01-02T18:17:38.462394+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462291+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:17:38.462291+0000","last_peered":"2023-01-02T18:17:38.462291+0000","last_clean":"2023-01-02T18:17:38.462291+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:17:38.462291+0000","last_undegraded":"2023-01-02T18:17:38.462291+0000","last_fullsized":"2023-01-02T18:17:38.462291+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.5","version":"106'3","reported_seq":29,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.342901+0000","last_change":"2023-01-02T18:17:38.464795+0000","last_active":"2023-01-02T18:17:39.342901+0000","last_peered":"2023-01-02T18:17:39.342901+0000","last_clean":"2023-01-02T18:17:39.342901+0000","last_became_active":"2023-01-02T18:17:36.442539+0000","last_became_peered":"2023-01-02T18:17:36.442539+0000","last_unstale":"2023-01-02T18:17:39.342901+0000","last_undegraded":"2023-01-02T18:17:39.342901+0000","last_fullsized":"2023-01-02T18:17:39.342901+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.4","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.314188+0000","last_change":"2023-01-02T18:17:34.316365+0000","last_active":"2023-01-02T18:17:39.314188+0000","last_peered":"2023-01-02T18:17:39.314188+0000","last_clean":"2023-01-02T18:17:39.314188+0000","last_became_active":"2023-01-02T18:17:32.336309+0000","last_became_peered":"2023-01-02T18:17:32.336309+0000","last_unstale":"2023-01-02T18:17:39.314188+0000","last_undegraded":"2023-01-02T18:17:39.314188+0000","last_fullsized":"2023-01-02T18:17:39.314188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.447395+0000","last_change":"2023-01-02T18:17:29.333481+0000","last_active":"2023-01-02T18:17:38.447395+0000","last_peered":"2023-01-02T18:17:38.447395+0000","last_clean":"2023-01-02T18:17:38.447395+0000","last_became_active":"2023-01-02T18:17:29.333173+0000","last_became_peered":"2023-01-02T18:17:29.333173+0000","last_unstale":"2023-01-02T18:17:38.447395+0000","last_undegraded":"2023-01-02T18:17:38.447395+0000","last_fullsized":"2023-01-02T18:17:38.447395+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445465+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:17:38.445465+0000","last_peered":"2023-01-02T18:17:38.445465+0000","last_clean":"2023-01-02T18:17:38.445465+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:17:38.445465+0000","last_undegraded":"2023-01-02T18:17:38.445465+0000","last_fullsized":"2023-01-02T18:17:38.445465+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458085+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:17:38.458085+0000","last_peered":"2023-01-02T18:17:38.458085+0000","last_clean":"2023-01-02T18:17:38.458085+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:17:38.458085+0000","last_undegraded":"2023-01-02T18:17:38.458085+0000","last_fullsized":"2023-01-02T18:17:38.458085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"46'4","reported_seq":155,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.319348+0000","last_change":"2023-01-02T18:17:30.335368+0000","last_active":"2023-01-02T18:17:39.319348+0000","last_peered":"2023-01-02T18:17:39.319348+0000","last_clean":"2023-01-02T18:17:39.319348+0000","last_became_active":"2023-01-02T18:17:29.341233+0000","last_became_peered":"2023-01-02T18:17:29.341233+0000","last_unstale":"2023-01-02T18:17:39.319348+0000","last_undegraded":"2023-01-02T18:17:39.319348+0000","last_fullsized":"2023-01-02T18:17:39.319348+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"56'8","reported_seq":77,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.541827+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:17:38.541827+0000","last_peered":"2023-01-02T18:17:38.541827+0000","last_clean":"2023-01-02T18:17:38.541827+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:17:38.541827+0000","last_undegraded":"2023-01-02T18:17:38.541827+0000","last_fullsized":"2023-01-02T18:17:38.541827+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462395+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:17:38.462395+0000","last_peered":"2023-01-02T18:17:38.462395+0000","last_clean":"2023-01-02T18:17:38.462395+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:17:38.462395+0000","last_undegraded":"2023-01-02T18:17:38.462395+0000","last_fullsized":"2023-01-02T18:17:38.462395+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":58,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444082+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:17:38.444082+0000","last_peered":"2023-01-02T18:17:38.444082+0000","last_clean":"2023-01-02T18:17:38.444082+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:17:38.444082+0000","last_undegraded":"2023-01-02T18:17:38.444082+0000","last_fullsized":"2023-01-02T18:17:38.444082+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"105'1","reported_seq":16,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.539819+0000","last_change":"2023-01-02T18:17:38.446055+0000","last_active":"2023-01-02T18:17:38.539819+0000","last_peered":"2023-01-02T18:17:38.539819+0000","last_clean":"2023-01-02T18:17:38.539819+0000","last_became_active":"2023-01-02T18:17:36.428938+0000","last_became_peered":"2023-01-02T18:17:36.428938+0000","last_unstale":"2023-01-02T18:17:38.539819+0000","last_undegraded":"2023-01-02T18:17:38.539819+0000","last_fullsized":"2023-01-02T18:17:38.539819+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.7","version":"101'8","reported_seq":43,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.340115+0000","last_change":"2023-01-02T18:17:34.327745+0000","last_active":"2023-01-02T18:17:39.340115+0000","last_peered":"2023-01-02T18:17:39.340115+0000","last_clean":"2023-01-02T18:17:39.340115+0000","last_became_active":"2023-01-02T18:17:32.347316+0000","last_became_peered":"2023-01-02T18:17:32.347316+0000","last_unstale":"2023-01-02T18:17:39.340115+0000","last_undegraded":"2023-01-02T18:17:39.340115+0000","last_fullsized":"2023-01-02T18:17:39.340115+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468183+0000","last_change":"2023-01-02T18:17:09.308354+0000","last_active":"2023-01-02T18:17:38.468183+0000","last_peered":"2023-01-02T18:17:38.468183+0000","last_clean":"2023-01-02T18:17:38.468183+0000","last_became_active":"2023-01-02T18:17:07.339211+0000","last_became_peered":"2023-01-02T18:17:07.339211+0000","last_unstale":"2023-01-02T18:17:38.468183+0000","last_undegraded":"2023-01-02T18:17:38.468183+0000","last_fullsized":"2023-01-02T18:17:38.468183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"71'2","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458542+0000","last_change":"2023-01-02T18:17:01.317443+0000","last_active":"2023-01-02T18:17:38.458542+0000","last_peered":"2023-01-02T18:17:38.458542+0000","last_clean":"2023-01-02T18:17:38.458542+0000","last_became_active":"2023-01-02T18:16:59.311550+0000","last_became_peered":"2023-01-02T18:16:59.311550+0000","last_unstale":"2023-01-02T18:17:38.458542+0000","last_undegraded":"2023-01-02T18:17:38.458542+0000","last_fullsized":"2023-01-02T18:17:38.458542+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"51'3","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448946+0000","last_change":"2023-01-02T18:16:48.345208+0000","last_active":"2023-01-02T18:17:38.448946+0000","last_peered":"2023-01-02T18:17:38.448946+0000","last_clean":"2023-01-02T18:17:38.448946+0000","last_became_active":"2023-01-02T18:16:48.327080+0000","last_became_peered":"2023-01-02T18:16:48.327080+0000","last_unstale":"2023-01-02T18:17:38.448946+0000","last_undegraded":"2023-01-02T18:17:38.448946+0000","last_fullsized":"2023-01-02T18:17:38.448946+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":160,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.319430+0000","last_change":"2023-01-02T18:17:30.335149+0000","last_active":"2023-01-02T18:17:39.319430+0000","last_peered":"2023-01-02T18:17:39.319430+0000","last_clean":"2023-01-02T18:17:39.319430+0000","last_became_active":"2023-01-02T18:16:48.327374+0000","last_became_peered":"2023-01-02T18:16:48.327374+0000","last_unstale":"2023-01-02T18:17:39.319430+0000","last_undegraded":"2023-01-02T18:17:39.319430+0000","last_fullsized":"2023-01-02T18:17:39.319430+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.443520+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:17:38.443520+0000","last_peered":"2023-01-02T18:17:38.443520+0000","last_clean":"2023-01-02T18:17:38.443520+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:17:38.443520+0000","last_undegraded":"2023-01-02T18:17:38.443520+0000","last_fullsized":"2023-01-02T18:17:38.443520+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449467+0000","last_change":"2023-01-02T18:16:53.342610+0000","last_active":"2023-01-02T18:17:38.449467+0000","last_peered":"2023-01-02T18:17:38.449467+0000","last_clean":"2023-01-02T18:17:38.449467+0000","last_became_active":"2023-01-02T18:16:51.341683+0000","last_became_peered":"2023-01-02T18:16:51.341683+0000","last_unstale":"2023-01-02T18:17:38.449467+0000","last_undegraded":"2023-01-02T18:17:38.449467+0000","last_fullsized":"2023-01-02T18:17:38.449467+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448825+0000","last_change":"2023-01-02T18:16:57.312289+0000","last_active":"2023-01-02T18:17:38.448825+0000","last_peered":"2023-01-02T18:17:38.448825+0000","last_clean":"2023-01-02T18:17:38.448825+0000","last_became_active":"2023-01-02T18:16:55.317023+0000","last_became_peered":"2023-01-02T18:16:55.317023+0000","last_unstale":"2023-01-02T18:17:38.448825+0000","last_undegraded":"2023-01-02T18:17:38.448825+0000","last_fullsized":"2023-01-02T18:17:38.448825+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"105'15","reported_seq":73,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.536761+0000","last_change":"2023-01-02T18:17:38.447587+0000","last_active":"2023-01-02T18:17:38.536761+0000","last_peered":"2023-01-02T18:17:38.536761+0000","last_clean":"2023-01-02T18:17:38.536761+0000","last_became_active":"2023-01-02T18:17:36.439633+0000","last_became_peered":"2023-01-02T18:17:36.439633+0000","last_unstale":"2023-01-02T18:17:38.536761+0000","last_undegraded":"2023-01-02T18:17:38.536761+0000","last_fullsized":"2023-01-02T18:17:38.536761+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.6","version":"101'19","reported_seq":94,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.327713+0000","last_change":"2023-01-02T18:17:34.318618+0000","last_active":"2023-01-02T18:17:39.327713+0000","last_peered":"2023-01-02T18:17:39.327713+0000","last_clean":"2023-01-02T18:17:39.327713+0000","last_became_active":"2023-01-02T18:17:32.337685+0000","last_became_peered":"2023-01-02T18:17:32.337685+0000","last_unstale":"2023-01-02T18:17:39.327713+0000","last_undegraded":"2023-01-02T18:17:39.327713+0000","last_fullsized":"2023-01-02T18:17:39.327713+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446569+0000","last_change":"2023-01-02T18:17:29.329576+0000","last_active":"2023-01-02T18:17:38.446569+0000","last_peered":"2023-01-02T18:17:38.446569+0000","last_clean":"2023-01-02T18:17:38.446569+0000","last_became_active":"2023-01-02T18:17:29.328074+0000","last_became_peered":"2023-01-02T18:17:29.328074+0000","last_unstale":"2023-01-02T18:17:38.446569+0000","last_undegraded":"2023-01-02T18:17:38.446569+0000","last_fullsized":"2023-01-02T18:17:38.446569+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"72'10","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446230+0000","last_change":"2023-01-02T18:17:29.331966+0000","last_active":"2023-01-02T18:17:38.446230+0000","last_peered":"2023-01-02T18:17:38.446230+0000","last_clean":"2023-01-02T18:17:38.446230+0000","last_became_active":"2023-01-02T18:17:29.322773+0000","last_became_peered":"2023-01-02T18:17:29.322773+0000","last_unstale":"2023-01-02T18:17:38.446230+0000","last_undegraded":"2023-01-02T18:17:38.446230+0000","last_fullsized":"2023-01-02T18:17:38.446230+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"51'1","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444858+0000","last_change":"2023-01-02T18:17:29.334624+0000","last_active":"2023-01-02T18:17:38.444858+0000","last_peered":"2023-01-02T18:17:38.444858+0000","last_clean":"2023-01-02T18:17:38.444858+0000","last_became_active":"2023-01-02T18:17:29.332434+0000","last_became_peered":"2023-01-02T18:17:29.332434+0000","last_unstale":"2023-01-02T18:17:38.444858+0000","last_undegraded":"2023-01-02T18:17:38.444858+0000","last_fullsized":"2023-01-02T18:17:38.444858+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"82'14","reported_seq":199,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.319657+0000","last_change":"2023-01-02T18:17:30.335393+0000","last_active":"2023-01-02T18:17:39.319657+0000","last_peered":"2023-01-02T18:17:39.319657+0000","last_clean":"2023-01-02T18:17:39.319657+0000","last_became_active":"2023-01-02T18:16:48.324242+0000","last_became_peered":"2023-01-02T18:16:48.324242+0000","last_unstale":"2023-01-02T18:17:39.319657+0000","last_undegraded":"2023-01-02T18:17:39.319657+0000","last_fullsized":"2023-01-02T18:17:39.319657+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":122,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":46,"num_keys_recovered":8,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462612+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:17:38.462612+0000","last_peered":"2023-01-02T18:17:38.462612+0000","last_clean":"2023-01-02T18:17:38.462612+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:38.462612+0000","last_undegraded":"2023-01-02T18:17:38.462612+0000","last_fullsized":"2023-01-02T18:17:38.462612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444984+0000","last_change":"2023-01-02T18:17:29.335316+0000","last_active":"2023-01-02T18:17:38.444984+0000","last_peered":"2023-01-02T18:17:38.444984+0000","last_clean":"2023-01-02T18:17:38.444984+0000","last_became_active":"2023-01-02T18:17:29.333739+0000","last_became_peered":"2023-01-02T18:17:29.333739+0000","last_unstale":"2023-01-02T18:17:38.444984+0000","last_undegraded":"2023-01-02T18:17:38.444984+0000","last_fullsized":"2023-01-02T18:17:38.444984+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468049+0000","last_change":"2023-01-02T18:17:29.319062+0000","last_active":"2023-01-02T18:17:38.468049+0000","last_peered":"2023-01-02T18:17:38.468049+0000","last_clean":"2023-01-02T18:17:38.468049+0000","last_became_active":"2023-01-02T18:17:29.318747+0000","last_became_peered":"2023-01-02T18:17:29.318747+0000","last_unstale":"2023-01-02T18:17:38.468049+0000","last_undegraded":"2023-01-02T18:17:38.468049+0000","last_fullsized":"2023-01-02T18:17:38.468049+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.460254+0000","last_change":"2023-01-02T18:17:38.460254+0000","last_active":"2023-01-02T18:17:38.460254+0000","last_peered":"2023-01-02T18:17:38.460254+0000","last_clean":"2023-01-02T18:17:38.460254+0000","last_became_active":"2023-01-02T18:17:36.446522+0000","last_became_peered":"2023-01-02T18:17:36.446522+0000","last_unstale":"2023-01-02T18:17:38.460254+0000","last_undegraded":"2023-01-02T18:17:38.460254+0000","last_fullsized":"2023-01-02T18:17:38.460254+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.19","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.311220+0000","last_change":"2023-01-02T18:17:34.331749+0000","last_active":"2023-01-02T18:17:39.311220+0000","last_peered":"2023-01-02T18:17:39.311220+0000","last_clean":"2023-01-02T18:17:39.311220+0000","last_became_active":"2023-01-02T18:17:32.337737+0000","last_became_peered":"2023-01-02T18:17:32.337737+0000","last_unstale":"2023-01-02T18:17:39.311220+0000","last_undegraded":"2023-01-02T18:17:39.311220+0000","last_fullsized":"2023-01-02T18:17:39.311220+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"76'3","reported_seq":130,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448580+0000","last_change":"2023-01-02T18:17:09.308112+0000","last_active":"2023-01-02T18:17:38.448580+0000","last_peered":"2023-01-02T18:17:38.448580+0000","last_clean":"2023-01-02T18:17:38.448580+0000","last_became_active":"2023-01-02T18:17:07.336295+0000","last_became_peered":"2023-01-02T18:17:07.336295+0000","last_unstale":"2023-01-02T18:17:38.448580+0000","last_undegraded":"2023-01-02T18:17:38.448580+0000","last_fullsized":"2023-01-02T18:17:38.448580+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":80,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'85","reported_seq":712,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458461+0000","last_change":"2023-01-02T18:17:01.316472+0000","last_active":"2023-01-02T18:17:38.458461+0000","last_peered":"2023-01-02T18:17:38.458461+0000","last_clean":"2023-01-02T18:17:38.458461+0000","last_became_active":"2023-01-02T18:16:59.310142+0000","last_became_peered":"2023-01-02T18:16:59.310142+0000","last_unstale":"2023-01-02T18:17:38.458461+0000","last_undegraded":"2023-01-02T18:17:38.458461+0000","last_fullsized":"2023-01-02T18:17:38.458461+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1544,"num_read_kb":1398,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.451339+0000","last_change":"2023-01-02T18:16:44.308280+0000","last_active":"2023-01-02T18:17:38.451339+0000","last_peered":"2023-01-02T18:17:38.451339+0000","last_clean":"2023-01-02T18:17:38.451339+0000","last_became_active":"2023-01-02T18:16:41.446391+0000","last_became_peered":"2023-01-02T18:16:41.446391+0000","last_unstale":"2023-01-02T18:17:38.451339+0000","last_undegraded":"2023-01-02T18:17:38.451339+0000","last_fullsized":"2023-01-02T18:17:38.451339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"80'15","reported_seq":193,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.339434+0000","last_change":"2023-01-02T18:17:30.502618+0000","last_active":"2023-01-02T18:17:39.339434+0000","last_peered":"2023-01-02T18:17:39.339434+0000","last_clean":"2023-01-02T18:17:39.339434+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:17:39.339434+0000","last_undegraded":"2023-01-02T18:17:39.339434+0000","last_fullsized":"2023-01-02T18:17:39.339434+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":151,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446875+0000","last_change":"2023-01-02T18:17:29.337167+0000","last_active":"2023-01-02T18:17:38.446875+0000","last_peered":"2023-01-02T18:17:38.446875+0000","last_clean":"2023-01-02T18:17:38.446875+0000","last_became_active":"2023-01-02T18:17:29.335412+0000","last_became_peered":"2023-01-02T18:17:29.335412+0000","last_unstale":"2023-01-02T18:17:38.446875+0000","last_undegraded":"2023-01-02T18:17:38.446875+0000","last_fullsized":"2023-01-02T18:17:38.446875+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464110+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:17:38.464110+0000","last_peered":"2023-01-02T18:17:38.464110+0000","last_clean":"2023-01-02T18:17:38.464110+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:17:38.464110+0000","last_undegraded":"2023-01-02T18:17:38.464110+0000","last_fullsized":"2023-01-02T18:17:38.464110+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":62,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450152+0000","last_change":"2023-01-02T18:16:57.313875+0000","last_active":"2023-01-02T18:17:38.450152+0000","last_peered":"2023-01-02T18:17:38.450152+0000","last_clean":"2023-01-02T18:17:38.450152+0000","last_became_active":"2023-01-02T18:16:55.318719+0000","last_became_peered":"2023-01-02T18:16:55.318719+0000","last_unstale":"2023-01-02T18:17:38.450152+0000","last_undegraded":"2023-01-02T18:17:38.450152+0000","last_fullsized":"2023-01-02T18:17:38.450152+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444327+0000","last_change":"2023-01-02T18:17:38.444327+0000","last_active":"2023-01-02T18:17:38.444327+0000","last_peered":"2023-01-02T18:17:38.444327+0000","last_clean":"2023-01-02T18:17:38.444327+0000","last_became_active":"2023-01-02T18:17:36.443020+0000","last_became_peered":"2023-01-02T18:17:36.443020+0000","last_unstale":"2023-01-02T18:17:38.444327+0000","last_undegraded":"2023-01-02T18:17:38.444327+0000","last_fullsized":"2023-01-02T18:17:38.444327+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.18","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.349648+0000","last_change":"2023-01-02T18:17:34.343511+0000","last_active":"2023-01-02T18:17:39.349648+0000","last_peered":"2023-01-02T18:17:39.349648+0000","last_clean":"2023-01-02T18:17:39.349648+0000","last_became_active":"2023-01-02T18:17:32.340038+0000","last_became_peered":"2023-01-02T18:17:32.340038+0000","last_unstale":"2023-01-02T18:17:39.349648+0000","last_undegraded":"2023-01-02T18:17:39.349648+0000","last_fullsized":"2023-01-02T18:17:39.349648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448711+0000","last_change":"2023-01-02T18:17:09.307476+0000","last_active":"2023-01-02T18:17:38.448711+0000","last_peered":"2023-01-02T18:17:38.448711+0000","last_clean":"2023-01-02T18:17:38.448711+0000","last_became_active":"2023-01-02T18:17:07.336526+0000","last_became_peered":"2023-01-02T18:17:07.336526+0000","last_unstale":"2023-01-02T18:17:38.448711+0000","last_undegraded":"2023-01-02T18:17:38.448711+0000","last_fullsized":"2023-01-02T18:17:38.448711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"68'2","reported_seq":160,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458843+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:17:38.458843+0000","last_peered":"2023-01-02T18:17:38.458843+0000","last_clean":"2023-01-02T18:17:38.458843+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:17:38.458843+0000","last_undegraded":"2023-01-02T18:17:38.458843+0000","last_fullsized":"2023-01-02T18:17:38.458843+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450273+0000","last_change":"2023-01-02T18:16:44.307606+0000","last_active":"2023-01-02T18:17:38.450273+0000","last_peered":"2023-01-02T18:17:38.450273+0000","last_clean":"2023-01-02T18:17:38.450273+0000","last_became_active":"2023-01-02T18:16:41.449266+0000","last_became_peered":"2023-01-02T18:16:41.449266+0000","last_unstale":"2023-01-02T18:17:38.450273+0000","last_undegraded":"2023-01-02T18:17:38.450273+0000","last_fullsized":"2023-01-02T18:17:38.450273+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":139,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.317922+0000","last_change":"2023-01-02T18:17:30.333872+0000","last_active":"2023-01-02T18:17:39.317922+0000","last_peered":"2023-01-02T18:17:39.317922+0000","last_clean":"2023-01-02T18:17:39.317922+0000","last_became_active":"2023-01-02T18:16:48.329249+0000","last_became_peered":"2023-01-02T18:16:48.329249+0000","last_unstale":"2023-01-02T18:17:39.317922+0000","last_undegraded":"2023-01-02T18:17:39.317922+0000","last_fullsized":"2023-01-02T18:17:39.317922+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.451455+0000","last_change":"2023-01-02T18:16:49.311129+0000","last_active":"2023-01-02T18:17:38.451455+0000","last_peered":"2023-01-02T18:17:38.451455+0000","last_clean":"2023-01-02T18:17:38.451455+0000","last_became_active":"2023-01-02T18:16:46.312301+0000","last_became_peered":"2023-01-02T18:16:46.312301+0000","last_unstale":"2023-01-02T18:17:38.451455+0000","last_undegraded":"2023-01-02T18:17:38.451455+0000","last_fullsized":"2023-01-02T18:17:38.451455+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.542441+0000","last_change":"2023-01-02T18:16:53.350359+0000","last_active":"2023-01-02T18:17:38.542441+0000","last_peered":"2023-01-02T18:17:38.542441+0000","last_clean":"2023-01-02T18:17:38.542441+0000","last_became_active":"2023-01-02T18:16:51.338043+0000","last_became_peered":"2023-01-02T18:16:51.338043+0000","last_unstale":"2023-01-02T18:17:38.542441+0000","last_undegraded":"2023-01-02T18:17:38.542441+0000","last_fullsized":"2023-01-02T18:17:38.542441+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":62,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463392+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:17:38.463392+0000","last_peered":"2023-01-02T18:17:38.463392+0000","last_clean":"2023-01-02T18:17:38.463392+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:17:38.463392+0000","last_undegraded":"2023-01-02T18:17:38.463392+0000","last_fullsized":"2023-01-02T18:17:38.463392+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"105'3","reported_seq":27,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.326982+0000","last_change":"2023-01-02T18:17:38.449366+0000","last_active":"2023-01-02T18:17:39.326982+0000","last_peered":"2023-01-02T18:17:39.326982+0000","last_clean":"2023-01-02T18:17:39.326982+0000","last_became_active":"2023-01-02T18:17:36.440502+0000","last_became_peered":"2023-01-02T18:17:36.440502+0000","last_unstale":"2023-01-02T18:17:39.326982+0000","last_undegraded":"2023-01-02T18:17:39.326982+0000","last_fullsized":"2023-01-02T18:17:39.326982+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.1b","version":"101'2","reported_seq":34,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.331298+0000","last_change":"2023-01-02T18:17:34.347105+0000","last_active":"2023-01-02T18:17:39.331298+0000","last_peered":"2023-01-02T18:17:39.331298+0000","last_clean":"2023-01-02T18:17:39.331298+0000","last_became_active":"2023-01-02T18:17:32.344891+0000","last_became_peered":"2023-01-02T18:17:32.344891+0000","last_unstale":"2023-01-02T18:17:39.331298+0000","last_undegraded":"2023-01-02T18:17:39.331298+0000","last_fullsized":"2023-01-02T18:17:39.331298+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.457820+0000","last_change":"2023-01-02T18:17:09.330482+0000","last_active":"2023-01-02T18:17:38.457820+0000","last_peered":"2023-01-02T18:17:38.457820+0000","last_clean":"2023-01-02T18:17:38.457820+0000","last_became_active":"2023-01-02T18:17:07.344261+0000","last_became_peered":"2023-01-02T18:17:07.344261+0000","last_unstale":"2023-01-02T18:17:38.457820+0000","last_undegraded":"2023-01-02T18:17:38.457820+0000","last_fullsized":"2023-01-02T18:17:38.457820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"68'4","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445104+0000","last_change":"2023-01-02T18:17:29.353714+0000","last_active":"2023-01-02T18:17:38.445104+0000","last_peered":"2023-01-02T18:17:38.445104+0000","last_clean":"2023-01-02T18:17:38.445104+0000","last_became_active":"2023-01-02T18:17:29.325542+0000","last_became_peered":"2023-01-02T18:17:29.325542+0000","last_unstale":"2023-01-02T18:17:38.445104+0000","last_undegraded":"2023-01-02T18:17:38.445104+0000","last_fullsized":"2023-01-02T18:17:38.445104+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446424+0000","last_change":"2023-01-02T18:17:29.335193+0000","last_active":"2023-01-02T18:17:38.446424+0000","last_peered":"2023-01-02T18:17:38.446424+0000","last_clean":"2023-01-02T18:17:38.446424+0000","last_became_active":"2023-01-02T18:17:29.334681+0000","last_became_peered":"2023-01-02T18:17:29.334681+0000","last_unstale":"2023-01-02T18:17:38.446424+0000","last_undegraded":"2023-01-02T18:17:38.446424+0000","last_fullsized":"2023-01-02T18:17:38.446424+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":119,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.317857+0000","last_change":"2023-01-02T18:17:30.333125+0000","last_active":"2023-01-02T18:17:39.317857+0000","last_peered":"2023-01-02T18:17:39.317857+0000","last_clean":"2023-01-02T18:17:39.317857+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:17:39.317857+0000","last_undegraded":"2023-01-02T18:17:39.317857+0000","last_fullsized":"2023-01-02T18:17:39.317857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450350+0000","last_change":"2023-01-02T18:16:49.310391+0000","last_active":"2023-01-02T18:17:38.450350+0000","last_peered":"2023-01-02T18:17:38.450350+0000","last_clean":"2023-01-02T18:17:38.450350+0000","last_became_active":"2023-01-02T18:16:46.316328+0000","last_became_peered":"2023-01-02T18:16:46.316328+0000","last_unstale":"2023-01-02T18:17:38.450350+0000","last_undegraded":"2023-01-02T18:17:38.450350+0000","last_fullsized":"2023-01-02T18:17:38.450350+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.447203+0000","last_change":"2023-01-02T18:17:29.324721+0000","last_active":"2023-01-02T18:17:38.447203+0000","last_peered":"2023-01-02T18:17:38.447203+0000","last_clean":"2023-01-02T18:17:38.447203+0000","last_became_active":"2023-01-02T18:17:29.323897+0000","last_became_peered":"2023-01-02T18:17:29.323897+0000","last_unstale":"2023-01-02T18:17:38.447203+0000","last_undegraded":"2023-01-02T18:17:38.447203+0000","last_fullsized":"2023-01-02T18:17:38.447203+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445539+0000","last_change":"2023-01-02T18:16:57.306845+0000","last_active":"2023-01-02T18:17:38.445539+0000","last_peered":"2023-01-02T18:17:38.445539+0000","last_clean":"2023-01-02T18:17:38.445539+0000","last_became_active":"2023-01-02T18:16:55.318612+0000","last_became_peered":"2023-01-02T18:16:55.318612+0000","last_unstale":"2023-01-02T18:17:38.445539+0000","last_undegraded":"2023-01-02T18:17:38.445539+0000","last_fullsized":"2023-01-02T18:17:38.445539+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463630+0000","last_change":"2023-01-02T18:17:38.463630+0000","last_active":"2023-01-02T18:17:38.463630+0000","last_peered":"2023-01-02T18:17:38.463630+0000","last_clean":"2023-01-02T18:17:38.463630+0000","last_became_active":"2023-01-02T18:17:36.449160+0000","last_became_peered":"2023-01-02T18:17:36.449160+0000","last_unstale":"2023-01-02T18:17:38.463630+0000","last_undegraded":"2023-01-02T18:17:38.463630+0000","last_fullsized":"2023-01-02T18:17:38.463630+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.1a","version":"101'8","reported_seq":56,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.338797+0000","last_change":"2023-01-02T18:17:34.325778+0000","last_active":"2023-01-02T18:17:39.338797+0000","last_peered":"2023-01-02T18:17:39.338797+0000","last_clean":"2023-01-02T18:17:39.338797+0000","last_became_active":"2023-01-02T18:17:32.340683+0000","last_became_peered":"2023-01-02T18:17:32.340683+0000","last_unstale":"2023-01-02T18:17:39.338797+0000","last_undegraded":"2023-01-02T18:17:39.338797+0000","last_fullsized":"2023-01-02T18:17:39.338797+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448267+0000","last_change":"2023-01-02T18:17:09.307508+0000","last_active":"2023-01-02T18:17:38.448267+0000","last_peered":"2023-01-02T18:17:38.448267+0000","last_clean":"2023-01-02T18:17:38.448267+0000","last_became_active":"2023-01-02T18:17:07.344914+0000","last_became_peered":"2023-01-02T18:17:07.344914+0000","last_unstale":"2023-01-02T18:17:38.448267+0000","last_undegraded":"2023-01-02T18:17:38.448267+0000","last_fullsized":"2023-01-02T18:17:38.448267+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"69'1","reported_seq":70,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448036+0000","last_change":"2023-01-02T18:17:29.365036+0000","last_active":"2023-01-02T18:17:38.448036+0000","last_peered":"2023-01-02T18:17:38.448036+0000","last_clean":"2023-01-02T18:17:38.448036+0000","last_became_active":"2023-01-02T18:17:29.334847+0000","last_became_peered":"2023-01-02T18:17:29.334847+0000","last_unstale":"2023-01-02T18:17:38.448036+0000","last_undegraded":"2023-01-02T18:17:38.448036+0000","last_fullsized":"2023-01-02T18:17:38.448036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450313+0000","last_change":"2023-01-02T18:16:44.307239+0000","last_active":"2023-01-02T18:17:38.450313+0000","last_peered":"2023-01-02T18:17:38.450313+0000","last_clean":"2023-01-02T18:17:38.450313+0000","last_became_active":"2023-01-02T18:16:41.447671+0000","last_became_peered":"2023-01-02T18:16:41.447671+0000","last_unstale":"2023-01-02T18:17:38.450313+0000","last_undegraded":"2023-01-02T18:17:38.450313+0000","last_fullsized":"2023-01-02T18:17:38.450313+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'20","reported_seq":220,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.319020+0000","last_change":"2023-01-02T18:17:30.334708+0000","last_active":"2023-01-02T18:17:39.319020+0000","last_peered":"2023-01-02T18:17:39.319020+0000","last_clean":"2023-01-02T18:17:39.319020+0000","last_became_active":"2023-01-02T18:16:48.322940+0000","last_became_peered":"2023-01-02T18:16:48.322940+0000","last_unstale":"2023-01-02T18:17:39.319020+0000","last_undegraded":"2023-01-02T18:17:39.319020+0000","last_fullsized":"2023-01-02T18:17:39.319020+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":200,"num_write":27,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446182+0000","last_change":"2023-01-02T18:17:29.329761+0000","last_active":"2023-01-02T18:17:38.446182+0000","last_peered":"2023-01-02T18:17:38.446182+0000","last_clean":"2023-01-02T18:17:38.446182+0000","last_became_active":"2023-01-02T18:17:29.327470+0000","last_became_peered":"2023-01-02T18:17:29.327470+0000","last_unstale":"2023-01-02T18:17:38.446182+0000","last_undegraded":"2023-01-02T18:17:38.446182+0000","last_fullsized":"2023-01-02T18:17:38.446182+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464099+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:17:38.464099+0000","last_peered":"2023-01-02T18:17:38.464099+0000","last_clean":"2023-01-02T18:17:38.464099+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:17:38.464099+0000","last_undegraded":"2023-01-02T18:17:38.464099+0000","last_fullsized":"2023-01-02T18:17:38.464099+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":65,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464941+0000","last_change":"2023-01-02T18:17:29.340931+0000","last_active":"2023-01-02T18:17:38.464941+0000","last_peered":"2023-01-02T18:17:38.464941+0000","last_clean":"2023-01-02T18:17:38.464941+0000","last_became_active":"2023-01-02T18:17:29.340602+0000","last_became_peered":"2023-01-02T18:17:29.340602+0000","last_unstale":"2023-01-02T18:17:38.464941+0000","last_undegraded":"2023-01-02T18:17:38.464941+0000","last_fullsized":"2023-01-02T18:17:38.464941+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"105'11","reported_seq":32,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.547933+0000","last_change":"2023-01-02T18:17:38.460374+0000","last_active":"2023-01-02T18:17:38.547933+0000","last_peered":"2023-01-02T18:17:38.547933+0000","last_clean":"2023-01-02T18:17:38.547933+0000","last_became_active":"2023-01-02T18:17:36.443934+0000","last_became_peered":"2023-01-02T18:17:36.443934+0000","last_unstale":"2023-01-02T18:17:38.547933+0000","last_undegraded":"2023-01-02T18:17:38.547933+0000","last_fullsized":"2023-01-02T18:17:38.547933+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.1d","version":"101'8","reported_seq":43,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.340003+0000","last_change":"2023-01-02T18:17:34.327085+0000","last_active":"2023-01-02T18:17:39.340003+0000","last_peered":"2023-01-02T18:17:39.340003+0000","last_clean":"2023-01-02T18:17:39.340003+0000","last_became_active":"2023-01-02T18:17:32.343328+0000","last_became_peered":"2023-01-02T18:17:32.343328+0000","last_unstale":"2023-01-02T18:17:39.340003+0000","last_undegraded":"2023-01-02T18:17:39.340003+0000","last_fullsized":"2023-01-02T18:17:39.340003+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445231+0000","last_change":"2023-01-02T18:17:09.325339+0000","last_active":"2023-01-02T18:17:38.445231+0000","last_peered":"2023-01-02T18:17:38.445231+0000","last_clean":"2023-01-02T18:17:38.445231+0000","last_became_active":"2023-01-02T18:17:07.341155+0000","last_became_peered":"2023-01-02T18:17:07.341155+0000","last_unstale":"2023-01-02T18:17:38.445231+0000","last_undegraded":"2023-01-02T18:17:38.445231+0000","last_fullsized":"2023-01-02T18:17:38.445231+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":73,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445097+0000","last_change":"2023-01-02T18:17:29.343403+0000","last_active":"2023-01-02T18:17:38.445097+0000","last_peered":"2023-01-02T18:17:38.445097+0000","last_clean":"2023-01-02T18:17:38.445097+0000","last_became_active":"2023-01-02T18:17:29.320060+0000","last_became_peered":"2023-01-02T18:17:29.320060+0000","last_unstale":"2023-01-02T18:17:38.445097+0000","last_undegraded":"2023-01-02T18:17:38.445097+0000","last_fullsized":"2023-01-02T18:17:38.445097+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":63,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458601+0000","last_change":"2023-01-02T18:16:48.329830+0000","last_active":"2023-01-02T18:17:38.458601+0000","last_peered":"2023-01-02T18:17:38.458601+0000","last_clean":"2023-01-02T18:17:38.458601+0000","last_became_active":"2023-01-02T18:16:48.329469+0000","last_became_peered":"2023-01-02T18:16:48.329469+0000","last_unstale":"2023-01-02T18:17:38.458601+0000","last_undegraded":"2023-01-02T18:17:38.458601+0000","last_fullsized":"2023-01-02T18:17:38.458601+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":120,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.318330+0000","last_change":"2023-01-02T18:17:30.334813+0000","last_active":"2023-01-02T18:17:39.318330+0000","last_peered":"2023-01-02T18:17:39.318330+0000","last_clean":"2023-01-02T18:17:39.318330+0000","last_became_active":"2023-01-02T18:16:48.326351+0000","last_became_peered":"2023-01-02T18:16:48.326351+0000","last_unstale":"2023-01-02T18:17:39.318330+0000","last_undegraded":"2023-01-02T18:17:39.318330+0000","last_fullsized":"2023-01-02T18:17:39.318330+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445492+0000","last_change":"2023-01-02T18:17:29.333748+0000","last_active":"2023-01-02T18:17:38.445492+0000","last_peered":"2023-01-02T18:17:38.445492+0000","last_clean":"2023-01-02T18:17:38.445492+0000","last_became_active":"2023-01-02T18:17:29.330002+0000","last_became_peered":"2023-01-02T18:17:29.330002+0000","last_unstale":"2023-01-02T18:17:38.445492+0000","last_undegraded":"2023-01-02T18:17:38.445492+0000","last_fullsized":"2023-01-02T18:17:38.445492+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448380+0000","last_change":"2023-01-02T18:16:53.342357+0000","last_active":"2023-01-02T18:17:38.448380+0000","last_peered":"2023-01-02T18:17:38.448380+0000","last_clean":"2023-01-02T18:17:38.448380+0000","last_became_active":"2023-01-02T18:16:51.341254+0000","last_became_peered":"2023-01-02T18:16:51.341254+0000","last_unstale":"2023-01-02T18:17:38.448380+0000","last_undegraded":"2023-01-02T18:17:38.448380+0000","last_fullsized":"2023-01-02T18:17:38.448380+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":14,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.541075+0000","last_change":"2023-01-02T18:17:36.438593+0000","last_active":"2023-01-02T18:17:38.541075+0000","last_peered":"2023-01-02T18:17:38.541075+0000","last_clean":"2023-01-02T18:17:38.541075+0000","last_became_active":"2023-01-02T18:17:36.438305+0000","last_became_peered":"2023-01-02T18:17:36.438305+0000","last_unstale":"2023-01-02T18:17:38.541075+0000","last_undegraded":"2023-01-02T18:17:38.541075+0000","last_fullsized":"2023-01-02T18:17:38.541075+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464600+0000","last_change":"2023-01-02T18:17:38.464600+0000","last_active":"2023-01-02T18:17:38.464600+0000","last_peered":"2023-01-02T18:17:38.464600+0000","last_clean":"2023-01-02T18:17:38.464600+0000","last_became_active":"2023-01-02T18:17:36.445763+0000","last_became_peered":"2023-01-02T18:17:36.445763+0000","last_unstale":"2023-01-02T18:17:38.464600+0000","last_undegraded":"2023-01-02T18:17:38.464600+0000","last_fullsized":"2023-01-02T18:17:38.464600+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.1c","version":"101'10","reported_seq":54,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.339671+0000","last_change":"2023-01-02T18:17:34.326274+0000","last_active":"2023-01-02T18:17:39.339671+0000","last_peered":"2023-01-02T18:17:39.339671+0000","last_clean":"2023-01-02T18:17:39.339671+0000","last_became_active":"2023-01-02T18:17:32.339630+0000","last_became_peered":"2023-01-02T18:17:32.339630+0000","last_unstale":"2023-01-02T18:17:39.339671+0000","last_undegraded":"2023-01-02T18:17:39.339671+0000","last_fullsized":"2023-01-02T18:17:39.339671+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468902+0000","last_change":"2023-01-02T18:17:09.308664+0000","last_active":"2023-01-02T18:17:38.468902+0000","last_peered":"2023-01-02T18:17:38.468902+0000","last_clean":"2023-01-02T18:17:38.468902+0000","last_became_active":"2023-01-02T18:17:07.344272+0000","last_became_peered":"2023-01-02T18:17:07.344272+0000","last_unstale":"2023-01-02T18:17:38.468902+0000","last_undegraded":"2023-01-02T18:17:38.468902+0000","last_fullsized":"2023-01-02T18:17:38.468902+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450168+0000","last_change":"2023-01-02T18:17:01.311474+0000","last_active":"2023-01-02T18:17:38.450168+0000","last_peered":"2023-01-02T18:17:38.450168+0000","last_clean":"2023-01-02T18:17:38.450168+0000","last_became_active":"2023-01-02T18:16:59.314245+0000","last_became_peered":"2023-01-02T18:16:59.314245+0000","last_unstale":"2023-01-02T18:17:38.450168+0000","last_undegraded":"2023-01-02T18:17:38.450168+0000","last_fullsized":"2023-01-02T18:17:38.450168+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":79,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458726+0000","last_change":"2023-01-02T18:17:36.450119+0000","last_active":"2023-01-02T18:17:38.458726+0000","last_peered":"2023-01-02T18:17:38.458726+0000","last_clean":"2023-01-02T18:17:38.458726+0000","last_became_active":"2023-01-02T18:17:36.449798+0000","last_became_peered":"2023-01-02T18:17:36.449798+0000","last_unstale":"2023-01-02T18:17:38.458726+0000","last_undegraded":"2023-01-02T18:17:38.458726+0000","last_fullsized":"2023-01-02T18:17:38.458726+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"86'18","reported_seq":212,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.319037+0000","last_change":"2023-01-02T18:17:30.335050+0000","last_active":"2023-01-02T18:17:39.319037+0000","last_peered":"2023-01-02T18:17:39.319037+0000","last_clean":"2023-01-02T18:17:39.319037+0000","last_became_active":"2023-01-02T18:16:37.436152+0000","last_became_peered":"2023-01-02T18:16:37.436152+0000","last_unstale":"2023-01-02T18:17:39.319037+0000","last_undegraded":"2023-01-02T18:17:39.319037+0000","last_fullsized":"2023-01-02T18:17:39.319037+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":192,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449307+0000","last_change":"2023-01-02T18:16:49.309763+0000","last_active":"2023-01-02T18:17:38.449307+0000","last_peered":"2023-01-02T18:17:38.449307+0000","last_clean":"2023-01-02T18:17:38.449307+0000","last_became_active":"2023-01-02T18:16:46.308336+0000","last_became_peered":"2023-01-02T18:16:46.308336+0000","last_unstale":"2023-01-02T18:17:38.449307+0000","last_undegraded":"2023-01-02T18:17:38.449307+0000","last_fullsized":"2023-01-02T18:17:38.449307+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":69,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.443718+0000","last_change":"2023-01-02T18:17:29.320574+0000","last_active":"2023-01-02T18:17:38.443718+0000","last_peered":"2023-01-02T18:17:38.443718+0000","last_clean":"2023-01-02T18:17:38.443718+0000","last_became_active":"2023-01-02T18:17:29.320274+0000","last_became_peered":"2023-01-02T18:17:29.320274+0000","last_unstale":"2023-01-02T18:17:38.443718+0000","last_undegraded":"2023-01-02T18:17:38.443718+0000","last_fullsized":"2023-01-02T18:17:38.443718+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462393+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:17:38.462393+0000","last_peered":"2023-01-02T18:17:38.462393+0000","last_clean":"2023-01-02T18:17:38.462393+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:17:38.462393+0000","last_undegraded":"2023-01-02T18:17:38.462393+0000","last_fullsized":"2023-01-02T18:17:38.462393+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.464884+0000","last_change":"2023-01-02T18:17:38.464884+0000","last_active":"2023-01-02T18:17:38.464884+0000","last_peered":"2023-01-02T18:17:38.464884+0000","last_clean":"2023-01-02T18:17:38.464884+0000","last_became_active":"2023-01-02T18:17:36.445153+0000","last_became_peered":"2023-01-02T18:17:36.445153+0000","last_unstale":"2023-01-02T18:17:38.464884+0000","last_undegraded":"2023-01-02T18:17:38.464884+0000","last_fullsized":"2023-01-02T18:17:38.464884+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.1f","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.319423+0000","last_change":"2023-01-02T18:17:34.343843+0000","last_active":"2023-01-02T18:17:39.319423+0000","last_peered":"2023-01-02T18:17:39.319423+0000","last_clean":"2023-01-02T18:17:39.319423+0000","last_became_active":"2023-01-02T18:17:32.344716+0000","last_became_peered":"2023-01-02T18:17:32.344716+0000","last_unstale":"2023-01-02T18:17:39.319423+0000","last_undegraded":"2023-01-02T18:17:39.319423+0000","last_fullsized":"2023-01-02T18:17:39.319423+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"76'3","reported_seq":54,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.468079+0000","last_change":"2023-01-02T18:17:09.308316+0000","last_active":"2023-01-02T18:17:38.468079+0000","last_peered":"2023-01-02T18:17:38.468079+0000","last_clean":"2023-01-02T18:17:38.468079+0000","last_became_active":"2023-01-02T18:17:07.339700+0000","last_became_peered":"2023-01-02T18:17:07.339700+0000","last_unstale":"2023-01-02T18:17:38.468079+0000","last_undegraded":"2023-01-02T18:17:38.468079+0000","last_fullsized":"2023-01-02T18:17:38.468079+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":59,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445144+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:17:38.445144+0000","last_peered":"2023-01-02T18:17:38.445144+0000","last_clean":"2023-01-02T18:17:38.445144+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:17:38.445144+0000","last_undegraded":"2023-01-02T18:17:38.445144+0000","last_fullsized":"2023-01-02T18:17:38.445144+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448907+0000","last_change":"2023-01-02T18:16:44.306989+0000","last_active":"2023-01-02T18:17:38.448907+0000","last_peered":"2023-01-02T18:17:38.448907+0000","last_clean":"2023-01-02T18:17:38.448907+0000","last_became_active":"2023-01-02T18:16:41.448619+0000","last_became_peered":"2023-01-02T18:16:41.448619+0000","last_unstale":"2023-01-02T18:17:38.448907+0000","last_undegraded":"2023-01-02T18:17:38.448907+0000","last_fullsized":"2023-01-02T18:17:38.448907+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"46'1","reported_seq":33,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.327992+0000","last_change":"2023-01-02T18:17:30.331472+0000","last_active":"2023-01-02T18:17:39.327992+0000","last_peered":"2023-01-02T18:17:39.327992+0000","last_clean":"2023-01-02T18:17:39.327992+0000","last_became_active":"2023-01-02T18:17:29.333176+0000","last_became_peered":"2023-01-02T18:17:29.333176+0000","last_unstale":"2023-01-02T18:17:39.327992+0000","last_undegraded":"2023-01-02T18:17:39.327992+0000","last_fullsized":"2023-01-02T18:17:39.327992+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":74,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462376+0000","last_change":"2023-01-02T18:16:49.304745+0000","last_active":"2023-01-02T18:17:38.462376+0000","last_peered":"2023-01-02T18:17:38.462376+0000","last_clean":"2023-01-02T18:17:38.462376+0000","last_became_active":"2023-01-02T18:16:48.325920+0000","last_became_peered":"2023-01-02T18:16:48.325920+0000","last_unstale":"2023-01-02T18:17:38.462376+0000","last_undegraded":"2023-01-02T18:17:38.462376+0000","last_fullsized":"2023-01-02T18:17:38.462376+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":62,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449762+0000","last_change":"2023-01-02T18:16:53.342417+0000","last_active":"2023-01-02T18:17:38.449762+0000","last_peered":"2023-01-02T18:17:38.449762+0000","last_clean":"2023-01-02T18:17:38.449762+0000","last_became_active":"2023-01-02T18:16:51.341971+0000","last_became_peered":"2023-01-02T18:16:51.341971+0000","last_unstale":"2023-01-02T18:17:38.449762+0000","last_undegraded":"2023-01-02T18:17:38.449762+0000","last_fullsized":"2023-01-02T18:17:38.449762+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.457850+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:17:38.457850+0000","last_peered":"2023-01-02T18:17:38.457850+0000","last_clean":"2023-01-02T18:17:38.457850+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:17:38.457850+0000","last_undegraded":"2023-01-02T18:17:38.457850+0000","last_fullsized":"2023-01-02T18:17:38.457850+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.451111+0000","last_change":"2023-01-02T18:17:38.451111+0000","last_active":"2023-01-02T18:17:38.451111+0000","last_peered":"2023-01-02T18:17:38.451111+0000","last_clean":"2023-01-02T18:17:38.451111+0000","last_became_active":"2023-01-02T18:17:36.442712+0000","last_became_peered":"2023-01-02T18:17:36.442712+0000","last_unstale":"2023-01-02T18:17:38.451111+0000","last_undegraded":"2023-01-02T18:17:38.451111+0000","last_fullsized":"2023-01-02T18:17:38.451111+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.1e","version":"101'8","reported_seq":43,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.315622+0000","last_change":"2023-01-02T18:17:34.316857+0000","last_active":"2023-01-02T18:17:39.315622+0000","last_peered":"2023-01-02T18:17:39.315622+0000","last_clean":"2023-01-02T18:17:39.315622+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:17:39.315622+0000","last_undegraded":"2023-01-02T18:17:39.315622+0000","last_fullsized":"2023-01-02T18:17:39.315622+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445033+0000","last_change":"2023-01-02T18:17:29.320212+0000","last_active":"2023-01-02T18:17:38.445033+0000","last_peered":"2023-01-02T18:17:38.445033+0000","last_clean":"2023-01-02T18:17:38.445033+0000","last_became_active":"2023-01-02T18:17:29.319459+0000","last_became_peered":"2023-01-02T18:17:29.319459+0000","last_unstale":"2023-01-02T18:17:38.445033+0000","last_undegraded":"2023-01-02T18:17:38.445033+0000","last_fullsized":"2023-01-02T18:17:38.445033+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"71'6","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446018+0000","last_change":"2023-01-02T18:17:29.380260+0000","last_active":"2023-01-02T18:17:38.446018+0000","last_peered":"2023-01-02T18:17:38.446018+0000","last_clean":"2023-01-02T18:17:38.446018+0000","last_became_active":"2023-01-02T18:17:29.334697+0000","last_became_peered":"2023-01-02T18:17:29.334697+0000","last_unstale":"2023-01-02T18:17:38.446018+0000","last_undegraded":"2023-01-02T18:17:38.446018+0000","last_fullsized":"2023-01-02T18:17:38.446018+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.449090+0000","last_change":"2023-01-02T18:16:44.306689+0000","last_active":"2023-01-02T18:17:38.449090+0000","last_peered":"2023-01-02T18:17:38.449090+0000","last_clean":"2023-01-02T18:17:38.449090+0000","last_became_active":"2023-01-02T18:16:41.448162+0000","last_became_peered":"2023-01-02T18:16:41.448162+0000","last_unstale":"2023-01-02T18:17:38.449090+0000","last_undegraded":"2023-01-02T18:17:38.449090+0000","last_fullsized":"2023-01-02T18:17:38.449090+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":33,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.328944+0000","last_change":"2023-01-02T18:17:30.331763+0000","last_active":"2023-01-02T18:17:39.328944+0000","last_peered":"2023-01-02T18:17:39.328944+0000","last_clean":"2023-01-02T18:17:39.328944+0000","last_became_active":"2023-01-02T18:17:29.327892+0000","last_became_peered":"2023-01-02T18:17:29.327892+0000","last_unstale":"2023-01-02T18:17:39.328944+0000","last_undegraded":"2023-01-02T18:17:39.328944+0000","last_fullsized":"2023-01-02T18:17:39.328944+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":74,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458198+0000","last_change":"2023-01-02T18:16:49.318037+0000","last_active":"2023-01-02T18:17:38.458198+0000","last_peered":"2023-01-02T18:17:38.458198+0000","last_clean":"2023-01-02T18:17:38.458198+0000","last_became_active":"2023-01-02T18:16:48.330758+0000","last_became_peered":"2023-01-02T18:16:48.330758+0000","last_unstale":"2023-01-02T18:17:38.458198+0000","last_undegraded":"2023-01-02T18:17:38.458198+0000","last_fullsized":"2023-01-02T18:17:38.458198+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":159,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462611+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:17:38.462611+0000","last_peered":"2023-01-02T18:17:38.462611+0000","last_clean":"2023-01-02T18:17:38.462611+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:17:38.462611+0000","last_undegraded":"2023-01-02T18:17:38.462611+0000","last_fullsized":"2023-01-02T18:17:38.462611+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":57,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444431+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:17:38.444431+0000","last_peered":"2023-01-02T18:17:38.444431+0000","last_clean":"2023-01-02T18:17:38.444431+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:17:38.444431+0000","last_undegraded":"2023-01-02T18:17:38.444431+0000","last_fullsized":"2023-01-02T18:17:38.444431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.444061+0000","last_change":"2023-01-02T18:17:38.444061+0000","last_active":"2023-01-02T18:17:38.444061+0000","last_peered":"2023-01-02T18:17:38.444061+0000","last_clean":"2023-01-02T18:17:38.444061+0000","last_became_active":"2023-01-02T18:17:36.437329+0000","last_became_peered":"2023-01-02T18:17:36.437329+0000","last_unstale":"2023-01-02T18:17:38.444061+0000","last_undegraded":"2023-01-02T18:17:38.444061+0000","last_fullsized":"2023-01-02T18:17:38.444061+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.11","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.326493+0000","last_change":"2023-01-02T18:17:34.316239+0000","last_active":"2023-01-02T18:17:39.326493+0000","last_peered":"2023-01-02T18:17:39.326493+0000","last_clean":"2023-01-02T18:17:39.326493+0000","last_became_active":"2023-01-02T18:17:32.337541+0000","last_became_peered":"2023-01-02T18:17:32.337541+0000","last_unstale":"2023-01-02T18:17:39.326493+0000","last_undegraded":"2023-01-02T18:17:39.326493+0000","last_fullsized":"2023-01-02T18:17:39.326493+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445410+0000","last_change":"2023-01-02T18:17:29.332434+0000","last_active":"2023-01-02T18:17:38.445410+0000","last_peered":"2023-01-02T18:17:38.445410+0000","last_clean":"2023-01-02T18:17:38.445410+0000","last_became_active":"2023-01-02T18:17:29.329956+0000","last_became_peered":"2023-01-02T18:17:29.329956+0000","last_unstale":"2023-01-02T18:17:38.445410+0000","last_undegraded":"2023-01-02T18:17:38.445410+0000","last_fullsized":"2023-01-02T18:17:38.445410+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.448898+0000","last_change":"2023-01-02T18:17:01.311515+0000","last_active":"2023-01-02T18:17:38.448898+0000","last_peered":"2023-01-02T18:17:38.448898+0000","last_clean":"2023-01-02T18:17:38.448898+0000","last_became_active":"2023-01-02T18:16:59.322412+0000","last_became_peered":"2023-01-02T18:16:59.322412+0000","last_unstale":"2023-01-02T18:17:38.448898+0000","last_undegraded":"2023-01-02T18:17:38.448898+0000","last_fullsized":"2023-01-02T18:17:38.448898+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":80,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.460228+0000","last_change":"2023-01-02T18:17:29.338927+0000","last_active":"2023-01-02T18:17:38.460228+0000","last_peered":"2023-01-02T18:17:38.460228+0000","last_clean":"2023-01-02T18:17:38.460228+0000","last_became_active":"2023-01-02T18:17:29.338639+0000","last_became_peered":"2023-01-02T18:17:29.338639+0000","last_unstale":"2023-01-02T18:17:38.460228+0000","last_undegraded":"2023-01-02T18:17:38.460228+0000","last_fullsized":"2023-01-02T18:17:38.460228+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":158,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.331108+0000","last_change":"2023-01-02T18:17:30.433577+0000","last_active":"2023-01-02T18:17:39.331108+0000","last_peered":"2023-01-02T18:17:39.331108+0000","last_clean":"2023-01-02T18:17:39.331108+0000","last_became_active":"2023-01-02T18:16:37.415177+0000","last_became_peered":"2023-01-02T18:16:37.415177+0000","last_unstale":"2023-01-02T18:17:39.331108+0000","last_undegraded":"2023-01-02T18:17:39.331108+0000","last_fullsized":"2023-01-02T18:17:39.331108+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":66,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445805+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:17:38.445805+0000","last_peered":"2023-01-02T18:17:38.445805+0000","last_clean":"2023-01-02T18:17:38.445805+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:17:38.445805+0000","last_undegraded":"2023-01-02T18:17:38.445805+0000","last_fullsized":"2023-01-02T18:17:38.445805+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":19,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446645+0000","last_change":"2023-01-02T18:17:29.329770+0000","last_active":"2023-01-02T18:17:38.446645+0000","last_peered":"2023-01-02T18:17:38.446645+0000","last_clean":"2023-01-02T18:17:38.446645+0000","last_became_active":"2023-01-02T18:17:29.328232+0000","last_became_peered":"2023-01-02T18:17:29.328232+0000","last_unstale":"2023-01-02T18:17:38.446645+0000","last_undegraded":"2023-01-02T18:17:38.446645+0000","last_fullsized":"2023-01-02T18:17:38.446645+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.446134+0000","last_change":"2023-01-02T18:17:29.384506+0000","last_active":"2023-01-02T18:17:38.446134+0000","last_peered":"2023-01-02T18:17:38.446134+0000","last_clean":"2023-01-02T18:17:38.446134+0000","last_became_active":"2023-01-02T18:17:29.335526+0000","last_became_peered":"2023-01-02T18:17:29.335526+0000","last_unstale":"2023-01-02T18:17:38.446134+0000","last_undegraded":"2023-01-02T18:17:38.446134+0000","last_fullsized":"2023-01-02T18:17:38.446134+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450093+0000","last_change":"2023-01-02T18:17:38.450093+0000","last_active":"2023-01-02T18:17:38.450093+0000","last_peered":"2023-01-02T18:17:38.450093+0000","last_clean":"2023-01-02T18:17:38.450093+0000","last_became_active":"2023-01-02T18:17:36.449051+0000","last_became_peered":"2023-01-02T18:17:36.449051+0000","last_unstale":"2023-01-02T18:17:38.450093+0000","last_undegraded":"2023-01-02T18:17:38.450093+0000","last_fullsized":"2023-01-02T18:17:38.450093+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.10","version":"0'0","reported_seq":32,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.317133+0000","last_change":"2023-01-02T18:17:34.343018+0000","last_active":"2023-01-02T18:17:39.317133+0000","last_peered":"2023-01-02T18:17:39.317133+0000","last_clean":"2023-01-02T18:17:39.317133+0000","last_became_active":"2023-01-02T18:17:32.345232+0000","last_became_peered":"2023-01-02T18:17:32.345232+0000","last_unstale":"2023-01-02T18:17:39.317133+0000","last_undegraded":"2023-01-02T18:17:39.317133+0000","last_fullsized":"2023-01-02T18:17:39.317133+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463010+0000","last_change":"2023-01-02T18:17:09.323079+0000","last_active":"2023-01-02T18:17:38.463010+0000","last_peered":"2023-01-02T18:17:38.463010+0000","last_clean":"2023-01-02T18:17:38.463010+0000","last_became_active":"2023-01-02T18:17:07.344746+0000","last_became_peered":"2023-01-02T18:17:07.344746+0000","last_unstale":"2023-01-02T18:17:38.463010+0000","last_undegraded":"2023-01-02T18:17:38.463010+0000","last_fullsized":"2023-01-02T18:17:38.463010+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":53,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458554+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:17:38.458554+0000","last_peered":"2023-01-02T18:17:38.458554+0000","last_clean":"2023-01-02T18:17:38.458554+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:17:38.458554+0000","last_undegraded":"2023-01-02T18:17:38.458554+0000","last_fullsized":"2023-01-02T18:17:38.458554+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":14,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.458358+0000","last_change":"2023-01-02T18:17:36.446219+0000","last_active":"2023-01-02T18:17:38.458358+0000","last_peered":"2023-01-02T18:17:38.458358+0000","last_clean":"2023-01-02T18:17:38.458358+0000","last_became_active":"2023-01-02T18:17:36.445846+0000","last_became_peered":"2023-01-02T18:17:36.445846+0000","last_unstale":"2023-01-02T18:17:38.458358+0000","last_undegraded":"2023-01-02T18:17:38.458358+0000","last_fullsized":"2023-01-02T18:17:38.458358+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":71,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445657+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:17:38.445657+0000","last_peered":"2023-01-02T18:17:38.445657+0000","last_clean":"2023-01-02T18:17:38.445657+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:17:38.445657+0000","last_undegraded":"2023-01-02T18:17:38.445657+0000","last_fullsized":"2023-01-02T18:17:38.445657+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":139,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.311991+0000","last_change":"2023-01-02T18:17:30.330120+0000","last_active":"2023-01-02T18:17:39.311991+0000","last_peered":"2023-01-02T18:17:39.311991+0000","last_clean":"2023-01-02T18:17:39.311991+0000","last_became_active":"2023-01-02T18:16:37.416142+0000","last_became_peered":"2023-01-02T18:16:37.416142+0000","last_unstale":"2023-01-02T18:17:39.311991+0000","last_undegraded":"2023-01-02T18:17:39.311991+0000","last_fullsized":"2023-01-02T18:17:39.311991+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"56'15","reported_seq":132,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.460137+0000","last_change":"2023-01-02T18:16:49.319188+0000","last_active":"2023-01-02T18:17:38.460137+0000","last_peered":"2023-01-02T18:17:38.460137+0000","last_clean":"2023-01-02T18:17:38.460137+0000","last_became_active":"2023-01-02T18:16:48.329016+0000","last_became_peered":"2023-01-02T18:16:48.329016+0000","last_unstale":"2023-01-02T18:17:38.460137+0000","last_undegraded":"2023-01-02T18:17:38.460137+0000","last_fullsized":"2023-01-02T18:17:38.460137+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":179,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.463352+0000","last_change":"2023-01-02T18:17:29.354782+0000","last_active":"2023-01-02T18:17:38.463352+0000","last_peered":"2023-01-02T18:17:38.463352+0000","last_clean":"2023-01-02T18:17:38.463352+0000","last_became_active":"2023-01-02T18:17:29.340734+0000","last_became_peered":"2023-01-02T18:17:29.340734+0000","last_unstale":"2023-01-02T18:17:38.463352+0000","last_undegraded":"2023-01-02T18:17:38.463352+0000","last_fullsized":"2023-01-02T18:17:38.463352+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":84,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":15,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462825+0000","last_change":"2023-01-02T18:17:38.462825+0000","last_active":"2023-01-02T18:17:38.462825+0000","last_peered":"2023-01-02T18:17:38.462825+0000","last_clean":"2023-01-02T18:17:38.462825+0000","last_became_active":"2023-01-02T18:17:36.449207+0000","last_became_peered":"2023-01-02T18:17:36.449207+0000","last_unstale":"2023-01-02T18:17:38.462825+0000","last_undegraded":"2023-01-02T18:17:38.462825+0000","last_fullsized":"2023-01-02T18:17:38.462825+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"10.13","version":"101'2","reported_seq":34,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.318119+0000","last_change":"2023-01-02T18:17:34.343730+0000","last_active":"2023-01-02T18:17:39.318119+0000","last_peered":"2023-01-02T18:17:39.318119+0000","last_clean":"2023-01-02T18:17:39.318119+0000","last_became_active":"2023-01-02T18:17:32.346354+0000","last_became_peered":"2023-01-02T18:17:32.346354+0000","last_unstale":"2023-01-02T18:17:39.318119+0000","last_undegraded":"2023-01-02T18:17:39.318119+0000","last_fullsized":"2023-01-02T18:17:39.318119+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":45,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.462111+0000","last_change":"2023-01-02T18:17:09.322935+0000","last_active":"2023-01-02T18:17:38.462111+0000","last_peered":"2023-01-02T18:17:38.462111+0000","last_clean":"2023-01-02T18:17:38.462111+0000","last_became_active":"2023-01-02T18:17:07.346620+0000","last_became_peered":"2023-01-02T18:17:07.346620+0000","last_unstale":"2023-01-02T18:17:38.462111+0000","last_undegraded":"2023-01-02T18:17:38.462111+0000","last_fullsized":"2023-01-02T18:17:38.462111+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"72'4","reported_seq":23,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.445017+0000","last_change":"2023-01-02T18:17:29.382390+0000","last_active":"2023-01-02T18:17:38.445017+0000","last_peered":"2023-01-02T18:17:38.445017+0000","last_clean":"2023-01-02T18:17:38.445017+0000","last_became_active":"2023-01-02T18:17:29.335369+0000","last_became_peered":"2023-01-02T18:17:29.335369+0000","last_unstale":"2023-01-02T18:17:38.445017+0000","last_undegraded":"2023-01-02T18:17:38.445017+0000","last_fullsized":"2023-01-02T18:17:38.445017+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":31,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450388+0000","last_change":"2023-01-02T18:17:36.453145+0000","last_active":"2023-01-02T18:17:38.450388+0000","last_peered":"2023-01-02T18:17:38.450388+0000","last_clean":"2023-01-02T18:17:38.450388+0000","last_became_active":"2023-01-02T18:17:36.444734+0000","last_became_peered":"2023-01-02T18:17:36.444734+0000","last_unstale":"2023-01-02T18:17:38.450388+0000","last_undegraded":"2023-01-02T18:17:38.450388+0000","last_fullsized":"2023-01-02T18:17:38.450388+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":82,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450213+0000","last_change":"2023-01-02T18:16:44.308144+0000","last_active":"2023-01-02T18:17:38.450213+0000","last_peered":"2023-01-02T18:17:38.450213+0000","last_clean":"2023-01-02T18:17:38.450213+0000","last_became_active":"2023-01-02T18:16:41.446839+0000","last_became_peered":"2023-01-02T18:16:41.446839+0000","last_unstale":"2023-01-02T18:17:38.450213+0000","last_undegraded":"2023-01-02T18:17:38.450213+0000","last_fullsized":"2023-01-02T18:17:38.450213+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"84'5","reported_seq":184,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-01-02T18:17:39.311531+0000","last_change":"2023-01-02T18:17:30.325949+0000","last_active":"2023-01-02T18:17:39.311531+0000","last_peered":"2023-01-02T18:17:39.311531+0000","last_clean":"2023-01-02T18:17:39.311531+0000","last_became_active":"2023-01-02T18:16:48.329379+0000","last_became_peered":"2023-01-02T18:16:48.329379+0000","last_unstale":"2023-01-02T18:17:39.311531+0000","last_undegraded":"2023-01-02T18:17:39.311531+0000","last_fullsized":"2023-01-02T18:17:39.311531+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":79,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.450620+0000","last_change":"2023-01-02T18:16:49.310230+0000","last_active":"2023-01-02T18:17:38.450620+0000","last_peered":"2023-01-02T18:17:38.450620+0000","last_clean":"2023-01-02T18:17:38.450620+0000","last_became_active":"2023-01-02T18:16:48.324944+0000","last_became_peered":"2023-01-02T18:16:48.324944+0000","last_unstale":"2023-01-02T18:17:38.450620+0000","last_undegraded":"2023-01-02T18:17:38.450620+0000","last_fullsized":"2023-01-02T18:17:38.450620+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":61,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-01-02T18:17:38.451234+0000","last_change":"2023-01-02T18:16:53.345118+0000","last_active":"2023-01-02T18:17:38.451234+0000","last_peered":"2023-01-02T18:17:38.451234+0000","last_clean":"2023-01-02T18:17:38.451234+0000","last_became_active":"2023-01-02T18:16:51.341889+0000","last_became_peered":"2023-01-02T18:16:51.341889+0000","last_unstale":"2023-01-02T18:17:38.451234+0000","last_undegraded":"2023-01-02T18:17:38.451234+0000","last_fullsized":"2023-01-02T18:17:38.451234+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1048649,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":167,"num_read_kb":135,"num_write":36,"num_write_kb":1039,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2121728,"data_stored":2097298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":472,"num_read_kb":400,"num_write":105,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":64,"acting":64,"num_store_stats":7},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":171,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1456,"num_read_kb":1306,"num_write":98,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":465,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2428,"num_read_kb":2178,"num_write":146,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":293,"num_keys_recovered":250,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":7},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1498,"num_read_kb":1362,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":89,"num_keys_recovered":6,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1078,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1918,"num_read_kb":1551,"num_write":240,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":726,"num_keys_recovered":150,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":102,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":70,"num_keys_recovered":16,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":109,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1496,"num_read_kb":1361,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":70,"num_keys_recovered":162,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12432,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":11072,"kb_avail":94359408,"statfs":{"total":96636764160,"available":96624033792,"internally_reserved":0,"allocated":1384448,"data_stored":703319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11337728},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":1.6060000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.6559999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.45000000000000001,"15min":0.42899999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":1.7769999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.8580000000000001}]},{"osd":2,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":1.6859999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.706}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.7490000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.8100000000000001}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":1.8240000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.7949999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":1.766},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":1.8839999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.34499999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.9159999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.8360000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13528,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":11136,"kb_avail":94358312,"statfs":{"total":96636764160,"available":96622911488,"internally_reserved":0,"allocated":2441216,"data_stored":1761304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11403264},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.629},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.50600000000000001}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.55600000000000005}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.48599999999999999}]},{"osd":3,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.36499999999999999}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.433},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.41499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":91,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12432,"kb_used_data":1352,"kb_used_omap":0,"kb_used_meta":11072,"kb_avail":94359408,"statfs":{"total":96636764160,"available":96624033792,"internally_reserved":0,"allocated":1384448,"data_stored":703331,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11337728},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.24099999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.40300000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.31900000000000001}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.321,"5min":1.321,"15min":1.321},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.54000000000000004}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.505},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.495}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12316,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":10944,"kb_avail":94359524,"statfs":{"total":96636764160,"available":96624152576,"internally_reserved":0,"allocated":1396736,"data_stored":703440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11206656},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":2.1899999999999999,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.34899999999999998}]},{"osd":4,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.9330000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.50700000000000001}]},{"osd":6,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.438},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.51800000000000002}]},{"osd":7,"last update":"Mon Jan 2 18:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.54300000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7852,"kb_used_data":1316,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":94363988,"statfs":{"total":96636764160,"available":96628723712,"internally_reserved":0,"allocated":1347584,"data_stored":703055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.46600000000000003,"15min":0.49299999999999999},"min":{"1min":0.24399999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":2.665,"15min":2.665},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.44,"15min":0.45800000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42099999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.23899999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.498,"15min":0.52500000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.47799999999999998,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.214},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.45800000000000002,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.36499999999999999}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.443,"15min":0.45900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50600000000000001,"5min":1.359,"15min":1.359},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.46700000000000003,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.33400000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":2.601,"15min":2.601},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.58899999999999997}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":1.25,"15min":1.25},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.76300000000000001,"15min":0.79800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68899999999999995,"5min":2.637,"15min":2.637},"last":0.66700000000000004}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65900000000000003,"15min":0.67600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.69599999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81599999999999995,"5min":1.321,"15min":1.321},"last":0.65500000000000003}]},{"osd":7,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73899999999999999,"5min":1.478,"15min":1.478},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78800000000000003,"5min":1.286,"15min":1.286},"last":0.61499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12544,"kb_used_data":1400,"kb_used_omap":0,"kb_used_meta":11136,"kb_avail":94359296,"statfs":{"total":96636764160,"available":96623919104,"internally_reserved":0,"allocated":1433600,"data_stored":703738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11403264},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42199999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8740000000000001,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.377}]},{"osd":2,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.49399999999999999}]},{"osd":4,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.51500000000000001}]},{"osd":5,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.47299999999999998}]},{"osd":6,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.41599999999999998}]},{"osd":7,"last update":"Mon Jan 2 18:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.6359999999999999,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.502},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.9279999999999999,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.48499999999999999}]}]},{"osd":4,"up_from":0,"seq":55834574875,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7772,"kb_used_data":1364,"kb_used_omap":0,"kb_used_meta":6400,"kb_avail":94364068,"statfs":{"total":96636764160,"available":96628805632,"internally_reserved":0,"allocated":1396736,"data_stored":703435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6553600},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.62},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.48399999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.58299999999999996}]},{"osd":2,"last update":"Mon Jan 2 18:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.438}]},{"osd":3,"last update":"Mon Jan 2 18:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.54000000000000004}]},{"osd":4,"last update":"Mon Jan 2 18:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.28499999999999998}]},{"osd":6,"last update":"Mon Jan 2 18:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.41599999999999998}]},{"osd":7,"last update":"Mon Jan 2 18:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.31},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.33100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":83,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":50,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1056768,"data_stored":1048633,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1056768,"data_stored":1048630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:17:40.836 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:40.837+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:40.895 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:40.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.458446260999999, 2023-01-02T18:17:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:40.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:40.897 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:40.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:40.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:40.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:40.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:40.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:40.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:40.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:40.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:40.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:40.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:40.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:40.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:40.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:40.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:40.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:40.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:40.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:40.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:40.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:40.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:40.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:40.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:40.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:40.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:40.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:40.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:40.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:40.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:40.912 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.912 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.912 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.913 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:40.913 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:40.913 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.584906152000002, 2023-01-02T18:17:40.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:40.913 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.914 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.914 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:40.914 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:40.914 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:40.914 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:40.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.915 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:40.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:40.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:40.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:40.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:40.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:40.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:40.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:40.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:40.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:40.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:40.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:40.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:40.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:40.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:40.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:40.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:40.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:40.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:40.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:40.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:40.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:40.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:40.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:40.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:40.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:40.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:40.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:40.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:40.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:40.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:40.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:40.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:40.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.929 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.929 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:40.930 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:40.930 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.278946197000003, 2023-01-02T18:17:40.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:40.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.931 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:40.931 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:40.931 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:40.931 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:40.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.931 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:40.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:40.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:40.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:40.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:40.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:40.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:40.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:40.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:40.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:40.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:40.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:40.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:40.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:40.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:40.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:40.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:40.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:40.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:40.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:40.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:40.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:40.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:40.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:40.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:40.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:40.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:40.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:40.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:40.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:40.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:40.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:40.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:40.945 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.946 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.946 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.946 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:40.946 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:40.947 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.564474382999997, 2023-01-02T18:17:40.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:40.947 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.947 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.947 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:40.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:40.948 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:40.948 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:40.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.948 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:40.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:40.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:40.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:40.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:40.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:40.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:40.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:40.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:40.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:40.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:40.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:40.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:40.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:40.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:40.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:40.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:40.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:40.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:40.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:40.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:40.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:40.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:40.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:40.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:40.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:40.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:40.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:40.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:40.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:40.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:40.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:40.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:40.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:40.962 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.962 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.962 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.963 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:40.963 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:40.963 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.555372982000002, 2023-01-02T18:17:40.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:40.964 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:40.964 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:40.964 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:40.965 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:40.965 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:40.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.965 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:40.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:40.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:40.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:40.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:40.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:40.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:40.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:40.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:40.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:40.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:40.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:40.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:40.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:40.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:40.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:40.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:40.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:40.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:40.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:40.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.974 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.975 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:40.975 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:40.975 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.284016690000001, 2023-01-02T18:17:40.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:40.976 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.976 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:40.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:40.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:40.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:40.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:40.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.977 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:40.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:40.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:40.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:40.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:40.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:40.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:40.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:40.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:40.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:40.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:40.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:40.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:40.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:40.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:40.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:40.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:40.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:40.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:40.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:40.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:40.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.987 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:40.987 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:40.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.988 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2643 3.7 3:e026f164:::rbd_object_map.12a23fc13ef0.0000000000000004:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:17:40.988 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:40.988 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.279503162000001, 2023-01-02T18:17:40.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001, 2023-01-02T18:17:40.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:40.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:40.989 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:40.989 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:40.989 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:40.989 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2643 2023-01-02T18:17:40.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.990 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:40.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:40.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:40.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:40.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:40.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614792+0000", 2023-01-02T18:17:40.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:40.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:40.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614790+0000", 2023-01-02T18:17:40.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3409999999999992e-06 2023-01-02T18:17:40.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:40.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614799+0000", 2023-01-02T18:17:40.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0420000000000008e-06 2023-01-02T18:17:40.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:40.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614808+0000", 2023-01-02T18:17:40.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1370000000000001e-06 2023-01-02T18:17:40.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:40.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614814+0000", 2023-01-02T18:17:40.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064692000000000005 2023-01-02T18:17:40.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:40.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615460+0000", 2023-01-02T18:17:40.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012489599999999999 2023-01-02T18:17:40.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:40.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615585+0000", 2023-01-02T18:17:40.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015799100000000001 2023-01-02T18:17:40.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:40.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.615743+0000", 2023-01-02T18:17:40.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097339900000000001 2023-01-02T18:17:40.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:40.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.616717+0000", 2023-01-02T18:17:40.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045439800000000001 2023-01-02T18:17:40.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:40.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:40.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:40.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617171+0000", 2023-01-02T18:17:40.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8190999999999999e-05 2023-01-02T18:17:40.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617229+0000", 2023-01-02T18:17:41.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5250000000000002e-05 2023-01-02T18:17:41.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.617275+0000", 2023-01-02T18:17:41.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024825910000000001 2023-01-02T18:17:41.001 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.001 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.002 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.002 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:41.002 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:41.003 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.274827034000001, 2023-01-02T18:17:41.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:41.003 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.003 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:41.003 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.004 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:41.004 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:41.004 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:41.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.004 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:41.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:41.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:41.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:41.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:41.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:41.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:41.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:41.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:41.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:41.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:41.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:41.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:41.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:41.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:41.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:41.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:41.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:41.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:41.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:41.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:41.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:41.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.014 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.015 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:41.015 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:41.015 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.566647366000002, 2023-01-02T18:17:41.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:41.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:41.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:41.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:41.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.017 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:41.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:41.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:41.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:41.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:41.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:41.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:41.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:41.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:41.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:41.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:41.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:41.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:41.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:41.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:41.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:41.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:41.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:41.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:41.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:41.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:41.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:41.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:41.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:41.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:41.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:41.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:41.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:41.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:41.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:41.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:41.030 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.030 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.030 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.031 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:41.031 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:41.031 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.539911124, 2023-01-02T18:17:41.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:41.031 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.032 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.032 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:41.032 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:41.032 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:41.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.033 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:41.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:41.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:41.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:41.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:41.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:41.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:41.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:41.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:41.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:41.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:41.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:41.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:41.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:41.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:41.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:41.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:41.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:41.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:41.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:41.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:41.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:41.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:41.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:41.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:41.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:41.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:41.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:41.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:41.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:41.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:41.046 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.046 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.046 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.046 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:41.047 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:41.047 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.539863528000001, 2023-01-02T18:17:41.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:17:41.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:41.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:41.048 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:17:41.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.048 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:41.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:41.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:41.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:17:41.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:17:41.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:17:41.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:17:41.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:17:41.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:17:41.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:17:41.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:17:41.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:17:41.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:17:41.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:41.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:17:41.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:17:41.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:17:41.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:17:41.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:17:41.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:17:41.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:41.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:17:41.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:17:41.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:17:41.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:17:41.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:17:41.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:17:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:17:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:17:41.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:17:41.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:17:41.061 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.061 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.062 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.062 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2238 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_trash_add in=21b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:41.062 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:41.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.519668932999998, 2023-01-02T18:17:41.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002, 2023-01-02T18:17:41.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.063 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.063 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:41.063 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:41.064 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2238 2023-01-02T18:17:41.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.064 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:41.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:41.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:41.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374625+0000", 2023-01-02T18:17:41.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9540000000000003e-06 2023-01-02T18:17:41.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374630+0000", 2023-01-02T18:17:41.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0295000000000001e-05 2023-01-02T18:17:41.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374641+0000", 2023-01-02T18:17:41.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3980000000000001e-06 2023-01-02T18:17:41.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374645+0000", 2023-01-02T18:17:41.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0728999999999997e-05 2023-01-02T18:17:41.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374676+0000", 2023-01-02T18:17:41.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8452000000000003e-05 2023-01-02T18:17:41.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374724+0000", 2023-01-02T18:17:41.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019847300000000001 2023-01-02T18:17:41.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:41.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374923+0000", 2023-01-02T18:17:41.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054292499999999998 2023-01-02T18:17:41.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.375466+0000", 2023-01-02T18:17:41.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025375240000000002 2023-01-02T18:17:41.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378003+0000", 2023-01-02T18:17:41.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1505e-05 2023-01-02T18:17:41.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378085+0000", 2023-01-02T18:17:41.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2633000000000002e-05 2023-01-02T18:17:41.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378107+0000", 2023-01-02T18:17:41.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002 2023-01-02T18:17:41.075 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.075 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.076 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.076 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:41.076 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:41.076 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.576794442000001, 2023-01-02T18:17:41.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:17:41.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.077 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.077 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.077 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:41.077 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:41.078 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:17:41.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.078 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:41.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:41.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:41.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:17:41.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:17:41.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:17:41.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:17:41.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:17:41.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:17:41.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:17:41.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:17:41.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:17:41.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:17:41.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:41.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:17:41.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:17:41.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:17:41.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:17:41.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:17:41.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:17:41.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:41.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:17:41.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:17:41.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:17:41.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:17:41.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:17:41.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:17:41.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:17:41.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:17:41.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:17:41.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:17:41.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.091 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.091 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.091 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:41.091 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:41.092 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.5606881789999996, 2023-01-02T18:17:41.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:17:41.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:41.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:41.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:17:41.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.093 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:41.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:41.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:41.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:17:41.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:17:41.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:17:41.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:17:41.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:17:41.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:17:41.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:17:41.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:17:41.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:17:41.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:17:41.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:41.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:17:41.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:17:41.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:17:41.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:17:41.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:17:41.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:17:41.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:41.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:17:41.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:17:41.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:17:41.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:17:41.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:17:41.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:17:41.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:17:41.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:17:41.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:17:41.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:17:41.106 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.107 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.107 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.107 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:41.107 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:41.108 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.5553659949999998, 2023-01-02T18:17:41.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:17:41.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.108 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.108 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.108 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:41.109 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:41.109 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:17:41.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.109 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:41.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:41.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:41.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:17:41.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:17:41.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:17:41.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:17:41.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:17:41.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:17:41.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:17:41.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:17:41.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:17:41.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:17:41.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:17:41.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:17:41.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:17:41.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:17:41.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:17:41.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:17:41.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:17:41.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:17:41.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:17:41.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:17:41.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:17:41.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:17:41.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:17:41.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.120 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.121 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:17:41.121 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:41.122 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.5518129299999996, 2023-01-02T18:17:41.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:17:41.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.122 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:41.122 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:41.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:41.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:41.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:17:41.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:17:41.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:17:41.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:17:41.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:17:41.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:17:41.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:17:41.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:17:41.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:17:41.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:17:41.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:17:41.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:17:41.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:17:41.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:17:41.130 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.131 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.131 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.131 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:41.131 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:41.132 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.5501808859999997, 2023-01-02T18:17:41.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:17:41.132 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.132 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.132 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.133 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:41.133 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:41.133 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:17:41.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.133 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:41.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:41.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:41.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:17:41.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:17:41.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:17:41.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:17:41.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:17:41.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:17:41.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:17:41.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:17:41.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:17:41.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:17:41.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:17:41.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:17:41.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:41.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:17:41.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:17:41.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:17:41.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:17:41.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:17:41.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:17:41.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:17:41.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:17:41.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:17:41.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:17:41.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.145 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.146 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:41.146 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:41.146 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.549987309, 2023-01-02T18:17:41.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:17:41.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.147 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.147 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:41.147 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:17:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:41.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:41.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:41.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:17:41.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:17:41.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:17:41.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:17:41.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:17:41.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:17:41.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:17:41.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:17:41.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:17:41.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:17:41.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:17:41.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:17:41.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:41.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:17:41.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:17:41.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:17:41.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:17:41.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:17:41.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:17:41.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:17:41.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:17:41.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:17:41.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:17:41.160 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.160 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.160 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.161 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:41.161 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:41.161 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.544571429, 2023-01-02T18:17:41.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:17:41.162 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.162 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:41.162 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.162 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:41.162 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:41.162 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:41.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.163 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:41.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:41.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:41.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:17:41.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:17:41.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:17:41.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:17:41.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:17:41.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:17:41.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:17:41.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:17:41.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:17:41.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:17:41.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:41.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:17:41.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:17:41.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:41.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:41.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:17:41.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:41.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:17:41.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:17:41.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:41.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:17:41.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:17:41.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:41.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:17:41.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:17:41.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:17:41.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:17:41.174 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.175 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.175 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.175 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:41.175 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:41.176 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.54403170000000001, 2023-01-02T18:17:41.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:17:41.176 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:41.176 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:17:41.176 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:41.176 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:41.177 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:41.177 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:41.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.177 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:41.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:41.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:41.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:41.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:41.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:41.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:41.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:41.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:17:41.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:17:41.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:41.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:17:41.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:17:41.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:41.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:41.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:17:41.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:41.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:17:41.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:17:41.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:41.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:17:41.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:17:41.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:17:41.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:17:41.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:17:41.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:41.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:41.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:41.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:17:41.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:17:41.185 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.185 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.185 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.185 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:41.186 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:41.186 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:41.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:41.188 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:41.188+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:41.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:41.287 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:41.287+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:41.328 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:41.328 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:41.328 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:41.328 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:41.333 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:17:41.338 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:41.374 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:41.388 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:41.389+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:41.392 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:41.409 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:41.427 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:41.447 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:41.467 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:41.485 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:41.488 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:41.489+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:41.503 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:41.504 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:41.505 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:41.506 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:41.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:41.588 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:41.590+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:41.643 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:41.643 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:41.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:41.696 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:41.696+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:41.778 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:41.779 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:41.788 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:41.829 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:41.829+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:41.891 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:41.892+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:41.953 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:41.953 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:41.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:41.991 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:41.992+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:42.087 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:42.087 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:42.091 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:42.091+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:42.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:42.192 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:42.192+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:42.263 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:42.263 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:42.273 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:42.293 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:42.294+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:42.394 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:42.394+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:42.437 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:42.438 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:42.447 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:42.495 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:42.495+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:42.595 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:42.596+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:42.612 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:42.613 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:42.624 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:42.626 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:17:42.696 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:42.697+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:42.748 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:42.748 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:42.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:42.797 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:42.798+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:42.883 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:42.883 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:42.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:42.936 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:42.936+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:42.998 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:42.999+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:43.017 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:43.017 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:43.027 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:43.099 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:43.100+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:43.167 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:43.167 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:43.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:43.200 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:43.200+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:43.300 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:43.301+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:43.348 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:43.348 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:43.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:43.403 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:43.404+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:43.484 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:43.484 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:43.494 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:43.502 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:43.502+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:43.516 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:43.603 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:43.603+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:43.666 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:43.666 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:43.676 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:43.679 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:43.699 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:43.704 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:43.705+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:43.717 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:43.751 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:43.770 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:43.788 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:43.805 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:43.805+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:43.806 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:43.817 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:43.817 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:43.817 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:43.817 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:43.818 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:43.824 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:43.825 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:43.826 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:43.827 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:43.827 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:43.828 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:43.919 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:43.920+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:44.002 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.003 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.578441084999994, 2023-01-02T18:17:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.004 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:44.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:44.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:44.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.519241377, 2023-01-02T18:17:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:44.015 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:44.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:44.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:44.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:44.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:44.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:44.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:44.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:44.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:44.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.029 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.673880535999999, 2023-01-02T18:17:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:44.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:400 6.1a e59/57 6:5cea7035:::rbd_info:head v 59'1, mlcod=0'0)", 2023-01-02T18:17:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.661444734, 2023-01-02T18:17:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997, 2023-01-02T18:17:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.041 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:44.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:44.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340963+0000", 2023-01-02T18:17:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6570000000000002e-06 2023-01-02T18:17:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340969+0000", 2023-01-02T18:17:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8513999999999999e-05 2023-01-02T18:17:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340987+0000", 2023-01-02T18:17:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.37e-06 2023-01-02T18:17:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.340994+0000", 2023-01-02T18:17:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6234999999999999e-05 2023-01-02T18:17:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341050+0000", 2023-01-02T18:17:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.722e-05 2023-01-02T18:17:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341077+0000", 2023-01-02T18:17:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082752699999999999 2023-01-02T18:17:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341905+0000", 2023-01-02T18:17:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.027e-05 2023-01-02T18:17:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:52.341935+0000", 2023-01-02T18:17:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097157199999999997 2023-01-02T18:17:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.052 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:44.052 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:44.052 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.626771996000002, 2023-01-02T18:17:44.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:44.053 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.053 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.053 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:44.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:44.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:44.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:44.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:44.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:44.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:44.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:44.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:44.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:44.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:44.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:44.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:44.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:44.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:44.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:44.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:44.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:44.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:44.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.063 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.063 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.064 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:44.064 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:44.064 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.616494977000002, 2023-01-02T18:17:44.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:44.064 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.065 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.065 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:44.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:44.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:44.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:44.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:44.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:44.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:44.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:44.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:44.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:44.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:44.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:44.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:44.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:44.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:44.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:44.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:44.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:44.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:44.074 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.075 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.075 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.075 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:44.076 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:44.076 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.308146557999997, 2023-01-02T18:17:44.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:44.076 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.077 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.077 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:44.077 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:44.077 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:44.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.077 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:44.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:44.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:44.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:44.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:44.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:44.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:44.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:44.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:44.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:44.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:44.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:44.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:44.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:44.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:44.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:44.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:44.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:44.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:44.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:44.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:44.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:44.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:44.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:44.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:44.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:44.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:44.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:44.090 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.090 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.090 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.091 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:44.091 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:44.091 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.372831668000003, 2023-01-02T18:17:44.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:44.092 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.092 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:44.093 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:44.093 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:44.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.093 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:44.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:44.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:44.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:44.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:44.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:44.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:44.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:44.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:44.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:44.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:44.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:44.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:44.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:44.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:44.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:44.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:44.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:44.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:44.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:44.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:44.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:44.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:44.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:44.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:44.112 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.112 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.112 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.113 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:44.113 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:44.114 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.368926811000001, 2023-01-02T18:17:44.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:44.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.114 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:44.114 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.114 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:44.115 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:44.115 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:44.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.115 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:44.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:44.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:44.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:44.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:44.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:44.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:44.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:44.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:44.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:44.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:44.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:44.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:44.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:44.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:44.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:44.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:44.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:44.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:44.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:44.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:44.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:44.127 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.127 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.128 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.128 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:44.128 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:44.129 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.664385141, 2023-01-02T18:17:44.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:44.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.129 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:44.130 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.130 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:44.130 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:44.131 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:44.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.131 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:44.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:44.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:44.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:44.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:44.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:44.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:44.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:44.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:44.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:44.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:44.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:44.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:44.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:44.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:44.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:44.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:44.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:44.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:44.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:44.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:44.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:44.141 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.141 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.142 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.142 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:44.142 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:44.142 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.674653405000001, 2023-01-02T18:17:44.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:44.143 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.143 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.143 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:44.144 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:44.144 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:44.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.144 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:44.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:44.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:44.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:44.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:44.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:44.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:44.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:44.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:44.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:44.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:44.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:44.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:44.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:44.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:44.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:44.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:44.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:44.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:44.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:44.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:44.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:44.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:44.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:44.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:44.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:44.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:44.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:44.156 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.156 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.156 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.157 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:44.157 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:44.157 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.651327550000001, 2023-01-02T18:17:44.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:44.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:44.158 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.158 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:44.158 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:44.159 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:44.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.159 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:44.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:44.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:44.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:44.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:44.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:44.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:44.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:44.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:44.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:44.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:44.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:44.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:44.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:44.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:44.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:44.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:44.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:44.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:44.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:44.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:44.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:44.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.169 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.170 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:44.170 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:44.170 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.64125232, 2023-01-02T18:17:44.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:17:44.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.171 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.171 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:44.171 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:44.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:17:44.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.172 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:44.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:17:44.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:17:44.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:17:44.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:17:44.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:17:44.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:17:44.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:17:44.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:17:44.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:17:44.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:17:44.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:44.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:17:44.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:17:44.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:17:44.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:17:44.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:17:44.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:17:44.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:44.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:17:44.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:17:44.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:44.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:17:44.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:17:44.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:44.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:17:44.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:17:44.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:17:44.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:17:44.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:17:44.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:17:44.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.186 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.187 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2241 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [call rbd.object_map_snap_remove in=25b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:44.187 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:44.187 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.623333884000001, 2023-01-02T18:17:44.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652, 2023-01-02T18:17:44.187 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:44.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:44.188 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:44.188 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2241 2023-01-02T18:17:44.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.189 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:44.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:44.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379073+0000", 2023-01-02T18:17:44.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:44.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379080+0000", 2023-01-02T18:17:44.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1620999999999999e-05 2023-01-02T18:17:44.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379091+0000", 2023-01-02T18:17:44.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0440000000000003e-06 2023-01-02T18:17:44.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379097+0000", 2023-01-02T18:17:44.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4477999999999997e-05 2023-01-02T18:17:44.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379141+0000", 2023-01-02T18:17:44.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9756999999999997e-05 2023-01-02T18:17:44.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379201+0000", 2023-01-02T18:17:44.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010401239999999999 2023-01-02T18:17:44.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.380241+0000", 2023-01-02T18:17:44.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652 2023-01-02T18:17:44.197 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.197 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.197 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.198 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:44.198 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:44.198 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.678102536000001, 2023-01-02T18:17:44.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:17:44.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.199 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:44.199 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:44.199 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:44.199 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:44.199 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:17:44.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.200 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:44.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:44.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:44.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:17:44.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:17:44.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:17:44.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:44.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:17:44.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:17:44.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:17:44.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:17:44.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:17:44.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:17:44.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:44.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:17:44.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:17:44.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:17:44.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:17:44.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:17:44.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:17:44.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:17:44.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:17:44.210 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.210 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.210 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.211 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:44.211 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:44.211 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6733390709999991, 2023-01-02T18:17:44.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:17:44.212 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.212 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.212 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:44.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:44.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:17:44.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:17:44.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:17:44.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:17:44.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:17:44.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:17:44.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:17:44.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:17:44.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:17:44.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:17:44.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:17:44.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:17:44.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:17:44.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:17:44.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:17:44.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:17:44.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.222 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.223 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:17:44.223 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:44.223 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6728058459999993, 2023-01-02T18:17:44.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:17:44.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.224 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.224 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:44.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:44.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:44.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:17:44.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:17:44.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:17:44.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:17:44.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:17:44.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:17:44.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:17:44.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:17:44.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:17:44.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:17:44.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:17:44.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:17:44.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:17:44.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:17:44.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:17:44.232 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.233 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.233 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.233 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:44.234 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:44.234 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6617875719999997, 2023-01-02T18:17:44.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:17:44.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.234 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.234 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:44.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:44.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:17:44.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:17:44.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:17:44.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:17:44.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:17:44.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:17:44.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:17:44.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:17:44.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:17:44.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:17:44.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:17:44.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:17:44.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:17:44.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:17:44.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:17:44.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:17:44.243 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.243 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.244 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.244 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:17:44.244 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:44.244 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6574430180000004, 2023-01-02T18:17:44.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:17:44.245 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.245 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.245 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:44.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:44.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:17:44.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:17:44.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:17:44.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:17:44.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:17:44.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:17:44.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:17:44.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:17:44.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:17:44.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:17:44.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:17:44.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:17:44.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:17:44.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:17:44.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:17:44.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:17:44.254 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.254 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.255 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.255 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2828 10.1d e101/98 10:bf37f79e:::rbd_object_map.12a2779686d1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:44.255 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:44.255 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6532463869999994, 2023-01-02T18:17:44.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010281450000000001, 2023-01-02T18:17:44.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.256 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.256 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:44.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349162+0000", 2023-01-02T18:17:44.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349161+0000", 2023-01-02T18:17:44.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4200000000000007e-06 2023-01-02T18:17:44.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349169+0000", 2023-01-02T18:17:44.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5036e-05 2023-01-02T18:17:44.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349184+0000", 2023-01-02T18:17:44.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8539999999999999e-06 2023-01-02T18:17:44.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349191+0000", 2023-01-02T18:17:44.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4647000000000001e-05 2023-01-02T18:17:44.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349236+0000", 2023-01-02T18:17:44.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3459999999999999e-05 2023-01-02T18:17:44.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349259+0000", 2023-01-02T18:17:44.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000900318 2023-01-02T18:17:44.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350159+0000", 2023-01-02T18:17:44.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0460999999999999e-05 2023-01-02T18:17:44.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350190+0000", 2023-01-02T18:17:44.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010281450000000001 2023-01-02T18:17:44.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.265 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.266 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.266 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:44.267 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:44.268 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:44.267+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:44.368 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:44.369+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:44.445 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:44.445 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:44.445 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:44.446 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:44.456 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:44.469 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:44.470+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:44.570 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:44.570+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:44.622 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:44.622 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:44.622 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:44.622 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:44.623 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:44.632 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:44.640 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:17:44.676 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:44.677+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:44.763 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:44.763 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:44.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:44.764 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:44.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.764 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:44.764 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:44.764 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 65.279188855000001, 2023-01-02T18:17:44.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:44.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.765 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:44.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:44.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:44.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:44.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:44.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:44.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:44.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:44.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:44.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:44.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:44.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:44.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:44.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:44.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:44.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:44.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:44.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:44.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.774 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.774 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.775 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:44.775 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:44.775 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.415122324999999, 2023-01-02T18:17:44.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:44.776 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.776 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.776 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:44.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:44.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:44.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:44.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:44.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:44.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:44.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:44.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:44.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:44.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:44.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:44.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:44.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:44.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:44.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:44.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:44.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:44.785 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.785 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.786 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.786 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:44.786 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:44.787 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.413442711999998, 2023-01-02T18:17:44.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:44.787 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.787 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.787 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:44.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:44.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:44.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:44.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:44.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:44.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:44.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:44.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:44.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:44.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:44.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:44.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:44.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:44.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:44.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:44.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:44.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:44.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.796 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.797 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:44.797 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:44.797 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.446614828000001, 2023-01-02T18:17:44.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:44.797 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.798 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:44.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:44.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:44.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:44.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:44.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:44.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:44.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:44.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:44.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:44.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:44.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:44.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:44.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:44.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:44.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:44.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:44.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:44.807 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.807 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.807 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.808 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:44.808 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:44.808 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.116477283999998, 2023-01-02T18:17:44.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:44.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.809 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:44.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:44.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:44.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:44.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:44.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:44.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:44.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:44.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:44.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:44.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:44.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:44.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:44.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:44.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:44.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:44.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:44.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:44.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.818 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.818 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.818 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:44.818 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:44.819 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.439124581000002, 2023-01-02T18:17:44.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:44.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.819 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:44.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:44.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:44.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:44.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:44.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:44.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:44.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:44.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:44.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:44.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:44.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:44.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.828 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.829 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.829 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:44.829 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:44.830 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.437331495999999, 2023-01-02T18:17:44.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:44.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.830 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:44.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:44.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:44.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:44.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:44.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:44.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:44.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:44.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:44.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:44.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:44.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:44.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:44.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:44.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:44.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:44.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:44.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:44.839 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.839 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.839 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.840 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:44.840 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:44.840 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.426493712000003, 2023-01-02T18:17:44.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:44.841 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.841 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.841 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:44.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:44.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:44.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:44.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:44.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:44.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:44.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:44.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:44.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:44.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:44.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:44.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:44.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:44.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:44.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:44.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:44.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:44.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:44.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.850 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.851 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:44.851 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:44.851 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.434440152000001, 2023-01-02T18:17:44.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:44.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.852 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:44.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:44.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:44.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:44.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:44.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:44.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:44.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:44.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:44.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:44.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:44.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:44.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:44.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:44.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:44.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:44.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:44.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:44.860 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.860 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.861 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.861 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:44.861 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:44.862 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.420241612000002, 2023-01-02T18:17:44.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:44.862 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.862 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.862 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:44.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:44.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:44.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:44.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:44.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:44.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:44.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:44.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:44.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:44.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:44.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:44.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:44.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:44.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:44.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:44.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:44.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:44.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:44.871 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.871 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.872 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.872 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:17:44.872 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:44.872 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.398159337999999, 2023-01-02T18:17:44.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:17:44.873 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.873 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.873 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:44.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:44.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:44.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:17:44.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:17:44.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:17:44.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:17:44.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:17:44.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:17:44.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:17:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:17:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:17:44.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:17:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:17:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:17:44.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:17:44.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:17:44.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:17:44.882 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.882 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.882 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.883 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2226 3.13 e89/54 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head v 89'2, mlcod=0'0)", 2023-01-02T18:17:44.883 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:44.883 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.395739228, 2023-01-02T18:17:44.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005, 2023-01-02T18:17:44.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.884 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:44.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:44.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:44.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:44.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0959999999999997e-06 2023-01-02T18:17:44.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367120+0000", 2023-01-02T18:17:44.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4494e-05 2023-01-02T18:17:44.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367135+0000", 2023-01-02T18:17:44.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5700000000000004e-06 2023-01-02T18:17:44.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367142+0000", 2023-01-02T18:17:44.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9985000000000003e-05 2023-01-02T18:17:44.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367192+0000", 2023-01-02T18:17:44.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8598e-05 2023-01-02T18:17:44.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367211+0000", 2023-01-02T18:17:44.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072699899999999998 2023-01-02T18:17:44.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367938+0000", 2023-01-02T18:17:44.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8569999999999998e-05 2023-01-02T18:17:44.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367977+0000", 2023-01-02T18:17:44.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005 2023-01-02T18:17:44.896 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.896 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.896 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.897 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:17:44.897 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:44.897 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.422524472999999, 2023-01-02T18:17:44.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:17:44.898 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.898 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:44.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:44.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:44.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:44.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:17:44.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:17:44.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:17:44.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:17:44.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:17:44.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:17:44.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:17:44.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:17:44.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:17:44.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:17:44.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:17:44.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:17:44.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:17:44.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:17:44.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:17:44.907 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.907 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.908 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.908 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:17:44.908 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:44.908 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.420785624000001, 2023-01-02T18:17:44.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:17:44.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.909 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:44.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:44.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:17:44.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:17:44.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:17:44.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:17:44.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:17:44.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:17:44.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:17:44.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:17:44.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:17:44.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:17:44.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:17:44.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:17:44.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:17:44.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:17:44.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:17:44.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:17:44.918 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.918 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.918 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.919 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:17:44.919 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:44.919 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.42846037, 2023-01-02T18:17:44.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:17:44.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.920 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.920 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:44.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:44.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:44.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:44.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:17:44.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:17:44.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:17:44.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:17:44.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:17:44.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:17:44.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:17:44.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:17:44.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:17:44.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:17:44.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:17:44.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:17:44.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:17:44.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:17:44.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:17:44.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.929 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.929 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.930 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:44.930 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:44.930 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.427317527, 2023-01-02T18:17:44.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:17:44.931 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.931 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.931 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:44.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:44.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:44.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:17:44.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:17:44.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:17:44.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:17:44.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:17:44.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:17:44.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:17:44.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:17:44.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:17:44.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:17:44.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:17:44.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:17:44.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:17:44.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:17:44.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:17:44.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.940 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.941 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:44.941 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:44.941 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.414763732999999, 2023-01-02T18:17:44.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:17:44.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.942 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:44.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:44.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:44.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:44.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:17:44.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:17:44.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:17:44.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:17:44.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:17:44.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:17:44.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:17:44.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:17:44.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:17:44.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:17:44.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:17:44.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:17:44.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:17:44.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:17:44.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:17:44.951 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.951 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.951 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.952 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2827 10.1e e101/98 10:7803159c:::rbd_object_map.12a2d48fcbc5:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:44.952 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:44.952 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.413826818, 2023-01-02T18:17:44.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004, 2023-01-02T18:17:44.952 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.953 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:44.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:44.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349026+0000", 2023-01-02T18:17:44.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5660000000000001e-06 2023-01-02T18:17:44.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349034+0000", 2023-01-02T18:17:44.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0851e-05 2023-01-02T18:17:44.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349044+0000", 2023-01-02T18:17:44.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5415000000000001e-05 2023-01-02T18:17:44.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349060+0000", 2023-01-02T18:17:44.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7527000000000002e-05 2023-01-02T18:17:44.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349097+0000", 2023-01-02T18:17:44.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3733999999999999e-05 2023-01-02T18:17:44.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349111+0000", 2023-01-02T18:17:44.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075968200000000002 2023-01-02T18:17:44.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349871+0000", 2023-01-02T18:17:44.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3843000000000001e-05 2023-01-02T18:17:44.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349905+0000", 2023-01-02T18:17:44.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004 2023-01-02T18:17:44.962 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.962 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.962 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.963 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:44.963 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:44.963 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.397361424, 2023-01-02T18:17:44.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:17:44.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.964 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.964 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:44.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:44.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:44.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:17:44.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:17:44.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:17:44.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:17:44.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:17:44.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:17:44.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:17:44.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:17:44.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:17:44.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:17:44.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:17:44.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:17:44.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:17:44.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:17:44.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:17:44.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:17:44.973 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.973 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.973 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.974 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:17:44.974 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:44.974 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.347307878000001, 2023-01-02T18:17:44.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:17:44.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:44.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:44.975 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:44.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:44.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:44.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:44.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:44.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:44.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:44.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:44.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:17:44.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:17:44.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:44.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:17:44.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:17:44.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:44.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:17:44.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:17:44.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:44.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:17:44.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:17:44.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:44.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:17:44.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:17:44.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:44.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:17:44.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:17:44.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:44.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:17:44.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:17:44.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:44.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:44.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:44.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:17:44.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:17:44.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.984 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.985 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.985 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:44.985 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:44.985 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:44.987 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:44.987 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:44.987+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:45.088 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:45.088+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:45.153 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:45.153 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:45.154 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:45.154 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:45.163 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:45.207 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:45.208+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:45.288 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:45.288 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:45.288 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:45.288 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:45.289 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:45.290 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:45.290+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:45.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:45.390 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:45.390+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:45.467 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:45.467 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:45.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:45.468 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:45.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.468 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:45.468 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:45.468 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.030063217999995, 2023-01-02T18:17:45.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:45.469 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.469 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.469 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.470 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.470 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.470 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:45.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.470 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:45.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:45.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:45.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:45.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:45.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:45.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:45.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:45.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:45.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:45.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:45.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:45.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:45.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:45.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:45.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:45.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:45.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:45.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:45.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:45.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:45.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:45.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:45.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:45.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:45.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:45.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:45.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:45.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:45.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.484 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.485 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.485 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:45.485 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:45.486 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.156523108999998, 2023-01-02T18:17:45.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:45.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.486 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.487 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:45.487 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:45.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:45.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.487 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:45.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:45.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:45.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:45.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:45.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:45.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:45.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:45.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:45.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:45.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:45.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:45.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:45.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:45.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:45.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:45.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:45.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:45.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:45.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:45.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:45.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:45.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:45.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:45.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:45.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:45.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:45.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:45.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:45.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:45.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.501 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.502 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:45.502 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:45.502 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.850563154, 2023-01-02T18:17:45.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:45.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:45.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.504 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:45.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:45.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:45.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:45.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:45.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:45.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:45.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:45.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:45.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:45.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:45.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:45.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:45.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:45.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:45.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:45.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:45.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:45.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:45.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:45.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:45.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:45.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:45.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:45.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:45.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:45.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:45.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:45.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:45.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:45.518 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.518 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.518 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.519 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:45.519 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:45.519 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.13609134, 2023-01-02T18:17:45.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:45.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.520 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.520 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.520 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.520 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:45.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.521 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:45.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:45.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:45.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:45.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:45.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:45.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:45.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:45.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:45.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:45.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:45.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:45.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:45.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:45.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:45.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:45.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:45.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:45.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:45.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:45.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:45.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:45.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:45.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:45.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:45.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:45.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:45.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:45.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:45.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:45.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.535 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.535 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:45.536 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:45.536 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.126989938999998, 2023-01-02T18:17:45.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:45.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:45.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:45.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:45.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:45.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.537 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:45.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:45.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:45.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:45.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:45.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:45.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:45.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:45.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:45.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:45.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:45.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:45.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:45.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:45.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:45.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:45.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:45.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:45.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:45.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:45.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.547 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.547 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:45.548 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:45.548 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.855633646999998, 2023-01-02T18:17:45.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:45.548 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:45.549 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.549 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.549 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.549 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:45.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.549 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:45.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:45.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:45.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:45.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:45.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:45.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:45.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:45.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:45.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:45.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:45.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:45.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:45.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:45.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:45.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:45.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:45.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:45.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:45.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:45.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:45.559 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.560 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.560 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.560 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:45.561 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:45.561 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.846443991000001, 2023-01-02T18:17:45.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:45.561 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.561 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:45.562 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.562 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.562 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.562 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:45.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.563 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:45.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:45.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:45.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:45.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:45.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:45.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:45.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:45.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:45.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:45.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:45.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:45.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:45.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:45.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:45.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:45.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:45.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:45.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:45.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:45.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:45.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.573 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.573 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.574 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:45.574 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:45.574 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.138264323000001, 2023-01-02T18:17:45.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:45.575 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.575 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.575 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.575 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.575 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.576 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:45.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.576 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:45.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:45.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:45.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:45.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:45.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:45.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:45.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:45.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:45.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:45.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:45.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:45.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:45.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:45.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:45.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:45.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:45.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:45.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:45.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:45.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:45.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:45.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:45.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:45.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:45.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:45.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:45.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:45.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:45.589 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.590 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.590 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:45.590 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:45.591 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.111528080999999, 2023-01-02T18:17:45.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:45.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.591 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:45.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:45.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:45.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.592 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:45.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:45.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:45.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:45.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:45.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:45.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:45.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:45.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:45.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:45.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:45.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:45.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:45.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:45.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:45.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:45.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:45.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:45.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:45.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:45.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:45.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:45.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:45.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:45.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:45.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:45.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:45.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:45.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:45.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.606 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.607 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:45.607 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:45.607 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.111480485000001, 2023-01-02T18:17:45.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:17:45.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.608 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.608 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.608 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:45.608 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:45.608 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:17:45.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.609 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:45.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:45.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:45.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:17:45.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:17:45.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:17:45.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:17:45.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:17:45.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:17:45.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:17:45.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:17:45.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:17:45.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:17:45.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:17:45.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:17:45.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:17:45.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:17:45.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:17:45.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:17:45.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:17:45.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:17:45.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:17:45.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:17:45.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:17:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:17:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:17:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:17:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:17:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:17:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2238 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_trash_add in=21b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.091285890000002, 2023-01-02T18:17:45.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002, 2023-01-02T18:17:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:45.625 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2238 2023-01-02T18:17:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374625+0000", 2023-01-02T18:17:45.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9540000000000003e-06 2023-01-02T18:17:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374630+0000", 2023-01-02T18:17:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0295000000000001e-05 2023-01-02T18:17:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374641+0000", 2023-01-02T18:17:45.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3980000000000001e-06 2023-01-02T18:17:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374645+0000", 2023-01-02T18:17:45.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0728999999999997e-05 2023-01-02T18:17:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374676+0000", 2023-01-02T18:17:45.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8452000000000003e-05 2023-01-02T18:17:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374724+0000", 2023-01-02T18:17:45.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019847300000000001 2023-01-02T18:17:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374923+0000", 2023-01-02T18:17:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054292499999999998 2023-01-02T18:17:45.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.375466+0000", 2023-01-02T18:17:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025375240000000002 2023-01-02T18:17:45.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378003+0000", 2023-01-02T18:17:45.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1505e-05 2023-01-02T18:17:45.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378085+0000", 2023-01-02T18:17:45.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2633000000000002e-05 2023-01-02T18:17:45.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378107+0000", 2023-01-02T18:17:45.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002 2023-01-02T18:17:45.638 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.638 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.639 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.639 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:45.639 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:45.640 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.148411399, 2023-01-02T18:17:45.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:17:45.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.640 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.640 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:45.641 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:45.641 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:17:45.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.641 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:45.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:45.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:45.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:17:45.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:17:45.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:17:45.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:17:45.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:17:45.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:17:45.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:17:45.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:17:45.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:17:45.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:17:45.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:17:45.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:17:45.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:17:45.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:17:45.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:17:45.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:17:45.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:17:45.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:17:45.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:17:45.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:17:45.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:17:45.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:17:45.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:17:45.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:17:45.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:17:45.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:17:45.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.655 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.656 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:45.656 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:45.657 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.132305135999999, 2023-01-02T18:17:45.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:17:45.657 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.657 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.657 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.658 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.658 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.658 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:17:45.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.658 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:45.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:45.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:45.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:17:45.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:17:45.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:17:45.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:17:45.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:17:45.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:17:45.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:17:45.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:17:45.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:17:45.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:17:45.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:45.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:17:45.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:17:45.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:17:45.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:17:45.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:17:45.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:17:45.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:45.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:17:45.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:17:45.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:17:45.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:17:45.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:17:45.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:17:45.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:17:45.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:17:45.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:17:45.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:17:45.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.672 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.673 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:45.673 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:45.673 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.126982952000001, 2023-01-02T18:17:45.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:17:45.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.674 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.674 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.674 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.674 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:17:45.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.675 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:45.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:45.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:45.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:17:45.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:17:45.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:17:45.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:17:45.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:17:45.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:17:45.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:17:45.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:17:45.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:17:45.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:17:45.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:17:45.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:17:45.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:17:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:17:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:17:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:17:45.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:17:45.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:17:45.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:17:45.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:17:45.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:17:45.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:17:45.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:17:45.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.687 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.688 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:17:45.688 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:45.688 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.123429887, 2023-01-02T18:17:45.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:17:45.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:45.689 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:45.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:45.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:45.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:17:45.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:17:45.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:17:45.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:17:45.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:17:45.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:17:45.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:17:45.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:17:45.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:17:45.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:17:45.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:17:45.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:17:45.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:17:45.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:17:45.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.697 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.698 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:45.698 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:45.698 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.121797843, 2023-01-02T18:17:45.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:17:45.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.699 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.699 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.699 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.700 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:17:45.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.700 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:45.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:45.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:45.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:17:45.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:17:45.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:17:45.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:17:45.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:17:45.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:17:45.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:17:45.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:17:45.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:17:45.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:17:45.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:17:45.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:17:45.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:17:45.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:17:45.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:17:45.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:17:45.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:17:45.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:17:45.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:17:45.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:17:45.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:17:45.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:17:45.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.713 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.713 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.713 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:45.714 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:45.714 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.1216042660000003, 2023-01-02T18:17:45.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:17:45.714 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.715 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.715 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.715 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.715 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:17:45.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.716 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:45.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:45.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:45.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:17:45.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:17:45.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:17:45.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:17:45.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:17:45.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:17:45.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:17:45.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:17:45.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:17:45.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:17:45.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:17:45.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:17:45.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:17:45.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:17:45.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:17:45.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:17:45.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:17:45.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:17:45.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:17:45.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:17:45.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:17:45.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:17:45.728 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.728 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.728 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.729 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:45.729 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:45.729 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.1161883860000001, 2023-01-02T18:17:45.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:17:45.730 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.730 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.730 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.730 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.730 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.731 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:45.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.731 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:45.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:45.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:45.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:17:45.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:17:45.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:17:45.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:17:45.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:17:45.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:17:45.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:17:45.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:17:45.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:17:45.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:17:45.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:17:45.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:17:45.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:45.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:17:45.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:17:45.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:17:45.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:17:45.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:17:45.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:17:45.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:17:45.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:17:45.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:17:45.743 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.743 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.744 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.744 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:45.744 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:45.744 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.1156486570000004, 2023-01-02T18:17:45.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:17:45.745 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.745 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:17:45.745 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.745 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.746 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.746 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:45.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.746 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:17:45.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:17:45.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:17:45.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:17:45.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:45.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:17:45.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:17:45.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:17:45.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:17:45.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:17:45.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:17:45.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:17:45.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:17:45.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:17:45.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:17:45.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.755 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.755 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.756 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:45.756 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:45.756 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.1096333649999996, 2023-01-02T18:17:45.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:17:45.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:45.757 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:45.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:45.757 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:45.758 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:45.758 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:17:45.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.758 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:45.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:45.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:45.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:45.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:45.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:45.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:45.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:45.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:17:45.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:17:45.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:45.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:17:45.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:17:45.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:45.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:17:45.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:17:45.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:45.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:17:45.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:17:45.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:45.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:17:45.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:17:45.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:45.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:17:45.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:17:45.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:45.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:17:45.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:17:45.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:45.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:17:45.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:17:45.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:45.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:17:45.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:17:45.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:45.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:17:45.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:17:45.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:45.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:45.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:45.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:17:45.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:17:45.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.771 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:45.772 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:45.772 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:45.773 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:45.774 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:17:45.775 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:45.774+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:45.809 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7, 5] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:17:45.810 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-01-02T18:17:45.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:45.873 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:45.873+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:45.914 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:45.914 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:45.915 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:45.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:46.000 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:46.007 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:46.007+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:46.017 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:46.052 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:46.069 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:46.075 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:46.075+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:46.091 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:46.091 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:46.091 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:17:46.091 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:17:46.091 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:46.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:46.102 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:46.135 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:46.168 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:46.184 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:46.184+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:46.192 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:46.193 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:46.194 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:46.194 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:46.194 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:46.194 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:46.194 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:46.195 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:46.195 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:46.266 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:46.266 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:46.276 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:46.277 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:46.277+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:46.377 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:46.378+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:46.442 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:46.442 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:46.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:46.478 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:46.479+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:46.577 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:46.578 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:46.579+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:46.587 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:46.635 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.0 to 1 (10000) 2023-01-02T18:17:46.648 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-01-02T18:17:46.689 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:46.690+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:46.714 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:46.714 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:46.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:46.780 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:46.779+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:46.849 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:46.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:46.899 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:46.900+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:46.982 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:46.981+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:47.023 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:47.023 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:47.033 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:47.082 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:47.083+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:47.183 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:47.184+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:47.207 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:47.207 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:47.208 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:47.284 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:47.285+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:47.335 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:47.336 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:47.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:47.385 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:47.386+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:47.472 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:47.473 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:47.482 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:47.525 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:47.525+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:47.588 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:47.589+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:47.607 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:47.607 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:47.617 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:47.658 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.1 to 1 (10000) 2023-01-02T18:17:47.672 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-01-02T18:17:47.713 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:47.714+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:47.761 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:47.762 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:47.773 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:47.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:17:47.816 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:47.817+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:47.891 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:47.891+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:47.903 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:47.903 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:47.914 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:47.991 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:47.991+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:48.042 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:48.042 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:48.052 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:48.092 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:48.092+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:48.178 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:48.178 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:48.188 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:48.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:48.232 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:48.233+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:48.293 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:48.294+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:48.315 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:48.326 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:48.374 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:48.393 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:48.394 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:48.395+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:48.411 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:48.430 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:48.449 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:48.468 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:48.486 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:48.495 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:48.496+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:48.497 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:48.497 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:48.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:48.498 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:48.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.498 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:48.498 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:48.499 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 69.073016437999996, 2023-01-02T18:17:48.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:48.499 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.499 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.499 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:48.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:48.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:48.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:48.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:48.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:48.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:48.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:48.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:48.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:48.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:48.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:48.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:48.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:48.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:48.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:48.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:48.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:48.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:48.509 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.510 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.510 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.510 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:48.511 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:48.511 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 69.013816730000002, 2023-01-02T18:17:48.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:48.511 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.511 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.512 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.512 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:48.512 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:48.512 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:48.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.513 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:48.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:48.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:48.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:48.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:48.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:48.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:48.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:48.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:48.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:48.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:48.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:48.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:48.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:48.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:48.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:48.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:48.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:48.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:48.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:48.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:48.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:48.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:48.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:48.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:48.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:48.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:48.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:48.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.525 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.526 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:48.526 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:48.527 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.168455889000001, 2023-01-02T18:17:48.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:48.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.527 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:48.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:48.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:48.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:48.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:48.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:48.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:48.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:48.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:48.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:48.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:48.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:48.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.538 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.121347348999997, 2023-01-02T18:17:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:48.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:48.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:48.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:48.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:48.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:48.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:48.549 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.550 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.111070329999997, 2023-01-02T18:17:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.551 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:48.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:48.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:48.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.802721910999999, 2023-01-02T18:17:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:48.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:48.564 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:48.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:48.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:48.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:48.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:48.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:48.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:48.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:48.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.578 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.867407020999998, 2023-01-02T18:17:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:48.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:48.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:48.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:48.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:48.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:48.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:48.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:48.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:48.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:48.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:48.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:48.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:48.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:48.593 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:48.594 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.863502164000003, 2023-01-02T18:17:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.595 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:48.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:48.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:48.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:48.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:48.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:48.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:48.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:48.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:48.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:48.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:48.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:48.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:48.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:48.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:48.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:48.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:48.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:48.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:48.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.607 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:48.608 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.158960493999999, 2023-01-02T18:17:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:48.609 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.610 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:48.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:48.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:48.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:48.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:48.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:48.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:48.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:48.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.621 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:48.622 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.169228758000003, 2023-01-02T18:17:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:48.623 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:48.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:48.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:48.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.145902903, 2023-01-02T18:17:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:48.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:48.640 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:48.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:48.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:48.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:48.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:48.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:48.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:48.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:48.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:48.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.652 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.135827673000001, 2023-01-02T18:17:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:17:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:17:48.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:48.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:48.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:17:48.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:17:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:17:48.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:17:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:17:48.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:17:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:17:48.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:17:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:17:48.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:17:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:17:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:17:48.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:17:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:17:48.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:17:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:17:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:17:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:17:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:17:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:17:48.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:17:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:17:48.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:17:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:17:48.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:17:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:17:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.669 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2241 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [call rbd.object_map_snap_remove in=25b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:48.670 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.117909236999999, 2023-01-02T18:17:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652, 2023-01-02T18:17:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:48.671 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2241 2023-01-02T18:17:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.672 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:48.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379073+0000", 2023-01-02T18:17:48.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379080+0000", 2023-01-02T18:17:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1620999999999999e-05 2023-01-02T18:17:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379091+0000", 2023-01-02T18:17:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0440000000000003e-06 2023-01-02T18:17:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379097+0000", 2023-01-02T18:17:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4477999999999997e-05 2023-01-02T18:17:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379141+0000", 2023-01-02T18:17:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9756999999999997e-05 2023-01-02T18:17:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379201+0000", 2023-01-02T18:17:48.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010401239999999999 2023-01-02T18:17:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.380241+0000", 2023-01-02T18:17:48.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652 2023-01-02T18:17:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.172677888999999, 2023-01-02T18:17:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:17:48.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:48.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:17:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:17:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:17:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:17:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:17:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:17:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:17:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:17:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:17:48.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:17:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:17:48.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:17:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:17:48.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:17:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:17:48.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:17:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:17:48.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:17:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.167914423999999, 2023-01-02T18:17:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:17:48.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:17:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:17:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:17:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:17:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:17:48.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:17:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:17:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:17:48.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:17:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:17:48.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:17:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:17:48.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:17:48.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:17:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:17:48.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:17:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:17:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.167381198999999, 2023-01-02T18:17:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:17:48.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:48.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:48.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:17:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:17:48.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:17:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:17:48.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:17:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:17:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:17:48.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:17:48.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:17:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:17:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:17:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:17:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:17:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:17:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:17:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:48.721 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.156362925, 2023-01-02T18:17:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:17:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:17:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:17:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:17:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:17:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:17:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:17:48.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:17:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:17:48.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:17:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:17:48.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:17:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:17:48.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:17:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:17:48.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:17:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:17:48.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.733 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:17:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.152018371, 2023-01-02T18:17:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:17:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.734 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:48.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:17:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:17:48.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:17:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:17:48.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:17:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:17:48.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:17:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:17:48.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:17:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:17:48.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:17:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:17:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:17:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:17:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:17:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:17:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.744 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:17:48.745 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.114932381, 2023-01-02T18:17:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:17:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.746 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:48.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:17:48.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:17:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:17:48.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:17:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:17:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:17:48.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:17:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:17:48.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:17:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:17:48.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:17:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:17:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:17:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:17:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:17:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:17:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:17:48.757 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.1074514930000001, 2023-01-02T18:17:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:17:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:48.758 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:48.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:48.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:17:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:17:48.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:17:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:17:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:17:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:17:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:17:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:17:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:17:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:17:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:17:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:17:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:17:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:17:48.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:17:48.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:17:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.769 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:48.770 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:48.770 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:48.771 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:48.771 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:48.771 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:48.772 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:48.772 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:48.772 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:48.772 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:48.772 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:48.772 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:48.774 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:48.775 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.2 to 1 (10000) 2023-01-02T18:17:48.776 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:17:48.777 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:48.771+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:48.777 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2023-01-02T18:17:48.872 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:48.872+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:48.945 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:48.945 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:48.946 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:48.946 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:48.955 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:48.999 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:49.000+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:49.074 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:49.074+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:49.081 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:49.081 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:49.082 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:49.082 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:49.091 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:49.175 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:49.176+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:49.258 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:49.258 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:49.259 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 69.774378898999998, 2023-01-02T18:17:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.260 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:49.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:49.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:49.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:49.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.270 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:49.271 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.910312369000003, 2023-01-02T18:17:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.282 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:49.283 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.908632756000003, 2023-01-02T18:17:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.284 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:49.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.294 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:49.295 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.941804871999999, 2023-01-02T18:17:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.296 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:49.307 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.611667328000003, 2023-01-02T18:17:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.934314624999999, 2023-01-02T18:17:49.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:49.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:49.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:49.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:49.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.329 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:49.330 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.932521540000003, 2023-01-02T18:17:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:49.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:49.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1245 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'3, mlcod=68'1)", 2023-01-02T18:17:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.921683756, 2023-01-02T18:17:49.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002, 2023-01-02T18:17:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336360+0000", 2023-01-02T18:17:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336358+0000", 2023-01-02T18:17:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4457999999999999e-05 2023-01-02T18:17:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336373+0000", 2023-01-02T18:17:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8966000000000001e-05 2023-01-02T18:17:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336392+0000", 2023-01-02T18:17:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9189999999999994e-06 2023-01-02T18:17:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336401+0000", 2023-01-02T18:17:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4437999999999994e-05 2023-01-02T18:17:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336476+0000", 2023-01-02T18:17:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0758999999999999e-05 2023-01-02T18:17:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.336497+0000", 2023-01-02T18:17:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061614799999999996 2023-01-02T18:17:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337113+0000", 2023-01-02T18:17:49.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4272e-05 2023-01-02T18:17:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.337147+0000", 2023-01-02T18:17:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00078713600000000002 2023-01-02T18:17:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.929630195999998, 2023-01-02T18:17:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:49.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:49.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:49.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:49.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:49.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:49.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:49.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:49.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:49.365 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.366 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.915431655999999, 2023-01-02T18:17:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.367 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:49.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.377 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:17:49.378 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.893349382, 2023-01-02T18:17:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:17:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.379 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:17:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:17:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:17:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:17:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:17:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:17:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:17:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:17:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:17:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:17:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:17:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:17:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:17:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:17:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:17:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2226 3.13 e89/54 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head v 89'2, mlcod=0'0)", 2023-01-02T18:17:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:49.390 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.890929272000001, 2023-01-02T18:17:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005, 2023-01-02T18:17:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0959999999999997e-06 2023-01-02T18:17:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367120+0000", 2023-01-02T18:17:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4494e-05 2023-01-02T18:17:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367135+0000", 2023-01-02T18:17:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5700000000000004e-06 2023-01-02T18:17:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367142+0000", 2023-01-02T18:17:49.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9985000000000003e-05 2023-01-02T18:17:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367192+0000", 2023-01-02T18:17:49.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8598e-05 2023-01-02T18:17:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367211+0000", 2023-01-02T18:17:49.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072699899999999998 2023-01-02T18:17:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367938+0000", 2023-01-02T18:17:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8569999999999998e-05 2023-01-02T18:17:49.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367977+0000", 2023-01-02T18:17:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005 2023-01-02T18:17:49.400 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:17:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.917714517, 2023-01-02T18:17:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:17:49.402 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:49.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:17:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:17:49.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:17:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:17:49.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:17:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:17:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:17:49.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:17:49.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:17:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:17:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:17:49.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:17:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:17:49.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:17:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:17:49.412 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.413 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:17:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.915975668000002, 2023-01-02T18:17:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:17:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.414 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:49.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:49.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:17:49.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:17:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:17:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:17:49.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:17:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:17:49.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:17:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:17:49.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:17:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:17:49.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:17:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:17:49.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:17:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:17:49.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:17:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:17:49.424 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:17:49.425 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.923650414000001, 2023-01-02T18:17:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:17:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.426 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:49.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:49.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:17:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:17:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:17:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:17:49.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:17:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:17:49.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:17:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:17:49.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:17:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:17:49.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:17:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:17:49.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:17:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:17:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:17:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:49.438 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.922507571000001, 2023-01-02T18:17:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:17:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:17:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:17:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:17:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:17:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:17:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:17:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:17:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:17:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:17:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:17:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:17:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:17:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:17:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:17:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:17:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.450 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:49.451 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.909953777, 2023-01-02T18:17:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:17:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.452 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:49.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:49.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:49.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:17:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:17:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:17:49.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:17:49.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:17:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:17:49.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:17:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:17:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:17:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:17:49.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:17:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:17:49.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:17:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:17:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:17:49.462 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.463 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2827 10.1e e101/98 10:7803159c:::rbd_object_map.12a2d48fcbc5:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.909016862, 2023-01-02T18:17:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004, 2023-01-02T18:17:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.464 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:49.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349026+0000", 2023-01-02T18:17:49.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5660000000000001e-06 2023-01-02T18:17:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349034+0000", 2023-01-02T18:17:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0851e-05 2023-01-02T18:17:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349044+0000", 2023-01-02T18:17:49.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5415000000000001e-05 2023-01-02T18:17:49.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349060+0000", 2023-01-02T18:17:49.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7527000000000002e-05 2023-01-02T18:17:49.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349097+0000", 2023-01-02T18:17:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3733999999999999e-05 2023-01-02T18:17:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349111+0000", 2023-01-02T18:17:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075968200000000002 2023-01-02T18:17:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349871+0000", 2023-01-02T18:17:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3843000000000001e-05 2023-01-02T18:17:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349905+0000", 2023-01-02T18:17:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004 2023-01-02T18:17:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.892551468000001, 2023-01-02T18:17:49.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:17:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:17:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:17:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:17:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:17:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:17:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:17:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:17:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:17:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:17:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:17:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:17:49.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:17:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:17:49.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:17:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:17:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:17:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:17:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:49.488 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.842497922, 2023-01-02T18:17:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:17:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:49.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:17:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:17:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:17:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:17:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:17:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:17:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:17:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:17:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:17:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:17:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:49.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:17:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:17:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:49.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:17:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:17:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:49.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:17:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:17:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.499 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:49.500 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:49.500 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:49.502 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:49.502 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:49.502+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:49.602 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:49.603+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:49.668 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:49.669 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:49.669 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:49.679 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.3 to 1 (10000) 2023-01-02T18:17:49.683 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:49.691 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2023-01-02T18:17:49.733 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:49.734+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:49.804 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:49.805+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:49.869 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:49.869 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:49.870 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:49.880 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:49.905 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:49.906+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:50.006 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:50.006+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:50.008 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.009 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 70.571703713999995, 2023-01-02T18:17:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:50.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:50.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:50.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:50.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:50.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:50.029 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.698163604999998, 2023-01-02T18:17:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:50.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:50.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:50.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:50.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:50.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:50.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:50.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:50.045 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.046 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.392203649999999, 2023-01-02T18:17:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:50.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.048 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:50.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:50.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:50.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:50.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.064 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:50.065 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.677731836, 2023-01-02T18:17:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.066 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.067 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:50.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:50.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:50.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:50.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:50.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:50.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:50.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:50.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:50.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:50.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:50.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:50.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:50.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:50.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:50.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:50.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:50.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:50.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:50.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:50.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:50.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:50.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:50.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:50.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:50.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:50.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:50.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:50.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:50.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:50.083 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.083 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.083 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.084 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:50.084 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:50.084 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.668630434999997, 2023-01-02T18:17:50.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:50.084 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.085 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:50.085 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.085 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:50.085 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:50.085 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:50.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.086 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:50.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:50.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:50.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:50.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:50.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:50.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:50.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:50.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:50.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:50.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:50.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:50.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:50.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:50.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:50.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:50.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:50.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:50.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:50.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:50.096 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.096 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.097 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:50.098 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:50.098 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.397274142999997, 2023-01-02T18:17:50.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:50.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:50.099 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.099 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.099 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.099 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:50.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.100 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:50.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:50.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:50.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:50.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:50.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:50.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:50.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:50.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:50.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:50.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:50.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:50.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:50.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:50.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:50.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:50.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:50.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:50.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:50.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:50.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:50.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.111 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.111 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2671 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:50.112 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:50.112 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.388084487, 2023-01-02T18:17:50.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998, 2023-01-02T18:17:50.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:50.112 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.113 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.113 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.113 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2671 2023-01-02T18:17:50.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.113 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:50.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619468+0000", 2023-01-02T18:17:50.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:50.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619466+0000", 2023-01-02T18:17:50.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4089999999999992e-06 2023-01-02T18:17:50.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619476+0000", 2023-01-02T18:17:50.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7742999999999999e-05 2023-01-02T18:17:50.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619493+0000", 2023-01-02T18:17:50.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7280000000000001e-06 2023-01-02T18:17:50.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619502+0000", 2023-01-02T18:17:50.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4848999999999997e-05 2023-01-02T18:17:50.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619547+0000", 2023-01-02T18:17:50.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:17:50.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.619552+0000", 2023-01-02T18:17:50.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027600480000000002 2023-01-02T18:17:50.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622312+0000", 2023-01-02T18:17:50.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4872999999999999e-05 2023-01-02T18:17:50.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622397+0000", 2023-01-02T18:17:50.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113219 2023-01-02T18:17:50.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.622511+0000", 2023-01-02T18:17:50.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030424229999999998 2023-01-02T18:17:50.124 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.124 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.125 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.125 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:50.126 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:50.126 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.679904819000001, 2023-01-02T18:17:50.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:50.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.127 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.127 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.127 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.127 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.128 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:50.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.128 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:50.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:50.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:50.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:50.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:50.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:50.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:50.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:50.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:50.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:50.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:50.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:50.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:50.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:50.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:50.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:50.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:50.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:50.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:50.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:50.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:50.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:50.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:50.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:50.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:50.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:50.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:50.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:50.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:50.143 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.143 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.144 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.144 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:50.144 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:50.145 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.653168576999999, 2023-01-02T18:17:50.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:50.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.146 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.146 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:50.146 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:50.146 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:50.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.147 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:50.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:50.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:50.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:50.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:50.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:50.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:50.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:50.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:50.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:50.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:50.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:50.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:50.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:50.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:50.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:50.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:50.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:50.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:50.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:50.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:50.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:50.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:50.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:50.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:50.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:50.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:50.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:50.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:50.162 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.162 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.163 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.163 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:50.163 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:50.164 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.653120981000001, 2023-01-02T18:17:50.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:17:50.164 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.164 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.164 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.165 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:50.165 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:50.165 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:17:50.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.165 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:50.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:50.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:50.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:17:50.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:17:50.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:17:50.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:17:50.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:17:50.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:17:50.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:17:50.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:17:50.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:17:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:17:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:17:50.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:17:50.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:17:50.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:17:50.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:17:50.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:17:50.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:17:50.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:17:50.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:17:50.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:17:50.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:17:50.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:17:50.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:17:50.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:17:50.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:17:50.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:17:50.181 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.181 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.181 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.182 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2238 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_trash_add in=21b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:50.182 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:50.182 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.632926386000001, 2023-01-02T18:17:50.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002, 2023-01-02T18:17:50.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.183 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.183 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:50.183 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:50.184 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2238 2023-01-02T18:17:50.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.184 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:50.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:50.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374625+0000", 2023-01-02T18:17:50.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9540000000000003e-06 2023-01-02T18:17:50.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374630+0000", 2023-01-02T18:17:50.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0295000000000001e-05 2023-01-02T18:17:50.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374641+0000", 2023-01-02T18:17:50.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3980000000000001e-06 2023-01-02T18:17:50.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374645+0000", 2023-01-02T18:17:50.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0728999999999997e-05 2023-01-02T18:17:50.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374676+0000", 2023-01-02T18:17:50.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8452000000000003e-05 2023-01-02T18:17:50.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374724+0000", 2023-01-02T18:17:50.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019847300000000001 2023-01-02T18:17:50.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374923+0000", 2023-01-02T18:17:50.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054292499999999998 2023-01-02T18:17:50.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.375466+0000", 2023-01-02T18:17:50.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025375240000000002 2023-01-02T18:17:50.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378003+0000", 2023-01-02T18:17:50.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1505e-05 2023-01-02T18:17:50.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378085+0000", 2023-01-02T18:17:50.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2633000000000002e-05 2023-01-02T18:17:50.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378107+0000", 2023-01-02T18:17:50.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002 2023-01-02T18:17:50.198 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.198 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.198 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.199 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:50.199 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:50.199 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.690051895, 2023-01-02T18:17:50.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:17:50.199 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.200 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.200 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.200 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:50.200 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:50.200 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:17:50.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.201 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:50.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:50.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:50.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:17:50.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:17:50.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:17:50.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:17:50.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:17:50.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:17:50.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:17:50.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:17:50.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:17:50.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:17:50.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:17:50.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:17:50.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:17:50.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:17:50.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:17:50.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:17:50.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:17:50.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:17:50.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:17:50.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:17:50.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:17:50.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:17:50.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:17:50.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:17:50.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:17:50.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:17:50.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.216 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.217 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:50.217 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:50.217 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.673945632000001, 2023-01-02T18:17:50.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:17:50.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.218 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.218 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.219 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.219 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:17:50.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.219 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:50.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:50.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:50.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:17:50.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:17:50.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:17:50.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:17:50.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:17:50.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:17:50.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:17:50.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:17:50.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:17:50.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:17:50.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:17:50.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:17:50.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:17:50.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:17:50.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:17:50.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:17:50.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:50.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:17:50.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:17:50.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:17:50.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:17:50.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:17:50.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:17:50.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:17:50.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:17:50.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:17:50.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:17:50.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.234 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.235 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:50.235 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:50.235 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.668623448, 2023-01-02T18:17:50.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:17:50.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.238 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:17:50.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.238 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:50.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:50.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:50.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:17:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:17:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:17:50.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:17:50.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:17:50.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:17:50.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:17:50.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:17:50.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:17:50.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:17:50.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:17:50.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:17:50.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:17:50.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:17:50.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:17:50.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:17:50.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:17:50.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:17:50.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:17:50.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:17:50.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:17:50.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:17:50.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:17:50.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.252 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.252 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.253 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:17:50.253 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:50.253 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.665070383, 2023-01-02T18:17:50.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:17:50.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.254 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:50.254 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:50.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:50.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:17:50.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:17:50.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:17:50.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:17:50.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:17:50.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:17:50.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:17:50.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:17:50.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:17:50.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:17:50.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:17:50.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:17:50.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:17:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:17:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.263 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:50.264 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.663438339000001, 2023-01-02T18:17:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:17:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.265 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:17:50.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.267 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:50.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:50.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:50.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:17:50.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:17:50.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:17:50.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:17:50.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:17:50.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:17:50.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:17:50.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:17:50.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:17:50.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:17:50.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:17:50.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:17:50.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:17:50.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:17:50.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:17:50.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:17:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:17:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:17:50.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:17:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:17:50.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:17:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:17:50.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.281 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.663244762, 2023-01-02T18:17:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:17:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.282 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:17:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.283 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:50.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:17:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:17:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:17:50.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:17:50.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:17:50.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:17:50.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:17:50.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:17:50.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:17:50.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:17:50.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:17:50.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:17:50.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:17:50.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:17:50.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:17:50.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:17:50.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:17:50.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:17:50.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:17:50.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:17:50.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:17:50.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:17:50.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.298 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.298 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.298 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:50.298 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:50.299 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6578288820000004, 2023-01-02T18:17:50.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:17:50.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:50.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.300 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:50.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:50.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:50.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:17:50.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:17:50.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:17:50.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:17:50.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:17:50.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:17:50.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:17:50.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:17:50.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:17:50.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:17:50.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:17:50.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:17:50.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:50.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:17:50.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:17:50.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:17:50.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:17:50.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:17:50.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:17:50.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:17:50.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:17:50.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:17:50.313 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.313 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.314 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.314 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:50.314 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:50.314 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.6572891530000007, 2023-01-02T18:17:50.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:17:50.315 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.315 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:17:50.315 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.315 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.315 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.316 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:50.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.316 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:50.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:50.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:17:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:17:50.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:17:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:17:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:50.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:17:50.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:17:50.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:17:50.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:17:50.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:17:50.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:17:50.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:17:50.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:17:50.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:17:50.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:17:50.325 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.325 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.325 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.326 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:50.326 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:50.326 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.651273861, 2023-01-02T18:17:50.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:17:50.326 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:50.327 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.327 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:50.327 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:50.327 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.328 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:17:50.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.328 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:50.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:50.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:50.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:50.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:50.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:50.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:50.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:50.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:17:50.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:17:50.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:50.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:17:50.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:17:50.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:50.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:17:50.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:17:50.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:17:50.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:17:50.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:50.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:17:50.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:17:50.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:50.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:17:50.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:17:50.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:50.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:17:50.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:17:50.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:50.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:17:50.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:17:50.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:17:50.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:17:50.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:50.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:17:50.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:17:50.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:50.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:50.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:50.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:17:50.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:17:50.340 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.341 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:50.341 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:50.341 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:50.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:50.344 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:50.343+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:50.443 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:50.444+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:50.484 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:50.485 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:50.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:50.544 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:50.544+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:50.620 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:50.620 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:50.621 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:17:50.621 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:17:50.621 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:50.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:50.645 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:50.646+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:50.686 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.6 to 1 (10000) 2023-01-02T18:17:50.700 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2023-01-02T18:17:50.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:50.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:17:50.784 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:50.785+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:50.801 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:50.801 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:17:50.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:17:50.801 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:17:50.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.802 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1 3.1a 3:5bdd5772:::image1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:17:50.802 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:50.802 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.386685826000004, 2023-01-02T18:17:50.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839, 2023-01-02T18:17:50.803 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.803 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:17:50.803 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:50.803 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:50.804 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.804 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1 2023-01-02T18:17:50.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.804 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:50.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:17:50.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413949+0000", 2023-01-02T18:17:50.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8359999999999999e-06 2023-01-02T18:17:50.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413954+0000", 2023-01-02T18:17:50.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2023-01-02T18:17:50.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413961+0000", 2023-01-02T18:17:50.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7519999999999999e-06 2023-01-02T18:17:50.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413968+0000", 2023-01-02T18:17:50.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0071999999999999e-05 2023-01-02T18:17:50.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414008+0000", 2023-01-02T18:17:50.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1890000000000001e-06 2023-01-02T18:17:50.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:17:50.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414015+0000", 2023-01-02T18:17:50.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013744829999999999 2023-01-02T18:17:50.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415389+0000", 2023-01-02T18:17:50.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1655000000000003e-05 2023-01-02T18:17:50.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415471+0000", 2023-01-02T18:17:50.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839 2023-01-02T18:17:50.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.815 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.815 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.815 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:17:50.816 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:50.816 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 72.385736038999994, 2023-01-02T18:17:50.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:17:50.816 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.816 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.817 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:50.817 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:50.817 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.817 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:17:50.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.818 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:50.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:17:50.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:50.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:17:50.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:17:50.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:17:50.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:17:50.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:17:50.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:17:50.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:17:50.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:17:50.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:17:50.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:17:50.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:17:50.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:17:50.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:17:50.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:17:50.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:17:50.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:17:50.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:50.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:17:50.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:17:50.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:17:50.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:17:50.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:50.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:17:50.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:17:50.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:17:50.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:17:50.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:17:50.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:17:50.832 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.832 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.832 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.833 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:50.833 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:50.833 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.380067776999994, 2023-01-02T18:17:50.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:17:50.834 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.834 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.834 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:50.834 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:50.835 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.835 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:17:50.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.835 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:50.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:17:50.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:50.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:17:50.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:17:50.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:17:50.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:17:50.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:17:50.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:17:50.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:17:50.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:17:50.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:17:50.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:17:50.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:50.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:17:50.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:17:50.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:17:50.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:17:50.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:17:50.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:17:50.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:50.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:17:50.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:17:50.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:50.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:17:50.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:17:50.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:17:50.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:17:50.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:17:50.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:17:50.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:17:50.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:17:50.850 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.850 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.850 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.851 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:50.851 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:50.851 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.374534115000003, 2023-01-02T18:17:50.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:17:50.852 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.852 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.852 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:50.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:17:50.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:50.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:17:50.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:17:50.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:17:50.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:17:50.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:17:50.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:17:50.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:17:50.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:17:50.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:17:50.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:17:50.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:17:50.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:17:50.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:17:50.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:17:50.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:17:50.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:17:50.862 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.862 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.863 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:11 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:50.863 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:50.864 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.366831114999997, 2023-01-02T18:17:50.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152, 2023-01-02T18:17:50.864 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.864 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.864 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:50.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:50.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:50.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:17:50.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:17:50.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433810+0000", 2023-01-02T18:17:50.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1821000000000001e-05 2023-01-02T18:17:50.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433822+0000", 2023-01-02T18:17:50.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4549999999999998e-06 2023-01-02T18:17:50.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433829+0000", 2023-01-02T18:17:50.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6005000000000003e-05 2023-01-02T18:17:50.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433885+0000", 2023-01-02T18:17:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.16e-05 2023-01-02T18:17:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433907+0000", 2023-01-02T18:17:50.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011094480000000001 2023-01-02T18:17:50.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435016+0000", 2023-01-02T18:17:50.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8626999999999999e-05 2023-01-02T18:17:50.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435045+0000", 2023-01-02T18:17:50.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152 2023-01-02T18:17:50.874 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.874 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.874 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.874 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:24 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:50.875 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:50.875 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.351202611000005, 2023-01-02T18:17:50.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997, 2023-01-02T18:17:50.875 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.875 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.876 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:50.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:17:50.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:50.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449431+0000", 2023-01-02T18:17:50.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7706e-05 2023-01-02T18:17:50.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449449+0000", 2023-01-02T18:17:50.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0883999999999998e-05 2023-01-02T18:17:50.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449480+0000", 2023-01-02T18:17:50.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4416000000000001e-05 2023-01-02T18:17:50.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449494+0000", 2023-01-02T18:17:50.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6549000000000001e-05 2023-01-02T18:17:50.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449581+0000", 2023-01-02T18:17:50.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9669000000000003e-05 2023-01-02T18:17:50.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449620+0000", 2023-01-02T18:17:50.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0006958 2023-01-02T18:17:50.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450316+0000", 2023-01-02T18:17:50.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0188e-05 2023-01-02T18:17:50.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450346+0000", 2023-01-02T18:17:50.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997 2023-01-02T18:17:50.885 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.885 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.886 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.886 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:30 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:50.886 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:50.887 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.343800105, 2023-01-02T18:17:50.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003, 2023-01-02T18:17:50.887 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.887 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.888 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:50.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:17:50.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456835+0000", 2023-01-02T18:17:50.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7504999999999999e-05 2023-01-02T18:17:50.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456852+0000", 2023-01-02T18:17:50.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2356e-05 2023-01-02T18:17:50.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456865+0000", 2023-01-02T18:17:50.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.421e-06 2023-01-02T18:17:50.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456871+0000", 2023-01-02T18:17:50.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8040999999999997e-05 2023-01-02T18:17:50.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456909+0000", 2023-01-02T18:17:50.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5384e-05 2023-01-02T18:17:50.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456925+0000", 2023-01-02T18:17:50.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074633700000000002 2023-01-02T18:17:50.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457671+0000", 2023-01-02T18:17:50.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7826000000000001e-05 2023-01-02T18:17:50.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457699+0000", 2023-01-02T18:17:50.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003 2023-01-02T18:17:50.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.898 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.898 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.898 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:31 3.1c e46/43 3:3d3f3250:::rbd_id.image2:head v 46'3, mlcod=46'1)", 2023-01-02T18:17:50.898 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:50.899 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.342171621999995, 2023-01-02T18:17:50.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999, 2023-01-02T18:17:50.899 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.899 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.900 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:50.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:17:50.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458463+0000", 2023-01-02T18:17:50.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3389999999999998e-06 2023-01-02T18:17:50.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458470+0000", 2023-01-02T18:17:50.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.205e-05 2023-01-02T18:17:50.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458482+0000", 2023-01-02T18:17:50.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5809999999999996e-06 2023-01-02T18:17:50.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458487+0000", 2023-01-02T18:17:50.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8702000000000001e-05 2023-01-02T18:17:50.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458546+0000", 2023-01-02T18:17:50.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2495e-05 2023-01-02T18:17:50.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458559+0000", 2023-01-02T18:17:50.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001846735 2023-01-02T18:17:50.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460405+0000", 2023-01-02T18:17:50.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9183000000000002e-05 2023-01-02T18:17:50.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460435+0000", 2023-01-02T18:17:50.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999 2023-01-02T18:17:50.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.909 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.910 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:32 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:50.910 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:50.910 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.338821913000004, 2023-01-02T18:17:50.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997, 2023-01-02T18:17:50.911 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.911 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.911 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:50.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:50.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:50.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461814+0000", 2023-01-02T18:17:50.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3030000000000001e-06 2023-01-02T18:17:50.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461818+0000", 2023-01-02T18:17:50.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0964999999999999e-05 2023-01-02T18:17:50.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461829+0000", 2023-01-02T18:17:50.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8039999999999998e-06 2023-01-02T18:17:50.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461835+0000", 2023-01-02T18:17:50.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8708999999999997e-05 2023-01-02T18:17:50.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461884+0000", 2023-01-02T18:17:50.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5057e-05 2023-01-02T18:17:50.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.461899+0000", 2023-01-02T18:17:50.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00061687999999999999 2023-01-02T18:17:50.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462515+0000", 2023-01-02T18:17:50.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1633e-05 2023-01-02T18:17:50.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462547+0000", 2023-01-02T18:17:50.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073305799999999997 2023-01-02T18:17:50.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.921 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.922 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:33 3.3 3:c76fae31:::rbd_object_map.12a21ad382ee:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:50.922 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:50.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.337779060000003, 2023-01-02T18:17:50.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001, 2023-01-02T18:17:50.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.923 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:50.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:50.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:50.923 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33 2023-01-02T18:17:50.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.924 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:50.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:17:50.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462856+0000", 2023-01-02T18:17:50.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4710000000000004e-06 2023-01-02T18:17:50.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462862+0000", 2023-01-02T18:17:50.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:17:50.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462875+0000", 2023-01-02T18:17:50.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.491e-05 2023-01-02T18:17:50.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462890+0000", 2023-01-02T18:17:50.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9657999999999999e-05 2023-01-02T18:17:50.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462930+0000", 2023-01-02T18:17:50.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1362999999999999e-05 2023-01-02T18:17:50.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463021+0000", 2023-01-02T18:17:50.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015166800000000001 2023-01-02T18:17:50.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:17:50.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463173+0000", 2023-01-02T18:17:50.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074740899999999999 2023-01-02T18:17:50.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:50.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463920+0000", 2023-01-02T18:17:50.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045107699999999998 2023-01-02T18:17:50.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:50.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464372+0000", 2023-01-02T18:17:50.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6213e-05 2023-01-02T18:17:50.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464408+0000", 2023-01-02T18:17:50.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.535e-05 2023-01-02T18:17:50.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464433+0000", 2023-01-02T18:17:50.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001 2023-01-02T18:17:50.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.939 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.939 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.940 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:45 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:50.940 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:50.940 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.327069453999997, 2023-01-02T18:17:50.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892, 2023-01-02T18:17:50.940 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.941 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.941 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:50.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473566+0000", 2023-01-02T18:17:50.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473565+0000", 2023-01-02T18:17:50.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5140000000000004e-06 2023-01-02T18:17:50.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473573+0000", 2023-01-02T18:17:50.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2473000000000001e-05 2023-01-02T18:17:50.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473585+0000", 2023-01-02T18:17:50.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2159999999999997e-06 2023-01-02T18:17:50.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473591+0000", 2023-01-02T18:17:50.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0025999999999999e-05 2023-01-02T18:17:50.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473631+0000", 2023-01-02T18:17:50.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3309000000000001e-05 2023-01-02T18:17:50.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.473644+0000", 2023-01-02T18:17:50.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057332800000000001 2023-01-02T18:17:50.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474217+0000", 2023-01-02T18:17:50.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0043999999999999e-05 2023-01-02T18:17:50.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474247+0000", 2023-01-02T18:17:50.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000680892 2023-01-02T18:17:50.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:46 3.a e46/43 3:50d44281:::rbd_header.12a21ad382ee:head v 46'3, mlcod=46'1)", 2023-01-02T18:17:50.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:50.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.325737692000004, 2023-01-02T18:17:50.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997, 2023-01-02T18:17:50.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.953 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.953 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:50.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474898+0000", 2023-01-02T18:17:50.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474897+0000", 2023-01-02T18:17:50.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8789999999999992e-06 2023-01-02T18:17:50.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474906+0000", 2023-01-02T18:17:50.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3468e-05 2023-01-02T18:17:50.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474920+0000", 2023-01-02T18:17:50.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8460000000000002e-06 2023-01-02T18:17:50.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474926+0000", 2023-01-02T18:17:50.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6996000000000003e-05 2023-01-02T18:17:50.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474963+0000", 2023-01-02T18:17:50.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2276000000000001e-05 2023-01-02T18:17:50.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.474976+0000", 2023-01-02T18:17:50.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066849900000000002 2023-01-02T18:17:50.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475644+0000", 2023-01-02T18:17:50.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2233999999999997e-05 2023-01-02T18:17:50.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.475676+0000", 2023-01-02T18:17:50.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00077813999999999997 2023-01-02T18:17:50.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.963 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.964 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:53 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:50.964 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:50.964 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.290825502999994, 2023-01-02T18:17:50.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082, 2023-01-02T18:17:50.964 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.965 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.965 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:50.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:50.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:50.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:17:50.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3499999999999996e-06 2023-01-02T18:17:50.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509815+0000", 2023-01-02T18:17:50.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0020999999999999e-05 2023-01-02T18:17:50.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509825+0000", 2023-01-02T18:17:50.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1399999999999997e-06 2023-01-02T18:17:50.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509832+0000", 2023-01-02T18:17:50.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3279999999999999e-05 2023-01-02T18:17:50.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509875+0000", 2023-01-02T18:17:50.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0288e-05 2023-01-02T18:17:50.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509895+0000", 2023-01-02T18:17:50.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000905152 2023-01-02T18:17:50.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510800+0000", 2023-01-02T18:17:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1238000000000001e-05 2023-01-02T18:17:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510832+0000", 2023-01-02T18:17:50.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082 2023-01-02T18:17:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:17:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.288834961999996, 2023-01-02T18:17:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:17:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.976 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:17:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:17:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:17:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:17:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:17:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:17:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:17:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:17:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:17:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:17:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:17:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:17:50.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:17:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:17:50.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:17:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:17:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:17:50.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:50.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:66 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:50.988 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.277676804999999, 2023-01-02T18:17:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997, 2023-01-02T18:17:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:50.989 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:50.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522959+0000", 2023-01-02T18:17:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:50.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522958+0000", 2023-01-02T18:17:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6449999999999994e-06 2023-01-02T18:17:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522967+0000", 2023-01-02T18:17:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3166000000000001e-05 2023-01-02T18:17:50.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522980+0000", 2023-01-02T18:17:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:17:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.522987+0000", 2023-01-02T18:17:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4501000000000001e-05 2023-01-02T18:17:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523022+0000", 2023-01-02T18:17:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5023e-05 2023-01-02T18:17:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523037+0000", 2023-01-02T18:17:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057705099999999997 2023-01-02T18:17:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523614+0000", 2023-01-02T18:17:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1579999999999999e-05 2023-01-02T18:17:50.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.523645+0000", 2023-01-02T18:17:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068621299999999997 2023-01-02T18:17:50.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.000 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:26 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'6, mlcod=46'4)", 2023-01-02T18:17:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.262312198999993, 2023-01-02T18:17:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005, 2023-01-02T18:17:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:51.001 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538324+0000", 2023-01-02T18:17:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:51.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538323+0000", 2023-01-02T18:17:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8736000000000002e-05 2023-01-02T18:17:51.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538342+0000", 2023-01-02T18:17:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6739999999999992e-06 2023-01-02T18:17:51.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538351+0000", 2023-01-02T18:17:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6460000000000001e-06 2023-01-02T18:17:51.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538356+0000", 2023-01-02T18:17:51.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.57e-05 2023-01-02T18:17:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538402+0000", 2023-01-02T18:17:51.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6050999999999998e-05 2023-01-02T18:17:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538428+0000", 2023-01-02T18:17:51.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055106199999999995 2023-01-02T18:17:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.538979+0000", 2023-01-02T18:17:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7333000000000001e-05 2023-01-02T18:17:51.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539006+0000", 2023-01-02T18:17:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068247900000000005 2023-01-02T18:17:51.011 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.012 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:27 3.f e46/43 3:f63788c7:::rbd_id.image5:head v 46'6, mlcod=46'4)", 2023-01-02T18:17:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.260992127999998, 2023-01-02T18:17:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001, 2023-01-02T18:17:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:51.013 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:51.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539644+0000", 2023-01-02T18:17:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:17:51.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539643+0000", 2023-01-02T18:17:51.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0418999999999999e-05 2023-01-02T18:17:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:51.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539663+0000", 2023-01-02T18:17:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3852999999999999e-05 2023-01-02T18:17:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:51.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539677+0000", 2023-01-02T18:17:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5100000000000004e-06 2023-01-02T18:17:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:51.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539684+0000", 2023-01-02T18:17:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9595999999999998e-05 2023-01-02T18:17:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:51.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539723+0000", 2023-01-02T18:17:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7207999999999999e-05 2023-01-02T18:17:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:51.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.539741+0000", 2023-01-02T18:17:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063475200000000004 2023-01-02T18:17:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:51.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540375+0000", 2023-01-02T18:17:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5425e-05 2023-01-02T18:17:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.540411+0000", 2023-01-02T18:17:51.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076698000000000001 2023-01-02T18:17:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.024 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:17:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.366879299000004, 2023-01-02T18:17:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:17:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:51.025 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:17:51.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:51.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:51.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:17:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:51.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:17:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:17:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:17:51.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:17:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:17:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:17:51.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:17:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:17:51.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:17:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:17:51.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:17:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:17:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:17:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:17:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:17:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:17:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:17:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:17:51.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:17:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:17:51.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:17:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:17:51.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:17:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:17:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:17:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:17:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.041 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:17:51.042 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.502098240999999, 2023-01-02T18:17:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:17:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:51.043 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:17:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:51.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:51.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:17:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:51.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:17:51.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:17:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:17:51.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:17:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:17:51.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:17:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:17:51.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:17:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:17:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:17:51.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:17:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:17:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:17:51.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:17:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:17:51.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:17:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:17:51.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:17:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:17:51.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:17:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:17:51.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:17:51.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:17:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:51.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:17:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:17:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:17:51.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:17:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:272 4.9 4:911e4614:::rbd_id.image18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:17:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.490469720999997, 2023-01-02T18:17:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999, 2023-01-02T18:17:51.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:17:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:17:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:17:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 272 2023-01-02T18:17:51.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:17:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:17:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:51.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:17:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:17:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:17:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:51.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:17:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310165+0000", 2023-01-02T18:17:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.628e-06 2023-01-02T18:17:51.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:17:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310174+0000", 2023-01-02T18:17:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2023-01-02T18:17:51.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:17:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310190+0000", 2023-01-02T18:17:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:17:51.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:17:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310198+0000", 2023-01-02T18:17:51.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6770000000000001e-05 2023-01-02T18:17:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:17:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310245+0000", 2023-01-02T18:17:51.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159517 2023-01-02T18:17:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:17:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310404+0000", 2023-01-02T18:17:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023075600000000001 2023-01-02T18:17:51.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310635+0000", 2023-01-02T18:17:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088889700000000004 2023-01-02T18:17:51.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311524+0000", 2023-01-02T18:17:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011021 2023-01-02T18:17:51.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:17:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311634+0000", 2023-01-02T18:17:51.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2626000000000002e-05 2023-01-02T18:17:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:17:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311667+0000", 2023-01-02T18:17:51.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9774000000000002e-05 2023-01-02T18:17:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:17:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:17:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:17:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311706+0000", 2023-01-02T18:17:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999 2023-01-02T18:17:51.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:17:51.076 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:17:51.077 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:51.079 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:51.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:51.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:51.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:51.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:51.080 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:51.081 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:51.081 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:51.081 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:51.082 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:51.082 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:51.082 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:51.083 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:51.083 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:51.083 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:51.083 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:51.083 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:51.084 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:51.079+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:51.179 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:51.180+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:51.209 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:51.210 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:51.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:51.280 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:51.281+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:51.381 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:51.381+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:51.384 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:51.385 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:51.394 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:51.482 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:51.482+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:51.559 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:51.560 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:51.569 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:51.582 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:51.583+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:51.683 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:51.684+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.7 to 1 (10000) 2023-01-02T18:17:51.696 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:17:51.712 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2023-01-02T18:17:51.739 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:51.739 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:51.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:51.796 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:51.797+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:51.874 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:51.874 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:51.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:51.885 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:51.884+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:51.985 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:51.986+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:52.049 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:52.050 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:52.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:52.103 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:52.104+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:52.185 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:52.185 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:52.186 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:52.187+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:52.195 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:52.287 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:52.288+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:52.360 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:52.360 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:52.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:52.387 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:52.388+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:52.488 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:52.489+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:52.496 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:52.496 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:52.505 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:52.589 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:52.590+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:52.636 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:52.637 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:52.646 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:52.691 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:52.691+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:52.704 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.5 to 1 (10000) 2023-01-02T18:17:52.715 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-01-02T18:17:52.716 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:17:52.781 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:52.781 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:52.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:52.792 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:52.792+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:52.893 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:52.893+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:52.960 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:52.960 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:52.971 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:53.015 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:53.016+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:53.046 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:53.053 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:17:53.056 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-01-02T18:17:52.701310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11536626,"num_objects":146,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":146,"num_whiteouts":0,"num_read":9706,"num_read_kb":8514,"num_write":881,"num_write_kb":11912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":1369,"num_keys_recovered":670,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1038,"ondisk_log_size":1038,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":601,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":101084,"kb_used_data":31780,"kb_used_omap":0,"kb_used_meta":69248,"kb_avail":660501796,"statfs":{"total":676457349120,"available":676353839104,"internally_reserved":0,"allocated":32542720,"data_stored":27388314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70909952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":105,"num_keys_recovered":8,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.056414"},"pg_stats":[{"pgid":"11.17","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653235+0000","last_change":"2023-01-02T18:17:38.460472+0000","last_active":"2023-01-02T18:17:47.653235+0000","last_peered":"2023-01-02T18:17:47.653235+0000","last_clean":"2023-01-02T18:17:47.653235+0000","last_became_active":"2023-01-02T18:17:36.439954+0000","last_became_peered":"2023-01-02T18:17:36.439954+0000","last_unstale":"2023-01-02T18:17:47.653235+0000","last_undegraded":"2023-01-02T18:17:47.653235+0000","last_fullsized":"2023-01-02T18:17:47.653235+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653236+0000","last_change":"2023-01-02T18:17:34.327371+0000","last_active":"2023-01-02T18:17:47.653236+0000","last_peered":"2023-01-02T18:17:47.653236+0000","last_clean":"2023-01-02T18:17:47.653236+0000","last_became_active":"2023-01-02T18:17:32.345158+0000","last_became_peered":"2023-01-02T18:17:32.345158+0000","last_unstale":"2023-01-02T18:17:47.653236+0000","last_undegraded":"2023-01-02T18:17:47.653236+0000","last_fullsized":"2023-01-02T18:17:47.653236+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665679+0000","last_change":"2023-01-02T18:17:09.324265+0000","last_active":"2023-01-02T18:17:47.665679+0000","last_peered":"2023-01-02T18:17:47.665679+0000","last_clean":"2023-01-02T18:17:47.665679+0000","last_became_active":"2023-01-02T18:17:07.348058+0000","last_became_peered":"2023-01-02T18:17:07.348058+0000","last_unstale":"2023-01-02T18:17:47.665679+0000","last_undegraded":"2023-01-02T18:17:47.665679+0000","last_fullsized":"2023-01-02T18:17:47.665679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648138+0000","last_change":"2023-01-02T18:17:01.320137+0000","last_active":"2023-01-02T18:17:47.648138+0000","last_peered":"2023-01-02T18:17:47.648138+0000","last_clean":"2023-01-02T18:17:47.648138+0000","last_became_active":"2023-01-02T18:16:59.324809+0000","last_became_peered":"2023-01-02T18:16:59.324809+0000","last_unstale":"2023-01-02T18:17:47.648138+0000","last_undegraded":"2023-01-02T18:17:47.648138+0000","last_fullsized":"2023-01-02T18:17:47.648138+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652744+0000","last_change":"2023-01-02T18:16:48.330409+0000","last_active":"2023-01-02T18:17:47.652744+0000","last_peered":"2023-01-02T18:17:47.652744+0000","last_clean":"2023-01-02T18:17:47.652744+0000","last_became_active":"2023-01-02T18:16:48.329903+0000","last_became_peered":"2023-01-02T18:16:48.329903+0000","last_unstale":"2023-01-02T18:17:47.652744+0000","last_undegraded":"2023-01-02T18:17:47.652744+0000","last_fullsized":"2023-01-02T18:17:47.652744+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":137,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648595+0000","last_change":"2023-01-02T18:17:30.328135+0000","last_active":"2023-01-02T18:17:47.648595+0000","last_peered":"2023-01-02T18:17:47.648595+0000","last_clean":"2023-01-02T18:17:47.648595+0000","last_became_active":"2023-01-02T18:17:29.335258+0000","last_became_peered":"2023-01-02T18:17:29.335258+0000","last_unstale":"2023-01-02T18:17:47.648595+0000","last_undegraded":"2023-01-02T18:17:47.648595+0000","last_fullsized":"2023-01-02T18:17:47.648595+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654218+0000","last_change":"2023-01-02T18:17:29.327043+0000","last_active":"2023-01-02T18:17:47.654218+0000","last_peered":"2023-01-02T18:17:47.654218+0000","last_clean":"2023-01-02T18:17:47.654218+0000","last_became_active":"2023-01-02T18:17:29.326459+0000","last_became_peered":"2023-01-02T18:17:29.326459+0000","last_unstale":"2023-01-02T18:17:47.654218+0000","last_undegraded":"2023-01-02T18:17:47.654218+0000","last_fullsized":"2023-01-02T18:17:47.654218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":33,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655598+0000","last_change":"2023-01-02T18:17:29.370303+0000","last_active":"2023-01-02T18:17:47.655598+0000","last_peered":"2023-01-02T18:17:47.655598+0000","last_clean":"2023-01-02T18:17:47.655598+0000","last_became_active":"2023-01-02T18:17:29.329505+0000","last_became_peered":"2023-01-02T18:17:29.329505+0000","last_unstale":"2023-01-02T18:17:47.655598+0000","last_undegraded":"2023-01-02T18:17:47.655598+0000","last_fullsized":"2023-01-02T18:17:47.655598+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":76,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":161,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646685+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:17:47.646685+0000","last_peered":"2023-01-02T18:17:47.646685+0000","last_clean":"2023-01-02T18:17:47.646685+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:17:47.646685+0000","last_undegraded":"2023-01-02T18:17:47.646685+0000","last_fullsized":"2023-01-02T18:17:47.646685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656032+0000","last_change":"2023-01-02T18:17:38.446984+0000","last_active":"2023-01-02T18:17:47.656032+0000","last_peered":"2023-01-02T18:17:47.656032+0000","last_clean":"2023-01-02T18:17:47.656032+0000","last_became_active":"2023-01-02T18:17:36.442630+0000","last_became_peered":"2023-01-02T18:17:36.442630+0000","last_unstale":"2023-01-02T18:17:47.656032+0000","last_undegraded":"2023-01-02T18:17:47.656032+0000","last_fullsized":"2023-01-02T18:17:47.656032+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"101'15","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655641+0000","last_change":"2023-01-02T18:17:34.347463+0000","last_active":"2023-01-02T18:17:47.655641+0000","last_peered":"2023-01-02T18:17:47.655641+0000","last_clean":"2023-01-02T18:17:47.655641+0000","last_became_active":"2023-01-02T18:17:32.344665+0000","last_became_peered":"2023-01-02T18:17:32.344665+0000","last_unstale":"2023-01-02T18:17:47.655641+0000","last_undegraded":"2023-01-02T18:17:47.655641+0000","last_fullsized":"2023-01-02T18:17:47.655641+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654210+0000","last_change":"2023-01-02T18:17:09.308994+0000","last_active":"2023-01-02T18:17:47.654210+0000","last_peered":"2023-01-02T18:17:47.654210+0000","last_clean":"2023-01-02T18:17:47.654210+0000","last_became_active":"2023-01-02T18:17:07.339263+0000","last_became_peered":"2023-01-02T18:17:07.339263+0000","last_unstale":"2023-01-02T18:17:47.654210+0000","last_undegraded":"2023-01-02T18:17:47.654210+0000","last_fullsized":"2023-01-02T18:17:47.654210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'22","reported_seq":280,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665524+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:17:47.665524+0000","last_peered":"2023-01-02T18:17:47.665524+0000","last_clean":"2023-01-02T18:17:47.665524+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:17:47.665524+0000","last_undegraded":"2023-01-02T18:17:47.665524+0000","last_fullsized":"2023-01-02T18:17:47.665524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":276,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652734+0000","last_change":"2023-01-02T18:16:44.306676+0000","last_active":"2023-01-02T18:17:47.652734+0000","last_peered":"2023-01-02T18:17:47.652734+0000","last_clean":"2023-01-02T18:17:47.652734+0000","last_became_active":"2023-01-02T18:16:41.446794+0000","last_became_peered":"2023-01-02T18:16:41.446794+0000","last_unstale":"2023-01-02T18:17:47.652734+0000","last_undegraded":"2023-01-02T18:17:47.652734+0000","last_fullsized":"2023-01-02T18:17:47.652734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"92'24","reported_seq":225,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655118+0000","last_change":"2023-01-02T18:17:30.435534+0000","last_active":"2023-01-02T18:17:47.655118+0000","last_peered":"2023-01-02T18:17:47.655118+0000","last_clean":"2023-01-02T18:17:47.655118+0000","last_became_active":"2023-01-02T18:16:37.427175+0000","last_became_peered":"2023-01-02T18:16:37.427175+0000","last_unstale":"2023-01-02T18:17:47.655118+0000","last_undegraded":"2023-01-02T18:17:47.655118+0000","last_fullsized":"2023-01-02T18:17:47.655118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":270,"num_read_kb":225,"num_write":35,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":73,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652949+0000","last_change":"2023-01-02T18:16:49.318455+0000","last_active":"2023-01-02T18:17:47.652949+0000","last_peered":"2023-01-02T18:17:47.652949+0000","last_clean":"2023-01-02T18:17:47.652949+0000","last_became_active":"2023-01-02T18:16:48.329597+0000","last_became_peered":"2023-01-02T18:16:48.329597+0000","last_unstale":"2023-01-02T18:17:47.652949+0000","last_undegraded":"2023-01-02T18:17:47.652949+0000","last_fullsized":"2023-01-02T18:17:47.652949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655649+0000","last_change":"2023-01-02T18:16:53.344973+0000","last_active":"2023-01-02T18:17:47.655649+0000","last_peered":"2023-01-02T18:17:47.655649+0000","last_clean":"2023-01-02T18:17:47.655649+0000","last_became_active":"2023-01-02T18:16:51.341196+0000","last_became_peered":"2023-01-02T18:16:51.341196+0000","last_unstale":"2023-01-02T18:17:47.655649+0000","last_undegraded":"2023-01-02T18:17:47.655649+0000","last_fullsized":"2023-01-02T18:17:47.655649+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":155,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654015+0000","last_change":"2023-01-02T18:17:29.345837+0000","last_active":"2023-01-02T18:17:47.654015+0000","last_peered":"2023-01-02T18:17:47.654015+0000","last_clean":"2023-01-02T18:17:47.654015+0000","last_became_active":"2023-01-02T18:17:29.339458+0000","last_became_peered":"2023-01-02T18:17:29.339458+0000","last_unstale":"2023-01-02T18:17:47.654015+0000","last_undegraded":"2023-01-02T18:17:47.654015+0000","last_fullsized":"2023-01-02T18:17:47.654015+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647006+0000","last_change":"2023-01-02T18:17:38.542677+0000","last_active":"2023-01-02T18:17:47.647006+0000","last_peered":"2023-01-02T18:17:47.647006+0000","last_clean":"2023-01-02T18:17:47.647006+0000","last_became_active":"2023-01-02T18:17:36.441682+0000","last_became_peered":"2023-01-02T18:17:36.441682+0000","last_unstale":"2023-01-02T18:17:47.647006+0000","last_undegraded":"2023-01-02T18:17:47.647006+0000","last_fullsized":"2023-01-02T18:17:47.647006+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654291+0000","last_change":"2023-01-02T18:17:34.333930+0000","last_active":"2023-01-02T18:17:47.654291+0000","last_peered":"2023-01-02T18:17:47.654291+0000","last_clean":"2023-01-02T18:17:47.654291+0000","last_became_active":"2023-01-02T18:17:32.340028+0000","last_became_peered":"2023-01-02T18:17:32.340028+0000","last_unstale":"2023-01-02T18:17:47.654291+0000","last_undegraded":"2023-01-02T18:17:47.654291+0000","last_fullsized":"2023-01-02T18:17:47.654291+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"76'1","reported_seq":53,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665350+0000","last_change":"2023-01-02T18:17:09.324016+0000","last_active":"2023-01-02T18:17:47.665350+0000","last_peered":"2023-01-02T18:17:47.665350+0000","last_clean":"2023-01-02T18:17:47.665350+0000","last_became_active":"2023-01-02T18:17:07.347854+0000","last_became_peered":"2023-01-02T18:17:07.347854+0000","last_unstale":"2023-01-02T18:17:47.665350+0000","last_undegraded":"2023-01-02T18:17:47.665350+0000","last_fullsized":"2023-01-02T18:17:47.665350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"72'4","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654909+0000","last_change":"2023-01-02T18:17:01.311706+0000","last_active":"2023-01-02T18:17:47.654909+0000","last_peered":"2023-01-02T18:17:47.654909+0000","last_clean":"2023-01-02T18:17:47.654909+0000","last_became_active":"2023-01-02T18:16:59.313908+0000","last_became_peered":"2023-01-02T18:16:59.313908+0000","last_unstale":"2023-01-02T18:17:47.654909+0000","last_undegraded":"2023-01-02T18:17:47.654909+0000","last_fullsized":"2023-01-02T18:17:47.654909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"51'2","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653540+0000","last_change":"2023-01-02T18:16:48.343757+0000","last_active":"2023-01-02T18:17:47.653540+0000","last_peered":"2023-01-02T18:17:47.653540+0000","last_clean":"2023-01-02T18:17:47.653540+0000","last_became_active":"2023-01-02T18:16:48.326121+0000","last_became_peered":"2023-01-02T18:16:48.326121+0000","last_unstale":"2023-01-02T18:17:47.653540+0000","last_undegraded":"2023-01-02T18:17:47.653540+0000","last_fullsized":"2023-01-02T18:17:47.653540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"86'2","reported_seq":41,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655595+0000","last_change":"2023-01-02T18:17:30.331220+0000","last_active":"2023-01-02T18:17:47.655595+0000","last_peered":"2023-01-02T18:17:47.655595+0000","last_clean":"2023-01-02T18:17:47.655595+0000","last_became_active":"2023-01-02T18:17:29.331135+0000","last_became_peered":"2023-01-02T18:17:29.331135+0000","last_unstale":"2023-01-02T18:17:47.655595+0000","last_undegraded":"2023-01-02T18:17:47.655595+0000","last_fullsized":"2023-01-02T18:17:47.655595+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":86,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"56'1","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654949+0000","last_change":"2023-01-02T18:17:29.356376+0000","last_active":"2023-01-02T18:17:47.654949+0000","last_peered":"2023-01-02T18:17:47.654949+0000","last_clean":"2023-01-02T18:17:47.654949+0000","last_became_active":"2023-01-02T18:17:29.327003+0000","last_became_peered":"2023-01-02T18:17:29.327003+0000","last_unstale":"2023-01-02T18:17:47.654949+0000","last_undegraded":"2023-01-02T18:17:47.654949+0000","last_fullsized":"2023-01-02T18:17:47.654949+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646530+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:17:47.646530+0000","last_peered":"2023-01-02T18:17:47.646530+0000","last_clean":"2023-01-02T18:17:47.646530+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:17:47.646530+0000","last_undegraded":"2023-01-02T18:17:47.646530+0000","last_fullsized":"2023-01-02T18:17:47.646530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653125+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:17:47.653125+0000","last_peered":"2023-01-02T18:17:47.653125+0000","last_clean":"2023-01-02T18:17:47.653125+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:17:47.653125+0000","last_undegraded":"2023-01-02T18:17:47.653125+0000","last_fullsized":"2023-01-02T18:17:47.653125+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"109'4","reported_seq":26,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652835+0000","last_change":"2023-01-02T18:17:38.459353+0000","last_active":"2023-01-02T18:17:47.652835+0000","last_peered":"2023-01-02T18:17:47.652835+0000","last_clean":"2023-01-02T18:17:47.652835+0000","last_became_active":"2023-01-02T18:17:36.439601+0000","last_became_peered":"2023-01-02T18:17:36.439601+0000","last_unstale":"2023-01-02T18:17:47.652835+0000","last_undegraded":"2023-01-02T18:17:47.652835+0000","last_fullsized":"2023-01-02T18:17:47.652835+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"101'8","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654544+0000","last_change":"2023-01-02T18:17:34.347450+0000","last_active":"2023-01-02T18:17:47.654544+0000","last_peered":"2023-01-02T18:17:47.654544+0000","last_clean":"2023-01-02T18:17:47.654544+0000","last_became_active":"2023-01-02T18:17:32.337265+0000","last_became_peered":"2023-01-02T18:17:32.337265+0000","last_unstale":"2023-01-02T18:17:47.654544+0000","last_undegraded":"2023-01-02T18:17:47.654544+0000","last_fullsized":"2023-01-02T18:17:47.654544+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"76'1","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655576+0000","last_change":"2023-01-02T18:17:09.308912+0000","last_active":"2023-01-02T18:17:47.655576+0000","last_peered":"2023-01-02T18:17:47.655576+0000","last_clean":"2023-01-02T18:17:47.655576+0000","last_became_active":"2023-01-02T18:17:07.339397+0000","last_became_peered":"2023-01-02T18:17:07.339397+0000","last_unstale":"2023-01-02T18:17:47.655576+0000","last_undegraded":"2023-01-02T18:17:47.655576+0000","last_fullsized":"2023-01-02T18:17:47.655576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":58,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662628+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:17:47.662628+0000","last_peered":"2023-01-02T18:17:47.662628+0000","last_clean":"2023-01-02T18:17:47.662628+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:17:47.662628+0000","last_undegraded":"2023-01-02T18:17:47.662628+0000","last_fullsized":"2023-01-02T18:17:47.662628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655543+0000","last_change":"2023-01-02T18:16:48.330072+0000","last_active":"2023-01-02T18:17:47.655543+0000","last_peered":"2023-01-02T18:17:47.655543+0000","last_clean":"2023-01-02T18:17:47.655543+0000","last_became_active":"2023-01-02T18:16:48.329697+0000","last_became_peered":"2023-01-02T18:16:48.329697+0000","last_unstale":"2023-01-02T18:17:47.655543+0000","last_undegraded":"2023-01-02T18:17:47.655543+0000","last_fullsized":"2023-01-02T18:17:47.655543+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"97'33","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655221+0000","last_change":"2023-01-02T18:17:30.331571+0000","last_active":"2023-01-02T18:17:47.655221+0000","last_peered":"2023-01-02T18:17:47.655221+0000","last_clean":"2023-01-02T18:17:47.655221+0000","last_became_active":"2023-01-02T18:17:29.326006+0000","last_became_peered":"2023-01-02T18:17:29.326006+0000","last_unstale":"2023-01-02T18:17:47.655221+0000","last_undegraded":"2023-01-02T18:17:47.655221+0000","last_fullsized":"2023-01-02T18:17:47.655221+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":86,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":58,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":137,"num_keys_recovered":70,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"56'2","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663958+0000","last_change":"2023-01-02T18:16:49.305216+0000","last_active":"2023-01-02T18:17:47.663958+0000","last_peered":"2023-01-02T18:17:47.663958+0000","last_clean":"2023-01-02T18:17:47.663958+0000","last_became_active":"2023-01-02T18:16:48.327069+0000","last_became_peered":"2023-01-02T18:16:48.327069+0000","last_unstale":"2023-01-02T18:17:47.663958+0000","last_undegraded":"2023-01-02T18:17:47.663958+0000","last_fullsized":"2023-01-02T18:17:47.663958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654386+0000","last_change":"2023-01-02T18:17:29.326893+0000","last_active":"2023-01-02T18:17:47.654386+0000","last_peered":"2023-01-02T18:17:47.654386+0000","last_clean":"2023-01-02T18:17:47.654386+0000","last_became_active":"2023-01-02T18:17:29.326037+0000","last_became_peered":"2023-01-02T18:17:29.326037+0000","last_unstale":"2023-01-02T18:17:47.654386+0000","last_undegraded":"2023-01-02T18:17:47.654386+0000","last_fullsized":"2023-01-02T18:17:47.654386+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":581,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653049+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:17:47.653049+0000","last_peered":"2023-01-02T18:17:47.653049+0000","last_clean":"2023-01-02T18:17:47.653049+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:17:47.653049+0000","last_undegraded":"2023-01-02T18:17:47.653049+0000","last_fullsized":"2023-01-02T18:17:47.653049+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655584+0000","last_change":"2023-01-02T18:17:38.445785+0000","last_active":"2023-01-02T18:17:47.655584+0000","last_peered":"2023-01-02T18:17:47.655584+0000","last_clean":"2023-01-02T18:17:47.655584+0000","last_became_active":"2023-01-02T18:17:36.435481+0000","last_became_peered":"2023-01-02T18:17:36.435481+0000","last_unstale":"2023-01-02T18:17:47.655584+0000","last_undegraded":"2023-01-02T18:17:47.655584+0000","last_fullsized":"2023-01-02T18:17:47.655584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654221+0000","last_change":"2023-01-02T18:17:34.326763+0000","last_active":"2023-01-02T18:17:47.654221+0000","last_peered":"2023-01-02T18:17:47.654221+0000","last_clean":"2023-01-02T18:17:47.654221+0000","last_became_active":"2023-01-02T18:17:32.347186+0000","last_became_peered":"2023-01-02T18:17:32.347186+0000","last_unstale":"2023-01-02T18:17:47.654221+0000","last_undegraded":"2023-01-02T18:17:47.654221+0000","last_fullsized":"2023-01-02T18:17:47.654221+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"76'79","reported_seq":572,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662854+0000","last_change":"2023-01-02T18:17:09.321800+0000","last_active":"2023-01-02T18:17:47.662854+0000","last_peered":"2023-01-02T18:17:47.662854+0000","last_clean":"2023-01-02T18:17:47.662854+0000","last_became_active":"2023-01-02T18:17:07.340907+0000","last_became_peered":"2023-01-02T18:17:07.340907+0000","last_unstale":"2023-01-02T18:17:47.662854+0000","last_undegraded":"2023-01-02T18:17:47.662854+0000","last_fullsized":"2023-01-02T18:17:47.662854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1144,"num_read_kb":1037,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'17","reported_seq":197,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662823+0000","last_change":"2023-01-02T18:17:29.368980+0000","last_active":"2023-01-02T18:17:47.662823+0000","last_peered":"2023-01-02T18:17:47.662823+0000","last_clean":"2023-01-02T18:17:47.662823+0000","last_became_active":"2023-01-02T18:17:29.341397+0000","last_became_peered":"2023-01-02T18:17:29.341397+0000","last_unstale":"2023-01-02T18:17:47.662823+0000","last_undegraded":"2023-01-02T18:17:47.662823+0000","last_fullsized":"2023-01-02T18:17:47.662823+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653401+0000","last_change":"2023-01-02T18:16:57.307585+0000","last_active":"2023-01-02T18:17:47.653401+0000","last_peered":"2023-01-02T18:17:47.653401+0000","last_clean":"2023-01-02T18:17:47.653401+0000","last_became_active":"2023-01-02T18:16:55.315726+0000","last_became_peered":"2023-01-02T18:16:55.315726+0000","last_unstale":"2023-01-02T18:17:47.653401+0000","last_undegraded":"2023-01-02T18:17:47.653401+0000","last_fullsized":"2023-01-02T18:17:47.653401+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":91,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646715+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:17:47.646715+0000","last_peered":"2023-01-02T18:17:47.646715+0000","last_clean":"2023-01-02T18:17:47.646715+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:17:47.646715+0000","last_undegraded":"2023-01-02T18:17:47.646715+0000","last_fullsized":"2023-01-02T18:17:47.646715+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":137,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647213+0000","last_change":"2023-01-02T18:17:30.328445+0000","last_active":"2023-01-02T18:17:47.647213+0000","last_peered":"2023-01-02T18:17:47.647213+0000","last_clean":"2023-01-02T18:17:47.647213+0000","last_became_active":"2023-01-02T18:16:48.331845+0000","last_became_peered":"2023-01-02T18:16:48.331845+0000","last_unstale":"2023-01-02T18:17:47.647213+0000","last_undegraded":"2023-01-02T18:17:47.647213+0000","last_fullsized":"2023-01-02T18:17:47.647213+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648052+0000","last_change":"2023-01-02T18:16:49.324534+0000","last_active":"2023-01-02T18:17:47.648052+0000","last_peered":"2023-01-02T18:17:47.648052+0000","last_clean":"2023-01-02T18:17:47.648052+0000","last_became_active":"2023-01-02T18:16:48.327014+0000","last_became_peered":"2023-01-02T18:16:48.327014+0000","last_unstale":"2023-01-02T18:17:47.648052+0000","last_undegraded":"2023-01-02T18:17:47.648052+0000","last_fullsized":"2023-01-02T18:17:47.648052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":75,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654247+0000","last_change":"2023-01-02T18:17:29.338016+0000","last_active":"2023-01-02T18:17:47.654247+0000","last_peered":"2023-01-02T18:17:47.654247+0000","last_clean":"2023-01-02T18:17:47.654247+0000","last_became_active":"2023-01-02T18:17:29.337654+0000","last_became_peered":"2023-01-02T18:17:29.337654+0000","last_unstale":"2023-01-02T18:17:47.654247+0000","last_undegraded":"2023-01-02T18:17:47.654247+0000","last_fullsized":"2023-01-02T18:17:47.654247+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655726+0000","last_change":"2023-01-02T18:17:38.469074+0000","last_active":"2023-01-02T18:17:47.655726+0000","last_peered":"2023-01-02T18:17:47.655726+0000","last_clean":"2023-01-02T18:17:47.655726+0000","last_became_active":"2023-01-02T18:17:36.439327+0000","last_became_peered":"2023-01-02T18:17:36.439327+0000","last_unstale":"2023-01-02T18:17:47.655726+0000","last_undegraded":"2023-01-02T18:17:47.655726+0000","last_fullsized":"2023-01-02T18:17:47.655726+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653445+0000","last_change":"2023-01-02T18:17:34.327801+0000","last_active":"2023-01-02T18:17:47.653445+0000","last_peered":"2023-01-02T18:17:47.653445+0000","last_clean":"2023-01-02T18:17:47.653445+0000","last_became_active":"2023-01-02T18:17:32.346998+0000","last_became_peered":"2023-01-02T18:17:32.346998+0000","last_unstale":"2023-01-02T18:17:47.653445+0000","last_undegraded":"2023-01-02T18:17:47.653445+0000","last_fullsized":"2023-01-02T18:17:47.653445+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654499+0000","last_change":"2023-01-02T18:17:09.310675+0000","last_active":"2023-01-02T18:17:47.654499+0000","last_peered":"2023-01-02T18:17:47.654499+0000","last_clean":"2023-01-02T18:17:47.654499+0000","last_became_active":"2023-01-02T18:17:07.345963+0000","last_became_peered":"2023-01-02T18:17:07.345963+0000","last_unstale":"2023-01-02T18:17:47.654499+0000","last_undegraded":"2023-01-02T18:17:47.654499+0000","last_fullsized":"2023-01-02T18:17:47.654499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655840+0000","last_change":"2023-01-02T18:17:29.335050+0000","last_active":"2023-01-02T18:17:47.655840+0000","last_peered":"2023-01-02T18:17:47.655840+0000","last_clean":"2023-01-02T18:17:47.655840+0000","last_became_active":"2023-01-02T18:17:29.333986+0000","last_became_peered":"2023-01-02T18:17:29.333986+0000","last_unstale":"2023-01-02T18:17:47.655840+0000","last_undegraded":"2023-01-02T18:17:47.655840+0000","last_fullsized":"2023-01-02T18:17:47.655840+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652983+0000","last_change":"2023-01-02T18:16:49.309259+0000","last_active":"2023-01-02T18:17:47.652983+0000","last_peered":"2023-01-02T18:17:47.652983+0000","last_clean":"2023-01-02T18:17:47.652983+0000","last_became_active":"2023-01-02T18:16:46.313760+0000","last_became_peered":"2023-01-02T18:16:46.313760+0000","last_unstale":"2023-01-02T18:17:47.652983+0000","last_undegraded":"2023-01-02T18:17:47.652983+0000","last_fullsized":"2023-01-02T18:17:47.652983+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656072+0000","last_change":"2023-01-02T18:17:29.372464+0000","last_active":"2023-01-02T18:17:47.656072+0000","last_peered":"2023-01-02T18:17:47.656072+0000","last_clean":"2023-01-02T18:17:47.656072+0000","last_became_active":"2023-01-02T18:17:29.332091+0000","last_became_peered":"2023-01-02T18:17:29.332091+0000","last_unstale":"2023-01-02T18:17:47.656072+0000","last_undegraded":"2023-01-02T18:17:47.656072+0000","last_fullsized":"2023-01-02T18:17:47.656072+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":132,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648546+0000","last_change":"2023-01-02T18:17:30.328637+0000","last_active":"2023-01-02T18:17:47.648546+0000","last_peered":"2023-01-02T18:17:47.648546+0000","last_clean":"2023-01-02T18:17:47.648546+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:17:47.648546+0000","last_undegraded":"2023-01-02T18:17:47.648546+0000","last_fullsized":"2023-01-02T18:17:47.648546+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653488+0000","last_change":"2023-01-02T18:17:36.450224+0000","last_active":"2023-01-02T18:17:47.653488+0000","last_peered":"2023-01-02T18:17:47.653488+0000","last_clean":"2023-01-02T18:17:47.653488+0000","last_became_active":"2023-01-02T18:17:36.449891+0000","last_became_peered":"2023-01-02T18:17:36.449891+0000","last_unstale":"2023-01-02T18:17:47.653488+0000","last_undegraded":"2023-01-02T18:17:47.653488+0000","last_fullsized":"2023-01-02T18:17:47.653488+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662630+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:17:47.662630+0000","last_peered":"2023-01-02T18:17:47.662630+0000","last_clean":"2023-01-02T18:17:47.662630+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:17:47.662630+0000","last_undegraded":"2023-01-02T18:17:47.662630+0000","last_fullsized":"2023-01-02T18:17:47.662630+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654122+0000","last_change":"2023-01-02T18:16:57.312949+0000","last_active":"2023-01-02T18:17:47.654122+0000","last_peered":"2023-01-02T18:17:47.654122+0000","last_clean":"2023-01-02T18:17:47.654122+0000","last_became_active":"2023-01-02T18:16:55.315334+0000","last_became_peered":"2023-01-02T18:16:55.315334+0000","last_unstale":"2023-01-02T18:17:47.654122+0000","last_undegraded":"2023-01-02T18:17:47.654122+0000","last_fullsized":"2023-01-02T18:17:47.654122+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665368+0000","last_change":"2023-01-02T18:17:38.465060+0000","last_active":"2023-01-02T18:17:47.665368+0000","last_peered":"2023-01-02T18:17:47.665368+0000","last_clean":"2023-01-02T18:17:47.665368+0000","last_became_active":"2023-01-02T18:17:36.442117+0000","last_became_peered":"2023-01-02T18:17:36.442117+0000","last_unstale":"2023-01-02T18:17:47.665368+0000","last_undegraded":"2023-01-02T18:17:47.665368+0000","last_fullsized":"2023-01-02T18:17:47.665368+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"101'15","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653488+0000","last_change":"2023-01-02T18:17:34.328115+0000","last_active":"2023-01-02T18:17:47.653488+0000","last_peered":"2023-01-02T18:17:47.653488+0000","last_clean":"2023-01-02T18:17:47.653488+0000","last_became_active":"2023-01-02T18:17:32.347252+0000","last_became_peered":"2023-01-02T18:17:32.347252+0000","last_unstale":"2023-01-02T18:17:47.653488+0000","last_undegraded":"2023-01-02T18:17:47.653488+0000","last_fullsized":"2023-01-02T18:17:47.653488+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":66,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.662784+0000","last_change":"2023-01-02T18:17:48.662784+0000","last_active":"2023-01-02T18:17:48.662784+0000","last_peered":"2023-01-02T18:17:48.662784+0000","last_clean":"2023-01-02T18:17:48.662784+0000","last_became_active":"2023-01-02T18:17:48.662397+0000","last_became_peered":"2023-01-02T18:17:48.662397+0000","last_unstale":"2023-01-02T18:17:48.662784+0000","last_undegraded":"2023-01-02T18:17:48.662784+0000","last_fullsized":"2023-01-02T18:17:48.662784+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648056+0000","last_change":"2023-01-02T18:17:01.319510+0000","last_active":"2023-01-02T18:17:47.648056+0000","last_peered":"2023-01-02T18:17:47.648056+0000","last_clean":"2023-01-02T18:17:47.648056+0000","last_became_active":"2023-01-02T18:16:59.327716+0000","last_became_peered":"2023-01-02T18:16:59.327716+0000","last_unstale":"2023-01-02T18:17:47.648056+0000","last_undegraded":"2023-01-02T18:17:47.648056+0000","last_fullsized":"2023-01-02T18:17:47.648056+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":73,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656912+0000","last_change":"2023-01-02T18:16:49.310704+0000","last_active":"2023-01-02T18:17:47.656912+0000","last_peered":"2023-01-02T18:17:47.656912+0000","last_clean":"2023-01-02T18:17:47.656912+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:47.656912+0000","last_undegraded":"2023-01-02T18:17:47.656912+0000","last_fullsized":"2023-01-02T18:17:47.656912+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652569+0000","last_change":"2023-01-02T18:16:44.307480+0000","last_active":"2023-01-02T18:17:47.652569+0000","last_peered":"2023-01-02T18:17:47.652569+0000","last_clean":"2023-01-02T18:17:47.652569+0000","last_became_active":"2023-01-02T18:16:41.447912+0000","last_became_peered":"2023-01-02T18:16:41.447912+0000","last_unstale":"2023-01-02T18:17:47.652569+0000","last_undegraded":"2023-01-02T18:17:47.652569+0000","last_fullsized":"2023-01-02T18:17:47.652569+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655915+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:17:47.655915+0000","last_peered":"2023-01-02T18:17:47.655915+0000","last_clean":"2023-01-02T18:17:47.655915+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:17:47.655915+0000","last_undegraded":"2023-01-02T18:17:47.655915+0000","last_fullsized":"2023-01-02T18:17:47.655915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"92'13","reported_seq":148,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656231+0000","last_change":"2023-01-02T18:17:30.435879+0000","last_active":"2023-01-02T18:17:47.656231+0000","last_peered":"2023-01-02T18:17:47.656231+0000","last_clean":"2023-01-02T18:17:47.656231+0000","last_became_active":"2023-01-02T18:16:37.431863+0000","last_became_peered":"2023-01-02T18:16:37.431863+0000","last_unstale":"2023-01-02T18:17:47.656231+0000","last_undegraded":"2023-01-02T18:17:47.656231+0000","last_fullsized":"2023-01-02T18:17:47.656231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654038+0000","last_change":"2023-01-02T18:16:53.344851+0000","last_active":"2023-01-02T18:17:47.654038+0000","last_peered":"2023-01-02T18:17:47.654038+0000","last_clean":"2023-01-02T18:17:47.654038+0000","last_became_active":"2023-01-02T18:16:51.341804+0000","last_became_peered":"2023-01-02T18:16:51.341804+0000","last_unstale":"2023-01-02T18:17:47.654038+0000","last_undegraded":"2023-01-02T18:17:47.654038+0000","last_fullsized":"2023-01-02T18:17:47.654038+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656123+0000","last_change":"2023-01-02T18:16:57.313134+0000","last_active":"2023-01-02T18:17:47.656123+0000","last_peered":"2023-01-02T18:17:47.656123+0000","last_clean":"2023-01-02T18:17:47.656123+0000","last_became_active":"2023-01-02T18:16:55.311645+0000","last_became_peered":"2023-01-02T18:16:55.311645+0000","last_unstale":"2023-01-02T18:17:47.656123+0000","last_undegraded":"2023-01-02T18:17:47.656123+0000","last_fullsized":"2023-01-02T18:17:47.656123+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654833+0000","last_change":"2023-01-02T18:17:38.469077+0000","last_active":"2023-01-02T18:17:47.654833+0000","last_peered":"2023-01-02T18:17:47.654833+0000","last_clean":"2023-01-02T18:17:47.654833+0000","last_became_active":"2023-01-02T18:17:36.436242+0000","last_became_peered":"2023-01-02T18:17:36.436242+0000","last_unstale":"2023-01-02T18:17:47.654833+0000","last_undegraded":"2023-01-02T18:17:47.654833+0000","last_fullsized":"2023-01-02T18:17:47.654833+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653043+0000","last_change":"2023-01-02T18:17:34.327358+0000","last_active":"2023-01-02T18:17:47.653043+0000","last_peered":"2023-01-02T18:17:47.653043+0000","last_clean":"2023-01-02T18:17:47.653043+0000","last_became_active":"2023-01-02T18:17:32.339808+0000","last_became_peered":"2023-01-02T18:17:32.339808+0000","last_unstale":"2023-01-02T18:17:47.653043+0000","last_undegraded":"2023-01-02T18:17:47.653043+0000","last_fullsized":"2023-01-02T18:17:47.653043+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665131+0000","last_change":"2023-01-02T18:17:09.323298+0000","last_active":"2023-01-02T18:17:47.665131+0000","last_peered":"2023-01-02T18:17:47.665131+0000","last_clean":"2023-01-02T18:17:47.665131+0000","last_became_active":"2023-01-02T18:17:07.342742+0000","last_became_peered":"2023-01-02T18:17:07.342742+0000","last_unstale":"2023-01-02T18:17:47.665131+0000","last_undegraded":"2023-01-02T18:17:47.665131+0000","last_fullsized":"2023-01-02T18:17:47.665131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655807+0000","last_change":"2023-01-02T18:17:01.310492+0000","last_active":"2023-01-02T18:17:47.655807+0000","last_peered":"2023-01-02T18:17:47.655807+0000","last_clean":"2023-01-02T18:17:47.655807+0000","last_became_active":"2023-01-02T18:16:59.313793+0000","last_became_peered":"2023-01-02T18:16:59.313793+0000","last_unstale":"2023-01-02T18:17:47.655807+0000","last_undegraded":"2023-01-02T18:17:47.655807+0000","last_fullsized":"2023-01-02T18:17:47.655807+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"56'1","reported_seq":73,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654303+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:17:47.654303+0000","last_peered":"2023-01-02T18:17:47.654303+0000","last_clean":"2023-01-02T18:17:47.654303+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:17:47.654303+0000","last_undegraded":"2023-01-02T18:17:47.654303+0000","last_fullsized":"2023-01-02T18:17:47.654303+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":31,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655667+0000","last_change":"2023-01-02T18:17:29.344997+0000","last_active":"2023-01-02T18:17:47.655667+0000","last_peered":"2023-01-02T18:17:47.655667+0000","last_clean":"2023-01-02T18:17:47.655667+0000","last_became_active":"2023-01-02T18:17:29.323459+0000","last_became_peered":"2023-01-02T18:17:29.323459+0000","last_unstale":"2023-01-02T18:17:47.655667+0000","last_undegraded":"2023-01-02T18:17:47.655667+0000","last_fullsized":"2023-01-02T18:17:47.655667+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":81,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"46'2","reported_seq":128,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654927+0000","last_change":"2023-01-02T18:17:30.330076+0000","last_active":"2023-01-02T18:17:47.654927+0000","last_peered":"2023-01-02T18:17:47.654927+0000","last_clean":"2023-01-02T18:17:47.654927+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:17:47.654927+0000","last_undegraded":"2023-01-02T18:17:47.654927+0000","last_fullsized":"2023-01-02T18:17:47.654927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665285+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:17:47.665285+0000","last_peered":"2023-01-02T18:17:47.665285+0000","last_clean":"2023-01-02T18:17:47.665285+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:17:47.665285+0000","last_undegraded":"2023-01-02T18:17:47.665285+0000","last_fullsized":"2023-01-02T18:17:47.665285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653033+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:17:47.653033+0000","last_peered":"2023-01-02T18:17:47.653033+0000","last_clean":"2023-01-02T18:17:47.653033+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:17:47.653033+0000","last_undegraded":"2023-01-02T18:17:47.653033+0000","last_fullsized":"2023-01-02T18:17:47.653033+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654334+0000","last_change":"2023-01-02T18:17:29.326283+0000","last_active":"2023-01-02T18:17:47.654334+0000","last_peered":"2023-01-02T18:17:47.654334+0000","last_clean":"2023-01-02T18:17:47.654334+0000","last_became_active":"2023-01-02T18:17:29.325965+0000","last_became_peered":"2023-01-02T18:17:29.325965+0000","last_unstale":"2023-01-02T18:17:47.654334+0000","last_undegraded":"2023-01-02T18:17:47.654334+0000","last_fullsized":"2023-01-02T18:17:47.654334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"106'4","reported_seq":26,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656986+0000","last_change":"2023-01-02T18:17:38.450921+0000","last_active":"2023-01-02T18:17:47.656986+0000","last_peered":"2023-01-02T18:17:47.656986+0000","last_clean":"2023-01-02T18:17:47.656986+0000","last_became_active":"2023-01-02T18:17:36.444808+0000","last_became_peered":"2023-01-02T18:17:36.444808+0000","last_unstale":"2023-01-02T18:17:47.656986+0000","last_undegraded":"2023-01-02T18:17:47.656986+0000","last_fullsized":"2023-01-02T18:17:47.656986+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647015+0000","last_change":"2023-01-02T18:17:34.316738+0000","last_active":"2023-01-02T18:17:47.647015+0000","last_peered":"2023-01-02T18:17:47.647015+0000","last_clean":"2023-01-02T18:17:47.647015+0000","last_became_active":"2023-01-02T18:17:32.340483+0000","last_became_peered":"2023-01-02T18:17:32.340483+0000","last_unstale":"2023-01-02T18:17:47.647015+0000","last_undegraded":"2023-01-02T18:17:47.647015+0000","last_fullsized":"2023-01-02T18:17:47.647015+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646596+0000","last_change":"2023-01-02T18:17:09.321395+0000","last_active":"2023-01-02T18:17:47.646596+0000","last_peered":"2023-01-02T18:17:47.646596+0000","last_clean":"2023-01-02T18:17:47.646596+0000","last_became_active":"2023-01-02T18:17:07.344789+0000","last_became_peered":"2023-01-02T18:17:07.344789+0000","last_unstale":"2023-01-02T18:17:47.646596+0000","last_undegraded":"2023-01-02T18:17:47.646596+0000","last_fullsized":"2023-01-02T18:17:47.646596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"71'3","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651884+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:17:47.651884+0000","last_peered":"2023-01-02T18:17:47.651884+0000","last_clean":"2023-01-02T18:17:47.651884+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:17:47.651884+0000","last_undegraded":"2023-01-02T18:17:47.651884+0000","last_fullsized":"2023-01-02T18:17:47.651884+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'2","reported_seq":79,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648982+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:17:47.648982+0000","last_peered":"2023-01-02T18:17:47.648982+0000","last_clean":"2023-01-02T18:17:47.648982+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:17:47.648982+0000","last_undegraded":"2023-01-02T18:17:47.648982+0000","last_fullsized":"2023-01-02T18:17:47.648982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"94'15","reported_seq":195,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647390+0000","last_change":"2023-01-02T18:17:30.328344+0000","last_active":"2023-01-02T18:17:47.647390+0000","last_peered":"2023-01-02T18:17:47.647390+0000","last_clean":"2023-01-02T18:17:47.647390+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:47.647390+0000","last_undegraded":"2023-01-02T18:17:47.647390+0000","last_fullsized":"2023-01-02T18:17:47.647390+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":93,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652650+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:17:47.652650+0000","last_peered":"2023-01-02T18:17:47.652650+0000","last_clean":"2023-01-02T18:17:47.652650+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:17:47.652650+0000","last_undegraded":"2023-01-02T18:17:47.652650+0000","last_fullsized":"2023-01-02T18:17:47.652650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656970+0000","last_change":"2023-01-02T18:17:29.326478+0000","last_active":"2023-01-02T18:17:47.656970+0000","last_peered":"2023-01-02T18:17:47.656970+0000","last_clean":"2023-01-02T18:17:47.656970+0000","last_became_active":"2023-01-02T18:17:29.325843+0000","last_became_peered":"2023-01-02T18:17:29.325843+0000","last_unstale":"2023-01-02T18:17:47.656970+0000","last_undegraded":"2023-01-02T18:17:47.656970+0000","last_fullsized":"2023-01-02T18:17:47.656970+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":75,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654531+0000","last_change":"2023-01-02T18:17:29.318734+0000","last_active":"2023-01-02T18:17:47.654531+0000","last_peered":"2023-01-02T18:17:47.654531+0000","last_clean":"2023-01-02T18:17:47.654531+0000","last_became_active":"2023-01-02T18:17:29.318419+0000","last_became_peered":"2023-01-02T18:17:29.318419+0000","last_unstale":"2023-01-02T18:17:47.654531+0000","last_undegraded":"2023-01-02T18:17:47.654531+0000","last_fullsized":"2023-01-02T18:17:47.654531+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665510+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:17:47.665510+0000","last_peered":"2023-01-02T18:17:47.665510+0000","last_clean":"2023-01-02T18:17:47.665510+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:17:47.665510+0000","last_undegraded":"2023-01-02T18:17:47.665510+0000","last_fullsized":"2023-01-02T18:17:47.665510+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653624+0000","last_change":"2023-01-02T18:17:38.450765+0000","last_active":"2023-01-02T18:17:47.653624+0000","last_peered":"2023-01-02T18:17:47.653624+0000","last_clean":"2023-01-02T18:17:47.653624+0000","last_became_active":"2023-01-02T18:17:36.444834+0000","last_became_peered":"2023-01-02T18:17:36.444834+0000","last_unstale":"2023-01-02T18:17:47.653624+0000","last_undegraded":"2023-01-02T18:17:47.653624+0000","last_fullsized":"2023-01-02T18:17:47.653624+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653320+0000","last_change":"2023-01-02T18:17:34.327117+0000","last_active":"2023-01-02T18:17:47.653320+0000","last_peered":"2023-01-02T18:17:47.653320+0000","last_clean":"2023-01-02T18:17:47.653320+0000","last_became_active":"2023-01-02T18:17:32.340616+0000","last_became_peered":"2023-01-02T18:17:32.340616+0000","last_unstale":"2023-01-02T18:17:47.653320+0000","last_undegraded":"2023-01-02T18:17:47.653320+0000","last_fullsized":"2023-01-02T18:17:47.653320+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":20,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646786+0000","last_change":"2023-01-02T18:17:36.433551+0000","last_active":"2023-01-02T18:17:47.646786+0000","last_peered":"2023-01-02T18:17:47.646786+0000","last_clean":"2023-01-02T18:17:47.646786+0000","last_became_active":"2023-01-02T18:17:36.433227+0000","last_became_peered":"2023-01-02T18:17:36.433227+0000","last_unstale":"2023-01-02T18:17:47.646786+0000","last_undegraded":"2023-01-02T18:17:47.646786+0000","last_fullsized":"2023-01-02T18:17:47.646786+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652862+0000","last_change":"2023-01-02T18:17:29.338386+0000","last_active":"2023-01-02T18:17:47.652862+0000","last_peered":"2023-01-02T18:17:47.652862+0000","last_clean":"2023-01-02T18:17:47.652862+0000","last_became_active":"2023-01-02T18:17:29.337596+0000","last_became_peered":"2023-01-02T18:17:29.337596+0000","last_unstale":"2023-01-02T18:17:47.652862+0000","last_undegraded":"2023-01-02T18:17:47.652862+0000","last_fullsized":"2023-01-02T18:17:47.652862+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664427+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:17:47.664427+0000","last_peered":"2023-01-02T18:17:47.664427+0000","last_clean":"2023-01-02T18:17:47.664427+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:17:47.664427+0000","last_undegraded":"2023-01-02T18:17:47.664427+0000","last_fullsized":"2023-01-02T18:17:47.664427+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":90,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653268+0000","last_change":"2023-01-02T18:16:48.345373+0000","last_active":"2023-01-02T18:17:47.653268+0000","last_peered":"2023-01-02T18:17:47.653268+0000","last_clean":"2023-01-02T18:17:47.653268+0000","last_became_active":"2023-01-02T18:16:48.328041+0000","last_became_peered":"2023-01-02T18:16:48.328041+0000","last_unstale":"2023-01-02T18:17:47.653268+0000","last_undegraded":"2023-01-02T18:17:47.653268+0000","last_fullsized":"2023-01-02T18:17:47.653268+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"96'9","reported_seq":175,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653688+0000","last_change":"2023-01-02T18:17:30.434525+0000","last_active":"2023-01-02T18:17:47.653688+0000","last_peered":"2023-01-02T18:17:47.653688+0000","last_clean":"2023-01-02T18:17:47.653688+0000","last_became_active":"2023-01-02T18:17:29.334562+0000","last_became_peered":"2023-01-02T18:17:29.334562+0000","last_unstale":"2023-01-02T18:17:47.653688+0000","last_undegraded":"2023-01-02T18:17:47.653688+0000","last_fullsized":"2023-01-02T18:17:47.653688+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":70,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663027+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:17:47.663027+0000","last_peered":"2023-01-02T18:17:47.663027+0000","last_clean":"2023-01-02T18:17:47.663027+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:17:47.663027+0000","last_undegraded":"2023-01-02T18:17:47.663027+0000","last_fullsized":"2023-01-02T18:17:47.663027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654855+0000","last_change":"2023-01-02T18:17:29.323754+0000","last_active":"2023-01-02T18:17:47.654855+0000","last_peered":"2023-01-02T18:17:47.654855+0000","last_clean":"2023-01-02T18:17:47.654855+0000","last_became_active":"2023-01-02T18:17:29.320497+0000","last_became_peered":"2023-01-02T18:17:29.320497+0000","last_unstale":"2023-01-02T18:17:47.654855+0000","last_undegraded":"2023-01-02T18:17:47.654855+0000","last_fullsized":"2023-01-02T18:17:47.654855+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656476+0000","last_change":"2023-01-02T18:17:29.389087+0000","last_active":"2023-01-02T18:17:47.656476+0000","last_peered":"2023-01-02T18:17:47.656476+0000","last_clean":"2023-01-02T18:17:47.656476+0000","last_became_active":"2023-01-02T18:17:29.337136+0000","last_became_peered":"2023-01-02T18:17:29.337136+0000","last_unstale":"2023-01-02T18:17:47.656476+0000","last_undegraded":"2023-01-02T18:17:47.656476+0000","last_fullsized":"2023-01-02T18:17:47.656476+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648713+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:17:47.648713+0000","last_peered":"2023-01-02T18:17:47.648713+0000","last_clean":"2023-01-02T18:17:47.648713+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:17:47.648713+0000","last_undegraded":"2023-01-02T18:17:47.648713+0000","last_fullsized":"2023-01-02T18:17:47.648713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652817+0000","last_change":"2023-01-02T18:17:38.450620+0000","last_active":"2023-01-02T18:17:47.652817+0000","last_peered":"2023-01-02T18:17:47.652817+0000","last_clean":"2023-01-02T18:17:47.652817+0000","last_became_active":"2023-01-02T18:17:36.443497+0000","last_became_peered":"2023-01-02T18:17:36.443497+0000","last_unstale":"2023-01-02T18:17:47.652817+0000","last_undegraded":"2023-01-02T18:17:47.652817+0000","last_fullsized":"2023-01-02T18:17:47.652817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654137+0000","last_change":"2023-01-02T18:17:34.316527+0000","last_active":"2023-01-02T18:17:47.654137+0000","last_peered":"2023-01-02T18:17:47.654137+0000","last_clean":"2023-01-02T18:17:47.654137+0000","last_became_active":"2023-01-02T18:17:32.342303+0000","last_became_peered":"2023-01-02T18:17:32.342303+0000","last_unstale":"2023-01-02T18:17:47.654137+0000","last_undegraded":"2023-01-02T18:17:47.654137+0000","last_fullsized":"2023-01-02T18:17:47.654137+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"76'9","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655514+0000","last_change":"2023-01-02T18:17:29.361212+0000","last_active":"2023-01-02T18:17:47.655514+0000","last_peered":"2023-01-02T18:17:47.655514+0000","last_clean":"2023-01-02T18:17:47.655514+0000","last_became_active":"2023-01-02T18:17:29.328070+0000","last_became_peered":"2023-01-02T18:17:29.328070+0000","last_unstale":"2023-01-02T18:17:47.655514+0000","last_undegraded":"2023-01-02T18:17:47.655514+0000","last_fullsized":"2023-01-02T18:17:47.655514+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"72'1","reported_seq":84,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.660556+0000","last_change":"2023-01-02T18:17:48.660556+0000","last_active":"2023-01-02T18:17:48.660556+0000","last_peered":"2023-01-02T18:17:48.660556+0000","last_clean":"2023-01-02T18:17:48.660556+0000","last_became_active":"2023-01-02T18:17:48.656706+0000","last_became_peered":"2023-01-02T18:17:48.656706+0000","last_unstale":"2023-01-02T18:17:48.660556+0000","last_undegraded":"2023-01-02T18:17:48.660556+0000","last_fullsized":"2023-01-02T18:17:48.660556+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.654077+0000","last_change":"2023-01-02T18:17:48.654077+0000","last_active":"2023-01-02T18:17:48.654077+0000","last_peered":"2023-01-02T18:17:48.654077+0000","last_clean":"2023-01-02T18:17:48.654077+0000","last_became_active":"2023-01-02T18:17:48.653707+0000","last_became_peered":"2023-01-02T18:17:48.653707+0000","last_unstale":"2023-01-02T18:17:48.654077+0000","last_undegraded":"2023-01-02T18:17:48.654077+0000","last_fullsized":"2023-01-02T18:17:48.654077+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"90'10","reported_seq":166,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651062+0000","last_change":"2023-01-02T18:17:30.324702+0000","last_active":"2023-01-02T18:17:47.651062+0000","last_peered":"2023-01-02T18:17:47.651062+0000","last_clean":"2023-01-02T18:17:47.651062+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:17:47.651062+0000","last_undegraded":"2023-01-02T18:17:47.651062+0000","last_fullsized":"2023-01-02T18:17:47.651062+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":84,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652660+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:17:47.652660+0000","last_peered":"2023-01-02T18:17:47.652660+0000","last_clean":"2023-01-02T18:17:47.652660+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:17:47.652660+0000","last_undegraded":"2023-01-02T18:17:47.652660+0000","last_fullsized":"2023-01-02T18:17:47.652660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":81,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647269+0000","last_change":"2023-01-02T18:17:29.328315+0000","last_active":"2023-01-02T18:17:47.647269+0000","last_peered":"2023-01-02T18:17:47.647269+0000","last_clean":"2023-01-02T18:17:47.647269+0000","last_became_active":"2023-01-02T18:17:29.328011+0000","last_became_peered":"2023-01-02T18:17:29.328011+0000","last_unstale":"2023-01-02T18:17:47.647269+0000","last_undegraded":"2023-01-02T18:17:47.647269+0000","last_fullsized":"2023-01-02T18:17:47.647269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664334+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:17:47.664334+0000","last_peered":"2023-01-02T18:17:47.664334+0000","last_clean":"2023-01-02T18:17:47.664334+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:17:47.664334+0000","last_undegraded":"2023-01-02T18:17:47.664334+0000","last_fullsized":"2023-01-02T18:17:47.664334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647890+0000","last_change":"2023-01-02T18:16:57.306312+0000","last_active":"2023-01-02T18:17:47.647890+0000","last_peered":"2023-01-02T18:17:47.647890+0000","last_clean":"2023-01-02T18:17:47.647890+0000","last_became_active":"2023-01-02T18:16:55.314537+0000","last_became_peered":"2023-01-02T18:16:55.314537+0000","last_unstale":"2023-01-02T18:17:47.647890+0000","last_undegraded":"2023-01-02T18:17:47.647890+0000","last_fullsized":"2023-01-02T18:17:47.647890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655121+0000","last_change":"2023-01-02T18:17:38.449874+0000","last_active":"2023-01-02T18:17:47.655121+0000","last_peered":"2023-01-02T18:17:47.655121+0000","last_clean":"2023-01-02T18:17:47.655121+0000","last_became_active":"2023-01-02T18:17:36.445029+0000","last_became_peered":"2023-01-02T18:17:36.445029+0000","last_unstale":"2023-01-02T18:17:47.655121+0000","last_undegraded":"2023-01-02T18:17:47.655121+0000","last_fullsized":"2023-01-02T18:17:47.655121+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652691+0000","last_change":"2023-01-02T18:17:34.326569+0000","last_active":"2023-01-02T18:17:47.652691+0000","last_peered":"2023-01-02T18:17:47.652691+0000","last_clean":"2023-01-02T18:17:47.652691+0000","last_became_active":"2023-01-02T18:17:32.341143+0000","last_became_peered":"2023-01-02T18:17:32.341143+0000","last_unstale":"2023-01-02T18:17:47.652691+0000","last_undegraded":"2023-01-02T18:17:47.652691+0000","last_fullsized":"2023-01-02T18:17:47.652691+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"76'4","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662605+0000","last_change":"2023-01-02T18:17:09.322082+0000","last_active":"2023-01-02T18:17:47.662605+0000","last_peered":"2023-01-02T18:17:47.662605+0000","last_clean":"2023-01-02T18:17:47.662605+0000","last_became_active":"2023-01-02T18:17:07.340751+0000","last_became_peered":"2023-01-02T18:17:07.340751+0000","last_unstale":"2023-01-02T18:17:47.662605+0000","last_undegraded":"2023-01-02T18:17:47.662605+0000","last_fullsized":"2023-01-02T18:17:47.662605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654246+0000","last_change":"2023-01-02T18:17:29.386698+0000","last_active":"2023-01-02T18:17:47.654246+0000","last_peered":"2023-01-02T18:17:47.654246+0000","last_clean":"2023-01-02T18:17:47.654246+0000","last_became_active":"2023-01-02T18:17:29.336976+0000","last_became_peered":"2023-01-02T18:17:29.336976+0000","last_unstale":"2023-01-02T18:17:47.654246+0000","last_undegraded":"2023-01-02T18:17:47.654246+0000","last_fullsized":"2023-01-02T18:17:47.654246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654667+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:17:47.654667+0000","last_peered":"2023-01-02T18:17:47.654667+0000","last_clean":"2023-01-02T18:17:47.654667+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:17:47.654667+0000","last_undegraded":"2023-01-02T18:17:47.654667+0000","last_fullsized":"2023-01-02T18:17:47.654667+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"85'12","reported_seq":127,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653631+0000","last_change":"2023-01-02T18:17:30.503301+0000","last_active":"2023-01-02T18:17:47.653631+0000","last_peered":"2023-01-02T18:17:47.653631+0000","last_clean":"2023-01-02T18:17:47.653631+0000","last_became_active":"2023-01-02T18:16:48.335418+0000","last_became_peered":"2023-01-02T18:16:48.335418+0000","last_unstale":"2023-01-02T18:17:47.653631+0000","last_undegraded":"2023-01-02T18:17:47.653631+0000","last_fullsized":"2023-01-02T18:17:47.653631+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655763+0000","last_change":"2023-01-02T18:17:29.331000+0000","last_active":"2023-01-02T18:17:47.655763+0000","last_peered":"2023-01-02T18:17:47.655763+0000","last_clean":"2023-01-02T18:17:47.655763+0000","last_became_active":"2023-01-02T18:17:29.329297+0000","last_became_peered":"2023-01-02T18:17:29.329297+0000","last_unstale":"2023-01-02T18:17:47.655763+0000","last_undegraded":"2023-01-02T18:17:47.655763+0000","last_fullsized":"2023-01-02T18:17:47.655763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647892+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:17:47.647892+0000","last_peered":"2023-01-02T18:17:47.647892+0000","last_clean":"2023-01-02T18:17:47.647892+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:17:47.647892+0000","last_undegraded":"2023-01-02T18:17:47.647892+0000","last_fullsized":"2023-01-02T18:17:47.647892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655243+0000","last_change":"2023-01-02T18:16:53.345663+0000","last_active":"2023-01-02T18:17:47.655243+0000","last_peered":"2023-01-02T18:17:47.655243+0000","last_clean":"2023-01-02T18:17:47.655243+0000","last_became_active":"2023-01-02T18:16:51.341075+0000","last_became_peered":"2023-01-02T18:16:51.341075+0000","last_unstale":"2023-01-02T18:17:47.655243+0000","last_undegraded":"2023-01-02T18:17:47.655243+0000","last_fullsized":"2023-01-02T18:17:47.655243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653809+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:17:47.653809+0000","last_peered":"2023-01-02T18:17:47.653809+0000","last_clean":"2023-01-02T18:17:47.653809+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:17:47.653809+0000","last_undegraded":"2023-01-02T18:17:47.653809+0000","last_fullsized":"2023-01-02T18:17:47.653809+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652846+0000","last_change":"2023-01-02T18:17:38.459459+0000","last_active":"2023-01-02T18:17:47.652846+0000","last_peered":"2023-01-02T18:17:47.652846+0000","last_clean":"2023-01-02T18:17:47.652846+0000","last_became_active":"2023-01-02T18:17:36.442021+0000","last_became_peered":"2023-01-02T18:17:36.442021+0000","last_unstale":"2023-01-02T18:17:47.652846+0000","last_undegraded":"2023-01-02T18:17:47.652846+0000","last_fullsized":"2023-01-02T18:17:47.652846+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664250+0000","last_change":"2023-01-02T18:17:34.343439+0000","last_active":"2023-01-02T18:17:47.664250+0000","last_peered":"2023-01-02T18:17:47.664250+0000","last_clean":"2023-01-02T18:17:47.664250+0000","last_became_active":"2023-01-02T18:17:32.344028+0000","last_became_peered":"2023-01-02T18:17:32.344028+0000","last_unstale":"2023-01-02T18:17:47.664250+0000","last_undegraded":"2023-01-02T18:17:47.664250+0000","last_fullsized":"2023-01-02T18:17:47.664250+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656911+0000","last_change":"2023-01-02T18:17:29.326591+0000","last_active":"2023-01-02T18:17:47.656911+0000","last_peered":"2023-01-02T18:17:47.656911+0000","last_clean":"2023-01-02T18:17:47.656911+0000","last_became_active":"2023-01-02T18:17:29.326222+0000","last_became_peered":"2023-01-02T18:17:29.326222+0000","last_unstale":"2023-01-02T18:17:47.656911+0000","last_undegraded":"2023-01-02T18:17:47.656911+0000","last_fullsized":"2023-01-02T18:17:47.656911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648379+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:17:47.648379+0000","last_peered":"2023-01-02T18:17:47.648379+0000","last_clean":"2023-01-02T18:17:47.648379+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:17:47.648379+0000","last_undegraded":"2023-01-02T18:17:47.648379+0000","last_fullsized":"2023-01-02T18:17:47.648379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'4","reported_seq":81,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653515+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:17:47.653515+0000","last_peered":"2023-01-02T18:17:47.653515+0000","last_clean":"2023-01-02T18:17:47.653515+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:47.653515+0000","last_undegraded":"2023-01-02T18:17:47.653515+0000","last_fullsized":"2023-01-02T18:17:47.653515+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":94,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652325+0000","last_change":"2023-01-02T18:17:29.319612+0000","last_active":"2023-01-02T18:17:47.652325+0000","last_peered":"2023-01-02T18:17:47.652325+0000","last_clean":"2023-01-02T18:17:47.652325+0000","last_became_active":"2023-01-02T18:17:29.319276+0000","last_became_peered":"2023-01-02T18:17:29.319276+0000","last_unstale":"2023-01-02T18:17:47.652325+0000","last_undegraded":"2023-01-02T18:17:47.652325+0000","last_fullsized":"2023-01-02T18:17:47.652325+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"82'2","reported_seq":41,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655976+0000","last_change":"2023-01-02T18:17:30.331827+0000","last_active":"2023-01-02T18:17:47.655976+0000","last_peered":"2023-01-02T18:17:47.655976+0000","last_clean":"2023-01-02T18:17:47.655976+0000","last_became_active":"2023-01-02T18:17:29.335527+0000","last_became_peered":"2023-01-02T18:17:29.335527+0000","last_unstale":"2023-01-02T18:17:47.655976+0000","last_undegraded":"2023-01-02T18:17:47.655976+0000","last_fullsized":"2023-01-02T18:17:47.655976+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":48,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654749+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:17:47.654749+0000","last_peered":"2023-01-02T18:17:47.654749+0000","last_clean":"2023-01-02T18:17:47.654749+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:17:47.654749+0000","last_undegraded":"2023-01-02T18:17:47.654749+0000","last_fullsized":"2023-01-02T18:17:47.654749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646703+0000","last_change":"2023-01-02T18:16:53.685845+0000","last_active":"2023-01-02T18:17:47.646703+0000","last_peered":"2023-01-02T18:17:47.646703+0000","last_clean":"2023-01-02T18:17:47.646703+0000","last_became_active":"2023-01-02T18:16:51.345111+0000","last_became_peered":"2023-01-02T18:16:51.345111+0000","last_unstale":"2023-01-02T18:17:47.646703+0000","last_undegraded":"2023-01-02T18:17:47.646703+0000","last_fullsized":"2023-01-02T18:17:47.646703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":40,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652662+0000","last_change":"2023-01-02T18:17:36.453036+0000","last_active":"2023-01-02T18:17:47.652662+0000","last_peered":"2023-01-02T18:17:47.652662+0000","last_clean":"2023-01-02T18:17:47.652662+0000","last_became_active":"2023-01-02T18:17:36.447351+0000","last_became_peered":"2023-01-02T18:17:36.447351+0000","last_unstale":"2023-01-02T18:17:47.652662+0000","last_undegraded":"2023-01-02T18:17:47.652662+0000","last_fullsized":"2023-01-02T18:17:47.652662+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652368+0000","last_change":"2023-01-02T18:17:38.449421+0000","last_active":"2023-01-02T18:17:47.652368+0000","last_peered":"2023-01-02T18:17:47.652368+0000","last_clean":"2023-01-02T18:17:47.652368+0000","last_became_active":"2023-01-02T18:17:36.446175+0000","last_became_peered":"2023-01-02T18:17:36.446175+0000","last_unstale":"2023-01-02T18:17:47.652368+0000","last_undegraded":"2023-01-02T18:17:47.652368+0000","last_fullsized":"2023-01-02T18:17:47.652368+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663063+0000","last_change":"2023-01-02T18:17:34.343264+0000","last_active":"2023-01-02T18:17:47.663063+0000","last_peered":"2023-01-02T18:17:47.663063+0000","last_clean":"2023-01-02T18:17:47.663063+0000","last_became_active":"2023-01-02T18:17:32.345763+0000","last_became_peered":"2023-01-02T18:17:32.345763+0000","last_unstale":"2023-01-02T18:17:47.663063+0000","last_undegraded":"2023-01-02T18:17:47.663063+0000","last_fullsized":"2023-01-02T18:17:47.663063+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2","version":"76'12","reported_seq":161,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653423+0000","last_change":"2023-01-02T18:17:09.308235+0000","last_active":"2023-01-02T18:17:47.653423+0000","last_peered":"2023-01-02T18:17:47.653423+0000","last_clean":"2023-01-02T18:17:47.653423+0000","last_became_active":"2023-01-02T18:17:07.340498+0000","last_became_peered":"2023-01-02T18:17:07.340498+0000","last_unstale":"2023-01-02T18:17:47.653423+0000","last_undegraded":"2023-01-02T18:17:47.653423+0000","last_fullsized":"2023-01-02T18:17:47.653423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"69'1","reported_seq":53,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.664153+0000","last_change":"2023-01-02T18:17:48.664153+0000","last_active":"2023-01-02T18:17:48.664153+0000","last_peered":"2023-01-02T18:17:48.664153+0000","last_clean":"2023-01-02T18:17:48.664153+0000","last_became_active":"2023-01-02T18:17:48.656642+0000","last_became_peered":"2023-01-02T18:17:48.656642+0000","last_unstale":"2023-01-02T18:17:48.664153+0000","last_undegraded":"2023-01-02T18:17:48.664153+0000","last_fullsized":"2023-01-02T18:17:48.664153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656547+0000","last_change":"2023-01-02T18:16:44.298243+0000","last_active":"2023-01-02T18:17:47.656547+0000","last_peered":"2023-01-02T18:17:47.656547+0000","last_clean":"2023-01-02T18:17:47.656547+0000","last_became_active":"2023-01-02T18:16:41.448643+0000","last_became_peered":"2023-01-02T18:16:41.448643+0000","last_unstale":"2023-01-02T18:17:47.656547+0000","last_undegraded":"2023-01-02T18:17:47.656547+0000","last_fullsized":"2023-01-02T18:17:47.656547+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"76'8","reported_seq":135,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652476+0000","last_change":"2023-01-02T18:17:30.433551+0000","last_active":"2023-01-02T18:17:47.652476+0000","last_peered":"2023-01-02T18:17:47.652476+0000","last_clean":"2023-01-02T18:17:47.652476+0000","last_became_active":"2023-01-02T18:16:37.414106+0000","last_became_peered":"2023-01-02T18:16:37.414106+0000","last_unstale":"2023-01-02T18:17:47.652476+0000","last_undegraded":"2023-01-02T18:17:47.652476+0000","last_fullsized":"2023-01-02T18:17:47.652476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656403+0000","last_change":"2023-01-02T18:17:29.325726+0000","last_active":"2023-01-02T18:17:47.656403+0000","last_peered":"2023-01-02T18:17:47.656403+0000","last_clean":"2023-01-02T18:17:47.656403+0000","last_became_active":"2023-01-02T18:17:29.325418+0000","last_became_peered":"2023-01-02T18:17:29.325418+0000","last_unstale":"2023-01-02T18:17:47.656403+0000","last_undegraded":"2023-01-02T18:17:47.656403+0000","last_fullsized":"2023-01-02T18:17:47.656403+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655677+0000","last_change":"2023-01-02T18:17:29.329378+0000","last_active":"2023-01-02T18:17:47.655677+0000","last_peered":"2023-01-02T18:17:47.655677+0000","last_clean":"2023-01-02T18:17:47.655677+0000","last_became_active":"2023-01-02T18:17:29.327709+0000","last_became_peered":"2023-01-02T18:17:29.327709+0000","last_unstale":"2023-01-02T18:17:47.655677+0000","last_undegraded":"2023-01-02T18:17:47.655677+0000","last_fullsized":"2023-01-02T18:17:47.655677+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654621+0000","last_change":"2023-01-02T18:16:57.307540+0000","last_active":"2023-01-02T18:17:47.654621+0000","last_peered":"2023-01-02T18:17:47.654621+0000","last_clean":"2023-01-02T18:17:47.654621+0000","last_became_active":"2023-01-02T18:16:55.319082+0000","last_became_peered":"2023-01-02T18:16:55.319082+0000","last_unstale":"2023-01-02T18:17:47.654621+0000","last_undegraded":"2023-01-02T18:17:47.654621+0000","last_fullsized":"2023-01-02T18:17:47.654621+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"112'8","reported_seq":31,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.653026+0000","last_change":"2023-01-02T18:17:38.459021+0000","last_active":"2023-01-02T18:17:48.653026+0000","last_peered":"2023-01-02T18:17:48.653026+0000","last_clean":"2023-01-02T18:17:48.653026+0000","last_became_active":"2023-01-02T18:17:36.440780+0000","last_became_peered":"2023-01-02T18:17:36.440780+0000","last_unstale":"2023-01-02T18:17:48.653026+0000","last_undegraded":"2023-01-02T18:17:48.653026+0000","last_fullsized":"2023-01-02T18:17:48.653026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3145766,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":11,"num_write_kb":3079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652498+0000","last_change":"2023-01-02T18:17:34.324670+0000","last_active":"2023-01-02T18:17:47.652498+0000","last_peered":"2023-01-02T18:17:47.652498+0000","last_clean":"2023-01-02T18:17:47.652498+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:17:47.652498+0000","last_undegraded":"2023-01-02T18:17:47.652498+0000","last_fullsized":"2023-01-02T18:17:47.652498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"76'4","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662918+0000","last_change":"2023-01-02T18:17:09.323147+0000","last_active":"2023-01-02T18:17:47.662918+0000","last_peered":"2023-01-02T18:17:47.662918+0000","last_clean":"2023-01-02T18:17:47.662918+0000","last_became_active":"2023-01-02T18:17:07.341052+0000","last_became_peered":"2023-01-02T18:17:07.341052+0000","last_unstale":"2023-01-02T18:17:47.662918+0000","last_undegraded":"2023-01-02T18:17:47.662918+0000","last_fullsized":"2023-01-02T18:17:47.662918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646111+0000","last_change":"2023-01-02T18:17:29.319986+0000","last_active":"2023-01-02T18:17:47.646111+0000","last_peered":"2023-01-02T18:17:47.646111+0000","last_clean":"2023-01-02T18:17:47.646111+0000","last_became_active":"2023-01-02T18:17:29.319682+0000","last_became_peered":"2023-01-02T18:17:29.319682+0000","last_unstale":"2023-01-02T18:17:47.646111+0000","last_undegraded":"2023-01-02T18:17:47.646111+0000","last_fullsized":"2023-01-02T18:17:47.646111+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"51'1","reported_seq":111,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.666369+0000","last_change":"2023-01-02T18:17:48.666369+0000","last_active":"2023-01-02T18:17:48.666369+0000","last_peered":"2023-01-02T18:17:48.666369+0000","last_clean":"2023-01-02T18:17:48.666369+0000","last_became_active":"2023-01-02T18:17:48.662204+0000","last_became_peered":"2023-01-02T18:17:48.662204+0000","last_unstale":"2023-01-02T18:17:48.666369+0000","last_undegraded":"2023-01-02T18:17:48.666369+0000","last_fullsized":"2023-01-02T18:17:48.666369+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663394+0000","last_change":"2023-01-02T18:17:30.333300+0000","last_active":"2023-01-02T18:17:47.663394+0000","last_peered":"2023-01-02T18:17:47.663394+0000","last_clean":"2023-01-02T18:17:47.663394+0000","last_became_active":"2023-01-02T18:16:48.322710+0000","last_became_peered":"2023-01-02T18:16:48.322710+0000","last_unstale":"2023-01-02T18:17:47.663394+0000","last_undegraded":"2023-01-02T18:17:47.663394+0000","last_fullsized":"2023-01-02T18:17:47.663394+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656606+0000","last_change":"2023-01-02T18:17:29.333377+0000","last_active":"2023-01-02T18:17:47.656606+0000","last_peered":"2023-01-02T18:17:47.656606+0000","last_clean":"2023-01-02T18:17:47.656606+0000","last_became_active":"2023-01-02T18:17:29.332106+0000","last_became_peered":"2023-01-02T18:17:29.332106+0000","last_unstale":"2023-01-02T18:17:47.656606+0000","last_undegraded":"2023-01-02T18:17:47.656606+0000","last_fullsized":"2023-01-02T18:17:47.656606+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654967+0000","last_change":"2023-01-02T18:16:53.345390+0000","last_active":"2023-01-02T18:17:47.654967+0000","last_peered":"2023-01-02T18:17:47.654967+0000","last_clean":"2023-01-02T18:17:47.654967+0000","last_became_active":"2023-01-02T18:16:51.339020+0000","last_became_peered":"2023-01-02T18:16:51.339020+0000","last_unstale":"2023-01-02T18:17:47.654967+0000","last_undegraded":"2023-01-02T18:17:47.654967+0000","last_fullsized":"2023-01-02T18:17:47.654967+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654926+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:17:47.654926+0000","last_peered":"2023-01-02T18:17:47.654926+0000","last_clean":"2023-01-02T18:17:47.654926+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:17:47.654926+0000","last_undegraded":"2023-01-02T18:17:47.654926+0000","last_fullsized":"2023-01-02T18:17:47.654926+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653380+0000","last_change":"2023-01-02T18:17:38.449658+0000","last_active":"2023-01-02T18:17:47.653380+0000","last_peered":"2023-01-02T18:17:47.653380+0000","last_clean":"2023-01-02T18:17:47.653380+0000","last_became_active":"2023-01-02T18:17:36.450509+0000","last_became_peered":"2023-01-02T18:17:36.450509+0000","last_unstale":"2023-01-02T18:17:47.653380+0000","last_undegraded":"2023-01-02T18:17:47.653380+0000","last_fullsized":"2023-01-02T18:17:47.653380+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"101'31","reported_seq":128,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655499+0000","last_change":"2023-01-02T18:17:34.318218+0000","last_active":"2023-01-02T18:17:47.655499+0000","last_peered":"2023-01-02T18:17:47.655499+0000","last_clean":"2023-01-02T18:17:47.655499+0000","last_became_active":"2023-01-02T18:17:32.342244+0000","last_became_peered":"2023-01-02T18:17:32.342244+0000","last_unstale":"2023-01-02T18:17:47.655499+0000","last_undegraded":"2023-01-02T18:17:47.655499+0000","last_fullsized":"2023-01-02T18:17:47.655499+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":99,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652653+0000","last_change":"2023-01-02T18:17:09.330500+0000","last_active":"2023-01-02T18:17:47.652653+0000","last_peered":"2023-01-02T18:17:47.652653+0000","last_clean":"2023-01-02T18:17:47.652653+0000","last_became_active":"2023-01-02T18:17:07.345902+0000","last_became_peered":"2023-01-02T18:17:07.345902+0000","last_unstale":"2023-01-02T18:17:47.652653+0000","last_undegraded":"2023-01-02T18:17:47.652653+0000","last_fullsized":"2023-01-02T18:17:47.652653+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651339+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:17:47.651339+0000","last_peered":"2023-01-02T18:17:47.651339+0000","last_clean":"2023-01-02T18:17:47.651339+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:17:47.651339+0000","last_undegraded":"2023-01-02T18:17:47.651339+0000","last_fullsized":"2023-01-02T18:17:47.651339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656614+0000","last_change":"2023-01-02T18:16:48.329052+0000","last_active":"2023-01-02T18:17:47.656614+0000","last_peered":"2023-01-02T18:17:47.656614+0000","last_clean":"2023-01-02T18:17:47.656614+0000","last_became_active":"2023-01-02T18:16:48.327662+0000","last_became_peered":"2023-01-02T18:16:48.327662+0000","last_unstale":"2023-01-02T18:17:47.656614+0000","last_undegraded":"2023-01-02T18:17:47.656614+0000","last_fullsized":"2023-01-02T18:17:47.656614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'4","reported_seq":150,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654468+0000","last_change":"2023-01-02T18:17:30.503114+0000","last_active":"2023-01-02T18:17:47.654468+0000","last_peered":"2023-01-02T18:17:47.654468+0000","last_clean":"2023-01-02T18:17:47.654468+0000","last_became_active":"2023-01-02T18:16:48.329461+0000","last_became_peered":"2023-01-02T18:16:48.329461+0000","last_unstale":"2023-01-02T18:17:47.654468+0000","last_undegraded":"2023-01-02T18:17:47.654468+0000","last_fullsized":"2023-01-02T18:17:47.654468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646014+0000","last_change":"2023-01-02T18:16:49.323150+0000","last_active":"2023-01-02T18:17:47.646014+0000","last_peered":"2023-01-02T18:17:47.646014+0000","last_clean":"2023-01-02T18:17:47.646014+0000","last_became_active":"2023-01-02T18:16:48.326635+0000","last_became_peered":"2023-01-02T18:16:48.326635+0000","last_unstale":"2023-01-02T18:17:47.646014+0000","last_undegraded":"2023-01-02T18:17:47.646014+0000","last_fullsized":"2023-01-02T18:17:47.646014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656074+0000","last_change":"2023-01-02T18:16:53.345223+0000","last_active":"2023-01-02T18:17:47.656074+0000","last_peered":"2023-01-02T18:17:47.656074+0000","last_clean":"2023-01-02T18:17:47.656074+0000","last_became_active":"2023-01-02T18:16:51.341580+0000","last_became_peered":"2023-01-02T18:16:51.341580+0000","last_unstale":"2023-01-02T18:17:47.656074+0000","last_undegraded":"2023-01-02T18:17:47.656074+0000","last_fullsized":"2023-01-02T18:17:47.656074+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647340+0000","last_change":"2023-01-02T18:17:29.325884+0000","last_active":"2023-01-02T18:17:47.647340+0000","last_peered":"2023-01-02T18:17:47.647340+0000","last_clean":"2023-01-02T18:17:47.647340+0000","last_became_active":"2023-01-02T18:17:29.325539+0000","last_became_peered":"2023-01-02T18:17:29.325539+0000","last_unstale":"2023-01-02T18:17:47.647340+0000","last_undegraded":"2023-01-02T18:17:47.647340+0000","last_fullsized":"2023-01-02T18:17:47.647340+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"105'7","reported_seq":35,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653225+0000","last_change":"2023-01-02T18:17:38.459018+0000","last_active":"2023-01-02T18:17:47.653225+0000","last_peered":"2023-01-02T18:17:47.653225+0000","last_clean":"2023-01-02T18:17:47.653225+0000","last_became_active":"2023-01-02T18:17:36.442139+0000","last_became_peered":"2023-01-02T18:17:36.442139+0000","last_unstale":"2023-01-02T18:17:47.653225+0000","last_undegraded":"2023-01-02T18:17:47.653225+0000","last_fullsized":"2023-01-02T18:17:47.653225+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652137+0000","last_change":"2023-01-02T18:17:34.332222+0000","last_active":"2023-01-02T18:17:47.652137+0000","last_peered":"2023-01-02T18:17:47.652137+0000","last_clean":"2023-01-02T18:17:47.652137+0000","last_became_active":"2023-01-02T18:17:32.337498+0000","last_became_peered":"2023-01-02T18:17:32.337498+0000","last_unstale":"2023-01-02T18:17:47.652137+0000","last_undegraded":"2023-01-02T18:17:47.652137+0000","last_fullsized":"2023-01-02T18:17:47.652137+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652301+0000","last_change":"2023-01-02T18:17:09.307789+0000","last_active":"2023-01-02T18:17:47.652301+0000","last_peered":"2023-01-02T18:17:47.652301+0000","last_clean":"2023-01-02T18:17:47.652301+0000","last_became_active":"2023-01-02T18:17:07.345090+0000","last_became_peered":"2023-01-02T18:17:07.345090+0000","last_unstale":"2023-01-02T18:17:47.652301+0000","last_undegraded":"2023-01-02T18:17:47.652301+0000","last_fullsized":"2023-01-02T18:17:47.652301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"72'11","reported_seq":122,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652211+0000","last_change":"2023-01-02T18:17:29.350765+0000","last_active":"2023-01-02T18:17:47.652211+0000","last_peered":"2023-01-02T18:17:47.652211+0000","last_clean":"2023-01-02T18:17:47.652211+0000","last_became_active":"2023-01-02T18:17:29.334376+0000","last_became_peered":"2023-01-02T18:17:29.334376+0000","last_unstale":"2023-01-02T18:17:47.652211+0000","last_undegraded":"2023-01-02T18:17:47.652211+0000","last_fullsized":"2023-01-02T18:17:47.652211+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":64,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655021+0000","last_change":"2023-01-02T18:16:48.328829+0000","last_active":"2023-01-02T18:17:47.655021+0000","last_peered":"2023-01-02T18:17:47.655021+0000","last_clean":"2023-01-02T18:17:47.655021+0000","last_became_active":"2023-01-02T18:16:48.328372+0000","last_became_peered":"2023-01-02T18:16:48.328372+0000","last_unstale":"2023-01-02T18:17:47.655021+0000","last_undegraded":"2023-01-02T18:17:47.655021+0000","last_fullsized":"2023-01-02T18:17:47.655021+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":135,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655550+0000","last_change":"2023-01-02T18:17:30.434777+0000","last_active":"2023-01-02T18:17:47.655550+0000","last_peered":"2023-01-02T18:17:47.655550+0000","last_clean":"2023-01-02T18:17:47.655550+0000","last_became_active":"2023-01-02T18:16:37.415896+0000","last_became_peered":"2023-01-02T18:16:37.415896+0000","last_unstale":"2023-01-02T18:17:47.655550+0000","last_undegraded":"2023-01-02T18:17:47.655550+0000","last_fullsized":"2023-01-02T18:17:47.655550+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'3","reported_seq":74,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664500+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:17:47.664500+0000","last_peered":"2023-01-02T18:17:47.664500+0000","last_clean":"2023-01-02T18:17:47.664500+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:17:47.664500+0000","last_undegraded":"2023-01-02T18:17:47.664500+0000","last_fullsized":"2023-01-02T18:17:47.664500+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655650+0000","last_change":"2023-01-02T18:16:53.344544+0000","last_active":"2023-01-02T18:17:47.655650+0000","last_peered":"2023-01-02T18:17:47.655650+0000","last_clean":"2023-01-02T18:17:47.655650+0000","last_became_active":"2023-01-02T18:16:51.339073+0000","last_became_peered":"2023-01-02T18:16:51.339073+0000","last_unstale":"2023-01-02T18:17:47.655650+0000","last_undegraded":"2023-01-02T18:17:47.655650+0000","last_fullsized":"2023-01-02T18:17:47.655650+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":158,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648517+0000","last_change":"2023-01-02T18:16:57.307483+0000","last_active":"2023-01-02T18:17:47.648517+0000","last_peered":"2023-01-02T18:17:47.648517+0000","last_clean":"2023-01-02T18:17:47.648517+0000","last_became_active":"2023-01-02T18:16:55.316680+0000","last_became_peered":"2023-01-02T18:16:55.316680+0000","last_unstale":"2023-01-02T18:17:47.648517+0000","last_undegraded":"2023-01-02T18:17:47.648517+0000","last_fullsized":"2023-01-02T18:17:47.648517+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664121+0000","last_change":"2023-01-02T18:17:38.463731+0000","last_active":"2023-01-02T18:17:47.664121+0000","last_peered":"2023-01-02T18:17:47.664121+0000","last_clean":"2023-01-02T18:17:47.664121+0000","last_became_active":"2023-01-02T18:17:36.444543+0000","last_became_peered":"2023-01-02T18:17:36.444543+0000","last_unstale":"2023-01-02T18:17:47.664121+0000","last_undegraded":"2023-01-02T18:17:47.664121+0000","last_fullsized":"2023-01-02T18:17:47.664121+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"101'2","reported_seq":40,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647745+0000","last_change":"2023-01-02T18:17:34.316134+0000","last_active":"2023-01-02T18:17:47.647745+0000","last_peered":"2023-01-02T18:17:47.647745+0000","last_clean":"2023-01-02T18:17:47.647745+0000","last_became_active":"2023-01-02T18:17:32.340596+0000","last_became_peered":"2023-01-02T18:17:32.340596+0000","last_unstale":"2023-01-02T18:17:47.647745+0000","last_undegraded":"2023-01-02T18:17:47.647745+0000","last_fullsized":"2023-01-02T18:17:47.647745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656306+0000","last_change":"2023-01-02T18:17:29.323882+0000","last_active":"2023-01-02T18:17:47.656306+0000","last_peered":"2023-01-02T18:17:47.656306+0000","last_clean":"2023-01-02T18:17:47.656306+0000","last_became_active":"2023-01-02T18:17:29.323226+0000","last_became_peered":"2023-01-02T18:17:29.323226+0000","last_unstale":"2023-01-02T18:17:47.656306+0000","last_undegraded":"2023-01-02T18:17:47.656306+0000","last_fullsized":"2023-01-02T18:17:47.656306+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655721+0000","last_change":"2023-01-02T18:17:01.310439+0000","last_active":"2023-01-02T18:17:47.655721+0000","last_peered":"2023-01-02T18:17:47.655721+0000","last_clean":"2023-01-02T18:17:47.655721+0000","last_became_active":"2023-01-02T18:16:59.315925+0000","last_became_peered":"2023-01-02T18:16:59.315925+0000","last_unstale":"2023-01-02T18:17:47.655721+0000","last_undegraded":"2023-01-02T18:17:47.655721+0000","last_fullsized":"2023-01-02T18:17:47.655721+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647085+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:17:47.647085+0000","last_peered":"2023-01-02T18:17:47.647085+0000","last_clean":"2023-01-02T18:17:47.647085+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:17:47.647085+0000","last_undegraded":"2023-01-02T18:17:47.647085+0000","last_fullsized":"2023-01-02T18:17:47.647085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'5","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654913+0000","last_change":"2023-01-02T18:17:30.331199+0000","last_active":"2023-01-02T18:17:47.654913+0000","last_peered":"2023-01-02T18:17:47.654913+0000","last_clean":"2023-01-02T18:17:47.654913+0000","last_became_active":"2023-01-02T18:17:29.337008+0000","last_became_peered":"2023-01-02T18:17:29.337008+0000","last_unstale":"2023-01-02T18:17:47.654913+0000","last_undegraded":"2023-01-02T18:17:47.654913+0000","last_fullsized":"2023-01-02T18:17:47.654913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653950+0000","last_change":"2023-01-02T18:16:49.309370+0000","last_active":"2023-01-02T18:17:47.653950+0000","last_peered":"2023-01-02T18:17:47.653950+0000","last_clean":"2023-01-02T18:17:47.653950+0000","last_became_active":"2023-01-02T18:16:48.323683+0000","last_became_peered":"2023-01-02T18:16:48.323683+0000","last_unstale":"2023-01-02T18:17:47.653950+0000","last_undegraded":"2023-01-02T18:17:47.653950+0000","last_fullsized":"2023-01-02T18:17:47.653950+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662437+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:17:47.662437+0000","last_peered":"2023-01-02T18:17:47.662437+0000","last_clean":"2023-01-02T18:17:47.662437+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:17:47.662437+0000","last_undegraded":"2023-01-02T18:17:47.662437+0000","last_fullsized":"2023-01-02T18:17:47.662437+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663128+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:17:47.663128+0000","last_peered":"2023-01-02T18:17:47.663128+0000","last_clean":"2023-01-02T18:17:47.663128+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:17:47.663128+0000","last_undegraded":"2023-01-02T18:17:47.663128+0000","last_fullsized":"2023-01-02T18:17:47.663128+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.5","version":"106'3","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665371+0000","last_change":"2023-01-02T18:17:38.464795+0000","last_active":"2023-01-02T18:17:47.665371+0000","last_peered":"2023-01-02T18:17:47.665371+0000","last_clean":"2023-01-02T18:17:47.665371+0000","last_became_active":"2023-01-02T18:17:36.442539+0000","last_became_peered":"2023-01-02T18:17:36.442539+0000","last_unstale":"2023-01-02T18:17:47.665371+0000","last_undegraded":"2023-01-02T18:17:47.665371+0000","last_fullsized":"2023-01-02T18:17:47.665371+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.645921+0000","last_change":"2023-01-02T18:17:34.316365+0000","last_active":"2023-01-02T18:17:47.645921+0000","last_peered":"2023-01-02T18:17:47.645921+0000","last_clean":"2023-01-02T18:17:47.645921+0000","last_became_active":"2023-01-02T18:17:32.336309+0000","last_became_peered":"2023-01-02T18:17:32.336309+0000","last_unstale":"2023-01-02T18:17:47.645921+0000","last_undegraded":"2023-01-02T18:17:47.645921+0000","last_fullsized":"2023-01-02T18:17:47.645921+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656906+0000","last_change":"2023-01-02T18:17:29.333481+0000","last_active":"2023-01-02T18:17:47.656906+0000","last_peered":"2023-01-02T18:17:47.656906+0000","last_clean":"2023-01-02T18:17:47.656906+0000","last_became_active":"2023-01-02T18:17:29.333173+0000","last_became_peered":"2023-01-02T18:17:29.333173+0000","last_unstale":"2023-01-02T18:17:47.656906+0000","last_undegraded":"2023-01-02T18:17:47.656906+0000","last_fullsized":"2023-01-02T18:17:47.656906+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648366+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:17:47.648366+0000","last_peered":"2023-01-02T18:17:47.648366+0000","last_clean":"2023-01-02T18:17:47.648366+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:17:47.648366+0000","last_undegraded":"2023-01-02T18:17:47.648366+0000","last_fullsized":"2023-01-02T18:17:47.648366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654145+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:17:47.654145+0000","last_peered":"2023-01-02T18:17:47.654145+0000","last_clean":"2023-01-02T18:17:47.654145+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:17:47.654145+0000","last_undegraded":"2023-01-02T18:17:47.654145+0000","last_fullsized":"2023-01-02T18:17:47.654145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"46'4","reported_seq":160,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665367+0000","last_change":"2023-01-02T18:17:30.335368+0000","last_active":"2023-01-02T18:17:47.665367+0000","last_peered":"2023-01-02T18:17:47.665367+0000","last_clean":"2023-01-02T18:17:47.665367+0000","last_became_active":"2023-01-02T18:17:29.341233+0000","last_became_peered":"2023-01-02T18:17:29.341233+0000","last_unstale":"2023-01-02T18:17:47.665367+0000","last_undegraded":"2023-01-02T18:17:47.665367+0000","last_fullsized":"2023-01-02T18:17:47.665367+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"56'8","reported_seq":83,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646131+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:17:47.646131+0000","last_peered":"2023-01-02T18:17:47.646131+0000","last_clean":"2023-01-02T18:17:47.646131+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:17:47.646131+0000","last_undegraded":"2023-01-02T18:17:47.646131+0000","last_fullsized":"2023-01-02T18:17:47.646131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662373+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:17:47.662373+0000","last_peered":"2023-01-02T18:17:47.662373+0000","last_clean":"2023-01-02T18:17:47.662373+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:17:47.662373+0000","last_undegraded":"2023-01-02T18:17:47.662373+0000","last_fullsized":"2023-01-02T18:17:47.662373+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647521+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:17:47.647521+0000","last_peered":"2023-01-02T18:17:47.647521+0000","last_clean":"2023-01-02T18:17:47.647521+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:17:47.647521+0000","last_undegraded":"2023-01-02T18:17:47.647521+0000","last_fullsized":"2023-01-02T18:17:47.647521+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"105'1","reported_seq":23,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647729+0000","last_change":"2023-01-02T18:17:38.446055+0000","last_active":"2023-01-02T18:17:47.647729+0000","last_peered":"2023-01-02T18:17:47.647729+0000","last_clean":"2023-01-02T18:17:47.647729+0000","last_became_active":"2023-01-02T18:17:36.428938+0000","last_became_peered":"2023-01-02T18:17:36.428938+0000","last_unstale":"2023-01-02T18:17:47.647729+0000","last_undegraded":"2023-01-02T18:17:47.647729+0000","last_fullsized":"2023-01-02T18:17:47.647729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"101'8","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653346+0000","last_change":"2023-01-02T18:17:34.327745+0000","last_active":"2023-01-02T18:17:47.653346+0000","last_peered":"2023-01-02T18:17:47.653346+0000","last_clean":"2023-01-02T18:17:47.653346+0000","last_became_active":"2023-01-02T18:17:32.347316+0000","last_became_peered":"2023-01-02T18:17:32.347316+0000","last_unstale":"2023-01-02T18:17:47.653346+0000","last_undegraded":"2023-01-02T18:17:47.653346+0000","last_fullsized":"2023-01-02T18:17:47.653346+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654383+0000","last_change":"2023-01-02T18:17:09.308354+0000","last_active":"2023-01-02T18:17:47.654383+0000","last_peered":"2023-01-02T18:17:47.654383+0000","last_clean":"2023-01-02T18:17:47.654383+0000","last_became_active":"2023-01-02T18:17:07.339211+0000","last_became_peered":"2023-01-02T18:17:07.339211+0000","last_unstale":"2023-01-02T18:17:47.654383+0000","last_undegraded":"2023-01-02T18:17:47.654383+0000","last_fullsized":"2023-01-02T18:17:47.654383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"71'2","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655281+0000","last_change":"2023-01-02T18:17:01.317443+0000","last_active":"2023-01-02T18:17:47.655281+0000","last_peered":"2023-01-02T18:17:47.655281+0000","last_clean":"2023-01-02T18:17:47.655281+0000","last_became_active":"2023-01-02T18:16:59.311550+0000","last_became_peered":"2023-01-02T18:16:59.311550+0000","last_unstale":"2023-01-02T18:17:47.655281+0000","last_undegraded":"2023-01-02T18:17:47.655281+0000","last_fullsized":"2023-01-02T18:17:47.655281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"51'3","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652430+0000","last_change":"2023-01-02T18:16:48.345208+0000","last_active":"2023-01-02T18:17:47.652430+0000","last_peered":"2023-01-02T18:17:47.652430+0000","last_clean":"2023-01-02T18:17:47.652430+0000","last_became_active":"2023-01-02T18:16:48.327080+0000","last_became_peered":"2023-01-02T18:16:48.327080+0000","last_unstale":"2023-01-02T18:17:47.652430+0000","last_undegraded":"2023-01-02T18:17:47.652430+0000","last_fullsized":"2023-01-02T18:17:47.652430+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":165,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665517+0000","last_change":"2023-01-02T18:17:30.335149+0000","last_active":"2023-01-02T18:17:47.665517+0000","last_peered":"2023-01-02T18:17:47.665517+0000","last_clean":"2023-01-02T18:17:47.665517+0000","last_became_active":"2023-01-02T18:16:48.327374+0000","last_became_peered":"2023-01-02T18:16:48.327374+0000","last_unstale":"2023-01-02T18:17:47.665517+0000","last_undegraded":"2023-01-02T18:17:47.665517+0000","last_fullsized":"2023-01-02T18:17:47.665517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646612+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:17:47.646612+0000","last_peered":"2023-01-02T18:17:47.646612+0000","last_clean":"2023-01-02T18:17:47.646612+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:17:47.646612+0000","last_undegraded":"2023-01-02T18:17:47.646612+0000","last_fullsized":"2023-01-02T18:17:47.646612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655723+0000","last_change":"2023-01-02T18:16:53.342610+0000","last_active":"2023-01-02T18:17:47.655723+0000","last_peered":"2023-01-02T18:17:47.655723+0000","last_clean":"2023-01-02T18:17:47.655723+0000","last_became_active":"2023-01-02T18:16:51.341683+0000","last_became_peered":"2023-01-02T18:16:51.341683+0000","last_unstale":"2023-01-02T18:17:47.655723+0000","last_undegraded":"2023-01-02T18:17:47.655723+0000","last_fullsized":"2023-01-02T18:17:47.655723+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653853+0000","last_change":"2023-01-02T18:16:57.312289+0000","last_active":"2023-01-02T18:17:47.653853+0000","last_peered":"2023-01-02T18:17:47.653853+0000","last_clean":"2023-01-02T18:17:47.653853+0000","last_became_active":"2023-01-02T18:16:55.317023+0000","last_became_peered":"2023-01-02T18:16:55.317023+0000","last_unstale":"2023-01-02T18:17:47.653853+0000","last_undegraded":"2023-01-02T18:17:47.653853+0000","last_fullsized":"2023-01-02T18:17:47.653853+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"105'15","reported_seq":80,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656233+0000","last_change":"2023-01-02T18:17:38.447587+0000","last_active":"2023-01-02T18:17:47.656233+0000","last_peered":"2023-01-02T18:17:47.656233+0000","last_clean":"2023-01-02T18:17:47.656233+0000","last_became_active":"2023-01-02T18:17:36.439633+0000","last_became_peered":"2023-01-02T18:17:36.439633+0000","last_unstale":"2023-01-02T18:17:47.656233+0000","last_undegraded":"2023-01-02T18:17:47.656233+0000","last_fullsized":"2023-01-02T18:17:47.656233+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"101'19","reported_seq":100,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656114+0000","last_change":"2023-01-02T18:17:34.318618+0000","last_active":"2023-01-02T18:17:47.656114+0000","last_peered":"2023-01-02T18:17:47.656114+0000","last_clean":"2023-01-02T18:17:47.656114+0000","last_became_active":"2023-01-02T18:17:32.337685+0000","last_became_peered":"2023-01-02T18:17:32.337685+0000","last_unstale":"2023-01-02T18:17:47.656114+0000","last_undegraded":"2023-01-02T18:17:47.656114+0000","last_fullsized":"2023-01-02T18:17:47.656114+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655884+0000","last_change":"2023-01-02T18:17:29.329576+0000","last_active":"2023-01-02T18:17:47.655884+0000","last_peered":"2023-01-02T18:17:47.655884+0000","last_clean":"2023-01-02T18:17:47.655884+0000","last_became_active":"2023-01-02T18:17:29.328074+0000","last_became_peered":"2023-01-02T18:17:29.328074+0000","last_unstale":"2023-01-02T18:17:47.655884+0000","last_undegraded":"2023-01-02T18:17:47.655884+0000","last_fullsized":"2023-01-02T18:17:47.655884+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"72'10","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655129+0000","last_change":"2023-01-02T18:17:29.331966+0000","last_active":"2023-01-02T18:17:47.655129+0000","last_peered":"2023-01-02T18:17:47.655129+0000","last_clean":"2023-01-02T18:17:47.655129+0000","last_became_active":"2023-01-02T18:17:29.322773+0000","last_became_peered":"2023-01-02T18:17:29.322773+0000","last_unstale":"2023-01-02T18:17:47.655129+0000","last_undegraded":"2023-01-02T18:17:47.655129+0000","last_fullsized":"2023-01-02T18:17:47.655129+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"51'1","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654194+0000","last_change":"2023-01-02T18:17:29.334624+0000","last_active":"2023-01-02T18:17:47.654194+0000","last_peered":"2023-01-02T18:17:47.654194+0000","last_clean":"2023-01-02T18:17:47.654194+0000","last_became_active":"2023-01-02T18:17:29.332434+0000","last_became_peered":"2023-01-02T18:17:29.332434+0000","last_unstale":"2023-01-02T18:17:47.654194+0000","last_undegraded":"2023-01-02T18:17:47.654194+0000","last_fullsized":"2023-01-02T18:17:47.654194+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"82'14","reported_seq":204,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665636+0000","last_change":"2023-01-02T18:17:30.335393+0000","last_active":"2023-01-02T18:17:47.665636+0000","last_peered":"2023-01-02T18:17:47.665636+0000","last_clean":"2023-01-02T18:17:47.665636+0000","last_became_active":"2023-01-02T18:16:48.324242+0000","last_became_peered":"2023-01-02T18:16:48.324242+0000","last_unstale":"2023-01-02T18:17:47.665636+0000","last_undegraded":"2023-01-02T18:17:47.665636+0000","last_fullsized":"2023-01-02T18:17:47.665636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":122,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":46,"num_keys_recovered":8,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663376+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:17:47.663376+0000","last_peered":"2023-01-02T18:17:47.663376+0000","last_clean":"2023-01-02T18:17:47.663376+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:47.663376+0000","last_undegraded":"2023-01-02T18:17:47.663376+0000","last_fullsized":"2023-01-02T18:17:47.663376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655428+0000","last_change":"2023-01-02T18:17:29.335316+0000","last_active":"2023-01-02T18:17:47.655428+0000","last_peered":"2023-01-02T18:17:47.655428+0000","last_clean":"2023-01-02T18:17:47.655428+0000","last_became_active":"2023-01-02T18:17:29.333739+0000","last_became_peered":"2023-01-02T18:17:29.333739+0000","last_unstale":"2023-01-02T18:17:47.655428+0000","last_undegraded":"2023-01-02T18:17:47.655428+0000","last_fullsized":"2023-01-02T18:17:47.655428+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652457+0000","last_change":"2023-01-02T18:17:29.319062+0000","last_active":"2023-01-02T18:17:47.652457+0000","last_peered":"2023-01-02T18:17:47.652457+0000","last_clean":"2023-01-02T18:17:47.652457+0000","last_became_active":"2023-01-02T18:17:29.318747+0000","last_became_peered":"2023-01-02T18:17:29.318747+0000","last_unstale":"2023-01-02T18:17:47.652457+0000","last_undegraded":"2023-01-02T18:17:47.652457+0000","last_fullsized":"2023-01-02T18:17:47.652457+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652857+0000","last_change":"2023-01-02T18:17:38.460254+0000","last_active":"2023-01-02T18:17:47.652857+0000","last_peered":"2023-01-02T18:17:47.652857+0000","last_clean":"2023-01-02T18:17:47.652857+0000","last_became_active":"2023-01-02T18:17:36.446522+0000","last_became_peered":"2023-01-02T18:17:36.446522+0000","last_unstale":"2023-01-02T18:17:47.652857+0000","last_undegraded":"2023-01-02T18:17:47.652857+0000","last_fullsized":"2023-01-02T18:17:47.652857+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651227+0000","last_change":"2023-01-02T18:17:34.331749+0000","last_active":"2023-01-02T18:17:47.651227+0000","last_peered":"2023-01-02T18:17:47.651227+0000","last_clean":"2023-01-02T18:17:47.651227+0000","last_became_active":"2023-01-02T18:17:32.337737+0000","last_became_peered":"2023-01-02T18:17:32.337737+0000","last_unstale":"2023-01-02T18:17:47.651227+0000","last_undegraded":"2023-01-02T18:17:47.651227+0000","last_fullsized":"2023-01-02T18:17:47.651227+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"76'3","reported_seq":136,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653163+0000","last_change":"2023-01-02T18:17:09.308112+0000","last_active":"2023-01-02T18:17:47.653163+0000","last_peered":"2023-01-02T18:17:47.653163+0000","last_clean":"2023-01-02T18:17:47.653163+0000","last_became_active":"2023-01-02T18:17:07.336295+0000","last_became_peered":"2023-01-02T18:17:07.336295+0000","last_unstale":"2023-01-02T18:17:47.653163+0000","last_undegraded":"2023-01-02T18:17:47.653163+0000","last_fullsized":"2023-01-02T18:17:47.653163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":80,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'85","reported_seq":718,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653474+0000","last_change":"2023-01-02T18:17:01.316472+0000","last_active":"2023-01-02T18:17:47.653474+0000","last_peered":"2023-01-02T18:17:47.653474+0000","last_clean":"2023-01-02T18:17:47.653474+0000","last_became_active":"2023-01-02T18:16:59.310142+0000","last_became_peered":"2023-01-02T18:16:59.310142+0000","last_unstale":"2023-01-02T18:17:47.653474+0000","last_undegraded":"2023-01-02T18:17:47.653474+0000","last_fullsized":"2023-01-02T18:17:47.653474+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1544,"num_read_kb":1398,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656152+0000","last_change":"2023-01-02T18:16:44.308280+0000","last_active":"2023-01-02T18:17:47.656152+0000","last_peered":"2023-01-02T18:17:47.656152+0000","last_clean":"2023-01-02T18:17:47.656152+0000","last_became_active":"2023-01-02T18:16:41.446391+0000","last_became_peered":"2023-01-02T18:16:41.446391+0000","last_unstale":"2023-01-02T18:17:47.656152+0000","last_undegraded":"2023-01-02T18:17:47.656152+0000","last_fullsized":"2023-01-02T18:17:47.656152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"80'15","reported_seq":199,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652863+0000","last_change":"2023-01-02T18:17:30.502618+0000","last_active":"2023-01-02T18:17:47.652863+0000","last_peered":"2023-01-02T18:17:47.652863+0000","last_clean":"2023-01-02T18:17:47.652863+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:17:47.652863+0000","last_undegraded":"2023-01-02T18:17:47.652863+0000","last_fullsized":"2023-01-02T18:17:47.652863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":151,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656396+0000","last_change":"2023-01-02T18:17:29.337167+0000","last_active":"2023-01-02T18:17:47.656396+0000","last_peered":"2023-01-02T18:17:47.656396+0000","last_clean":"2023-01-02T18:17:47.656396+0000","last_became_active":"2023-01-02T18:17:29.335412+0000","last_became_peered":"2023-01-02T18:17:29.335412+0000","last_unstale":"2023-01-02T18:17:47.656396+0000","last_undegraded":"2023-01-02T18:17:47.656396+0000","last_fullsized":"2023-01-02T18:17:47.656396+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663728+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:17:47.663728+0000","last_peered":"2023-01-02T18:17:47.663728+0000","last_clean":"2023-01-02T18:17:47.663728+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:17:47.663728+0000","last_undegraded":"2023-01-02T18:17:47.663728+0000","last_fullsized":"2023-01-02T18:17:47.663728+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":68,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654693+0000","last_change":"2023-01-02T18:16:57.313875+0000","last_active":"2023-01-02T18:17:47.654693+0000","last_peered":"2023-01-02T18:17:47.654693+0000","last_clean":"2023-01-02T18:17:47.654693+0000","last_became_active":"2023-01-02T18:16:55.318719+0000","last_became_peered":"2023-01-02T18:16:55.318719+0000","last_unstale":"2023-01-02T18:17:47.654693+0000","last_undegraded":"2023-01-02T18:17:47.654693+0000","last_fullsized":"2023-01-02T18:17:47.654693+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.645560+0000","last_change":"2023-01-02T18:17:38.444327+0000","last_active":"2023-01-02T18:17:47.645560+0000","last_peered":"2023-01-02T18:17:47.645560+0000","last_clean":"2023-01-02T18:17:47.645560+0000","last_became_active":"2023-01-02T18:17:36.443020+0000","last_became_peered":"2023-01-02T18:17:36.443020+0000","last_unstale":"2023-01-02T18:17:47.645560+0000","last_undegraded":"2023-01-02T18:17:47.645560+0000","last_fullsized":"2023-01-02T18:17:47.645560+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.644638+0000","last_change":"2023-01-02T18:17:34.343511+0000","last_active":"2023-01-02T18:17:47.644638+0000","last_peered":"2023-01-02T18:17:47.644638+0000","last_clean":"2023-01-02T18:17:47.644638+0000","last_became_active":"2023-01-02T18:17:32.340038+0000","last_became_peered":"2023-01-02T18:17:32.340038+0000","last_unstale":"2023-01-02T18:17:47.644638+0000","last_undegraded":"2023-01-02T18:17:47.644638+0000","last_fullsized":"2023-01-02T18:17:47.644638+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655309+0000","last_change":"2023-01-02T18:17:09.307476+0000","last_active":"2023-01-02T18:17:47.655309+0000","last_peered":"2023-01-02T18:17:47.655309+0000","last_clean":"2023-01-02T18:17:47.655309+0000","last_became_active":"2023-01-02T18:17:07.336526+0000","last_became_peered":"2023-01-02T18:17:07.336526+0000","last_unstale":"2023-01-02T18:17:47.655309+0000","last_undegraded":"2023-01-02T18:17:47.655309+0000","last_fullsized":"2023-01-02T18:17:47.655309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"68'2","reported_seq":166,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654636+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:17:47.654636+0000","last_peered":"2023-01-02T18:17:47.654636+0000","last_clean":"2023-01-02T18:17:47.654636+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:17:47.654636+0000","last_undegraded":"2023-01-02T18:17:47.654636+0000","last_fullsized":"2023-01-02T18:17:47.654636+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654999+0000","last_change":"2023-01-02T18:16:44.307606+0000","last_active":"2023-01-02T18:17:47.654999+0000","last_peered":"2023-01-02T18:17:47.654999+0000","last_clean":"2023-01-02T18:17:47.654999+0000","last_became_active":"2023-01-02T18:16:41.449266+0000","last_became_peered":"2023-01-02T18:16:41.449266+0000","last_unstale":"2023-01-02T18:17:47.654999+0000","last_undegraded":"2023-01-02T18:17:47.654999+0000","last_fullsized":"2023-01-02T18:17:47.654999+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":144,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663301+0000","last_change":"2023-01-02T18:17:30.333872+0000","last_active":"2023-01-02T18:17:47.663301+0000","last_peered":"2023-01-02T18:17:47.663301+0000","last_clean":"2023-01-02T18:17:47.663301+0000","last_became_active":"2023-01-02T18:16:48.329249+0000","last_became_peered":"2023-01-02T18:16:48.329249+0000","last_unstale":"2023-01-02T18:17:47.663301+0000","last_undegraded":"2023-01-02T18:17:47.663301+0000","last_fullsized":"2023-01-02T18:17:47.663301+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656335+0000","last_change":"2023-01-02T18:16:49.311129+0000","last_active":"2023-01-02T18:17:47.656335+0000","last_peered":"2023-01-02T18:17:47.656335+0000","last_clean":"2023-01-02T18:17:47.656335+0000","last_became_active":"2023-01-02T18:16:46.312301+0000","last_became_peered":"2023-01-02T18:16:46.312301+0000","last_unstale":"2023-01-02T18:17:47.656335+0000","last_undegraded":"2023-01-02T18:17:47.656335+0000","last_fullsized":"2023-01-02T18:17:47.656335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646838+0000","last_change":"2023-01-02T18:16:53.350359+0000","last_active":"2023-01-02T18:17:47.646838+0000","last_peered":"2023-01-02T18:17:47.646838+0000","last_clean":"2023-01-02T18:17:47.646838+0000","last_became_active":"2023-01-02T18:16:51.338043+0000","last_became_peered":"2023-01-02T18:16:51.338043+0000","last_unstale":"2023-01-02T18:17:47.646838+0000","last_undegraded":"2023-01-02T18:17:47.646838+0000","last_fullsized":"2023-01-02T18:17:47.646838+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664500+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:17:47.664500+0000","last_peered":"2023-01-02T18:17:47.664500+0000","last_clean":"2023-01-02T18:17:47.664500+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:17:47.664500+0000","last_undegraded":"2023-01-02T18:17:47.664500+0000","last_fullsized":"2023-01-02T18:17:47.664500+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"105'3","reported_seq":34,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655685+0000","last_change":"2023-01-02T18:17:38.449366+0000","last_active":"2023-01-02T18:17:47.655685+0000","last_peered":"2023-01-02T18:17:47.655685+0000","last_clean":"2023-01-02T18:17:47.655685+0000","last_became_active":"2023-01-02T18:17:36.440502+0000","last_became_peered":"2023-01-02T18:17:36.440502+0000","last_unstale":"2023-01-02T18:17:47.655685+0000","last_undegraded":"2023-01-02T18:17:47.655685+0000","last_fullsized":"2023-01-02T18:17:47.655685+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"101'2","reported_seq":40,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655225+0000","last_change":"2023-01-02T18:17:34.347105+0000","last_active":"2023-01-02T18:17:47.655225+0000","last_peered":"2023-01-02T18:17:47.655225+0000","last_clean":"2023-01-02T18:17:47.655225+0000","last_became_active":"2023-01-02T18:17:32.344891+0000","last_became_peered":"2023-01-02T18:17:32.344891+0000","last_unstale":"2023-01-02T18:17:47.655225+0000","last_undegraded":"2023-01-02T18:17:47.655225+0000","last_fullsized":"2023-01-02T18:17:47.655225+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652494+0000","last_change":"2023-01-02T18:17:09.330482+0000","last_active":"2023-01-02T18:17:47.652494+0000","last_peered":"2023-01-02T18:17:47.652494+0000","last_clean":"2023-01-02T18:17:47.652494+0000","last_became_active":"2023-01-02T18:17:07.344261+0000","last_became_peered":"2023-01-02T18:17:07.344261+0000","last_unstale":"2023-01-02T18:17:47.652494+0000","last_undegraded":"2023-01-02T18:17:47.652494+0000","last_fullsized":"2023-01-02T18:17:47.652494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"68'4","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654393+0000","last_change":"2023-01-02T18:17:29.353714+0000","last_active":"2023-01-02T18:17:47.654393+0000","last_peered":"2023-01-02T18:17:47.654393+0000","last_clean":"2023-01-02T18:17:47.654393+0000","last_became_active":"2023-01-02T18:17:29.325542+0000","last_became_peered":"2023-01-02T18:17:29.325542+0000","last_unstale":"2023-01-02T18:17:47.654393+0000","last_undegraded":"2023-01-02T18:17:47.654393+0000","last_fullsized":"2023-01-02T18:17:47.654393+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655752+0000","last_change":"2023-01-02T18:17:29.335193+0000","last_active":"2023-01-02T18:17:47.655752+0000","last_peered":"2023-01-02T18:17:47.655752+0000","last_clean":"2023-01-02T18:17:47.655752+0000","last_became_active":"2023-01-02T18:17:29.334681+0000","last_became_peered":"2023-01-02T18:17:29.334681+0000","last_unstale":"2023-01-02T18:17:47.655752+0000","last_undegraded":"2023-01-02T18:17:47.655752+0000","last_fullsized":"2023-01-02T18:17:47.655752+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":124,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664254+0000","last_change":"2023-01-02T18:17:30.333125+0000","last_active":"2023-01-02T18:17:47.664254+0000","last_peered":"2023-01-02T18:17:47.664254+0000","last_clean":"2023-01-02T18:17:47.664254+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:17:47.664254+0000","last_undegraded":"2023-01-02T18:17:47.664254+0000","last_fullsized":"2023-01-02T18:17:47.664254+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654897+0000","last_change":"2023-01-02T18:16:49.310391+0000","last_active":"2023-01-02T18:17:47.654897+0000","last_peered":"2023-01-02T18:17:47.654897+0000","last_clean":"2023-01-02T18:17:47.654897+0000","last_became_active":"2023-01-02T18:16:46.316328+0000","last_became_peered":"2023-01-02T18:16:46.316328+0000","last_unstale":"2023-01-02T18:17:47.654897+0000","last_undegraded":"2023-01-02T18:17:47.654897+0000","last_fullsized":"2023-01-02T18:17:47.654897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656699+0000","last_change":"2023-01-02T18:17:29.324721+0000","last_active":"2023-01-02T18:17:47.656699+0000","last_peered":"2023-01-02T18:17:47.656699+0000","last_clean":"2023-01-02T18:17:47.656699+0000","last_became_active":"2023-01-02T18:17:29.323897+0000","last_became_peered":"2023-01-02T18:17:29.323897+0000","last_unstale":"2023-01-02T18:17:47.656699+0000","last_undegraded":"2023-01-02T18:17:47.656699+0000","last_fullsized":"2023-01-02T18:17:47.656699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648440+0000","last_change":"2023-01-02T18:16:57.306845+0000","last_active":"2023-01-02T18:17:47.648440+0000","last_peered":"2023-01-02T18:17:47.648440+0000","last_clean":"2023-01-02T18:17:47.648440+0000","last_became_active":"2023-01-02T18:16:55.318612+0000","last_became_peered":"2023-01-02T18:16:55.318612+0000","last_unstale":"2023-01-02T18:17:47.648440+0000","last_undegraded":"2023-01-02T18:17:47.648440+0000","last_fullsized":"2023-01-02T18:17:47.648440+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665284+0000","last_change":"2023-01-02T18:17:38.463630+0000","last_active":"2023-01-02T18:17:47.665284+0000","last_peered":"2023-01-02T18:17:47.665284+0000","last_clean":"2023-01-02T18:17:47.665284+0000","last_became_active":"2023-01-02T18:17:36.449160+0000","last_became_peered":"2023-01-02T18:17:36.449160+0000","last_unstale":"2023-01-02T18:17:47.665284+0000","last_undegraded":"2023-01-02T18:17:47.665284+0000","last_fullsized":"2023-01-02T18:17:47.665284+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1a","version":"101'8","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652601+0000","last_change":"2023-01-02T18:17:34.325778+0000","last_active":"2023-01-02T18:17:47.652601+0000","last_peered":"2023-01-02T18:17:47.652601+0000","last_clean":"2023-01-02T18:17:47.652601+0000","last_became_active":"2023-01-02T18:17:32.340683+0000","last_became_peered":"2023-01-02T18:17:32.340683+0000","last_unstale":"2023-01-02T18:17:47.652601+0000","last_undegraded":"2023-01-02T18:17:47.652601+0000","last_fullsized":"2023-01-02T18:17:47.652601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652217+0000","last_change":"2023-01-02T18:17:09.307508+0000","last_active":"2023-01-02T18:17:47.652217+0000","last_peered":"2023-01-02T18:17:47.652217+0000","last_clean":"2023-01-02T18:17:47.652217+0000","last_became_active":"2023-01-02T18:17:07.344914+0000","last_became_peered":"2023-01-02T18:17:07.344914+0000","last_unstale":"2023-01-02T18:17:47.652217+0000","last_undegraded":"2023-01-02T18:17:47.652217+0000","last_fullsized":"2023-01-02T18:17:47.652217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"69'1","reported_seq":76,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651719+0000","last_change":"2023-01-02T18:17:29.365036+0000","last_active":"2023-01-02T18:17:47.651719+0000","last_peered":"2023-01-02T18:17:47.651719+0000","last_clean":"2023-01-02T18:17:47.651719+0000","last_became_active":"2023-01-02T18:17:29.334847+0000","last_became_peered":"2023-01-02T18:17:29.334847+0000","last_unstale":"2023-01-02T18:17:47.651719+0000","last_undegraded":"2023-01-02T18:17:47.651719+0000","last_fullsized":"2023-01-02T18:17:47.651719+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654774+0000","last_change":"2023-01-02T18:16:44.307239+0000","last_active":"2023-01-02T18:17:47.654774+0000","last_peered":"2023-01-02T18:17:47.654774+0000","last_clean":"2023-01-02T18:17:47.654774+0000","last_became_active":"2023-01-02T18:16:41.447671+0000","last_became_peered":"2023-01-02T18:16:41.447671+0000","last_unstale":"2023-01-02T18:17:47.654774+0000","last_undegraded":"2023-01-02T18:17:47.654774+0000","last_fullsized":"2023-01-02T18:17:47.654774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'20","reported_seq":225,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665131+0000","last_change":"2023-01-02T18:17:30.334708+0000","last_active":"2023-01-02T18:17:47.665131+0000","last_peered":"2023-01-02T18:17:47.665131+0000","last_clean":"2023-01-02T18:17:47.665131+0000","last_became_active":"2023-01-02T18:16:48.322940+0000","last_became_peered":"2023-01-02T18:16:48.322940+0000","last_unstale":"2023-01-02T18:17:47.665131+0000","last_undegraded":"2023-01-02T18:17:47.665131+0000","last_fullsized":"2023-01-02T18:17:47.665131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":200,"num_write":27,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655511+0000","last_change":"2023-01-02T18:17:29.329761+0000","last_active":"2023-01-02T18:17:47.655511+0000","last_peered":"2023-01-02T18:17:47.655511+0000","last_clean":"2023-01-02T18:17:47.655511+0000","last_became_active":"2023-01-02T18:17:29.327470+0000","last_became_peered":"2023-01-02T18:17:29.327470+0000","last_unstale":"2023-01-02T18:17:47.655511+0000","last_undegraded":"2023-01-02T18:17:47.655511+0000","last_fullsized":"2023-01-02T18:17:47.655511+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662617+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:17:47.662617+0000","last_peered":"2023-01-02T18:17:47.662617+0000","last_clean":"2023-01-02T18:17:47.662617+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:17:47.662617+0000","last_undegraded":"2023-01-02T18:17:47.662617+0000","last_fullsized":"2023-01-02T18:17:47.662617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":70,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665722+0000","last_change":"2023-01-02T18:17:29.340931+0000","last_active":"2023-01-02T18:17:47.665722+0000","last_peered":"2023-01-02T18:17:47.665722+0000","last_clean":"2023-01-02T18:17:47.665722+0000","last_became_active":"2023-01-02T18:17:29.340602+0000","last_became_peered":"2023-01-02T18:17:29.340602+0000","last_unstale":"2023-01-02T18:17:47.665722+0000","last_undegraded":"2023-01-02T18:17:47.665722+0000","last_fullsized":"2023-01-02T18:17:47.665722+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"105'11","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654467+0000","last_change":"2023-01-02T18:17:38.460374+0000","last_active":"2023-01-02T18:17:47.654467+0000","last_peered":"2023-01-02T18:17:47.654467+0000","last_clean":"2023-01-02T18:17:47.654467+0000","last_became_active":"2023-01-02T18:17:36.443934+0000","last_became_peered":"2023-01-02T18:17:36.443934+0000","last_unstale":"2023-01-02T18:17:47.654467+0000","last_undegraded":"2023-01-02T18:17:47.654467+0000","last_fullsized":"2023-01-02T18:17:47.654467+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"101'8","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652945+0000","last_change":"2023-01-02T18:17:34.327085+0000","last_active":"2023-01-02T18:17:47.652945+0000","last_peered":"2023-01-02T18:17:47.652945+0000","last_clean":"2023-01-02T18:17:47.652945+0000","last_became_active":"2023-01-02T18:17:32.343328+0000","last_became_peered":"2023-01-02T18:17:32.343328+0000","last_unstale":"2023-01-02T18:17:47.652945+0000","last_undegraded":"2023-01-02T18:17:47.652945+0000","last_fullsized":"2023-01-02T18:17:47.652945+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648271+0000","last_change":"2023-01-02T18:17:09.325339+0000","last_active":"2023-01-02T18:17:47.648271+0000","last_peered":"2023-01-02T18:17:47.648271+0000","last_clean":"2023-01-02T18:17:47.648271+0000","last_became_active":"2023-01-02T18:17:07.341155+0000","last_became_peered":"2023-01-02T18:17:07.341155+0000","last_unstale":"2023-01-02T18:17:47.648271+0000","last_undegraded":"2023-01-02T18:17:47.648271+0000","last_fullsized":"2023-01-02T18:17:47.648271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":79,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648416+0000","last_change":"2023-01-02T18:17:29.343403+0000","last_active":"2023-01-02T18:17:47.648416+0000","last_peered":"2023-01-02T18:17:47.648416+0000","last_clean":"2023-01-02T18:17:47.648416+0000","last_became_active":"2023-01-02T18:17:29.320060+0000","last_became_peered":"2023-01-02T18:17:29.320060+0000","last_unstale":"2023-01-02T18:17:47.648416+0000","last_undegraded":"2023-01-02T18:17:47.648416+0000","last_fullsized":"2023-01-02T18:17:47.648416+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653560+0000","last_change":"2023-01-02T18:16:48.329830+0000","last_active":"2023-01-02T18:17:47.653560+0000","last_peered":"2023-01-02T18:17:47.653560+0000","last_clean":"2023-01-02T18:17:47.653560+0000","last_became_active":"2023-01-02T18:16:48.329469+0000","last_became_peered":"2023-01-02T18:16:48.329469+0000","last_unstale":"2023-01-02T18:17:47.653560+0000","last_undegraded":"2023-01-02T18:17:47.653560+0000","last_fullsized":"2023-01-02T18:17:47.653560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":125,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664277+0000","last_change":"2023-01-02T18:17:30.334813+0000","last_active":"2023-01-02T18:17:47.664277+0000","last_peered":"2023-01-02T18:17:47.664277+0000","last_clean":"2023-01-02T18:17:47.664277+0000","last_became_active":"2023-01-02T18:16:48.326351+0000","last_became_peered":"2023-01-02T18:16:48.326351+0000","last_unstale":"2023-01-02T18:17:47.664277+0000","last_undegraded":"2023-01-02T18:17:47.664277+0000","last_fullsized":"2023-01-02T18:17:47.664277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655934+0000","last_change":"2023-01-02T18:17:29.333748+0000","last_active":"2023-01-02T18:17:47.655934+0000","last_peered":"2023-01-02T18:17:47.655934+0000","last_clean":"2023-01-02T18:17:47.655934+0000","last_became_active":"2023-01-02T18:17:29.330002+0000","last_became_peered":"2023-01-02T18:17:29.330002+0000","last_unstale":"2023-01-02T18:17:47.655934+0000","last_undegraded":"2023-01-02T18:17:47.655934+0000","last_fullsized":"2023-01-02T18:17:47.655934+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652370+0000","last_change":"2023-01-02T18:16:53.342357+0000","last_active":"2023-01-02T18:17:47.652370+0000","last_peered":"2023-01-02T18:17:47.652370+0000","last_clean":"2023-01-02T18:17:47.652370+0000","last_became_active":"2023-01-02T18:16:51.341254+0000","last_became_peered":"2023-01-02T18:16:51.341254+0000","last_unstale":"2023-01-02T18:17:47.652370+0000","last_undegraded":"2023-01-02T18:17:47.652370+0000","last_fullsized":"2023-01-02T18:17:47.652370+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.644930+0000","last_change":"2023-01-02T18:17:36.438593+0000","last_active":"2023-01-02T18:17:47.644930+0000","last_peered":"2023-01-02T18:17:47.644930+0000","last_clean":"2023-01-02T18:17:47.644930+0000","last_became_active":"2023-01-02T18:17:36.438305+0000","last_became_peered":"2023-01-02T18:17:36.438305+0000","last_unstale":"2023-01-02T18:17:47.644930+0000","last_undegraded":"2023-01-02T18:17:47.644930+0000","last_fullsized":"2023-01-02T18:17:47.644930+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665154+0000","last_change":"2023-01-02T18:17:38.464600+0000","last_active":"2023-01-02T18:17:47.665154+0000","last_peered":"2023-01-02T18:17:47.665154+0000","last_clean":"2023-01-02T18:17:47.665154+0000","last_became_active":"2023-01-02T18:17:36.445763+0000","last_became_peered":"2023-01-02T18:17:36.445763+0000","last_unstale":"2023-01-02T18:17:47.665154+0000","last_undegraded":"2023-01-02T18:17:47.665154+0000","last_fullsized":"2023-01-02T18:17:47.665154+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"101'10","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652936+0000","last_change":"2023-01-02T18:17:34.326274+0000","last_active":"2023-01-02T18:17:47.652936+0000","last_peered":"2023-01-02T18:17:47.652936+0000","last_clean":"2023-01-02T18:17:47.652936+0000","last_became_active":"2023-01-02T18:17:32.339630+0000","last_became_peered":"2023-01-02T18:17:32.339630+0000","last_unstale":"2023-01-02T18:17:47.652936+0000","last_undegraded":"2023-01-02T18:17:47.652936+0000","last_fullsized":"2023-01-02T18:17:47.652936+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656372+0000","last_change":"2023-01-02T18:17:09.308664+0000","last_active":"2023-01-02T18:17:47.656372+0000","last_peered":"2023-01-02T18:17:47.656372+0000","last_clean":"2023-01-02T18:17:47.656372+0000","last_became_active":"2023-01-02T18:17:07.344272+0000","last_became_peered":"2023-01-02T18:17:07.344272+0000","last_unstale":"2023-01-02T18:17:47.656372+0000","last_undegraded":"2023-01-02T18:17:47.656372+0000","last_fullsized":"2023-01-02T18:17:47.656372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654820+0000","last_change":"2023-01-02T18:17:01.311474+0000","last_active":"2023-01-02T18:17:47.654820+0000","last_peered":"2023-01-02T18:17:47.654820+0000","last_clean":"2023-01-02T18:17:47.654820+0000","last_became_active":"2023-01-02T18:16:59.314245+0000","last_became_peered":"2023-01-02T18:16:59.314245+0000","last_unstale":"2023-01-02T18:17:47.654820+0000","last_undegraded":"2023-01-02T18:17:47.654820+0000","last_fullsized":"2023-01-02T18:17:47.654820+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":93,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.662639+0000","last_change":"2023-01-02T18:17:48.662639+0000","last_active":"2023-01-02T18:17:48.662639+0000","last_peered":"2023-01-02T18:17:48.662639+0000","last_clean":"2023-01-02T18:17:48.662639+0000","last_became_active":"2023-01-02T18:17:48.662288+0000","last_became_peered":"2023-01-02T18:17:48.662288+0000","last_unstale":"2023-01-02T18:17:48.662639+0000","last_undegraded":"2023-01-02T18:17:48.662639+0000","last_fullsized":"2023-01-02T18:17:48.662639+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"86'18","reported_seq":217,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665166+0000","last_change":"2023-01-02T18:17:30.335050+0000","last_active":"2023-01-02T18:17:47.665166+0000","last_peered":"2023-01-02T18:17:47.665166+0000","last_clean":"2023-01-02T18:17:47.665166+0000","last_became_active":"2023-01-02T18:16:37.436152+0000","last_became_peered":"2023-01-02T18:16:37.436152+0000","last_unstale":"2023-01-02T18:17:47.665166+0000","last_undegraded":"2023-01-02T18:17:47.665166+0000","last_fullsized":"2023-01-02T18:17:47.665166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":192,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655645+0000","last_change":"2023-01-02T18:16:49.309763+0000","last_active":"2023-01-02T18:17:47.655645+0000","last_peered":"2023-01-02T18:17:47.655645+0000","last_clean":"2023-01-02T18:17:47.655645+0000","last_became_active":"2023-01-02T18:16:46.308336+0000","last_became_peered":"2023-01-02T18:16:46.308336+0000","last_unstale":"2023-01-02T18:17:47.655645+0000","last_undegraded":"2023-01-02T18:17:47.655645+0000","last_fullsized":"2023-01-02T18:17:47.655645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":75,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646930+0000","last_change":"2023-01-02T18:17:29.320574+0000","last_active":"2023-01-02T18:17:47.646930+0000","last_peered":"2023-01-02T18:17:47.646930+0000","last_clean":"2023-01-02T18:17:47.646930+0000","last_became_active":"2023-01-02T18:17:29.320274+0000","last_became_peered":"2023-01-02T18:17:29.320274+0000","last_unstale":"2023-01-02T18:17:47.646930+0000","last_undegraded":"2023-01-02T18:17:47.646930+0000","last_fullsized":"2023-01-02T18:17:47.646930+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663170+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:17:47.663170+0000","last_peered":"2023-01-02T18:17:47.663170+0000","last_clean":"2023-01-02T18:17:47.663170+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:17:47.663170+0000","last_undegraded":"2023-01-02T18:17:47.663170+0000","last_fullsized":"2023-01-02T18:17:47.663170+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665389+0000","last_change":"2023-01-02T18:17:38.464884+0000","last_active":"2023-01-02T18:17:47.665389+0000","last_peered":"2023-01-02T18:17:47.665389+0000","last_clean":"2023-01-02T18:17:47.665389+0000","last_became_active":"2023-01-02T18:17:36.445153+0000","last_became_peered":"2023-01-02T18:17:36.445153+0000","last_unstale":"2023-01-02T18:17:47.665389+0000","last_undegraded":"2023-01-02T18:17:47.665389+0000","last_fullsized":"2023-01-02T18:17:47.665389+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665485+0000","last_change":"2023-01-02T18:17:34.343843+0000","last_active":"2023-01-02T18:17:47.665485+0000","last_peered":"2023-01-02T18:17:47.665485+0000","last_clean":"2023-01-02T18:17:47.665485+0000","last_became_active":"2023-01-02T18:17:32.344716+0000","last_became_peered":"2023-01-02T18:17:32.344716+0000","last_unstale":"2023-01-02T18:17:47.665485+0000","last_undegraded":"2023-01-02T18:17:47.665485+0000","last_fullsized":"2023-01-02T18:17:47.665485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"76'3","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654127+0000","last_change":"2023-01-02T18:17:09.308316+0000","last_active":"2023-01-02T18:17:47.654127+0000","last_peered":"2023-01-02T18:17:47.654127+0000","last_clean":"2023-01-02T18:17:47.654127+0000","last_became_active":"2023-01-02T18:17:07.339700+0000","last_became_peered":"2023-01-02T18:17:07.339700+0000","last_unstale":"2023-01-02T18:17:47.654127+0000","last_undegraded":"2023-01-02T18:17:47.654127+0000","last_fullsized":"2023-01-02T18:17:47.654127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":65,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647942+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:17:47.647942+0000","last_peered":"2023-01-02T18:17:47.647942+0000","last_clean":"2023-01-02T18:17:47.647942+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:17:47.647942+0000","last_undegraded":"2023-01-02T18:17:47.647942+0000","last_fullsized":"2023-01-02T18:17:47.647942+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656820+0000","last_change":"2023-01-02T18:16:44.306989+0000","last_active":"2023-01-02T18:17:47.656820+0000","last_peered":"2023-01-02T18:17:47.656820+0000","last_clean":"2023-01-02T18:17:47.656820+0000","last_became_active":"2023-01-02T18:16:41.448619+0000","last_became_peered":"2023-01-02T18:16:41.448619+0000","last_unstale":"2023-01-02T18:17:47.656820+0000","last_undegraded":"2023-01-02T18:17:47.656820+0000","last_fullsized":"2023-01-02T18:17:47.656820+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"46'1","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656308+0000","last_change":"2023-01-02T18:17:30.331472+0000","last_active":"2023-01-02T18:17:47.656308+0000","last_peered":"2023-01-02T18:17:47.656308+0000","last_clean":"2023-01-02T18:17:47.656308+0000","last_became_active":"2023-01-02T18:17:29.333176+0000","last_became_peered":"2023-01-02T18:17:29.333176+0000","last_unstale":"2023-01-02T18:17:47.656308+0000","last_undegraded":"2023-01-02T18:17:47.656308+0000","last_fullsized":"2023-01-02T18:17:47.656308+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":79,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663240+0000","last_change":"2023-01-02T18:16:49.304745+0000","last_active":"2023-01-02T18:17:47.663240+0000","last_peered":"2023-01-02T18:17:47.663240+0000","last_clean":"2023-01-02T18:17:47.663240+0000","last_became_active":"2023-01-02T18:16:48.325920+0000","last_became_peered":"2023-01-02T18:16:48.325920+0000","last_unstale":"2023-01-02T18:17:47.663240+0000","last_undegraded":"2023-01-02T18:17:47.663240+0000","last_fullsized":"2023-01-02T18:17:47.663240+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":68,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655819+0000","last_change":"2023-01-02T18:16:53.342417+0000","last_active":"2023-01-02T18:17:47.655819+0000","last_peered":"2023-01-02T18:17:47.655819+0000","last_clean":"2023-01-02T18:17:47.655819+0000","last_became_active":"2023-01-02T18:16:51.341971+0000","last_became_peered":"2023-01-02T18:16:51.341971+0000","last_unstale":"2023-01-02T18:17:47.655819+0000","last_undegraded":"2023-01-02T18:17:47.655819+0000","last_fullsized":"2023-01-02T18:17:47.655819+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653929+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:17:47.653929+0000","last_peered":"2023-01-02T18:17:47.653929+0000","last_clean":"2023-01-02T18:17:47.653929+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:17:47.653929+0000","last_undegraded":"2023-01-02T18:17:47.653929+0000","last_fullsized":"2023-01-02T18:17:47.653929+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655417+0000","last_change":"2023-01-02T18:17:38.451111+0000","last_active":"2023-01-02T18:17:47.655417+0000","last_peered":"2023-01-02T18:17:47.655417+0000","last_clean":"2023-01-02T18:17:47.655417+0000","last_became_active":"2023-01-02T18:17:36.442712+0000","last_became_peered":"2023-01-02T18:17:36.442712+0000","last_unstale":"2023-01-02T18:17:47.655417+0000","last_undegraded":"2023-01-02T18:17:47.655417+0000","last_fullsized":"2023-01-02T18:17:47.655417+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1e","version":"101'8","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648273+0000","last_change":"2023-01-02T18:17:34.316857+0000","last_active":"2023-01-02T18:17:47.648273+0000","last_peered":"2023-01-02T18:17:47.648273+0000","last_clean":"2023-01-02T18:17:47.648273+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:17:47.648273+0000","last_undegraded":"2023-01-02T18:17:47.648273+0000","last_fullsized":"2023-01-02T18:17:47.648273+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647844+0000","last_change":"2023-01-02T18:17:29.320212+0000","last_active":"2023-01-02T18:17:47.647844+0000","last_peered":"2023-01-02T18:17:47.647844+0000","last_clean":"2023-01-02T18:17:47.647844+0000","last_became_active":"2023-01-02T18:17:29.319459+0000","last_became_peered":"2023-01-02T18:17:29.319459+0000","last_unstale":"2023-01-02T18:17:47.647844+0000","last_undegraded":"2023-01-02T18:17:47.647844+0000","last_fullsized":"2023-01-02T18:17:47.647844+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"71'6","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655996+0000","last_change":"2023-01-02T18:17:29.380260+0000","last_active":"2023-01-02T18:17:47.655996+0000","last_peered":"2023-01-02T18:17:47.655996+0000","last_clean":"2023-01-02T18:17:47.655996+0000","last_became_active":"2023-01-02T18:17:29.334697+0000","last_became_peered":"2023-01-02T18:17:29.334697+0000","last_unstale":"2023-01-02T18:17:47.655996+0000","last_undegraded":"2023-01-02T18:17:47.655996+0000","last_fullsized":"2023-01-02T18:17:47.655996+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652902+0000","last_change":"2023-01-02T18:16:44.306689+0000","last_active":"2023-01-02T18:17:47.652902+0000","last_peered":"2023-01-02T18:17:47.652902+0000","last_clean":"2023-01-02T18:17:47.652902+0000","last_became_active":"2023-01-02T18:16:41.448162+0000","last_became_peered":"2023-01-02T18:16:41.448162+0000","last_unstale":"2023-01-02T18:17:47.652902+0000","last_undegraded":"2023-01-02T18:17:47.652902+0000","last_fullsized":"2023-01-02T18:17:47.652902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656808+0000","last_change":"2023-01-02T18:17:30.331763+0000","last_active":"2023-01-02T18:17:47.656808+0000","last_peered":"2023-01-02T18:17:47.656808+0000","last_clean":"2023-01-02T18:17:47.656808+0000","last_became_active":"2023-01-02T18:17:29.327892+0000","last_became_peered":"2023-01-02T18:17:29.327892+0000","last_unstale":"2023-01-02T18:17:47.656808+0000","last_undegraded":"2023-01-02T18:17:47.656808+0000","last_fullsized":"2023-01-02T18:17:47.656808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":80,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652684+0000","last_change":"2023-01-02T18:16:49.318037+0000","last_active":"2023-01-02T18:17:47.652684+0000","last_peered":"2023-01-02T18:17:47.652684+0000","last_clean":"2023-01-02T18:17:47.652684+0000","last_became_active":"2023-01-02T18:16:48.330758+0000","last_became_peered":"2023-01-02T18:16:48.330758+0000","last_unstale":"2023-01-02T18:17:47.652684+0000","last_undegraded":"2023-01-02T18:17:47.652684+0000","last_fullsized":"2023-01-02T18:17:47.652684+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":164,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662465+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:17:47.662465+0000","last_peered":"2023-01-02T18:17:47.662465+0000","last_clean":"2023-01-02T18:17:47.662465+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:17:47.662465+0000","last_undegraded":"2023-01-02T18:17:47.662465+0000","last_fullsized":"2023-01-02T18:17:47.662465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646769+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:17:47.646769+0000","last_peered":"2023-01-02T18:17:47.646769+0000","last_clean":"2023-01-02T18:17:47.646769+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:17:47.646769+0000","last_undegraded":"2023-01-02T18:17:47.646769+0000","last_fullsized":"2023-01-02T18:17:47.646769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646373+0000","last_change":"2023-01-02T18:17:38.444061+0000","last_active":"2023-01-02T18:17:47.646373+0000","last_peered":"2023-01-02T18:17:47.646373+0000","last_clean":"2023-01-02T18:17:47.646373+0000","last_became_active":"2023-01-02T18:17:36.437329+0000","last_became_peered":"2023-01-02T18:17:36.437329+0000","last_unstale":"2023-01-02T18:17:47.646373+0000","last_undegraded":"2023-01-02T18:17:47.646373+0000","last_fullsized":"2023-01-02T18:17:47.646373+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654052+0000","last_change":"2023-01-02T18:17:34.316239+0000","last_active":"2023-01-02T18:17:47.654052+0000","last_peered":"2023-01-02T18:17:47.654052+0000","last_clean":"2023-01-02T18:17:47.654052+0000","last_became_active":"2023-01-02T18:17:32.337541+0000","last_became_peered":"2023-01-02T18:17:32.337541+0000","last_unstale":"2023-01-02T18:17:47.654052+0000","last_undegraded":"2023-01-02T18:17:47.654052+0000","last_fullsized":"2023-01-02T18:17:47.654052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655862+0000","last_change":"2023-01-02T18:17:29.332434+0000","last_active":"2023-01-02T18:17:47.655862+0000","last_peered":"2023-01-02T18:17:47.655862+0000","last_clean":"2023-01-02T18:17:47.655862+0000","last_became_active":"2023-01-02T18:17:29.329956+0000","last_became_peered":"2023-01-02T18:17:29.329956+0000","last_unstale":"2023-01-02T18:17:47.655862+0000","last_undegraded":"2023-01-02T18:17:47.655862+0000","last_fullsized":"2023-01-02T18:17:47.655862+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655454+0000","last_change":"2023-01-02T18:17:01.311515+0000","last_active":"2023-01-02T18:17:47.655454+0000","last_peered":"2023-01-02T18:17:47.655454+0000","last_clean":"2023-01-02T18:17:47.655454+0000","last_became_active":"2023-01-02T18:16:59.322412+0000","last_became_peered":"2023-01-02T18:16:59.322412+0000","last_unstale":"2023-01-02T18:17:47.655454+0000","last_undegraded":"2023-01-02T18:17:47.655454+0000","last_fullsized":"2023-01-02T18:17:47.655454+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653740+0000","last_change":"2023-01-02T18:17:29.338927+0000","last_active":"2023-01-02T18:17:47.653740+0000","last_peered":"2023-01-02T18:17:47.653740+0000","last_clean":"2023-01-02T18:17:47.653740+0000","last_became_active":"2023-01-02T18:17:29.338639+0000","last_became_peered":"2023-01-02T18:17:29.338639+0000","last_unstale":"2023-01-02T18:17:47.653740+0000","last_undegraded":"2023-01-02T18:17:47.653740+0000","last_fullsized":"2023-01-02T18:17:47.653740+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":164,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652733+0000","last_change":"2023-01-02T18:17:30.433577+0000","last_active":"2023-01-02T18:17:47.652733+0000","last_peered":"2023-01-02T18:17:47.652733+0000","last_clean":"2023-01-02T18:17:47.652733+0000","last_became_active":"2023-01-02T18:16:37.415177+0000","last_became_peered":"2023-01-02T18:16:37.415177+0000","last_unstale":"2023-01-02T18:17:47.652733+0000","last_undegraded":"2023-01-02T18:17:47.652733+0000","last_fullsized":"2023-01-02T18:17:47.652733+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648908+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:17:47.648908+0000","last_peered":"2023-01-02T18:17:47.648908+0000","last_clean":"2023-01-02T18:17:47.648908+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:17:47.648908+0000","last_undegraded":"2023-01-02T18:17:47.648908+0000","last_fullsized":"2023-01-02T18:17:47.648908+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655923+0000","last_change":"2023-01-02T18:17:29.329770+0000","last_active":"2023-01-02T18:17:47.655923+0000","last_peered":"2023-01-02T18:17:47.655923+0000","last_clean":"2023-01-02T18:17:47.655923+0000","last_became_active":"2023-01-02T18:17:29.328232+0000","last_became_peered":"2023-01-02T18:17:29.328232+0000","last_unstale":"2023-01-02T18:17:47.655923+0000","last_undegraded":"2023-01-02T18:17:47.655923+0000","last_fullsized":"2023-01-02T18:17:47.655923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655036+0000","last_change":"2023-01-02T18:17:29.384506+0000","last_active":"2023-01-02T18:17:47.655036+0000","last_peered":"2023-01-02T18:17:47.655036+0000","last_clean":"2023-01-02T18:17:47.655036+0000","last_became_active":"2023-01-02T18:17:29.335526+0000","last_became_peered":"2023-01-02T18:17:29.335526+0000","last_unstale":"2023-01-02T18:17:47.655036+0000","last_undegraded":"2023-01-02T18:17:47.655036+0000","last_fullsized":"2023-01-02T18:17:47.655036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652517+0000","last_change":"2023-01-02T18:17:38.450093+0000","last_active":"2023-01-02T18:17:47.652517+0000","last_peered":"2023-01-02T18:17:47.652517+0000","last_clean":"2023-01-02T18:17:47.652517+0000","last_became_active":"2023-01-02T18:17:36.449051+0000","last_became_peered":"2023-01-02T18:17:36.449051+0000","last_unstale":"2023-01-02T18:17:47.652517+0000","last_undegraded":"2023-01-02T18:17:47.652517+0000","last_fullsized":"2023-01-02T18:17:47.652517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663828+0000","last_change":"2023-01-02T18:17:34.343018+0000","last_active":"2023-01-02T18:17:47.663828+0000","last_peered":"2023-01-02T18:17:47.663828+0000","last_clean":"2023-01-02T18:17:47.663828+0000","last_became_active":"2023-01-02T18:17:32.345232+0000","last_became_peered":"2023-01-02T18:17:32.345232+0000","last_unstale":"2023-01-02T18:17:47.663828+0000","last_undegraded":"2023-01-02T18:17:47.663828+0000","last_fullsized":"2023-01-02T18:17:47.663828+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663049+0000","last_change":"2023-01-02T18:17:09.323079+0000","last_active":"2023-01-02T18:17:47.663049+0000","last_peered":"2023-01-02T18:17:47.663049+0000","last_clean":"2023-01-02T18:17:47.663049+0000","last_became_active":"2023-01-02T18:17:07.344746+0000","last_became_peered":"2023-01-02T18:17:07.344746+0000","last_unstale":"2023-01-02T18:17:47.663049+0000","last_undegraded":"2023-01-02T18:17:47.663049+0000","last_fullsized":"2023-01-02T18:17:47.663049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654385+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:17:47.654385+0000","last_peered":"2023-01-02T18:17:47.654385+0000","last_clean":"2023-01-02T18:17:47.654385+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:17:47.654385+0000","last_undegraded":"2023-01-02T18:17:47.654385+0000","last_fullsized":"2023-01-02T18:17:47.654385+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.664224+0000","last_change":"2023-01-02T18:17:48.664224+0000","last_active":"2023-01-02T18:17:48.664224+0000","last_peered":"2023-01-02T18:17:48.664224+0000","last_clean":"2023-01-02T18:17:48.664224+0000","last_became_active":"2023-01-02T18:17:48.663942+0000","last_became_peered":"2023-01-02T18:17:48.663942+0000","last_unstale":"2023-01-02T18:17:48.664224+0000","last_undegraded":"2023-01-02T18:17:48.664224+0000","last_fullsized":"2023-01-02T18:17:48.664224+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648625+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:17:47.648625+0000","last_peered":"2023-01-02T18:17:47.648625+0000","last_clean":"2023-01-02T18:17:47.648625+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:17:47.648625+0000","last_undegraded":"2023-01-02T18:17:47.648625+0000","last_fullsized":"2023-01-02T18:17:47.648625+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":145,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651361+0000","last_change":"2023-01-02T18:17:30.330120+0000","last_active":"2023-01-02T18:17:47.651361+0000","last_peered":"2023-01-02T18:17:47.651361+0000","last_clean":"2023-01-02T18:17:47.651361+0000","last_became_active":"2023-01-02T18:16:37.416142+0000","last_became_peered":"2023-01-02T18:16:37.416142+0000","last_unstale":"2023-01-02T18:17:47.651361+0000","last_undegraded":"2023-01-02T18:17:47.651361+0000","last_fullsized":"2023-01-02T18:17:47.651361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"56'15","reported_seq":138,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653661+0000","last_change":"2023-01-02T18:16:49.319188+0000","last_active":"2023-01-02T18:17:47.653661+0000","last_peered":"2023-01-02T18:17:47.653661+0000","last_clean":"2023-01-02T18:17:47.653661+0000","last_became_active":"2023-01-02T18:16:48.329016+0000","last_became_peered":"2023-01-02T18:16:48.329016+0000","last_unstale":"2023-01-02T18:17:47.653661+0000","last_undegraded":"2023-01-02T18:17:47.653661+0000","last_fullsized":"2023-01-02T18:17:47.653661+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":184,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664421+0000","last_change":"2023-01-02T18:17:29.354782+0000","last_active":"2023-01-02T18:17:47.664421+0000","last_peered":"2023-01-02T18:17:47.664421+0000","last_clean":"2023-01-02T18:17:47.664421+0000","last_became_active":"2023-01-02T18:17:29.340734+0000","last_became_peered":"2023-01-02T18:17:29.340734+0000","last_unstale":"2023-01-02T18:17:47.664421+0000","last_undegraded":"2023-01-02T18:17:47.664421+0000","last_fullsized":"2023-01-02T18:17:47.664421+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":84,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663943+0000","last_change":"2023-01-02T18:17:38.462825+0000","last_active":"2023-01-02T18:17:47.663943+0000","last_peered":"2023-01-02T18:17:47.663943+0000","last_clean":"2023-01-02T18:17:47.663943+0000","last_became_active":"2023-01-02T18:17:36.449207+0000","last_became_peered":"2023-01-02T18:17:36.449207+0000","last_unstale":"2023-01-02T18:17:47.663943+0000","last_undegraded":"2023-01-02T18:17:47.663943+0000","last_fullsized":"2023-01-02T18:17:47.663943+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"101'2","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664269+0000","last_change":"2023-01-02T18:17:34.343730+0000","last_active":"2023-01-02T18:17:47.664269+0000","last_peered":"2023-01-02T18:17:47.664269+0000","last_clean":"2023-01-02T18:17:47.664269+0000","last_became_active":"2023-01-02T18:17:32.346354+0000","last_became_peered":"2023-01-02T18:17:32.346354+0000","last_unstale":"2023-01-02T18:17:47.664269+0000","last_undegraded":"2023-01-02T18:17:47.664269+0000","last_fullsized":"2023-01-02T18:17:47.664269+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662640+0000","last_change":"2023-01-02T18:17:09.322935+0000","last_active":"2023-01-02T18:17:47.662640+0000","last_peered":"2023-01-02T18:17:47.662640+0000","last_clean":"2023-01-02T18:17:47.662640+0000","last_became_active":"2023-01-02T18:17:07.346620+0000","last_became_peered":"2023-01-02T18:17:07.346620+0000","last_unstale":"2023-01-02T18:17:47.662640+0000","last_undegraded":"2023-01-02T18:17:47.662640+0000","last_fullsized":"2023-01-02T18:17:47.662640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"72'4","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654305+0000","last_change":"2023-01-02T18:17:29.382390+0000","last_active":"2023-01-02T18:17:47.654305+0000","last_peered":"2023-01-02T18:17:47.654305+0000","last_clean":"2023-01-02T18:17:47.654305+0000","last_became_active":"2023-01-02T18:17:29.335369+0000","last_became_peered":"2023-01-02T18:17:29.335369+0000","last_unstale":"2023-01-02T18:17:47.654305+0000","last_undegraded":"2023-01-02T18:17:47.654305+0000","last_fullsized":"2023-01-02T18:17:47.654305+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.664412+0000","last_change":"2023-01-02T18:17:48.664412+0000","last_active":"2023-01-02T18:17:48.664412+0000","last_peered":"2023-01-02T18:17:48.664412+0000","last_clean":"2023-01-02T18:17:48.664412+0000","last_became_active":"2023-01-02T18:17:48.655335+0000","last_became_peered":"2023-01-02T18:17:48.655335+0000","last_unstale":"2023-01-02T18:17:48.664412+0000","last_undegraded":"2023-01-02T18:17:48.664412+0000","last_fullsized":"2023-01-02T18:17:48.664412+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":88,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654652+0000","last_change":"2023-01-02T18:16:44.308144+0000","last_active":"2023-01-02T18:17:47.654652+0000","last_peered":"2023-01-02T18:17:47.654652+0000","last_clean":"2023-01-02T18:17:47.654652+0000","last_became_active":"2023-01-02T18:16:41.446839+0000","last_became_peered":"2023-01-02T18:16:41.446839+0000","last_unstale":"2023-01-02T18:17:47.654652+0000","last_undegraded":"2023-01-02T18:17:47.654652+0000","last_fullsized":"2023-01-02T18:17:47.654652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"84'5","reported_seq":190,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652082+0000","last_change":"2023-01-02T18:17:30.325949+0000","last_active":"2023-01-02T18:17:47.652082+0000","last_peered":"2023-01-02T18:17:47.652082+0000","last_clean":"2023-01-02T18:17:47.652082+0000","last_became_active":"2023-01-02T18:16:48.329379+0000","last_became_peered":"2023-01-02T18:16:48.329379+0000","last_unstale":"2023-01-02T18:17:47.652082+0000","last_undegraded":"2023-01-02T18:17:47.652082+0000","last_fullsized":"2023-01-02T18:17:47.652082+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656461+0000","last_change":"2023-01-02T18:16:49.310230+0000","last_active":"2023-01-02T18:17:47.656461+0000","last_peered":"2023-01-02T18:17:47.656461+0000","last_clean":"2023-01-02T18:17:47.656461+0000","last_became_active":"2023-01-02T18:16:48.324944+0000","last_became_peered":"2023-01-02T18:16:48.324944+0000","last_unstale":"2023-01-02T18:17:47.656461+0000","last_undegraded":"2023-01-02T18:17:47.656461+0000","last_fullsized":"2023-01-02T18:17:47.656461+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655996+0000","last_change":"2023-01-02T18:16:53.345118+0000","last_active":"2023-01-02T18:17:47.655996+0000","last_peered":"2023-01-02T18:17:47.655996+0000","last_clean":"2023-01-02T18:17:47.655996+0000","last_became_active":"2023-01-02T18:16:51.341889+0000","last_became_peered":"2023-01-02T18:16:51.341889+0000","last_unstale":"2023-01-02T18:17:47.655996+0000","last_undegraded":"2023-01-02T18:17:47.655996+0000","last_fullsized":"2023-01-02T18:17:47.655996+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":11534409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":145,"num_write":50,"num_write_kb":11283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23093248,"data_stored":23068818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":64,"acting":64,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":472,"num_read_kb":400,"num_write":105,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":64,"acting":64,"num_store_stats":7},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":171,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1456,"num_read_kb":1306,"num_write":98,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":465,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2428,"num_read_kb":2178,"num_write":146,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":363,"num_keys_recovered":250,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":7},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1498,"num_read_kb":1362,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":124,"num_keys_recovered":6,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1078,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1918,"num_read_kb":1551,"num_write":240,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":726,"num_keys_recovered":150,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":102,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":70,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":109,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1496,"num_read_kb":1361,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":70,"num_keys_recovered":162,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12672,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":11200,"kb_avail":94359168,"statfs":{"total":96636764160,"available":96623788032,"internally_reserved":0,"allocated":1499136,"data_stored":766835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11468800},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.45000000000000001,"15min":0.42899999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.434},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.503}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.34499999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23028,"kb_used_data":11692,"kb_used_omap":0,"kb_used_meta":11328,"kb_avail":94348812,"statfs":{"total":96636764160,"available":96613183488,"internally_reserved":0,"allocated":11972608,"data_stored":11252529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11599872},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":2.109,"15min":2.109},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.443}]},{"osd":1,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45700000000000002,"15min":0.44900000000000001},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34699999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.282,"15min":1.282},"last":0.36399999999999999}]},{"osd":3,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72499999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.377}]},{"osd":4,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.29599999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.624,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.435},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":1.3,"15min":1.3},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.32000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16844,"kb_used_data":5572,"kb_used_omap":0,"kb_used_meta":11264,"kb_avail":94354996,"statfs":{"total":96636764160,"available":96619515904,"internally_reserved":0,"allocated":5705728,"data_stored":4961256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11534336},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.434,"15min":0.44900000000000001},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":0.46200000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.443},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45500000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.499}]},{"osd":2,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.43099999999999999,"5min":1.258,"15min":1.258},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.441,"15min":0.45300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48299999999999998,"5min":1.028,"15min":1.028},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.46500000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51700000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42799999999999999,"15min":0.439},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56399999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67700000000000005,"5min":1.321,"15min":1.321},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79000000000000004,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76700000000000002,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.64600000000000002,"15min":0.66400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70099999999999996,"5min":1.371,"15min":1.371},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.755,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67200000000000004,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.75900000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.71599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12556,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":11072,"kb_avail":94359284,"statfs":{"total":96636764160,"available":96623906816,"internally_reserved":0,"allocated":1511424,"data_stored":766956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11337728},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.503,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.48199999999999998,"15min":0.504},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":1.841,"15min":1.841},"last":0.30599999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61499999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.51500000000000001,"15min":0.54300000000000004},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52000000000000002,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.28699999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55000000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53300000000000003,"5min":1.875,"15min":1.875},"last":0.46700000000000003}]},{"osd":4,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6180000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78900000000000003,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.73199999999999998,"15min":0.752},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.583,"5min":1.903,"15min":1.903},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81299999999999994,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81399999999999995,"5min":1.139,"15min":1.139},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8024,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94363816,"statfs":{"total":96636764160,"available":96628547584,"internally_reserved":0,"allocated":1458176,"data_stored":766536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.46600000000000003,"15min":0.49299999999999999},"min":{"1min":0.24399999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":2.665,"15min":2.665},"last":0.374},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.44,"15min":0.45800000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42099999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.29799999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.498,"15min":0.52500000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.47799999999999998,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.252},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.45800000000000002,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.443,"15min":0.45900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50600000000000001,"5min":1.359,"15min":1.359},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.46700000000000003,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":2.601,"15min":2.601},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":1.25,"15min":1.25},"last":0.443},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.76300000000000001,"15min":0.79800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68899999999999995,"5min":2.637,"15min":2.637},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65900000000000003,"15min":0.67600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.69599999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81599999999999995,"5min":1.321,"15min":1.321},"last":0.497}]},{"osd":7,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73899999999999999,"5min":1.478,"15min":1.478},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78800000000000003,"5min":1.286,"15min":1.286},"last":0.54100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20016,"kb_used_data":8680,"kb_used_omap":0,"kb_used_meta":11328,"kb_avail":94351824,"statfs":{"total":96636764160,"available":96616267776,"internally_reserved":0,"allocated":8888320,"data_stored":8107286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11599872},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47999999999999998,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53500000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63600000000000001,"5min":1.766,"15min":1.766},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.51700000000000002,"15min":0.54300000000000004},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56699999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.315},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.42199999999999999}]},{"osd":4,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63200000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.63100000000000001,"15min":0.65300000000000002},"min":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70699999999999996,"5min":1.847,"15min":1.847},"last":0.498},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70099999999999996,"5min":1.615,"15min":1.615},"last":0.50900000000000001}]},{"osd":6,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.69799999999999995,"15min":0.72199999999999998},"min":{"1min":0.40400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82699999999999996,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69699999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.754,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80100000000000005,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.46700000000000003}]}]},{"osd":4,"up_from":0,"seq":55834574877,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7944,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":94363896,"statfs":{"total":96636764160,"available":96628629504,"internally_reserved":0,"allocated":1507328,"data_stored":766916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47599999999999998}]},{"osd":1,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50600000000000001}]},{"osd":3,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.625}]},{"osd":4,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81399999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.65600000000000003}]},{"osd":6,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79300000000000004,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.878,"15min":0.878},"last":0.751}]},{"osd":7,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":1.044},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90300000000000002,"5min":1.359,"15min":1.359},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":83,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":50,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7348224,"data_stored":7340089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11542528,"data_stored":11534390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:17:53.071 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:17:53.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:53.094 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:53.094+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:53.101 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:53.101 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:53.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:53.196 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:53.197+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:53.243 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:53.261 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:53.278 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:53.283 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:53.283 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:53.284 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:53.284 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:53.294 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:53.296 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:53.297 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:53.297+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:53.314 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:53.336 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:53.354 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:53.372 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:53.374 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:53.375 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:53.396 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:53.396+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:53.426 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:53.426 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:53.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:8 3.1a e46/43 3:5cea7035:::rbd_info:head v 46'2, mlcod=0'0)", 2023-01-02T18:17:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 74.001420836999998, 2023-01-02T18:17:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652, 2023-01-02T18:17:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:53.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:53.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423967+0000", 2023-01-02T18:17:53.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4359999999999996e-06 2023-01-02T18:17:53.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423974+0000", 2023-01-02T18:17:53.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4739999999999994e-06 2023-01-02T18:17:53.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423984+0000", 2023-01-02T18:17:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.934e-06 2023-01-02T18:17:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.423991+0000", 2023-01-02T18:17:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6594000000000001e-05 2023-01-02T18:17:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424037+0000", 2023-01-02T18:17:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0897e-05 2023-01-02T18:17:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.424058+0000", 2023-01-02T18:17:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001034844 2023-01-02T18:17:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425093+0000", 2023-01-02T18:17:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8775000000000001e-05 2023-01-02T18:17:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.425132+0000", 2023-01-02T18:17:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001164652 2023-01-02T18:17:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.942221129000004, 2023-01-02T18:17:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 65.096860288000002, 2023-01-02T18:17:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.049751747999998, 2023-01-02T18:17:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.039474728999998, 2023-01-02T18:17:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1078 7.1e 7:7ae419c7:::rbd_object_map.11d51c086ce8:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.731126310000001, 2023-01-02T18:17:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494, 2023-01-02T18:17:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1078 2023-01-02T18:17:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694262+0000", 2023-01-02T18:17:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694260+0000", 2023-01-02T18:17:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.421e-06 2023-01-02T18:17:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694266+0000", 2023-01-02T18:17:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1922e-05 2023-01-02T18:17:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694278+0000", 2023-01-02T18:17:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9400000000000001e-06 2023-01-02T18:17:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694283+0000", 2023-01-02T18:17:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6597000000000001e-05 2023-01-02T18:17:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694330+0000", 2023-01-02T18:17:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6854999999999994e-05 2023-01-02T18:17:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694417+0000", 2023-01-02T18:17:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000136329 2023-01-02T18:17:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:17:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.694553+0000", 2023-01-02T18:17:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062458299999999995 2023-01-02T18:17:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695178+0000", 2023-01-02T18:17:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020995899999999999 2023-01-02T18:17:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695388+0000", 2023-01-02T18:17:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2279e-05 2023-01-02T18:17:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695420+0000", 2023-01-02T18:17:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6665e-05 2023-01-02T18:17:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.695447+0000", 2023-01-02T18:17:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00118494 2023-01-02T18:17:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2150 8.a 8:535385f0:::rbd_children:head [call rbd.add_child in=12b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.79581142, 2023-01-02T18:17:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001, 2023-01-02T18:17:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2150 2023-01-02T18:17:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629576+0000", 2023-01-02T18:17:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629575+0000", 2023-01-02T18:17:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2420000000000003e-06 2023-01-02T18:17:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629582+0000", 2023-01-02T18:17:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4215e-05 2023-01-02T18:17:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629596+0000", 2023-01-02T18:17:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6420000000000001e-06 2023-01-02T18:17:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629603+0000", 2023-01-02T18:17:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7078e-05 2023-01-02T18:17:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629640+0000", 2023-01-02T18:17:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1589999999999996e-05 2023-01-02T18:17:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629721+0000", 2023-01-02T18:17:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111826 2023-01-02T18:17:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:53.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.629833+0000", 2023-01-02T18:17:53.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000482571 2023-01-02T18:17:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630316+0000", 2023-01-02T18:17:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00033611099999999999 2023-01-02T18:17:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630652+0000", 2023-01-02T18:17:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1423000000000001e-05 2023-01-02T18:17:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630683+0000", 2023-01-02T18:17:53.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2697e-05 2023-01-02T18:17:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.630706+0000", 2023-01-02T18:17:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011296570000000001 2023-01-02T18:17:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.524 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:53.525 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:53.525 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.791906562999998, 2023-01-02T18:17:53.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:53.526 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.526 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:53.526 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.087364893, 2023-01-02T18:17:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.097633156999997, 2023-01-02T18:17:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.074307302000001, 2023-01-02T18:17:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.064232072000003, 2023-01-02T18:17:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:17:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:17:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:17:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:17:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:17:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:17:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:17:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:17:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:17:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:17:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:17:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:17:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:17:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:17:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:17:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:17:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:17:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:17:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:17:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:17:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:17:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:17:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:17:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:17:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:17:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:17:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:17:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:17:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2241 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [call rbd.object_map_snap_remove in=25b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.046313636000001, 2023-01-02T18:17:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652, 2023-01-02T18:17:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2241 2023-01-02T18:17:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379074+0000", 2023-01-02T18:17:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379073+0000", 2023-01-02T18:17:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7109999999999998e-06 2023-01-02T18:17:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379080+0000", 2023-01-02T18:17:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1620999999999999e-05 2023-01-02T18:17:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379091+0000", 2023-01-02T18:17:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0440000000000003e-06 2023-01-02T18:17:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379097+0000", 2023-01-02T18:17:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4477999999999997e-05 2023-01-02T18:17:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379141+0000", 2023-01-02T18:17:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9756999999999997e-05 2023-01-02T18:17:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.379201+0000", 2023-01-02T18:17:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010401239999999999 2023-01-02T18:17:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.380241+0000", 2023-01-02T18:17:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166652 2023-01-02T18:17:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.101082288000001, 2023-01-02T18:17:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:17:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:17:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:17:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:17:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:17:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:17:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:17:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:17:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:17:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:17:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:17:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:17:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:17:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:17:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:17:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:17:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:17:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:17:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:17:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.096318823000001, 2023-01-02T18:17:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:17:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:17:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:17:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:17:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:17:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:17:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:17:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:17:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:17:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:17:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:17:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:17:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:17:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:17:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:17:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:17:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:17:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:17:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.095785597999999, 2023-01-02T18:17:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:17:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:17:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:17:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:17:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:17:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:17:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:17:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:17:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:17:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:17:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:17:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:17:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:17:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:17:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:17:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:17:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.084767324000001, 2023-01-02T18:17:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:17:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:17:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:17:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:17:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:17:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:17:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:17:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:17:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:17:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:17:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:17:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:17:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:17:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:17:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:17:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:17:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:17:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:17:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.080422769999998, 2023-01-02T18:17:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:17:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:17:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:17:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:17:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:17:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:17:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:17:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:17:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:17:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:17:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:17:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:17:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:17:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:17:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:17:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:17:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:17:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:17:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.0433367800000006, 2023-01-02T18:17:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:17:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:17:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:17:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:17:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:17:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:17:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:17:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:17:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:17:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:17:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:17:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:17:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:17:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:17:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:17:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:17:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:17:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:17:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.0358558920000007, 2023-01-02T18:17:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:17:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:17:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:17:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:17:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:17:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:17:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:17:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:17:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:17:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:17:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:17:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:17:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:17:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:17:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:17:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:17:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:17:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:53.695 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:53.700 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:53.703 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:53.697+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:53.704 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:17:53.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:53.711 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-01-02T18:17:52.701310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":11536626,"num_objects":146,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":146,"num_whiteouts":0,"num_read":9706,"num_read_kb":8514,"num_write":881,"num_write_kb":11912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":1369,"num_keys_recovered":670,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1038,"ondisk_log_size":1038,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":601,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":101084,"kb_used_data":31780,"kb_used_omap":0,"kb_used_meta":69248,"kb_avail":660501796,"statfs":{"total":676457349120,"available":676353839104,"internally_reserved":0,"allocated":32542720,"data_stored":27388314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":70909952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":105,"num_keys_recovered":8,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.056414"},"pg_stats":[{"pgid":"11.17","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653235+0000","last_change":"2023-01-02T18:17:38.460472+0000","last_active":"2023-01-02T18:17:47.653235+0000","last_peered":"2023-01-02T18:17:47.653235+0000","last_clean":"2023-01-02T18:17:47.653235+0000","last_became_active":"2023-01-02T18:17:36.439954+0000","last_became_peered":"2023-01-02T18:17:36.439954+0000","last_unstale":"2023-01-02T18:17:47.653235+0000","last_undegraded":"2023-01-02T18:17:47.653235+0000","last_fullsized":"2023-01-02T18:17:47.653235+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653236+0000","last_change":"2023-01-02T18:17:34.327371+0000","last_active":"2023-01-02T18:17:47.653236+0000","last_peered":"2023-01-02T18:17:47.653236+0000","last_clean":"2023-01-02T18:17:47.653236+0000","last_became_active":"2023-01-02T18:17:32.345158+0000","last_became_peered":"2023-01-02T18:17:32.345158+0000","last_unstale":"2023-01-02T18:17:47.653236+0000","last_undegraded":"2023-01-02T18:17:47.653236+0000","last_fullsized":"2023-01-02T18:17:47.653236+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665679+0000","last_change":"2023-01-02T18:17:09.324265+0000","last_active":"2023-01-02T18:17:47.665679+0000","last_peered":"2023-01-02T18:17:47.665679+0000","last_clean":"2023-01-02T18:17:47.665679+0000","last_became_active":"2023-01-02T18:17:07.348058+0000","last_became_peered":"2023-01-02T18:17:07.348058+0000","last_unstale":"2023-01-02T18:17:47.665679+0000","last_undegraded":"2023-01-02T18:17:47.665679+0000","last_fullsized":"2023-01-02T18:17:47.665679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648138+0000","last_change":"2023-01-02T18:17:01.320137+0000","last_active":"2023-01-02T18:17:47.648138+0000","last_peered":"2023-01-02T18:17:47.648138+0000","last_clean":"2023-01-02T18:17:47.648138+0000","last_became_active":"2023-01-02T18:16:59.324809+0000","last_became_peered":"2023-01-02T18:16:59.324809+0000","last_unstale":"2023-01-02T18:17:47.648138+0000","last_undegraded":"2023-01-02T18:17:47.648138+0000","last_fullsized":"2023-01-02T18:17:47.648138+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652744+0000","last_change":"2023-01-02T18:16:48.330409+0000","last_active":"2023-01-02T18:17:47.652744+0000","last_peered":"2023-01-02T18:17:47.652744+0000","last_clean":"2023-01-02T18:17:47.652744+0000","last_became_active":"2023-01-02T18:16:48.329903+0000","last_became_peered":"2023-01-02T18:16:48.329903+0000","last_unstale":"2023-01-02T18:17:47.652744+0000","last_undegraded":"2023-01-02T18:17:47.652744+0000","last_fullsized":"2023-01-02T18:17:47.652744+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":137,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648595+0000","last_change":"2023-01-02T18:17:30.328135+0000","last_active":"2023-01-02T18:17:47.648595+0000","last_peered":"2023-01-02T18:17:47.648595+0000","last_clean":"2023-01-02T18:17:47.648595+0000","last_became_active":"2023-01-02T18:17:29.335258+0000","last_became_peered":"2023-01-02T18:17:29.335258+0000","last_unstale":"2023-01-02T18:17:47.648595+0000","last_undegraded":"2023-01-02T18:17:47.648595+0000","last_fullsized":"2023-01-02T18:17:47.648595+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654218+0000","last_change":"2023-01-02T18:17:29.327043+0000","last_active":"2023-01-02T18:17:47.654218+0000","last_peered":"2023-01-02T18:17:47.654218+0000","last_clean":"2023-01-02T18:17:47.654218+0000","last_became_active":"2023-01-02T18:17:29.326459+0000","last_became_peered":"2023-01-02T18:17:29.326459+0000","last_unstale":"2023-01-02T18:17:47.654218+0000","last_undegraded":"2023-01-02T18:17:47.654218+0000","last_fullsized":"2023-01-02T18:17:47.654218+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":33,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655598+0000","last_change":"2023-01-02T18:17:29.370303+0000","last_active":"2023-01-02T18:17:47.655598+0000","last_peered":"2023-01-02T18:17:47.655598+0000","last_clean":"2023-01-02T18:17:47.655598+0000","last_became_active":"2023-01-02T18:17:29.329505+0000","last_became_peered":"2023-01-02T18:17:29.329505+0000","last_unstale":"2023-01-02T18:17:47.655598+0000","last_undegraded":"2023-01-02T18:17:47.655598+0000","last_fullsized":"2023-01-02T18:17:47.655598+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":76,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":161,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646685+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:17:47.646685+0000","last_peered":"2023-01-02T18:17:47.646685+0000","last_clean":"2023-01-02T18:17:47.646685+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:17:47.646685+0000","last_undegraded":"2023-01-02T18:17:47.646685+0000","last_fullsized":"2023-01-02T18:17:47.646685+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656032+0000","last_change":"2023-01-02T18:17:38.446984+0000","last_active":"2023-01-02T18:17:47.656032+0000","last_peered":"2023-01-02T18:17:47.656032+0000","last_clean":"2023-01-02T18:17:47.656032+0000","last_became_active":"2023-01-02T18:17:36.442630+0000","last_became_peered":"2023-01-02T18:17:36.442630+0000","last_unstale":"2023-01-02T18:17:47.656032+0000","last_undegraded":"2023-01-02T18:17:47.656032+0000","last_fullsized":"2023-01-02T18:17:47.656032+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"101'15","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655641+0000","last_change":"2023-01-02T18:17:34.347463+0000","last_active":"2023-01-02T18:17:47.655641+0000","last_peered":"2023-01-02T18:17:47.655641+0000","last_clean":"2023-01-02T18:17:47.655641+0000","last_became_active":"2023-01-02T18:17:32.344665+0000","last_became_peered":"2023-01-02T18:17:32.344665+0000","last_unstale":"2023-01-02T18:17:47.655641+0000","last_undegraded":"2023-01-02T18:17:47.655641+0000","last_fullsized":"2023-01-02T18:17:47.655641+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654210+0000","last_change":"2023-01-02T18:17:09.308994+0000","last_active":"2023-01-02T18:17:47.654210+0000","last_peered":"2023-01-02T18:17:47.654210+0000","last_clean":"2023-01-02T18:17:47.654210+0000","last_became_active":"2023-01-02T18:17:07.339263+0000","last_became_peered":"2023-01-02T18:17:07.339263+0000","last_unstale":"2023-01-02T18:17:47.654210+0000","last_undegraded":"2023-01-02T18:17:47.654210+0000","last_fullsized":"2023-01-02T18:17:47.654210+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'22","reported_seq":280,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665524+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:17:47.665524+0000","last_peered":"2023-01-02T18:17:47.665524+0000","last_clean":"2023-01-02T18:17:47.665524+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:17:47.665524+0000","last_undegraded":"2023-01-02T18:17:47.665524+0000","last_fullsized":"2023-01-02T18:17:47.665524+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":276,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652734+0000","last_change":"2023-01-02T18:16:44.306676+0000","last_active":"2023-01-02T18:17:47.652734+0000","last_peered":"2023-01-02T18:17:47.652734+0000","last_clean":"2023-01-02T18:17:47.652734+0000","last_became_active":"2023-01-02T18:16:41.446794+0000","last_became_peered":"2023-01-02T18:16:41.446794+0000","last_unstale":"2023-01-02T18:17:47.652734+0000","last_undegraded":"2023-01-02T18:17:47.652734+0000","last_fullsized":"2023-01-02T18:17:47.652734+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"92'24","reported_seq":225,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655118+0000","last_change":"2023-01-02T18:17:30.435534+0000","last_active":"2023-01-02T18:17:47.655118+0000","last_peered":"2023-01-02T18:17:47.655118+0000","last_clean":"2023-01-02T18:17:47.655118+0000","last_became_active":"2023-01-02T18:16:37.427175+0000","last_became_peered":"2023-01-02T18:16:37.427175+0000","last_unstale":"2023-01-02T18:17:47.655118+0000","last_undegraded":"2023-01-02T18:17:47.655118+0000","last_fullsized":"2023-01-02T18:17:47.655118+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":270,"num_read_kb":225,"num_write":35,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":73,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652949+0000","last_change":"2023-01-02T18:16:49.318455+0000","last_active":"2023-01-02T18:17:47.652949+0000","last_peered":"2023-01-02T18:17:47.652949+0000","last_clean":"2023-01-02T18:17:47.652949+0000","last_became_active":"2023-01-02T18:16:48.329597+0000","last_became_peered":"2023-01-02T18:16:48.329597+0000","last_unstale":"2023-01-02T18:17:47.652949+0000","last_undegraded":"2023-01-02T18:17:47.652949+0000","last_fullsized":"2023-01-02T18:17:47.652949+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655649+0000","last_change":"2023-01-02T18:16:53.344973+0000","last_active":"2023-01-02T18:17:47.655649+0000","last_peered":"2023-01-02T18:17:47.655649+0000","last_clean":"2023-01-02T18:17:47.655649+0000","last_became_active":"2023-01-02T18:16:51.341196+0000","last_became_peered":"2023-01-02T18:16:51.341196+0000","last_unstale":"2023-01-02T18:17:47.655649+0000","last_undegraded":"2023-01-02T18:17:47.655649+0000","last_fullsized":"2023-01-02T18:17:47.655649+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":155,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654015+0000","last_change":"2023-01-02T18:17:29.345837+0000","last_active":"2023-01-02T18:17:47.654015+0000","last_peered":"2023-01-02T18:17:47.654015+0000","last_clean":"2023-01-02T18:17:47.654015+0000","last_became_active":"2023-01-02T18:17:29.339458+0000","last_became_peered":"2023-01-02T18:17:29.339458+0000","last_unstale":"2023-01-02T18:17:47.654015+0000","last_undegraded":"2023-01-02T18:17:47.654015+0000","last_fullsized":"2023-01-02T18:17:47.654015+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647006+0000","last_change":"2023-01-02T18:17:38.542677+0000","last_active":"2023-01-02T18:17:47.647006+0000","last_peered":"2023-01-02T18:17:47.647006+0000","last_clean":"2023-01-02T18:17:47.647006+0000","last_became_active":"2023-01-02T18:17:36.441682+0000","last_became_peered":"2023-01-02T18:17:36.441682+0000","last_unstale":"2023-01-02T18:17:47.647006+0000","last_undegraded":"2023-01-02T18:17:47.647006+0000","last_fullsized":"2023-01-02T18:17:47.647006+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654291+0000","last_change":"2023-01-02T18:17:34.333930+0000","last_active":"2023-01-02T18:17:47.654291+0000","last_peered":"2023-01-02T18:17:47.654291+0000","last_clean":"2023-01-02T18:17:47.654291+0000","last_became_active":"2023-01-02T18:17:32.340028+0000","last_became_peered":"2023-01-02T18:17:32.340028+0000","last_unstale":"2023-01-02T18:17:47.654291+0000","last_undegraded":"2023-01-02T18:17:47.654291+0000","last_fullsized":"2023-01-02T18:17:47.654291+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"76'1","reported_seq":53,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665350+0000","last_change":"2023-01-02T18:17:09.324016+0000","last_active":"2023-01-02T18:17:47.665350+0000","last_peered":"2023-01-02T18:17:47.665350+0000","last_clean":"2023-01-02T18:17:47.665350+0000","last_became_active":"2023-01-02T18:17:07.347854+0000","last_became_peered":"2023-01-02T18:17:07.347854+0000","last_unstale":"2023-01-02T18:17:47.665350+0000","last_undegraded":"2023-01-02T18:17:47.665350+0000","last_fullsized":"2023-01-02T18:17:47.665350+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"72'4","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654909+0000","last_change":"2023-01-02T18:17:01.311706+0000","last_active":"2023-01-02T18:17:47.654909+0000","last_peered":"2023-01-02T18:17:47.654909+0000","last_clean":"2023-01-02T18:17:47.654909+0000","last_became_active":"2023-01-02T18:16:59.313908+0000","last_became_peered":"2023-01-02T18:16:59.313908+0000","last_unstale":"2023-01-02T18:17:47.654909+0000","last_undegraded":"2023-01-02T18:17:47.654909+0000","last_fullsized":"2023-01-02T18:17:47.654909+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"51'2","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653540+0000","last_change":"2023-01-02T18:16:48.343757+0000","last_active":"2023-01-02T18:17:47.653540+0000","last_peered":"2023-01-02T18:17:47.653540+0000","last_clean":"2023-01-02T18:17:47.653540+0000","last_became_active":"2023-01-02T18:16:48.326121+0000","last_became_peered":"2023-01-02T18:16:48.326121+0000","last_unstale":"2023-01-02T18:17:47.653540+0000","last_undegraded":"2023-01-02T18:17:47.653540+0000","last_fullsized":"2023-01-02T18:17:47.653540+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"86'2","reported_seq":41,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655595+0000","last_change":"2023-01-02T18:17:30.331220+0000","last_active":"2023-01-02T18:17:47.655595+0000","last_peered":"2023-01-02T18:17:47.655595+0000","last_clean":"2023-01-02T18:17:47.655595+0000","last_became_active":"2023-01-02T18:17:29.331135+0000","last_became_peered":"2023-01-02T18:17:29.331135+0000","last_unstale":"2023-01-02T18:17:47.655595+0000","last_undegraded":"2023-01-02T18:17:47.655595+0000","last_fullsized":"2023-01-02T18:17:47.655595+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":86,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"56'1","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654949+0000","last_change":"2023-01-02T18:17:29.356376+0000","last_active":"2023-01-02T18:17:47.654949+0000","last_peered":"2023-01-02T18:17:47.654949+0000","last_clean":"2023-01-02T18:17:47.654949+0000","last_became_active":"2023-01-02T18:17:29.327003+0000","last_became_peered":"2023-01-02T18:17:29.327003+0000","last_unstale":"2023-01-02T18:17:47.654949+0000","last_undegraded":"2023-01-02T18:17:47.654949+0000","last_fullsized":"2023-01-02T18:17:47.654949+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646530+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:17:47.646530+0000","last_peered":"2023-01-02T18:17:47.646530+0000","last_clean":"2023-01-02T18:17:47.646530+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:17:47.646530+0000","last_undegraded":"2023-01-02T18:17:47.646530+0000","last_fullsized":"2023-01-02T18:17:47.646530+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653125+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:17:47.653125+0000","last_peered":"2023-01-02T18:17:47.653125+0000","last_clean":"2023-01-02T18:17:47.653125+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:17:47.653125+0000","last_undegraded":"2023-01-02T18:17:47.653125+0000","last_fullsized":"2023-01-02T18:17:47.653125+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"109'4","reported_seq":26,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652835+0000","last_change":"2023-01-02T18:17:38.459353+0000","last_active":"2023-01-02T18:17:47.652835+0000","last_peered":"2023-01-02T18:17:47.652835+0000","last_clean":"2023-01-02T18:17:47.652835+0000","last_became_active":"2023-01-02T18:17:36.439601+0000","last_became_peered":"2023-01-02T18:17:36.439601+0000","last_unstale":"2023-01-02T18:17:47.652835+0000","last_undegraded":"2023-01-02T18:17:47.652835+0000","last_fullsized":"2023-01-02T18:17:47.652835+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"101'8","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654544+0000","last_change":"2023-01-02T18:17:34.347450+0000","last_active":"2023-01-02T18:17:47.654544+0000","last_peered":"2023-01-02T18:17:47.654544+0000","last_clean":"2023-01-02T18:17:47.654544+0000","last_became_active":"2023-01-02T18:17:32.337265+0000","last_became_peered":"2023-01-02T18:17:32.337265+0000","last_unstale":"2023-01-02T18:17:47.654544+0000","last_undegraded":"2023-01-02T18:17:47.654544+0000","last_fullsized":"2023-01-02T18:17:47.654544+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"76'1","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655576+0000","last_change":"2023-01-02T18:17:09.308912+0000","last_active":"2023-01-02T18:17:47.655576+0000","last_peered":"2023-01-02T18:17:47.655576+0000","last_clean":"2023-01-02T18:17:47.655576+0000","last_became_active":"2023-01-02T18:17:07.339397+0000","last_became_peered":"2023-01-02T18:17:07.339397+0000","last_unstale":"2023-01-02T18:17:47.655576+0000","last_undegraded":"2023-01-02T18:17:47.655576+0000","last_fullsized":"2023-01-02T18:17:47.655576+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":58,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662628+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:17:47.662628+0000","last_peered":"2023-01-02T18:17:47.662628+0000","last_clean":"2023-01-02T18:17:47.662628+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:17:47.662628+0000","last_undegraded":"2023-01-02T18:17:47.662628+0000","last_fullsized":"2023-01-02T18:17:47.662628+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655543+0000","last_change":"2023-01-02T18:16:48.330072+0000","last_active":"2023-01-02T18:17:47.655543+0000","last_peered":"2023-01-02T18:17:47.655543+0000","last_clean":"2023-01-02T18:17:47.655543+0000","last_became_active":"2023-01-02T18:16:48.329697+0000","last_became_peered":"2023-01-02T18:16:48.329697+0000","last_unstale":"2023-01-02T18:17:47.655543+0000","last_undegraded":"2023-01-02T18:17:47.655543+0000","last_fullsized":"2023-01-02T18:17:47.655543+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"97'33","reported_seq":47,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655221+0000","last_change":"2023-01-02T18:17:30.331571+0000","last_active":"2023-01-02T18:17:47.655221+0000","last_peered":"2023-01-02T18:17:47.655221+0000","last_clean":"2023-01-02T18:17:47.655221+0000","last_became_active":"2023-01-02T18:17:29.326006+0000","last_became_peered":"2023-01-02T18:17:29.326006+0000","last_unstale":"2023-01-02T18:17:47.655221+0000","last_undegraded":"2023-01-02T18:17:47.655221+0000","last_fullsized":"2023-01-02T18:17:47.655221+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":86,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":58,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":137,"num_keys_recovered":70,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"56'2","reported_seq":87,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663958+0000","last_change":"2023-01-02T18:16:49.305216+0000","last_active":"2023-01-02T18:17:47.663958+0000","last_peered":"2023-01-02T18:17:47.663958+0000","last_clean":"2023-01-02T18:17:47.663958+0000","last_became_active":"2023-01-02T18:16:48.327069+0000","last_became_peered":"2023-01-02T18:16:48.327069+0000","last_unstale":"2023-01-02T18:17:47.663958+0000","last_undegraded":"2023-01-02T18:17:47.663958+0000","last_fullsized":"2023-01-02T18:17:47.663958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654386+0000","last_change":"2023-01-02T18:17:29.326893+0000","last_active":"2023-01-02T18:17:47.654386+0000","last_peered":"2023-01-02T18:17:47.654386+0000","last_clean":"2023-01-02T18:17:47.654386+0000","last_became_active":"2023-01-02T18:17:29.326037+0000","last_became_peered":"2023-01-02T18:17:29.326037+0000","last_unstale":"2023-01-02T18:17:47.654386+0000","last_undegraded":"2023-01-02T18:17:47.654386+0000","last_fullsized":"2023-01-02T18:17:47.654386+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":581,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653049+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:17:47.653049+0000","last_peered":"2023-01-02T18:17:47.653049+0000","last_clean":"2023-01-02T18:17:47.653049+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:17:47.653049+0000","last_undegraded":"2023-01-02T18:17:47.653049+0000","last_fullsized":"2023-01-02T18:17:47.653049+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655584+0000","last_change":"2023-01-02T18:17:38.445785+0000","last_active":"2023-01-02T18:17:47.655584+0000","last_peered":"2023-01-02T18:17:47.655584+0000","last_clean":"2023-01-02T18:17:47.655584+0000","last_became_active":"2023-01-02T18:17:36.435481+0000","last_became_peered":"2023-01-02T18:17:36.435481+0000","last_unstale":"2023-01-02T18:17:47.655584+0000","last_undegraded":"2023-01-02T18:17:47.655584+0000","last_fullsized":"2023-01-02T18:17:47.655584+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654221+0000","last_change":"2023-01-02T18:17:34.326763+0000","last_active":"2023-01-02T18:17:47.654221+0000","last_peered":"2023-01-02T18:17:47.654221+0000","last_clean":"2023-01-02T18:17:47.654221+0000","last_became_active":"2023-01-02T18:17:32.347186+0000","last_became_peered":"2023-01-02T18:17:32.347186+0000","last_unstale":"2023-01-02T18:17:47.654221+0000","last_undegraded":"2023-01-02T18:17:47.654221+0000","last_fullsized":"2023-01-02T18:17:47.654221+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"76'79","reported_seq":572,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662854+0000","last_change":"2023-01-02T18:17:09.321800+0000","last_active":"2023-01-02T18:17:47.662854+0000","last_peered":"2023-01-02T18:17:47.662854+0000","last_clean":"2023-01-02T18:17:47.662854+0000","last_became_active":"2023-01-02T18:17:07.340907+0000","last_became_peered":"2023-01-02T18:17:07.340907+0000","last_unstale":"2023-01-02T18:17:47.662854+0000","last_undegraded":"2023-01-02T18:17:47.662854+0000","last_fullsized":"2023-01-02T18:17:47.662854+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1144,"num_read_kb":1037,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'17","reported_seq":197,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662823+0000","last_change":"2023-01-02T18:17:29.368980+0000","last_active":"2023-01-02T18:17:47.662823+0000","last_peered":"2023-01-02T18:17:47.662823+0000","last_clean":"2023-01-02T18:17:47.662823+0000","last_became_active":"2023-01-02T18:17:29.341397+0000","last_became_peered":"2023-01-02T18:17:29.341397+0000","last_unstale":"2023-01-02T18:17:47.662823+0000","last_undegraded":"2023-01-02T18:17:47.662823+0000","last_fullsized":"2023-01-02T18:17:47.662823+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653401+0000","last_change":"2023-01-02T18:16:57.307585+0000","last_active":"2023-01-02T18:17:47.653401+0000","last_peered":"2023-01-02T18:17:47.653401+0000","last_clean":"2023-01-02T18:17:47.653401+0000","last_became_active":"2023-01-02T18:16:55.315726+0000","last_became_peered":"2023-01-02T18:16:55.315726+0000","last_unstale":"2023-01-02T18:17:47.653401+0000","last_undegraded":"2023-01-02T18:17:47.653401+0000","last_fullsized":"2023-01-02T18:17:47.653401+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":91,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646715+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:17:47.646715+0000","last_peered":"2023-01-02T18:17:47.646715+0000","last_clean":"2023-01-02T18:17:47.646715+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:17:47.646715+0000","last_undegraded":"2023-01-02T18:17:47.646715+0000","last_fullsized":"2023-01-02T18:17:47.646715+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":137,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647213+0000","last_change":"2023-01-02T18:17:30.328445+0000","last_active":"2023-01-02T18:17:47.647213+0000","last_peered":"2023-01-02T18:17:47.647213+0000","last_clean":"2023-01-02T18:17:47.647213+0000","last_became_active":"2023-01-02T18:16:48.331845+0000","last_became_peered":"2023-01-02T18:16:48.331845+0000","last_unstale":"2023-01-02T18:17:47.647213+0000","last_undegraded":"2023-01-02T18:17:47.647213+0000","last_fullsized":"2023-01-02T18:17:47.647213+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648052+0000","last_change":"2023-01-02T18:16:49.324534+0000","last_active":"2023-01-02T18:17:47.648052+0000","last_peered":"2023-01-02T18:17:47.648052+0000","last_clean":"2023-01-02T18:17:47.648052+0000","last_became_active":"2023-01-02T18:16:48.327014+0000","last_became_peered":"2023-01-02T18:16:48.327014+0000","last_unstale":"2023-01-02T18:17:47.648052+0000","last_undegraded":"2023-01-02T18:17:47.648052+0000","last_fullsized":"2023-01-02T18:17:47.648052+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":75,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654247+0000","last_change":"2023-01-02T18:17:29.338016+0000","last_active":"2023-01-02T18:17:47.654247+0000","last_peered":"2023-01-02T18:17:47.654247+0000","last_clean":"2023-01-02T18:17:47.654247+0000","last_became_active":"2023-01-02T18:17:29.337654+0000","last_became_peered":"2023-01-02T18:17:29.337654+0000","last_unstale":"2023-01-02T18:17:47.654247+0000","last_undegraded":"2023-01-02T18:17:47.654247+0000","last_fullsized":"2023-01-02T18:17:47.654247+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655726+0000","last_change":"2023-01-02T18:17:38.469074+0000","last_active":"2023-01-02T18:17:47.655726+0000","last_peered":"2023-01-02T18:17:47.655726+0000","last_clean":"2023-01-02T18:17:47.655726+0000","last_became_active":"2023-01-02T18:17:36.439327+0000","last_became_peered":"2023-01-02T18:17:36.439327+0000","last_unstale":"2023-01-02T18:17:47.655726+0000","last_undegraded":"2023-01-02T18:17:47.655726+0000","last_fullsized":"2023-01-02T18:17:47.655726+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653445+0000","last_change":"2023-01-02T18:17:34.327801+0000","last_active":"2023-01-02T18:17:47.653445+0000","last_peered":"2023-01-02T18:17:47.653445+0000","last_clean":"2023-01-02T18:17:47.653445+0000","last_became_active":"2023-01-02T18:17:32.346998+0000","last_became_peered":"2023-01-02T18:17:32.346998+0000","last_unstale":"2023-01-02T18:17:47.653445+0000","last_undegraded":"2023-01-02T18:17:47.653445+0000","last_fullsized":"2023-01-02T18:17:47.653445+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654499+0000","last_change":"2023-01-02T18:17:09.310675+0000","last_active":"2023-01-02T18:17:47.654499+0000","last_peered":"2023-01-02T18:17:47.654499+0000","last_clean":"2023-01-02T18:17:47.654499+0000","last_became_active":"2023-01-02T18:17:07.345963+0000","last_became_peered":"2023-01-02T18:17:07.345963+0000","last_unstale":"2023-01-02T18:17:47.654499+0000","last_undegraded":"2023-01-02T18:17:47.654499+0000","last_fullsized":"2023-01-02T18:17:47.654499+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655840+0000","last_change":"2023-01-02T18:17:29.335050+0000","last_active":"2023-01-02T18:17:47.655840+0000","last_peered":"2023-01-02T18:17:47.655840+0000","last_clean":"2023-01-02T18:17:47.655840+0000","last_became_active":"2023-01-02T18:17:29.333986+0000","last_became_peered":"2023-01-02T18:17:29.333986+0000","last_unstale":"2023-01-02T18:17:47.655840+0000","last_undegraded":"2023-01-02T18:17:47.655840+0000","last_fullsized":"2023-01-02T18:17:47.655840+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652983+0000","last_change":"2023-01-02T18:16:49.309259+0000","last_active":"2023-01-02T18:17:47.652983+0000","last_peered":"2023-01-02T18:17:47.652983+0000","last_clean":"2023-01-02T18:17:47.652983+0000","last_became_active":"2023-01-02T18:16:46.313760+0000","last_became_peered":"2023-01-02T18:16:46.313760+0000","last_unstale":"2023-01-02T18:17:47.652983+0000","last_undegraded":"2023-01-02T18:17:47.652983+0000","last_fullsized":"2023-01-02T18:17:47.652983+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656072+0000","last_change":"2023-01-02T18:17:29.372464+0000","last_active":"2023-01-02T18:17:47.656072+0000","last_peered":"2023-01-02T18:17:47.656072+0000","last_clean":"2023-01-02T18:17:47.656072+0000","last_became_active":"2023-01-02T18:17:29.332091+0000","last_became_peered":"2023-01-02T18:17:29.332091+0000","last_unstale":"2023-01-02T18:17:47.656072+0000","last_undegraded":"2023-01-02T18:17:47.656072+0000","last_fullsized":"2023-01-02T18:17:47.656072+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":132,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648546+0000","last_change":"2023-01-02T18:17:30.328637+0000","last_active":"2023-01-02T18:17:47.648546+0000","last_peered":"2023-01-02T18:17:47.648546+0000","last_clean":"2023-01-02T18:17:47.648546+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:17:47.648546+0000","last_undegraded":"2023-01-02T18:17:47.648546+0000","last_fullsized":"2023-01-02T18:17:47.648546+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":109,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653488+0000","last_change":"2023-01-02T18:17:36.450224+0000","last_active":"2023-01-02T18:17:47.653488+0000","last_peered":"2023-01-02T18:17:47.653488+0000","last_clean":"2023-01-02T18:17:47.653488+0000","last_became_active":"2023-01-02T18:17:36.449891+0000","last_became_peered":"2023-01-02T18:17:36.449891+0000","last_unstale":"2023-01-02T18:17:47.653488+0000","last_undegraded":"2023-01-02T18:17:47.653488+0000","last_fullsized":"2023-01-02T18:17:47.653488+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662630+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:17:47.662630+0000","last_peered":"2023-01-02T18:17:47.662630+0000","last_clean":"2023-01-02T18:17:47.662630+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:17:47.662630+0000","last_undegraded":"2023-01-02T18:17:47.662630+0000","last_fullsized":"2023-01-02T18:17:47.662630+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654122+0000","last_change":"2023-01-02T18:16:57.312949+0000","last_active":"2023-01-02T18:17:47.654122+0000","last_peered":"2023-01-02T18:17:47.654122+0000","last_clean":"2023-01-02T18:17:47.654122+0000","last_became_active":"2023-01-02T18:16:55.315334+0000","last_became_peered":"2023-01-02T18:16:55.315334+0000","last_unstale":"2023-01-02T18:17:47.654122+0000","last_undegraded":"2023-01-02T18:17:47.654122+0000","last_fullsized":"2023-01-02T18:17:47.654122+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665368+0000","last_change":"2023-01-02T18:17:38.465060+0000","last_active":"2023-01-02T18:17:47.665368+0000","last_peered":"2023-01-02T18:17:47.665368+0000","last_clean":"2023-01-02T18:17:47.665368+0000","last_became_active":"2023-01-02T18:17:36.442117+0000","last_became_peered":"2023-01-02T18:17:36.442117+0000","last_unstale":"2023-01-02T18:17:47.665368+0000","last_undegraded":"2023-01-02T18:17:47.665368+0000","last_fullsized":"2023-01-02T18:17:47.665368+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"101'15","reported_seq":96,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653488+0000","last_change":"2023-01-02T18:17:34.328115+0000","last_active":"2023-01-02T18:17:47.653488+0000","last_peered":"2023-01-02T18:17:47.653488+0000","last_clean":"2023-01-02T18:17:47.653488+0000","last_became_active":"2023-01-02T18:17:32.347252+0000","last_became_peered":"2023-01-02T18:17:32.347252+0000","last_unstale":"2023-01-02T18:17:47.653488+0000","last_undegraded":"2023-01-02T18:17:47.653488+0000","last_fullsized":"2023-01-02T18:17:47.653488+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":66,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.662784+0000","last_change":"2023-01-02T18:17:48.662784+0000","last_active":"2023-01-02T18:17:48.662784+0000","last_peered":"2023-01-02T18:17:48.662784+0000","last_clean":"2023-01-02T18:17:48.662784+0000","last_became_active":"2023-01-02T18:17:48.662397+0000","last_became_peered":"2023-01-02T18:17:48.662397+0000","last_unstale":"2023-01-02T18:17:48.662784+0000","last_undegraded":"2023-01-02T18:17:48.662784+0000","last_fullsized":"2023-01-02T18:17:48.662784+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648056+0000","last_change":"2023-01-02T18:17:01.319510+0000","last_active":"2023-01-02T18:17:47.648056+0000","last_peered":"2023-01-02T18:17:47.648056+0000","last_clean":"2023-01-02T18:17:47.648056+0000","last_became_active":"2023-01-02T18:16:59.327716+0000","last_became_peered":"2023-01-02T18:16:59.327716+0000","last_unstale":"2023-01-02T18:17:47.648056+0000","last_undegraded":"2023-01-02T18:17:47.648056+0000","last_fullsized":"2023-01-02T18:17:47.648056+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":73,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656912+0000","last_change":"2023-01-02T18:16:49.310704+0000","last_active":"2023-01-02T18:17:47.656912+0000","last_peered":"2023-01-02T18:17:47.656912+0000","last_clean":"2023-01-02T18:17:47.656912+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:47.656912+0000","last_undegraded":"2023-01-02T18:17:47.656912+0000","last_fullsized":"2023-01-02T18:17:47.656912+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652569+0000","last_change":"2023-01-02T18:16:44.307480+0000","last_active":"2023-01-02T18:17:47.652569+0000","last_peered":"2023-01-02T18:17:47.652569+0000","last_clean":"2023-01-02T18:17:47.652569+0000","last_became_active":"2023-01-02T18:16:41.447912+0000","last_became_peered":"2023-01-02T18:16:41.447912+0000","last_unstale":"2023-01-02T18:17:47.652569+0000","last_undegraded":"2023-01-02T18:17:47.652569+0000","last_fullsized":"2023-01-02T18:17:47.652569+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":102,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655915+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:17:47.655915+0000","last_peered":"2023-01-02T18:17:47.655915+0000","last_clean":"2023-01-02T18:17:47.655915+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:17:47.655915+0000","last_undegraded":"2023-01-02T18:17:47.655915+0000","last_fullsized":"2023-01-02T18:17:47.655915+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"92'13","reported_seq":148,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656231+0000","last_change":"2023-01-02T18:17:30.435879+0000","last_active":"2023-01-02T18:17:47.656231+0000","last_peered":"2023-01-02T18:17:47.656231+0000","last_clean":"2023-01-02T18:17:47.656231+0000","last_became_active":"2023-01-02T18:16:37.431863+0000","last_became_peered":"2023-01-02T18:16:37.431863+0000","last_unstale":"2023-01-02T18:17:47.656231+0000","last_undegraded":"2023-01-02T18:17:47.656231+0000","last_fullsized":"2023-01-02T18:17:47.656231+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654038+0000","last_change":"2023-01-02T18:16:53.344851+0000","last_active":"2023-01-02T18:17:47.654038+0000","last_peered":"2023-01-02T18:17:47.654038+0000","last_clean":"2023-01-02T18:17:47.654038+0000","last_became_active":"2023-01-02T18:16:51.341804+0000","last_became_peered":"2023-01-02T18:16:51.341804+0000","last_unstale":"2023-01-02T18:17:47.654038+0000","last_undegraded":"2023-01-02T18:17:47.654038+0000","last_fullsized":"2023-01-02T18:17:47.654038+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656123+0000","last_change":"2023-01-02T18:16:57.313134+0000","last_active":"2023-01-02T18:17:47.656123+0000","last_peered":"2023-01-02T18:17:47.656123+0000","last_clean":"2023-01-02T18:17:47.656123+0000","last_became_active":"2023-01-02T18:16:55.311645+0000","last_became_peered":"2023-01-02T18:16:55.311645+0000","last_unstale":"2023-01-02T18:17:47.656123+0000","last_undegraded":"2023-01-02T18:17:47.656123+0000","last_fullsized":"2023-01-02T18:17:47.656123+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654833+0000","last_change":"2023-01-02T18:17:38.469077+0000","last_active":"2023-01-02T18:17:47.654833+0000","last_peered":"2023-01-02T18:17:47.654833+0000","last_clean":"2023-01-02T18:17:47.654833+0000","last_became_active":"2023-01-02T18:17:36.436242+0000","last_became_peered":"2023-01-02T18:17:36.436242+0000","last_unstale":"2023-01-02T18:17:47.654833+0000","last_undegraded":"2023-01-02T18:17:47.654833+0000","last_fullsized":"2023-01-02T18:17:47.654833+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653043+0000","last_change":"2023-01-02T18:17:34.327358+0000","last_active":"2023-01-02T18:17:47.653043+0000","last_peered":"2023-01-02T18:17:47.653043+0000","last_clean":"2023-01-02T18:17:47.653043+0000","last_became_active":"2023-01-02T18:17:32.339808+0000","last_became_peered":"2023-01-02T18:17:32.339808+0000","last_unstale":"2023-01-02T18:17:47.653043+0000","last_undegraded":"2023-01-02T18:17:47.653043+0000","last_fullsized":"2023-01-02T18:17:47.653043+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665131+0000","last_change":"2023-01-02T18:17:09.323298+0000","last_active":"2023-01-02T18:17:47.665131+0000","last_peered":"2023-01-02T18:17:47.665131+0000","last_clean":"2023-01-02T18:17:47.665131+0000","last_became_active":"2023-01-02T18:17:07.342742+0000","last_became_peered":"2023-01-02T18:17:07.342742+0000","last_unstale":"2023-01-02T18:17:47.665131+0000","last_undegraded":"2023-01-02T18:17:47.665131+0000","last_fullsized":"2023-01-02T18:17:47.665131+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655807+0000","last_change":"2023-01-02T18:17:01.310492+0000","last_active":"2023-01-02T18:17:47.655807+0000","last_peered":"2023-01-02T18:17:47.655807+0000","last_clean":"2023-01-02T18:17:47.655807+0000","last_became_active":"2023-01-02T18:16:59.313793+0000","last_became_peered":"2023-01-02T18:16:59.313793+0000","last_unstale":"2023-01-02T18:17:47.655807+0000","last_undegraded":"2023-01-02T18:17:47.655807+0000","last_fullsized":"2023-01-02T18:17:47.655807+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"56'1","reported_seq":73,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654303+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:17:47.654303+0000","last_peered":"2023-01-02T18:17:47.654303+0000","last_clean":"2023-01-02T18:17:47.654303+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:17:47.654303+0000","last_undegraded":"2023-01-02T18:17:47.654303+0000","last_fullsized":"2023-01-02T18:17:47.654303+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":31,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655667+0000","last_change":"2023-01-02T18:17:29.344997+0000","last_active":"2023-01-02T18:17:47.655667+0000","last_peered":"2023-01-02T18:17:47.655667+0000","last_clean":"2023-01-02T18:17:47.655667+0000","last_became_active":"2023-01-02T18:17:29.323459+0000","last_became_peered":"2023-01-02T18:17:29.323459+0000","last_unstale":"2023-01-02T18:17:47.655667+0000","last_undegraded":"2023-01-02T18:17:47.655667+0000","last_fullsized":"2023-01-02T18:17:47.655667+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":81,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"46'2","reported_seq":128,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654927+0000","last_change":"2023-01-02T18:17:30.330076+0000","last_active":"2023-01-02T18:17:47.654927+0000","last_peered":"2023-01-02T18:17:47.654927+0000","last_clean":"2023-01-02T18:17:47.654927+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:17:47.654927+0000","last_undegraded":"2023-01-02T18:17:47.654927+0000","last_fullsized":"2023-01-02T18:17:47.654927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":101,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665285+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:17:47.665285+0000","last_peered":"2023-01-02T18:17:47.665285+0000","last_clean":"2023-01-02T18:17:47.665285+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:17:47.665285+0000","last_undegraded":"2023-01-02T18:17:47.665285+0000","last_fullsized":"2023-01-02T18:17:47.665285+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653033+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:17:47.653033+0000","last_peered":"2023-01-02T18:17:47.653033+0000","last_clean":"2023-01-02T18:17:47.653033+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:17:47.653033+0000","last_undegraded":"2023-01-02T18:17:47.653033+0000","last_fullsized":"2023-01-02T18:17:47.653033+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654334+0000","last_change":"2023-01-02T18:17:29.326283+0000","last_active":"2023-01-02T18:17:47.654334+0000","last_peered":"2023-01-02T18:17:47.654334+0000","last_clean":"2023-01-02T18:17:47.654334+0000","last_became_active":"2023-01-02T18:17:29.325965+0000","last_became_peered":"2023-01-02T18:17:29.325965+0000","last_unstale":"2023-01-02T18:17:47.654334+0000","last_undegraded":"2023-01-02T18:17:47.654334+0000","last_fullsized":"2023-01-02T18:17:47.654334+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"106'4","reported_seq":26,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656986+0000","last_change":"2023-01-02T18:17:38.450921+0000","last_active":"2023-01-02T18:17:47.656986+0000","last_peered":"2023-01-02T18:17:47.656986+0000","last_clean":"2023-01-02T18:17:47.656986+0000","last_became_active":"2023-01-02T18:17:36.444808+0000","last_became_peered":"2023-01-02T18:17:36.444808+0000","last_unstale":"2023-01-02T18:17:47.656986+0000","last_undegraded":"2023-01-02T18:17:47.656986+0000","last_fullsized":"2023-01-02T18:17:47.656986+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647015+0000","last_change":"2023-01-02T18:17:34.316738+0000","last_active":"2023-01-02T18:17:47.647015+0000","last_peered":"2023-01-02T18:17:47.647015+0000","last_clean":"2023-01-02T18:17:47.647015+0000","last_became_active":"2023-01-02T18:17:32.340483+0000","last_became_peered":"2023-01-02T18:17:32.340483+0000","last_unstale":"2023-01-02T18:17:47.647015+0000","last_undegraded":"2023-01-02T18:17:47.647015+0000","last_fullsized":"2023-01-02T18:17:47.647015+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646596+0000","last_change":"2023-01-02T18:17:09.321395+0000","last_active":"2023-01-02T18:17:47.646596+0000","last_peered":"2023-01-02T18:17:47.646596+0000","last_clean":"2023-01-02T18:17:47.646596+0000","last_became_active":"2023-01-02T18:17:07.344789+0000","last_became_peered":"2023-01-02T18:17:07.344789+0000","last_unstale":"2023-01-02T18:17:47.646596+0000","last_undegraded":"2023-01-02T18:17:47.646596+0000","last_fullsized":"2023-01-02T18:17:47.646596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"71'3","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651884+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:17:47.651884+0000","last_peered":"2023-01-02T18:17:47.651884+0000","last_clean":"2023-01-02T18:17:47.651884+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:17:47.651884+0000","last_undegraded":"2023-01-02T18:17:47.651884+0000","last_fullsized":"2023-01-02T18:17:47.651884+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'2","reported_seq":79,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648982+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:17:47.648982+0000","last_peered":"2023-01-02T18:17:47.648982+0000","last_clean":"2023-01-02T18:17:47.648982+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:17:47.648982+0000","last_undegraded":"2023-01-02T18:17:47.648982+0000","last_fullsized":"2023-01-02T18:17:47.648982+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"94'15","reported_seq":195,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647390+0000","last_change":"2023-01-02T18:17:30.328344+0000","last_active":"2023-01-02T18:17:47.647390+0000","last_peered":"2023-01-02T18:17:47.647390+0000","last_clean":"2023-01-02T18:17:47.647390+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:47.647390+0000","last_undegraded":"2023-01-02T18:17:47.647390+0000","last_fullsized":"2023-01-02T18:17:47.647390+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":93,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":95,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652650+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:17:47.652650+0000","last_peered":"2023-01-02T18:17:47.652650+0000","last_clean":"2023-01-02T18:17:47.652650+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:17:47.652650+0000","last_undegraded":"2023-01-02T18:17:47.652650+0000","last_fullsized":"2023-01-02T18:17:47.652650+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656970+0000","last_change":"2023-01-02T18:17:29.326478+0000","last_active":"2023-01-02T18:17:47.656970+0000","last_peered":"2023-01-02T18:17:47.656970+0000","last_clean":"2023-01-02T18:17:47.656970+0000","last_became_active":"2023-01-02T18:17:29.325843+0000","last_became_peered":"2023-01-02T18:17:29.325843+0000","last_unstale":"2023-01-02T18:17:47.656970+0000","last_undegraded":"2023-01-02T18:17:47.656970+0000","last_fullsized":"2023-01-02T18:17:47.656970+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":75,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654531+0000","last_change":"2023-01-02T18:17:29.318734+0000","last_active":"2023-01-02T18:17:47.654531+0000","last_peered":"2023-01-02T18:17:47.654531+0000","last_clean":"2023-01-02T18:17:47.654531+0000","last_became_active":"2023-01-02T18:17:29.318419+0000","last_became_peered":"2023-01-02T18:17:29.318419+0000","last_unstale":"2023-01-02T18:17:47.654531+0000","last_undegraded":"2023-01-02T18:17:47.654531+0000","last_fullsized":"2023-01-02T18:17:47.654531+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665510+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:17:47.665510+0000","last_peered":"2023-01-02T18:17:47.665510+0000","last_clean":"2023-01-02T18:17:47.665510+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:17:47.665510+0000","last_undegraded":"2023-01-02T18:17:47.665510+0000","last_fullsized":"2023-01-02T18:17:47.665510+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653624+0000","last_change":"2023-01-02T18:17:38.450765+0000","last_active":"2023-01-02T18:17:47.653624+0000","last_peered":"2023-01-02T18:17:47.653624+0000","last_clean":"2023-01-02T18:17:47.653624+0000","last_became_active":"2023-01-02T18:17:36.444834+0000","last_became_peered":"2023-01-02T18:17:36.444834+0000","last_unstale":"2023-01-02T18:17:47.653624+0000","last_undegraded":"2023-01-02T18:17:47.653624+0000","last_fullsized":"2023-01-02T18:17:47.653624+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653320+0000","last_change":"2023-01-02T18:17:34.327117+0000","last_active":"2023-01-02T18:17:47.653320+0000","last_peered":"2023-01-02T18:17:47.653320+0000","last_clean":"2023-01-02T18:17:47.653320+0000","last_became_active":"2023-01-02T18:17:32.340616+0000","last_became_peered":"2023-01-02T18:17:32.340616+0000","last_unstale":"2023-01-02T18:17:47.653320+0000","last_undegraded":"2023-01-02T18:17:47.653320+0000","last_fullsized":"2023-01-02T18:17:47.653320+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":20,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646786+0000","last_change":"2023-01-02T18:17:36.433551+0000","last_active":"2023-01-02T18:17:47.646786+0000","last_peered":"2023-01-02T18:17:47.646786+0000","last_clean":"2023-01-02T18:17:47.646786+0000","last_became_active":"2023-01-02T18:17:36.433227+0000","last_became_peered":"2023-01-02T18:17:36.433227+0000","last_unstale":"2023-01-02T18:17:47.646786+0000","last_undegraded":"2023-01-02T18:17:47.646786+0000","last_fullsized":"2023-01-02T18:17:47.646786+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652862+0000","last_change":"2023-01-02T18:17:29.338386+0000","last_active":"2023-01-02T18:17:47.652862+0000","last_peered":"2023-01-02T18:17:47.652862+0000","last_clean":"2023-01-02T18:17:47.652862+0000","last_became_active":"2023-01-02T18:17:29.337596+0000","last_became_peered":"2023-01-02T18:17:29.337596+0000","last_unstale":"2023-01-02T18:17:47.652862+0000","last_undegraded":"2023-01-02T18:17:47.652862+0000","last_fullsized":"2023-01-02T18:17:47.652862+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664427+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:17:47.664427+0000","last_peered":"2023-01-02T18:17:47.664427+0000","last_clean":"2023-01-02T18:17:47.664427+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:17:47.664427+0000","last_undegraded":"2023-01-02T18:17:47.664427+0000","last_fullsized":"2023-01-02T18:17:47.664427+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":90,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653268+0000","last_change":"2023-01-02T18:16:48.345373+0000","last_active":"2023-01-02T18:17:47.653268+0000","last_peered":"2023-01-02T18:17:47.653268+0000","last_clean":"2023-01-02T18:17:47.653268+0000","last_became_active":"2023-01-02T18:16:48.328041+0000","last_became_peered":"2023-01-02T18:16:48.328041+0000","last_unstale":"2023-01-02T18:17:47.653268+0000","last_undegraded":"2023-01-02T18:17:47.653268+0000","last_fullsized":"2023-01-02T18:17:47.653268+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"96'9","reported_seq":175,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653688+0000","last_change":"2023-01-02T18:17:30.434525+0000","last_active":"2023-01-02T18:17:47.653688+0000","last_peered":"2023-01-02T18:17:47.653688+0000","last_clean":"2023-01-02T18:17:47.653688+0000","last_became_active":"2023-01-02T18:17:29.334562+0000","last_became_peered":"2023-01-02T18:17:29.334562+0000","last_unstale":"2023-01-02T18:17:47.653688+0000","last_undegraded":"2023-01-02T18:17:47.653688+0000","last_fullsized":"2023-01-02T18:17:47.653688+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":70,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":103,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663027+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:17:47.663027+0000","last_peered":"2023-01-02T18:17:47.663027+0000","last_clean":"2023-01-02T18:17:47.663027+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:17:47.663027+0000","last_undegraded":"2023-01-02T18:17:47.663027+0000","last_fullsized":"2023-01-02T18:17:47.663027+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654855+0000","last_change":"2023-01-02T18:17:29.323754+0000","last_active":"2023-01-02T18:17:47.654855+0000","last_peered":"2023-01-02T18:17:47.654855+0000","last_clean":"2023-01-02T18:17:47.654855+0000","last_became_active":"2023-01-02T18:17:29.320497+0000","last_became_peered":"2023-01-02T18:17:29.320497+0000","last_unstale":"2023-01-02T18:17:47.654855+0000","last_undegraded":"2023-01-02T18:17:47.654855+0000","last_fullsized":"2023-01-02T18:17:47.654855+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656476+0000","last_change":"2023-01-02T18:17:29.389087+0000","last_active":"2023-01-02T18:17:47.656476+0000","last_peered":"2023-01-02T18:17:47.656476+0000","last_clean":"2023-01-02T18:17:47.656476+0000","last_became_active":"2023-01-02T18:17:29.337136+0000","last_became_peered":"2023-01-02T18:17:29.337136+0000","last_unstale":"2023-01-02T18:17:47.656476+0000","last_undegraded":"2023-01-02T18:17:47.656476+0000","last_fullsized":"2023-01-02T18:17:47.656476+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648713+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:17:47.648713+0000","last_peered":"2023-01-02T18:17:47.648713+0000","last_clean":"2023-01-02T18:17:47.648713+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:17:47.648713+0000","last_undegraded":"2023-01-02T18:17:47.648713+0000","last_fullsized":"2023-01-02T18:17:47.648713+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652817+0000","last_change":"2023-01-02T18:17:38.450620+0000","last_active":"2023-01-02T18:17:47.652817+0000","last_peered":"2023-01-02T18:17:47.652817+0000","last_clean":"2023-01-02T18:17:47.652817+0000","last_became_active":"2023-01-02T18:17:36.443497+0000","last_became_peered":"2023-01-02T18:17:36.443497+0000","last_unstale":"2023-01-02T18:17:47.652817+0000","last_undegraded":"2023-01-02T18:17:47.652817+0000","last_fullsized":"2023-01-02T18:17:47.652817+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654137+0000","last_change":"2023-01-02T18:17:34.316527+0000","last_active":"2023-01-02T18:17:47.654137+0000","last_peered":"2023-01-02T18:17:47.654137+0000","last_clean":"2023-01-02T18:17:47.654137+0000","last_became_active":"2023-01-02T18:17:32.342303+0000","last_became_peered":"2023-01-02T18:17:32.342303+0000","last_unstale":"2023-01-02T18:17:47.654137+0000","last_undegraded":"2023-01-02T18:17:47.654137+0000","last_fullsized":"2023-01-02T18:17:47.654137+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"76'9","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655514+0000","last_change":"2023-01-02T18:17:29.361212+0000","last_active":"2023-01-02T18:17:47.655514+0000","last_peered":"2023-01-02T18:17:47.655514+0000","last_clean":"2023-01-02T18:17:47.655514+0000","last_became_active":"2023-01-02T18:17:29.328070+0000","last_became_peered":"2023-01-02T18:17:29.328070+0000","last_unstale":"2023-01-02T18:17:47.655514+0000","last_undegraded":"2023-01-02T18:17:47.655514+0000","last_fullsized":"2023-01-02T18:17:47.655514+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"72'1","reported_seq":84,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.660556+0000","last_change":"2023-01-02T18:17:48.660556+0000","last_active":"2023-01-02T18:17:48.660556+0000","last_peered":"2023-01-02T18:17:48.660556+0000","last_clean":"2023-01-02T18:17:48.660556+0000","last_became_active":"2023-01-02T18:17:48.656706+0000","last_became_peered":"2023-01-02T18:17:48.656706+0000","last_unstale":"2023-01-02T18:17:48.660556+0000","last_undegraded":"2023-01-02T18:17:48.660556+0000","last_fullsized":"2023-01-02T18:17:48.660556+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.654077+0000","last_change":"2023-01-02T18:17:48.654077+0000","last_active":"2023-01-02T18:17:48.654077+0000","last_peered":"2023-01-02T18:17:48.654077+0000","last_clean":"2023-01-02T18:17:48.654077+0000","last_became_active":"2023-01-02T18:17:48.653707+0000","last_became_peered":"2023-01-02T18:17:48.653707+0000","last_unstale":"2023-01-02T18:17:48.654077+0000","last_undegraded":"2023-01-02T18:17:48.654077+0000","last_fullsized":"2023-01-02T18:17:48.654077+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"90'10","reported_seq":166,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651062+0000","last_change":"2023-01-02T18:17:30.324702+0000","last_active":"2023-01-02T18:17:47.651062+0000","last_peered":"2023-01-02T18:17:47.651062+0000","last_clean":"2023-01-02T18:17:47.651062+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:17:47.651062+0000","last_undegraded":"2023-01-02T18:17:47.651062+0000","last_fullsized":"2023-01-02T18:17:47.651062+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":84,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":101,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652660+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:17:47.652660+0000","last_peered":"2023-01-02T18:17:47.652660+0000","last_clean":"2023-01-02T18:17:47.652660+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:17:47.652660+0000","last_undegraded":"2023-01-02T18:17:47.652660+0000","last_fullsized":"2023-01-02T18:17:47.652660+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":81,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647269+0000","last_change":"2023-01-02T18:17:29.328315+0000","last_active":"2023-01-02T18:17:47.647269+0000","last_peered":"2023-01-02T18:17:47.647269+0000","last_clean":"2023-01-02T18:17:47.647269+0000","last_became_active":"2023-01-02T18:17:29.328011+0000","last_became_peered":"2023-01-02T18:17:29.328011+0000","last_unstale":"2023-01-02T18:17:47.647269+0000","last_undegraded":"2023-01-02T18:17:47.647269+0000","last_fullsized":"2023-01-02T18:17:47.647269+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664334+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:17:47.664334+0000","last_peered":"2023-01-02T18:17:47.664334+0000","last_clean":"2023-01-02T18:17:47.664334+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:17:47.664334+0000","last_undegraded":"2023-01-02T18:17:47.664334+0000","last_fullsized":"2023-01-02T18:17:47.664334+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647890+0000","last_change":"2023-01-02T18:16:57.306312+0000","last_active":"2023-01-02T18:17:47.647890+0000","last_peered":"2023-01-02T18:17:47.647890+0000","last_clean":"2023-01-02T18:17:47.647890+0000","last_became_active":"2023-01-02T18:16:55.314537+0000","last_became_peered":"2023-01-02T18:16:55.314537+0000","last_unstale":"2023-01-02T18:17:47.647890+0000","last_undegraded":"2023-01-02T18:17:47.647890+0000","last_fullsized":"2023-01-02T18:17:47.647890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655121+0000","last_change":"2023-01-02T18:17:38.449874+0000","last_active":"2023-01-02T18:17:47.655121+0000","last_peered":"2023-01-02T18:17:47.655121+0000","last_clean":"2023-01-02T18:17:47.655121+0000","last_became_active":"2023-01-02T18:17:36.445029+0000","last_became_peered":"2023-01-02T18:17:36.445029+0000","last_unstale":"2023-01-02T18:17:47.655121+0000","last_undegraded":"2023-01-02T18:17:47.655121+0000","last_fullsized":"2023-01-02T18:17:47.655121+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652691+0000","last_change":"2023-01-02T18:17:34.326569+0000","last_active":"2023-01-02T18:17:47.652691+0000","last_peered":"2023-01-02T18:17:47.652691+0000","last_clean":"2023-01-02T18:17:47.652691+0000","last_became_active":"2023-01-02T18:17:32.341143+0000","last_became_peered":"2023-01-02T18:17:32.341143+0000","last_unstale":"2023-01-02T18:17:47.652691+0000","last_undegraded":"2023-01-02T18:17:47.652691+0000","last_fullsized":"2023-01-02T18:17:47.652691+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"76'4","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662605+0000","last_change":"2023-01-02T18:17:09.322082+0000","last_active":"2023-01-02T18:17:47.662605+0000","last_peered":"2023-01-02T18:17:47.662605+0000","last_clean":"2023-01-02T18:17:47.662605+0000","last_became_active":"2023-01-02T18:17:07.340751+0000","last_became_peered":"2023-01-02T18:17:07.340751+0000","last_unstale":"2023-01-02T18:17:47.662605+0000","last_undegraded":"2023-01-02T18:17:47.662605+0000","last_fullsized":"2023-01-02T18:17:47.662605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654246+0000","last_change":"2023-01-02T18:17:29.386698+0000","last_active":"2023-01-02T18:17:47.654246+0000","last_peered":"2023-01-02T18:17:47.654246+0000","last_clean":"2023-01-02T18:17:47.654246+0000","last_became_active":"2023-01-02T18:17:29.336976+0000","last_became_peered":"2023-01-02T18:17:29.336976+0000","last_unstale":"2023-01-02T18:17:47.654246+0000","last_undegraded":"2023-01-02T18:17:47.654246+0000","last_fullsized":"2023-01-02T18:17:47.654246+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654667+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:17:47.654667+0000","last_peered":"2023-01-02T18:17:47.654667+0000","last_clean":"2023-01-02T18:17:47.654667+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:17:47.654667+0000","last_undegraded":"2023-01-02T18:17:47.654667+0000","last_fullsized":"2023-01-02T18:17:47.654667+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"85'12","reported_seq":127,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653631+0000","last_change":"2023-01-02T18:17:30.503301+0000","last_active":"2023-01-02T18:17:47.653631+0000","last_peered":"2023-01-02T18:17:47.653631+0000","last_clean":"2023-01-02T18:17:47.653631+0000","last_became_active":"2023-01-02T18:16:48.335418+0000","last_became_peered":"2023-01-02T18:16:48.335418+0000","last_unstale":"2023-01-02T18:17:47.653631+0000","last_undegraded":"2023-01-02T18:17:47.653631+0000","last_fullsized":"2023-01-02T18:17:47.653631+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655763+0000","last_change":"2023-01-02T18:17:29.331000+0000","last_active":"2023-01-02T18:17:47.655763+0000","last_peered":"2023-01-02T18:17:47.655763+0000","last_clean":"2023-01-02T18:17:47.655763+0000","last_became_active":"2023-01-02T18:17:29.329297+0000","last_became_peered":"2023-01-02T18:17:29.329297+0000","last_unstale":"2023-01-02T18:17:47.655763+0000","last_undegraded":"2023-01-02T18:17:47.655763+0000","last_fullsized":"2023-01-02T18:17:47.655763+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647892+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:17:47.647892+0000","last_peered":"2023-01-02T18:17:47.647892+0000","last_clean":"2023-01-02T18:17:47.647892+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:17:47.647892+0000","last_undegraded":"2023-01-02T18:17:47.647892+0000","last_fullsized":"2023-01-02T18:17:47.647892+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655243+0000","last_change":"2023-01-02T18:16:53.345663+0000","last_active":"2023-01-02T18:17:47.655243+0000","last_peered":"2023-01-02T18:17:47.655243+0000","last_clean":"2023-01-02T18:17:47.655243+0000","last_became_active":"2023-01-02T18:16:51.341075+0000","last_became_peered":"2023-01-02T18:16:51.341075+0000","last_unstale":"2023-01-02T18:17:47.655243+0000","last_undegraded":"2023-01-02T18:17:47.655243+0000","last_fullsized":"2023-01-02T18:17:47.655243+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653809+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:17:47.653809+0000","last_peered":"2023-01-02T18:17:47.653809+0000","last_clean":"2023-01-02T18:17:47.653809+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:17:47.653809+0000","last_undegraded":"2023-01-02T18:17:47.653809+0000","last_fullsized":"2023-01-02T18:17:47.653809+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652846+0000","last_change":"2023-01-02T18:17:38.459459+0000","last_active":"2023-01-02T18:17:47.652846+0000","last_peered":"2023-01-02T18:17:47.652846+0000","last_clean":"2023-01-02T18:17:47.652846+0000","last_became_active":"2023-01-02T18:17:36.442021+0000","last_became_peered":"2023-01-02T18:17:36.442021+0000","last_unstale":"2023-01-02T18:17:47.652846+0000","last_undegraded":"2023-01-02T18:17:47.652846+0000","last_fullsized":"2023-01-02T18:17:47.652846+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664250+0000","last_change":"2023-01-02T18:17:34.343439+0000","last_active":"2023-01-02T18:17:47.664250+0000","last_peered":"2023-01-02T18:17:47.664250+0000","last_clean":"2023-01-02T18:17:47.664250+0000","last_became_active":"2023-01-02T18:17:32.344028+0000","last_became_peered":"2023-01-02T18:17:32.344028+0000","last_unstale":"2023-01-02T18:17:47.664250+0000","last_undegraded":"2023-01-02T18:17:47.664250+0000","last_fullsized":"2023-01-02T18:17:47.664250+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656911+0000","last_change":"2023-01-02T18:17:29.326591+0000","last_active":"2023-01-02T18:17:47.656911+0000","last_peered":"2023-01-02T18:17:47.656911+0000","last_clean":"2023-01-02T18:17:47.656911+0000","last_became_active":"2023-01-02T18:17:29.326222+0000","last_became_peered":"2023-01-02T18:17:29.326222+0000","last_unstale":"2023-01-02T18:17:47.656911+0000","last_undegraded":"2023-01-02T18:17:47.656911+0000","last_fullsized":"2023-01-02T18:17:47.656911+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648379+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:17:47.648379+0000","last_peered":"2023-01-02T18:17:47.648379+0000","last_clean":"2023-01-02T18:17:47.648379+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:17:47.648379+0000","last_undegraded":"2023-01-02T18:17:47.648379+0000","last_fullsized":"2023-01-02T18:17:47.648379+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'4","reported_seq":81,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653515+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:17:47.653515+0000","last_peered":"2023-01-02T18:17:47.653515+0000","last_clean":"2023-01-02T18:17:47.653515+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:47.653515+0000","last_undegraded":"2023-01-02T18:17:47.653515+0000","last_fullsized":"2023-01-02T18:17:47.653515+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":94,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652325+0000","last_change":"2023-01-02T18:17:29.319612+0000","last_active":"2023-01-02T18:17:47.652325+0000","last_peered":"2023-01-02T18:17:47.652325+0000","last_clean":"2023-01-02T18:17:47.652325+0000","last_became_active":"2023-01-02T18:17:29.319276+0000","last_became_peered":"2023-01-02T18:17:29.319276+0000","last_unstale":"2023-01-02T18:17:47.652325+0000","last_undegraded":"2023-01-02T18:17:47.652325+0000","last_fullsized":"2023-01-02T18:17:47.652325+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"82'2","reported_seq":41,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655976+0000","last_change":"2023-01-02T18:17:30.331827+0000","last_active":"2023-01-02T18:17:47.655976+0000","last_peered":"2023-01-02T18:17:47.655976+0000","last_clean":"2023-01-02T18:17:47.655976+0000","last_became_active":"2023-01-02T18:17:29.335527+0000","last_became_peered":"2023-01-02T18:17:29.335527+0000","last_unstale":"2023-01-02T18:17:47.655976+0000","last_undegraded":"2023-01-02T18:17:47.655976+0000","last_fullsized":"2023-01-02T18:17:47.655976+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":48,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":102,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654749+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:17:47.654749+0000","last_peered":"2023-01-02T18:17:47.654749+0000","last_clean":"2023-01-02T18:17:47.654749+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:17:47.654749+0000","last_undegraded":"2023-01-02T18:17:47.654749+0000","last_fullsized":"2023-01-02T18:17:47.654749+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646703+0000","last_change":"2023-01-02T18:16:53.685845+0000","last_active":"2023-01-02T18:17:47.646703+0000","last_peered":"2023-01-02T18:17:47.646703+0000","last_clean":"2023-01-02T18:17:47.646703+0000","last_became_active":"2023-01-02T18:16:51.345111+0000","last_became_peered":"2023-01-02T18:16:51.345111+0000","last_unstale":"2023-01-02T18:17:47.646703+0000","last_undegraded":"2023-01-02T18:17:47.646703+0000","last_fullsized":"2023-01-02T18:17:47.646703+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":40,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652662+0000","last_change":"2023-01-02T18:17:36.453036+0000","last_active":"2023-01-02T18:17:47.652662+0000","last_peered":"2023-01-02T18:17:47.652662+0000","last_clean":"2023-01-02T18:17:47.652662+0000","last_became_active":"2023-01-02T18:17:36.447351+0000","last_became_peered":"2023-01-02T18:17:36.447351+0000","last_unstale":"2023-01-02T18:17:47.652662+0000","last_undegraded":"2023-01-02T18:17:47.652662+0000","last_fullsized":"2023-01-02T18:17:47.652662+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652368+0000","last_change":"2023-01-02T18:17:38.449421+0000","last_active":"2023-01-02T18:17:47.652368+0000","last_peered":"2023-01-02T18:17:47.652368+0000","last_clean":"2023-01-02T18:17:47.652368+0000","last_became_active":"2023-01-02T18:17:36.446175+0000","last_became_peered":"2023-01-02T18:17:36.446175+0000","last_unstale":"2023-01-02T18:17:47.652368+0000","last_undegraded":"2023-01-02T18:17:47.652368+0000","last_fullsized":"2023-01-02T18:17:47.652368+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663063+0000","last_change":"2023-01-02T18:17:34.343264+0000","last_active":"2023-01-02T18:17:47.663063+0000","last_peered":"2023-01-02T18:17:47.663063+0000","last_clean":"2023-01-02T18:17:47.663063+0000","last_became_active":"2023-01-02T18:17:32.345763+0000","last_became_peered":"2023-01-02T18:17:32.345763+0000","last_unstale":"2023-01-02T18:17:47.663063+0000","last_undegraded":"2023-01-02T18:17:47.663063+0000","last_fullsized":"2023-01-02T18:17:47.663063+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2","version":"76'12","reported_seq":161,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653423+0000","last_change":"2023-01-02T18:17:09.308235+0000","last_active":"2023-01-02T18:17:47.653423+0000","last_peered":"2023-01-02T18:17:47.653423+0000","last_clean":"2023-01-02T18:17:47.653423+0000","last_became_active":"2023-01-02T18:17:07.340498+0000","last_became_peered":"2023-01-02T18:17:07.340498+0000","last_unstale":"2023-01-02T18:17:47.653423+0000","last_undegraded":"2023-01-02T18:17:47.653423+0000","last_fullsized":"2023-01-02T18:17:47.653423+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"69'1","reported_seq":53,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.664153+0000","last_change":"2023-01-02T18:17:48.664153+0000","last_active":"2023-01-02T18:17:48.664153+0000","last_peered":"2023-01-02T18:17:48.664153+0000","last_clean":"2023-01-02T18:17:48.664153+0000","last_became_active":"2023-01-02T18:17:48.656642+0000","last_became_peered":"2023-01-02T18:17:48.656642+0000","last_unstale":"2023-01-02T18:17:48.664153+0000","last_undegraded":"2023-01-02T18:17:48.664153+0000","last_fullsized":"2023-01-02T18:17:48.664153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656547+0000","last_change":"2023-01-02T18:16:44.298243+0000","last_active":"2023-01-02T18:17:47.656547+0000","last_peered":"2023-01-02T18:17:47.656547+0000","last_clean":"2023-01-02T18:17:47.656547+0000","last_became_active":"2023-01-02T18:16:41.448643+0000","last_became_peered":"2023-01-02T18:16:41.448643+0000","last_unstale":"2023-01-02T18:17:47.656547+0000","last_undegraded":"2023-01-02T18:17:47.656547+0000","last_fullsized":"2023-01-02T18:17:47.656547+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"76'8","reported_seq":135,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652476+0000","last_change":"2023-01-02T18:17:30.433551+0000","last_active":"2023-01-02T18:17:47.652476+0000","last_peered":"2023-01-02T18:17:47.652476+0000","last_clean":"2023-01-02T18:17:47.652476+0000","last_became_active":"2023-01-02T18:16:37.414106+0000","last_became_peered":"2023-01-02T18:16:37.414106+0000","last_unstale":"2023-01-02T18:17:47.652476+0000","last_undegraded":"2023-01-02T18:17:47.652476+0000","last_fullsized":"2023-01-02T18:17:47.652476+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656403+0000","last_change":"2023-01-02T18:17:29.325726+0000","last_active":"2023-01-02T18:17:47.656403+0000","last_peered":"2023-01-02T18:17:47.656403+0000","last_clean":"2023-01-02T18:17:47.656403+0000","last_became_active":"2023-01-02T18:17:29.325418+0000","last_became_peered":"2023-01-02T18:17:29.325418+0000","last_unstale":"2023-01-02T18:17:47.656403+0000","last_undegraded":"2023-01-02T18:17:47.656403+0000","last_fullsized":"2023-01-02T18:17:47.656403+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655677+0000","last_change":"2023-01-02T18:17:29.329378+0000","last_active":"2023-01-02T18:17:47.655677+0000","last_peered":"2023-01-02T18:17:47.655677+0000","last_clean":"2023-01-02T18:17:47.655677+0000","last_became_active":"2023-01-02T18:17:29.327709+0000","last_became_peered":"2023-01-02T18:17:29.327709+0000","last_unstale":"2023-01-02T18:17:47.655677+0000","last_undegraded":"2023-01-02T18:17:47.655677+0000","last_fullsized":"2023-01-02T18:17:47.655677+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654621+0000","last_change":"2023-01-02T18:16:57.307540+0000","last_active":"2023-01-02T18:17:47.654621+0000","last_peered":"2023-01-02T18:17:47.654621+0000","last_clean":"2023-01-02T18:17:47.654621+0000","last_became_active":"2023-01-02T18:16:55.319082+0000","last_became_peered":"2023-01-02T18:16:55.319082+0000","last_unstale":"2023-01-02T18:17:47.654621+0000","last_undegraded":"2023-01-02T18:17:47.654621+0000","last_fullsized":"2023-01-02T18:17:47.654621+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"112'8","reported_seq":31,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.653026+0000","last_change":"2023-01-02T18:17:38.459021+0000","last_active":"2023-01-02T18:17:48.653026+0000","last_peered":"2023-01-02T18:17:48.653026+0000","last_clean":"2023-01-02T18:17:48.653026+0000","last_became_active":"2023-01-02T18:17:36.440780+0000","last_became_peered":"2023-01-02T18:17:36.440780+0000","last_unstale":"2023-01-02T18:17:48.653026+0000","last_undegraded":"2023-01-02T18:17:48.653026+0000","last_fullsized":"2023-01-02T18:17:48.653026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3145766,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":11,"num_write_kb":3079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652498+0000","last_change":"2023-01-02T18:17:34.324670+0000","last_active":"2023-01-02T18:17:47.652498+0000","last_peered":"2023-01-02T18:17:47.652498+0000","last_clean":"2023-01-02T18:17:47.652498+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:17:47.652498+0000","last_undegraded":"2023-01-02T18:17:47.652498+0000","last_fullsized":"2023-01-02T18:17:47.652498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"76'4","reported_seq":56,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662918+0000","last_change":"2023-01-02T18:17:09.323147+0000","last_active":"2023-01-02T18:17:47.662918+0000","last_peered":"2023-01-02T18:17:47.662918+0000","last_clean":"2023-01-02T18:17:47.662918+0000","last_became_active":"2023-01-02T18:17:07.341052+0000","last_became_peered":"2023-01-02T18:17:07.341052+0000","last_unstale":"2023-01-02T18:17:47.662918+0000","last_undegraded":"2023-01-02T18:17:47.662918+0000","last_fullsized":"2023-01-02T18:17:47.662918+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646111+0000","last_change":"2023-01-02T18:17:29.319986+0000","last_active":"2023-01-02T18:17:47.646111+0000","last_peered":"2023-01-02T18:17:47.646111+0000","last_clean":"2023-01-02T18:17:47.646111+0000","last_became_active":"2023-01-02T18:17:29.319682+0000","last_became_peered":"2023-01-02T18:17:29.319682+0000","last_unstale":"2023-01-02T18:17:47.646111+0000","last_undegraded":"2023-01-02T18:17:47.646111+0000","last_fullsized":"2023-01-02T18:17:47.646111+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"51'1","reported_seq":111,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.666369+0000","last_change":"2023-01-02T18:17:48.666369+0000","last_active":"2023-01-02T18:17:48.666369+0000","last_peered":"2023-01-02T18:17:48.666369+0000","last_clean":"2023-01-02T18:17:48.666369+0000","last_became_active":"2023-01-02T18:17:48.662204+0000","last_became_peered":"2023-01-02T18:17:48.662204+0000","last_unstale":"2023-01-02T18:17:48.666369+0000","last_undegraded":"2023-01-02T18:17:48.666369+0000","last_fullsized":"2023-01-02T18:17:48.666369+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":106,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663394+0000","last_change":"2023-01-02T18:17:30.333300+0000","last_active":"2023-01-02T18:17:47.663394+0000","last_peered":"2023-01-02T18:17:47.663394+0000","last_clean":"2023-01-02T18:17:47.663394+0000","last_became_active":"2023-01-02T18:16:48.322710+0000","last_became_peered":"2023-01-02T18:16:48.322710+0000","last_unstale":"2023-01-02T18:17:47.663394+0000","last_undegraded":"2023-01-02T18:17:47.663394+0000","last_fullsized":"2023-01-02T18:17:47.663394+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656606+0000","last_change":"2023-01-02T18:17:29.333377+0000","last_active":"2023-01-02T18:17:47.656606+0000","last_peered":"2023-01-02T18:17:47.656606+0000","last_clean":"2023-01-02T18:17:47.656606+0000","last_became_active":"2023-01-02T18:17:29.332106+0000","last_became_peered":"2023-01-02T18:17:29.332106+0000","last_unstale":"2023-01-02T18:17:47.656606+0000","last_undegraded":"2023-01-02T18:17:47.656606+0000","last_fullsized":"2023-01-02T18:17:47.656606+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654967+0000","last_change":"2023-01-02T18:16:53.345390+0000","last_active":"2023-01-02T18:17:47.654967+0000","last_peered":"2023-01-02T18:17:47.654967+0000","last_clean":"2023-01-02T18:17:47.654967+0000","last_became_active":"2023-01-02T18:16:51.339020+0000","last_became_peered":"2023-01-02T18:16:51.339020+0000","last_unstale":"2023-01-02T18:17:47.654967+0000","last_undegraded":"2023-01-02T18:17:47.654967+0000","last_fullsized":"2023-01-02T18:17:47.654967+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654926+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:17:47.654926+0000","last_peered":"2023-01-02T18:17:47.654926+0000","last_clean":"2023-01-02T18:17:47.654926+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:17:47.654926+0000","last_undegraded":"2023-01-02T18:17:47.654926+0000","last_fullsized":"2023-01-02T18:17:47.654926+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653380+0000","last_change":"2023-01-02T18:17:38.449658+0000","last_active":"2023-01-02T18:17:47.653380+0000","last_peered":"2023-01-02T18:17:47.653380+0000","last_clean":"2023-01-02T18:17:47.653380+0000","last_became_active":"2023-01-02T18:17:36.450509+0000","last_became_peered":"2023-01-02T18:17:36.450509+0000","last_unstale":"2023-01-02T18:17:47.653380+0000","last_undegraded":"2023-01-02T18:17:47.653380+0000","last_fullsized":"2023-01-02T18:17:47.653380+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"101'31","reported_seq":128,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655499+0000","last_change":"2023-01-02T18:17:34.318218+0000","last_active":"2023-01-02T18:17:47.655499+0000","last_peered":"2023-01-02T18:17:47.655499+0000","last_clean":"2023-01-02T18:17:47.655499+0000","last_became_active":"2023-01-02T18:17:32.342244+0000","last_became_peered":"2023-01-02T18:17:32.342244+0000","last_unstale":"2023-01-02T18:17:47.655499+0000","last_undegraded":"2023-01-02T18:17:47.655499+0000","last_fullsized":"2023-01-02T18:17:47.655499+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":99,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652653+0000","last_change":"2023-01-02T18:17:09.330500+0000","last_active":"2023-01-02T18:17:47.652653+0000","last_peered":"2023-01-02T18:17:47.652653+0000","last_clean":"2023-01-02T18:17:47.652653+0000","last_became_active":"2023-01-02T18:17:07.345902+0000","last_became_peered":"2023-01-02T18:17:07.345902+0000","last_unstale":"2023-01-02T18:17:47.652653+0000","last_undegraded":"2023-01-02T18:17:47.652653+0000","last_fullsized":"2023-01-02T18:17:47.652653+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651339+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:17:47.651339+0000","last_peered":"2023-01-02T18:17:47.651339+0000","last_clean":"2023-01-02T18:17:47.651339+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:17:47.651339+0000","last_undegraded":"2023-01-02T18:17:47.651339+0000","last_fullsized":"2023-01-02T18:17:47.651339+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656614+0000","last_change":"2023-01-02T18:16:48.329052+0000","last_active":"2023-01-02T18:17:47.656614+0000","last_peered":"2023-01-02T18:17:47.656614+0000","last_clean":"2023-01-02T18:17:47.656614+0000","last_became_active":"2023-01-02T18:16:48.327662+0000","last_became_peered":"2023-01-02T18:16:48.327662+0000","last_unstale":"2023-01-02T18:17:47.656614+0000","last_undegraded":"2023-01-02T18:17:47.656614+0000","last_fullsized":"2023-01-02T18:17:47.656614+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'4","reported_seq":150,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654468+0000","last_change":"2023-01-02T18:17:30.503114+0000","last_active":"2023-01-02T18:17:47.654468+0000","last_peered":"2023-01-02T18:17:47.654468+0000","last_clean":"2023-01-02T18:17:47.654468+0000","last_became_active":"2023-01-02T18:16:48.329461+0000","last_became_peered":"2023-01-02T18:16:48.329461+0000","last_unstale":"2023-01-02T18:17:47.654468+0000","last_undegraded":"2023-01-02T18:17:47.654468+0000","last_fullsized":"2023-01-02T18:17:47.654468+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646014+0000","last_change":"2023-01-02T18:16:49.323150+0000","last_active":"2023-01-02T18:17:47.646014+0000","last_peered":"2023-01-02T18:17:47.646014+0000","last_clean":"2023-01-02T18:17:47.646014+0000","last_became_active":"2023-01-02T18:16:48.326635+0000","last_became_peered":"2023-01-02T18:16:48.326635+0000","last_unstale":"2023-01-02T18:17:47.646014+0000","last_undegraded":"2023-01-02T18:17:47.646014+0000","last_fullsized":"2023-01-02T18:17:47.646014+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656074+0000","last_change":"2023-01-02T18:16:53.345223+0000","last_active":"2023-01-02T18:17:47.656074+0000","last_peered":"2023-01-02T18:17:47.656074+0000","last_clean":"2023-01-02T18:17:47.656074+0000","last_became_active":"2023-01-02T18:16:51.341580+0000","last_became_peered":"2023-01-02T18:16:51.341580+0000","last_unstale":"2023-01-02T18:17:47.656074+0000","last_undegraded":"2023-01-02T18:17:47.656074+0000","last_fullsized":"2023-01-02T18:17:47.656074+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647340+0000","last_change":"2023-01-02T18:17:29.325884+0000","last_active":"2023-01-02T18:17:47.647340+0000","last_peered":"2023-01-02T18:17:47.647340+0000","last_clean":"2023-01-02T18:17:47.647340+0000","last_became_active":"2023-01-02T18:17:29.325539+0000","last_became_peered":"2023-01-02T18:17:29.325539+0000","last_unstale":"2023-01-02T18:17:47.647340+0000","last_undegraded":"2023-01-02T18:17:47.647340+0000","last_fullsized":"2023-01-02T18:17:47.647340+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"105'7","reported_seq":35,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653225+0000","last_change":"2023-01-02T18:17:38.459018+0000","last_active":"2023-01-02T18:17:47.653225+0000","last_peered":"2023-01-02T18:17:47.653225+0000","last_clean":"2023-01-02T18:17:47.653225+0000","last_became_active":"2023-01-02T18:17:36.442139+0000","last_became_peered":"2023-01-02T18:17:36.442139+0000","last_unstale":"2023-01-02T18:17:47.653225+0000","last_undegraded":"2023-01-02T18:17:47.653225+0000","last_fullsized":"2023-01-02T18:17:47.653225+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652137+0000","last_change":"2023-01-02T18:17:34.332222+0000","last_active":"2023-01-02T18:17:47.652137+0000","last_peered":"2023-01-02T18:17:47.652137+0000","last_clean":"2023-01-02T18:17:47.652137+0000","last_became_active":"2023-01-02T18:17:32.337498+0000","last_became_peered":"2023-01-02T18:17:32.337498+0000","last_unstale":"2023-01-02T18:17:47.652137+0000","last_undegraded":"2023-01-02T18:17:47.652137+0000","last_fullsized":"2023-01-02T18:17:47.652137+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652301+0000","last_change":"2023-01-02T18:17:09.307789+0000","last_active":"2023-01-02T18:17:47.652301+0000","last_peered":"2023-01-02T18:17:47.652301+0000","last_clean":"2023-01-02T18:17:47.652301+0000","last_became_active":"2023-01-02T18:17:07.345090+0000","last_became_peered":"2023-01-02T18:17:07.345090+0000","last_unstale":"2023-01-02T18:17:47.652301+0000","last_undegraded":"2023-01-02T18:17:47.652301+0000","last_fullsized":"2023-01-02T18:17:47.652301+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"72'11","reported_seq":122,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652211+0000","last_change":"2023-01-02T18:17:29.350765+0000","last_active":"2023-01-02T18:17:47.652211+0000","last_peered":"2023-01-02T18:17:47.652211+0000","last_clean":"2023-01-02T18:17:47.652211+0000","last_became_active":"2023-01-02T18:17:29.334376+0000","last_became_peered":"2023-01-02T18:17:29.334376+0000","last_unstale":"2023-01-02T18:17:47.652211+0000","last_undegraded":"2023-01-02T18:17:47.652211+0000","last_fullsized":"2023-01-02T18:17:47.652211+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":64,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655021+0000","last_change":"2023-01-02T18:16:48.328829+0000","last_active":"2023-01-02T18:17:47.655021+0000","last_peered":"2023-01-02T18:17:47.655021+0000","last_clean":"2023-01-02T18:17:47.655021+0000","last_became_active":"2023-01-02T18:16:48.328372+0000","last_became_peered":"2023-01-02T18:16:48.328372+0000","last_unstale":"2023-01-02T18:17:47.655021+0000","last_undegraded":"2023-01-02T18:17:47.655021+0000","last_fullsized":"2023-01-02T18:17:47.655021+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":135,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655550+0000","last_change":"2023-01-02T18:17:30.434777+0000","last_active":"2023-01-02T18:17:47.655550+0000","last_peered":"2023-01-02T18:17:47.655550+0000","last_clean":"2023-01-02T18:17:47.655550+0000","last_became_active":"2023-01-02T18:16:37.415896+0000","last_became_peered":"2023-01-02T18:16:37.415896+0000","last_unstale":"2023-01-02T18:17:47.655550+0000","last_undegraded":"2023-01-02T18:17:47.655550+0000","last_fullsized":"2023-01-02T18:17:47.655550+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'3","reported_seq":74,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664500+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:17:47.664500+0000","last_peered":"2023-01-02T18:17:47.664500+0000","last_clean":"2023-01-02T18:17:47.664500+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:17:47.664500+0000","last_undegraded":"2023-01-02T18:17:47.664500+0000","last_fullsized":"2023-01-02T18:17:47.664500+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655650+0000","last_change":"2023-01-02T18:16:53.344544+0000","last_active":"2023-01-02T18:17:47.655650+0000","last_peered":"2023-01-02T18:17:47.655650+0000","last_clean":"2023-01-02T18:17:47.655650+0000","last_became_active":"2023-01-02T18:16:51.339073+0000","last_became_peered":"2023-01-02T18:16:51.339073+0000","last_unstale":"2023-01-02T18:17:47.655650+0000","last_undegraded":"2023-01-02T18:17:47.655650+0000","last_fullsized":"2023-01-02T18:17:47.655650+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":158,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648517+0000","last_change":"2023-01-02T18:16:57.307483+0000","last_active":"2023-01-02T18:17:47.648517+0000","last_peered":"2023-01-02T18:17:47.648517+0000","last_clean":"2023-01-02T18:17:47.648517+0000","last_became_active":"2023-01-02T18:16:55.316680+0000","last_became_peered":"2023-01-02T18:16:55.316680+0000","last_unstale":"2023-01-02T18:17:47.648517+0000","last_undegraded":"2023-01-02T18:17:47.648517+0000","last_fullsized":"2023-01-02T18:17:47.648517+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664121+0000","last_change":"2023-01-02T18:17:38.463731+0000","last_active":"2023-01-02T18:17:47.664121+0000","last_peered":"2023-01-02T18:17:47.664121+0000","last_clean":"2023-01-02T18:17:47.664121+0000","last_became_active":"2023-01-02T18:17:36.444543+0000","last_became_peered":"2023-01-02T18:17:36.444543+0000","last_unstale":"2023-01-02T18:17:47.664121+0000","last_undegraded":"2023-01-02T18:17:47.664121+0000","last_fullsized":"2023-01-02T18:17:47.664121+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"101'2","reported_seq":40,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647745+0000","last_change":"2023-01-02T18:17:34.316134+0000","last_active":"2023-01-02T18:17:47.647745+0000","last_peered":"2023-01-02T18:17:47.647745+0000","last_clean":"2023-01-02T18:17:47.647745+0000","last_became_active":"2023-01-02T18:17:32.340596+0000","last_became_peered":"2023-01-02T18:17:32.340596+0000","last_unstale":"2023-01-02T18:17:47.647745+0000","last_undegraded":"2023-01-02T18:17:47.647745+0000","last_fullsized":"2023-01-02T18:17:47.647745+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656306+0000","last_change":"2023-01-02T18:17:29.323882+0000","last_active":"2023-01-02T18:17:47.656306+0000","last_peered":"2023-01-02T18:17:47.656306+0000","last_clean":"2023-01-02T18:17:47.656306+0000","last_became_active":"2023-01-02T18:17:29.323226+0000","last_became_peered":"2023-01-02T18:17:29.323226+0000","last_unstale":"2023-01-02T18:17:47.656306+0000","last_undegraded":"2023-01-02T18:17:47.656306+0000","last_fullsized":"2023-01-02T18:17:47.656306+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655721+0000","last_change":"2023-01-02T18:17:01.310439+0000","last_active":"2023-01-02T18:17:47.655721+0000","last_peered":"2023-01-02T18:17:47.655721+0000","last_clean":"2023-01-02T18:17:47.655721+0000","last_became_active":"2023-01-02T18:16:59.315925+0000","last_became_peered":"2023-01-02T18:16:59.315925+0000","last_unstale":"2023-01-02T18:17:47.655721+0000","last_undegraded":"2023-01-02T18:17:47.655721+0000","last_fullsized":"2023-01-02T18:17:47.655721+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647085+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:17:47.647085+0000","last_peered":"2023-01-02T18:17:47.647085+0000","last_clean":"2023-01-02T18:17:47.647085+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:17:47.647085+0000","last_undegraded":"2023-01-02T18:17:47.647085+0000","last_fullsized":"2023-01-02T18:17:47.647085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'5","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654913+0000","last_change":"2023-01-02T18:17:30.331199+0000","last_active":"2023-01-02T18:17:47.654913+0000","last_peered":"2023-01-02T18:17:47.654913+0000","last_clean":"2023-01-02T18:17:47.654913+0000","last_became_active":"2023-01-02T18:17:29.337008+0000","last_became_peered":"2023-01-02T18:17:29.337008+0000","last_unstale":"2023-01-02T18:17:47.654913+0000","last_undegraded":"2023-01-02T18:17:47.654913+0000","last_fullsized":"2023-01-02T18:17:47.654913+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653950+0000","last_change":"2023-01-02T18:16:49.309370+0000","last_active":"2023-01-02T18:17:47.653950+0000","last_peered":"2023-01-02T18:17:47.653950+0000","last_clean":"2023-01-02T18:17:47.653950+0000","last_became_active":"2023-01-02T18:16:48.323683+0000","last_became_peered":"2023-01-02T18:16:48.323683+0000","last_unstale":"2023-01-02T18:17:47.653950+0000","last_undegraded":"2023-01-02T18:17:47.653950+0000","last_fullsized":"2023-01-02T18:17:47.653950+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662437+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:17:47.662437+0000","last_peered":"2023-01-02T18:17:47.662437+0000","last_clean":"2023-01-02T18:17:47.662437+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:17:47.662437+0000","last_undegraded":"2023-01-02T18:17:47.662437+0000","last_fullsized":"2023-01-02T18:17:47.662437+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663128+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:17:47.663128+0000","last_peered":"2023-01-02T18:17:47.663128+0000","last_clean":"2023-01-02T18:17:47.663128+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:17:47.663128+0000","last_undegraded":"2023-01-02T18:17:47.663128+0000","last_fullsized":"2023-01-02T18:17:47.663128+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.5","version":"106'3","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665371+0000","last_change":"2023-01-02T18:17:38.464795+0000","last_active":"2023-01-02T18:17:47.665371+0000","last_peered":"2023-01-02T18:17:47.665371+0000","last_clean":"2023-01-02T18:17:47.665371+0000","last_became_active":"2023-01-02T18:17:36.442539+0000","last_became_peered":"2023-01-02T18:17:36.442539+0000","last_unstale":"2023-01-02T18:17:47.665371+0000","last_undegraded":"2023-01-02T18:17:47.665371+0000","last_fullsized":"2023-01-02T18:17:47.665371+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.645921+0000","last_change":"2023-01-02T18:17:34.316365+0000","last_active":"2023-01-02T18:17:47.645921+0000","last_peered":"2023-01-02T18:17:47.645921+0000","last_clean":"2023-01-02T18:17:47.645921+0000","last_became_active":"2023-01-02T18:17:32.336309+0000","last_became_peered":"2023-01-02T18:17:32.336309+0000","last_unstale":"2023-01-02T18:17:47.645921+0000","last_undegraded":"2023-01-02T18:17:47.645921+0000","last_fullsized":"2023-01-02T18:17:47.645921+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656906+0000","last_change":"2023-01-02T18:17:29.333481+0000","last_active":"2023-01-02T18:17:47.656906+0000","last_peered":"2023-01-02T18:17:47.656906+0000","last_clean":"2023-01-02T18:17:47.656906+0000","last_became_active":"2023-01-02T18:17:29.333173+0000","last_became_peered":"2023-01-02T18:17:29.333173+0000","last_unstale":"2023-01-02T18:17:47.656906+0000","last_undegraded":"2023-01-02T18:17:47.656906+0000","last_fullsized":"2023-01-02T18:17:47.656906+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648366+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:17:47.648366+0000","last_peered":"2023-01-02T18:17:47.648366+0000","last_clean":"2023-01-02T18:17:47.648366+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:17:47.648366+0000","last_undegraded":"2023-01-02T18:17:47.648366+0000","last_fullsized":"2023-01-02T18:17:47.648366+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654145+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:17:47.654145+0000","last_peered":"2023-01-02T18:17:47.654145+0000","last_clean":"2023-01-02T18:17:47.654145+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:17:47.654145+0000","last_undegraded":"2023-01-02T18:17:47.654145+0000","last_fullsized":"2023-01-02T18:17:47.654145+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"46'4","reported_seq":160,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665367+0000","last_change":"2023-01-02T18:17:30.335368+0000","last_active":"2023-01-02T18:17:47.665367+0000","last_peered":"2023-01-02T18:17:47.665367+0000","last_clean":"2023-01-02T18:17:47.665367+0000","last_became_active":"2023-01-02T18:17:29.341233+0000","last_became_peered":"2023-01-02T18:17:29.341233+0000","last_unstale":"2023-01-02T18:17:47.665367+0000","last_undegraded":"2023-01-02T18:17:47.665367+0000","last_fullsized":"2023-01-02T18:17:47.665367+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"56'8","reported_seq":83,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646131+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:17:47.646131+0000","last_peered":"2023-01-02T18:17:47.646131+0000","last_clean":"2023-01-02T18:17:47.646131+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:17:47.646131+0000","last_undegraded":"2023-01-02T18:17:47.646131+0000","last_fullsized":"2023-01-02T18:17:47.646131+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662373+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:17:47.662373+0000","last_peered":"2023-01-02T18:17:47.662373+0000","last_clean":"2023-01-02T18:17:47.662373+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:17:47.662373+0000","last_undegraded":"2023-01-02T18:17:47.662373+0000","last_fullsized":"2023-01-02T18:17:47.662373+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":64,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647521+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:17:47.647521+0000","last_peered":"2023-01-02T18:17:47.647521+0000","last_clean":"2023-01-02T18:17:47.647521+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:17:47.647521+0000","last_undegraded":"2023-01-02T18:17:47.647521+0000","last_fullsized":"2023-01-02T18:17:47.647521+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"105'1","reported_seq":23,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647729+0000","last_change":"2023-01-02T18:17:38.446055+0000","last_active":"2023-01-02T18:17:47.647729+0000","last_peered":"2023-01-02T18:17:47.647729+0000","last_clean":"2023-01-02T18:17:47.647729+0000","last_became_active":"2023-01-02T18:17:36.428938+0000","last_became_peered":"2023-01-02T18:17:36.428938+0000","last_unstale":"2023-01-02T18:17:47.647729+0000","last_undegraded":"2023-01-02T18:17:47.647729+0000","last_fullsized":"2023-01-02T18:17:47.647729+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"101'8","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653346+0000","last_change":"2023-01-02T18:17:34.327745+0000","last_active":"2023-01-02T18:17:47.653346+0000","last_peered":"2023-01-02T18:17:47.653346+0000","last_clean":"2023-01-02T18:17:47.653346+0000","last_became_active":"2023-01-02T18:17:32.347316+0000","last_became_peered":"2023-01-02T18:17:32.347316+0000","last_unstale":"2023-01-02T18:17:47.653346+0000","last_undegraded":"2023-01-02T18:17:47.653346+0000","last_fullsized":"2023-01-02T18:17:47.653346+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654383+0000","last_change":"2023-01-02T18:17:09.308354+0000","last_active":"2023-01-02T18:17:47.654383+0000","last_peered":"2023-01-02T18:17:47.654383+0000","last_clean":"2023-01-02T18:17:47.654383+0000","last_became_active":"2023-01-02T18:17:07.339211+0000","last_became_peered":"2023-01-02T18:17:07.339211+0000","last_unstale":"2023-01-02T18:17:47.654383+0000","last_undegraded":"2023-01-02T18:17:47.654383+0000","last_fullsized":"2023-01-02T18:17:47.654383+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"71'2","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655281+0000","last_change":"2023-01-02T18:17:01.317443+0000","last_active":"2023-01-02T18:17:47.655281+0000","last_peered":"2023-01-02T18:17:47.655281+0000","last_clean":"2023-01-02T18:17:47.655281+0000","last_became_active":"2023-01-02T18:16:59.311550+0000","last_became_peered":"2023-01-02T18:16:59.311550+0000","last_unstale":"2023-01-02T18:17:47.655281+0000","last_undegraded":"2023-01-02T18:17:47.655281+0000","last_fullsized":"2023-01-02T18:17:47.655281+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"51'3","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652430+0000","last_change":"2023-01-02T18:16:48.345208+0000","last_active":"2023-01-02T18:17:47.652430+0000","last_peered":"2023-01-02T18:17:47.652430+0000","last_clean":"2023-01-02T18:17:47.652430+0000","last_became_active":"2023-01-02T18:16:48.327080+0000","last_became_peered":"2023-01-02T18:16:48.327080+0000","last_unstale":"2023-01-02T18:17:47.652430+0000","last_undegraded":"2023-01-02T18:17:47.652430+0000","last_fullsized":"2023-01-02T18:17:47.652430+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":165,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665517+0000","last_change":"2023-01-02T18:17:30.335149+0000","last_active":"2023-01-02T18:17:47.665517+0000","last_peered":"2023-01-02T18:17:47.665517+0000","last_clean":"2023-01-02T18:17:47.665517+0000","last_became_active":"2023-01-02T18:16:48.327374+0000","last_became_peered":"2023-01-02T18:16:48.327374+0000","last_unstale":"2023-01-02T18:17:47.665517+0000","last_undegraded":"2023-01-02T18:17:47.665517+0000","last_fullsized":"2023-01-02T18:17:47.665517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646612+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:17:47.646612+0000","last_peered":"2023-01-02T18:17:47.646612+0000","last_clean":"2023-01-02T18:17:47.646612+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:17:47.646612+0000","last_undegraded":"2023-01-02T18:17:47.646612+0000","last_fullsized":"2023-01-02T18:17:47.646612+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655723+0000","last_change":"2023-01-02T18:16:53.342610+0000","last_active":"2023-01-02T18:17:47.655723+0000","last_peered":"2023-01-02T18:17:47.655723+0000","last_clean":"2023-01-02T18:17:47.655723+0000","last_became_active":"2023-01-02T18:16:51.341683+0000","last_became_peered":"2023-01-02T18:16:51.341683+0000","last_unstale":"2023-01-02T18:17:47.655723+0000","last_undegraded":"2023-01-02T18:17:47.655723+0000","last_fullsized":"2023-01-02T18:17:47.655723+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653853+0000","last_change":"2023-01-02T18:16:57.312289+0000","last_active":"2023-01-02T18:17:47.653853+0000","last_peered":"2023-01-02T18:17:47.653853+0000","last_clean":"2023-01-02T18:17:47.653853+0000","last_became_active":"2023-01-02T18:16:55.317023+0000","last_became_peered":"2023-01-02T18:16:55.317023+0000","last_unstale":"2023-01-02T18:17:47.653853+0000","last_undegraded":"2023-01-02T18:17:47.653853+0000","last_fullsized":"2023-01-02T18:17:47.653853+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"105'15","reported_seq":80,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656233+0000","last_change":"2023-01-02T18:17:38.447587+0000","last_active":"2023-01-02T18:17:47.656233+0000","last_peered":"2023-01-02T18:17:47.656233+0000","last_clean":"2023-01-02T18:17:47.656233+0000","last_became_active":"2023-01-02T18:17:36.439633+0000","last_became_peered":"2023-01-02T18:17:36.439633+0000","last_unstale":"2023-01-02T18:17:47.656233+0000","last_undegraded":"2023-01-02T18:17:47.656233+0000","last_fullsized":"2023-01-02T18:17:47.656233+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"101'19","reported_seq":100,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656114+0000","last_change":"2023-01-02T18:17:34.318618+0000","last_active":"2023-01-02T18:17:47.656114+0000","last_peered":"2023-01-02T18:17:47.656114+0000","last_clean":"2023-01-02T18:17:47.656114+0000","last_became_active":"2023-01-02T18:17:32.337685+0000","last_became_peered":"2023-01-02T18:17:32.337685+0000","last_unstale":"2023-01-02T18:17:47.656114+0000","last_undegraded":"2023-01-02T18:17:47.656114+0000","last_fullsized":"2023-01-02T18:17:47.656114+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655884+0000","last_change":"2023-01-02T18:17:29.329576+0000","last_active":"2023-01-02T18:17:47.655884+0000","last_peered":"2023-01-02T18:17:47.655884+0000","last_clean":"2023-01-02T18:17:47.655884+0000","last_became_active":"2023-01-02T18:17:29.328074+0000","last_became_peered":"2023-01-02T18:17:29.328074+0000","last_unstale":"2023-01-02T18:17:47.655884+0000","last_undegraded":"2023-01-02T18:17:47.655884+0000","last_fullsized":"2023-01-02T18:17:47.655884+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"72'10","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655129+0000","last_change":"2023-01-02T18:17:29.331966+0000","last_active":"2023-01-02T18:17:47.655129+0000","last_peered":"2023-01-02T18:17:47.655129+0000","last_clean":"2023-01-02T18:17:47.655129+0000","last_became_active":"2023-01-02T18:17:29.322773+0000","last_became_peered":"2023-01-02T18:17:29.322773+0000","last_unstale":"2023-01-02T18:17:47.655129+0000","last_undegraded":"2023-01-02T18:17:47.655129+0000","last_fullsized":"2023-01-02T18:17:47.655129+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"51'1","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654194+0000","last_change":"2023-01-02T18:17:29.334624+0000","last_active":"2023-01-02T18:17:47.654194+0000","last_peered":"2023-01-02T18:17:47.654194+0000","last_clean":"2023-01-02T18:17:47.654194+0000","last_became_active":"2023-01-02T18:17:29.332434+0000","last_became_peered":"2023-01-02T18:17:29.332434+0000","last_unstale":"2023-01-02T18:17:47.654194+0000","last_undegraded":"2023-01-02T18:17:47.654194+0000","last_fullsized":"2023-01-02T18:17:47.654194+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"82'14","reported_seq":204,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665636+0000","last_change":"2023-01-02T18:17:30.335393+0000","last_active":"2023-01-02T18:17:47.665636+0000","last_peered":"2023-01-02T18:17:47.665636+0000","last_clean":"2023-01-02T18:17:47.665636+0000","last_became_active":"2023-01-02T18:16:48.324242+0000","last_became_peered":"2023-01-02T18:16:48.324242+0000","last_unstale":"2023-01-02T18:17:47.665636+0000","last_undegraded":"2023-01-02T18:17:47.665636+0000","last_fullsized":"2023-01-02T18:17:47.665636+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":122,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":46,"num_keys_recovered":8,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663376+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:17:47.663376+0000","last_peered":"2023-01-02T18:17:47.663376+0000","last_clean":"2023-01-02T18:17:47.663376+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:47.663376+0000","last_undegraded":"2023-01-02T18:17:47.663376+0000","last_fullsized":"2023-01-02T18:17:47.663376+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655428+0000","last_change":"2023-01-02T18:17:29.335316+0000","last_active":"2023-01-02T18:17:47.655428+0000","last_peered":"2023-01-02T18:17:47.655428+0000","last_clean":"2023-01-02T18:17:47.655428+0000","last_became_active":"2023-01-02T18:17:29.333739+0000","last_became_peered":"2023-01-02T18:17:29.333739+0000","last_unstale":"2023-01-02T18:17:47.655428+0000","last_undegraded":"2023-01-02T18:17:47.655428+0000","last_fullsized":"2023-01-02T18:17:47.655428+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":71,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652457+0000","last_change":"2023-01-02T18:17:29.319062+0000","last_active":"2023-01-02T18:17:47.652457+0000","last_peered":"2023-01-02T18:17:47.652457+0000","last_clean":"2023-01-02T18:17:47.652457+0000","last_became_active":"2023-01-02T18:17:29.318747+0000","last_became_peered":"2023-01-02T18:17:29.318747+0000","last_unstale":"2023-01-02T18:17:47.652457+0000","last_undegraded":"2023-01-02T18:17:47.652457+0000","last_fullsized":"2023-01-02T18:17:47.652457+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652857+0000","last_change":"2023-01-02T18:17:38.460254+0000","last_active":"2023-01-02T18:17:47.652857+0000","last_peered":"2023-01-02T18:17:47.652857+0000","last_clean":"2023-01-02T18:17:47.652857+0000","last_became_active":"2023-01-02T18:17:36.446522+0000","last_became_peered":"2023-01-02T18:17:36.446522+0000","last_unstale":"2023-01-02T18:17:47.652857+0000","last_undegraded":"2023-01-02T18:17:47.652857+0000","last_fullsized":"2023-01-02T18:17:47.652857+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651227+0000","last_change":"2023-01-02T18:17:34.331749+0000","last_active":"2023-01-02T18:17:47.651227+0000","last_peered":"2023-01-02T18:17:47.651227+0000","last_clean":"2023-01-02T18:17:47.651227+0000","last_became_active":"2023-01-02T18:17:32.337737+0000","last_became_peered":"2023-01-02T18:17:32.337737+0000","last_unstale":"2023-01-02T18:17:47.651227+0000","last_undegraded":"2023-01-02T18:17:47.651227+0000","last_fullsized":"2023-01-02T18:17:47.651227+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"76'3","reported_seq":136,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653163+0000","last_change":"2023-01-02T18:17:09.308112+0000","last_active":"2023-01-02T18:17:47.653163+0000","last_peered":"2023-01-02T18:17:47.653163+0000","last_clean":"2023-01-02T18:17:47.653163+0000","last_became_active":"2023-01-02T18:17:07.336295+0000","last_became_peered":"2023-01-02T18:17:07.336295+0000","last_unstale":"2023-01-02T18:17:47.653163+0000","last_undegraded":"2023-01-02T18:17:47.653163+0000","last_fullsized":"2023-01-02T18:17:47.653163+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":80,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'85","reported_seq":718,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653474+0000","last_change":"2023-01-02T18:17:01.316472+0000","last_active":"2023-01-02T18:17:47.653474+0000","last_peered":"2023-01-02T18:17:47.653474+0000","last_clean":"2023-01-02T18:17:47.653474+0000","last_became_active":"2023-01-02T18:16:59.310142+0000","last_became_peered":"2023-01-02T18:16:59.310142+0000","last_unstale":"2023-01-02T18:17:47.653474+0000","last_undegraded":"2023-01-02T18:17:47.653474+0000","last_fullsized":"2023-01-02T18:17:47.653474+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1544,"num_read_kb":1398,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656152+0000","last_change":"2023-01-02T18:16:44.308280+0000","last_active":"2023-01-02T18:17:47.656152+0000","last_peered":"2023-01-02T18:17:47.656152+0000","last_clean":"2023-01-02T18:17:47.656152+0000","last_became_active":"2023-01-02T18:16:41.446391+0000","last_became_peered":"2023-01-02T18:16:41.446391+0000","last_unstale":"2023-01-02T18:17:47.656152+0000","last_undegraded":"2023-01-02T18:17:47.656152+0000","last_fullsized":"2023-01-02T18:17:47.656152+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"80'15","reported_seq":199,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652863+0000","last_change":"2023-01-02T18:17:30.502618+0000","last_active":"2023-01-02T18:17:47.652863+0000","last_peered":"2023-01-02T18:17:47.652863+0000","last_clean":"2023-01-02T18:17:47.652863+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:17:47.652863+0000","last_undegraded":"2023-01-02T18:17:47.652863+0000","last_fullsized":"2023-01-02T18:17:47.652863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":151,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656396+0000","last_change":"2023-01-02T18:17:29.337167+0000","last_active":"2023-01-02T18:17:47.656396+0000","last_peered":"2023-01-02T18:17:47.656396+0000","last_clean":"2023-01-02T18:17:47.656396+0000","last_became_active":"2023-01-02T18:17:29.335412+0000","last_became_peered":"2023-01-02T18:17:29.335412+0000","last_unstale":"2023-01-02T18:17:47.656396+0000","last_undegraded":"2023-01-02T18:17:47.656396+0000","last_fullsized":"2023-01-02T18:17:47.656396+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663728+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:17:47.663728+0000","last_peered":"2023-01-02T18:17:47.663728+0000","last_clean":"2023-01-02T18:17:47.663728+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:17:47.663728+0000","last_undegraded":"2023-01-02T18:17:47.663728+0000","last_fullsized":"2023-01-02T18:17:47.663728+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":68,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654693+0000","last_change":"2023-01-02T18:16:57.313875+0000","last_active":"2023-01-02T18:17:47.654693+0000","last_peered":"2023-01-02T18:17:47.654693+0000","last_clean":"2023-01-02T18:17:47.654693+0000","last_became_active":"2023-01-02T18:16:55.318719+0000","last_became_peered":"2023-01-02T18:16:55.318719+0000","last_unstale":"2023-01-02T18:17:47.654693+0000","last_undegraded":"2023-01-02T18:17:47.654693+0000","last_fullsized":"2023-01-02T18:17:47.654693+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.645560+0000","last_change":"2023-01-02T18:17:38.444327+0000","last_active":"2023-01-02T18:17:47.645560+0000","last_peered":"2023-01-02T18:17:47.645560+0000","last_clean":"2023-01-02T18:17:47.645560+0000","last_became_active":"2023-01-02T18:17:36.443020+0000","last_became_peered":"2023-01-02T18:17:36.443020+0000","last_unstale":"2023-01-02T18:17:47.645560+0000","last_undegraded":"2023-01-02T18:17:47.645560+0000","last_fullsized":"2023-01-02T18:17:47.645560+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.644638+0000","last_change":"2023-01-02T18:17:34.343511+0000","last_active":"2023-01-02T18:17:47.644638+0000","last_peered":"2023-01-02T18:17:47.644638+0000","last_clean":"2023-01-02T18:17:47.644638+0000","last_became_active":"2023-01-02T18:17:32.340038+0000","last_became_peered":"2023-01-02T18:17:32.340038+0000","last_unstale":"2023-01-02T18:17:47.644638+0000","last_undegraded":"2023-01-02T18:17:47.644638+0000","last_fullsized":"2023-01-02T18:17:47.644638+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655309+0000","last_change":"2023-01-02T18:17:09.307476+0000","last_active":"2023-01-02T18:17:47.655309+0000","last_peered":"2023-01-02T18:17:47.655309+0000","last_clean":"2023-01-02T18:17:47.655309+0000","last_became_active":"2023-01-02T18:17:07.336526+0000","last_became_peered":"2023-01-02T18:17:07.336526+0000","last_unstale":"2023-01-02T18:17:47.655309+0000","last_undegraded":"2023-01-02T18:17:47.655309+0000","last_fullsized":"2023-01-02T18:17:47.655309+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"68'2","reported_seq":166,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654636+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:17:47.654636+0000","last_peered":"2023-01-02T18:17:47.654636+0000","last_clean":"2023-01-02T18:17:47.654636+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:17:47.654636+0000","last_undegraded":"2023-01-02T18:17:47.654636+0000","last_fullsized":"2023-01-02T18:17:47.654636+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654999+0000","last_change":"2023-01-02T18:16:44.307606+0000","last_active":"2023-01-02T18:17:47.654999+0000","last_peered":"2023-01-02T18:17:47.654999+0000","last_clean":"2023-01-02T18:17:47.654999+0000","last_became_active":"2023-01-02T18:16:41.449266+0000","last_became_peered":"2023-01-02T18:16:41.449266+0000","last_unstale":"2023-01-02T18:17:47.654999+0000","last_undegraded":"2023-01-02T18:17:47.654999+0000","last_fullsized":"2023-01-02T18:17:47.654999+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":144,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663301+0000","last_change":"2023-01-02T18:17:30.333872+0000","last_active":"2023-01-02T18:17:47.663301+0000","last_peered":"2023-01-02T18:17:47.663301+0000","last_clean":"2023-01-02T18:17:47.663301+0000","last_became_active":"2023-01-02T18:16:48.329249+0000","last_became_peered":"2023-01-02T18:16:48.329249+0000","last_unstale":"2023-01-02T18:17:47.663301+0000","last_undegraded":"2023-01-02T18:17:47.663301+0000","last_fullsized":"2023-01-02T18:17:47.663301+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656335+0000","last_change":"2023-01-02T18:16:49.311129+0000","last_active":"2023-01-02T18:17:47.656335+0000","last_peered":"2023-01-02T18:17:47.656335+0000","last_clean":"2023-01-02T18:17:47.656335+0000","last_became_active":"2023-01-02T18:16:46.312301+0000","last_became_peered":"2023-01-02T18:16:46.312301+0000","last_unstale":"2023-01-02T18:17:47.656335+0000","last_undegraded":"2023-01-02T18:17:47.656335+0000","last_fullsized":"2023-01-02T18:17:47.656335+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646838+0000","last_change":"2023-01-02T18:16:53.350359+0000","last_active":"2023-01-02T18:17:47.646838+0000","last_peered":"2023-01-02T18:17:47.646838+0000","last_clean":"2023-01-02T18:17:47.646838+0000","last_became_active":"2023-01-02T18:16:51.338043+0000","last_became_peered":"2023-01-02T18:16:51.338043+0000","last_unstale":"2023-01-02T18:17:47.646838+0000","last_undegraded":"2023-01-02T18:17:47.646838+0000","last_fullsized":"2023-01-02T18:17:47.646838+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664500+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:17:47.664500+0000","last_peered":"2023-01-02T18:17:47.664500+0000","last_clean":"2023-01-02T18:17:47.664500+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:17:47.664500+0000","last_undegraded":"2023-01-02T18:17:47.664500+0000","last_fullsized":"2023-01-02T18:17:47.664500+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"105'3","reported_seq":34,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655685+0000","last_change":"2023-01-02T18:17:38.449366+0000","last_active":"2023-01-02T18:17:47.655685+0000","last_peered":"2023-01-02T18:17:47.655685+0000","last_clean":"2023-01-02T18:17:47.655685+0000","last_became_active":"2023-01-02T18:17:36.440502+0000","last_became_peered":"2023-01-02T18:17:36.440502+0000","last_unstale":"2023-01-02T18:17:47.655685+0000","last_undegraded":"2023-01-02T18:17:47.655685+0000","last_fullsized":"2023-01-02T18:17:47.655685+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"101'2","reported_seq":40,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655225+0000","last_change":"2023-01-02T18:17:34.347105+0000","last_active":"2023-01-02T18:17:47.655225+0000","last_peered":"2023-01-02T18:17:47.655225+0000","last_clean":"2023-01-02T18:17:47.655225+0000","last_became_active":"2023-01-02T18:17:32.344891+0000","last_became_peered":"2023-01-02T18:17:32.344891+0000","last_unstale":"2023-01-02T18:17:47.655225+0000","last_undegraded":"2023-01-02T18:17:47.655225+0000","last_fullsized":"2023-01-02T18:17:47.655225+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652494+0000","last_change":"2023-01-02T18:17:09.330482+0000","last_active":"2023-01-02T18:17:47.652494+0000","last_peered":"2023-01-02T18:17:47.652494+0000","last_clean":"2023-01-02T18:17:47.652494+0000","last_became_active":"2023-01-02T18:17:07.344261+0000","last_became_peered":"2023-01-02T18:17:07.344261+0000","last_unstale":"2023-01-02T18:17:47.652494+0000","last_undegraded":"2023-01-02T18:17:47.652494+0000","last_fullsized":"2023-01-02T18:17:47.652494+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"68'4","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654393+0000","last_change":"2023-01-02T18:17:29.353714+0000","last_active":"2023-01-02T18:17:47.654393+0000","last_peered":"2023-01-02T18:17:47.654393+0000","last_clean":"2023-01-02T18:17:47.654393+0000","last_became_active":"2023-01-02T18:17:29.325542+0000","last_became_peered":"2023-01-02T18:17:29.325542+0000","last_unstale":"2023-01-02T18:17:47.654393+0000","last_undegraded":"2023-01-02T18:17:47.654393+0000","last_fullsized":"2023-01-02T18:17:47.654393+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655752+0000","last_change":"2023-01-02T18:17:29.335193+0000","last_active":"2023-01-02T18:17:47.655752+0000","last_peered":"2023-01-02T18:17:47.655752+0000","last_clean":"2023-01-02T18:17:47.655752+0000","last_became_active":"2023-01-02T18:17:29.334681+0000","last_became_peered":"2023-01-02T18:17:29.334681+0000","last_unstale":"2023-01-02T18:17:47.655752+0000","last_undegraded":"2023-01-02T18:17:47.655752+0000","last_fullsized":"2023-01-02T18:17:47.655752+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":124,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664254+0000","last_change":"2023-01-02T18:17:30.333125+0000","last_active":"2023-01-02T18:17:47.664254+0000","last_peered":"2023-01-02T18:17:47.664254+0000","last_clean":"2023-01-02T18:17:47.664254+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:17:47.664254+0000","last_undegraded":"2023-01-02T18:17:47.664254+0000","last_fullsized":"2023-01-02T18:17:47.664254+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654897+0000","last_change":"2023-01-02T18:16:49.310391+0000","last_active":"2023-01-02T18:17:47.654897+0000","last_peered":"2023-01-02T18:17:47.654897+0000","last_clean":"2023-01-02T18:17:47.654897+0000","last_became_active":"2023-01-02T18:16:46.316328+0000","last_became_peered":"2023-01-02T18:16:46.316328+0000","last_unstale":"2023-01-02T18:17:47.654897+0000","last_undegraded":"2023-01-02T18:17:47.654897+0000","last_fullsized":"2023-01-02T18:17:47.654897+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656699+0000","last_change":"2023-01-02T18:17:29.324721+0000","last_active":"2023-01-02T18:17:47.656699+0000","last_peered":"2023-01-02T18:17:47.656699+0000","last_clean":"2023-01-02T18:17:47.656699+0000","last_became_active":"2023-01-02T18:17:29.323897+0000","last_became_peered":"2023-01-02T18:17:29.323897+0000","last_unstale":"2023-01-02T18:17:47.656699+0000","last_undegraded":"2023-01-02T18:17:47.656699+0000","last_fullsized":"2023-01-02T18:17:47.656699+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648440+0000","last_change":"2023-01-02T18:16:57.306845+0000","last_active":"2023-01-02T18:17:47.648440+0000","last_peered":"2023-01-02T18:17:47.648440+0000","last_clean":"2023-01-02T18:17:47.648440+0000","last_became_active":"2023-01-02T18:16:55.318612+0000","last_became_peered":"2023-01-02T18:16:55.318612+0000","last_unstale":"2023-01-02T18:17:47.648440+0000","last_undegraded":"2023-01-02T18:17:47.648440+0000","last_fullsized":"2023-01-02T18:17:47.648440+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665284+0000","last_change":"2023-01-02T18:17:38.463630+0000","last_active":"2023-01-02T18:17:47.665284+0000","last_peered":"2023-01-02T18:17:47.665284+0000","last_clean":"2023-01-02T18:17:47.665284+0000","last_became_active":"2023-01-02T18:17:36.449160+0000","last_became_peered":"2023-01-02T18:17:36.449160+0000","last_unstale":"2023-01-02T18:17:47.665284+0000","last_undegraded":"2023-01-02T18:17:47.665284+0000","last_fullsized":"2023-01-02T18:17:47.665284+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1a","version":"101'8","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652601+0000","last_change":"2023-01-02T18:17:34.325778+0000","last_active":"2023-01-02T18:17:47.652601+0000","last_peered":"2023-01-02T18:17:47.652601+0000","last_clean":"2023-01-02T18:17:47.652601+0000","last_became_active":"2023-01-02T18:17:32.340683+0000","last_became_peered":"2023-01-02T18:17:32.340683+0000","last_unstale":"2023-01-02T18:17:47.652601+0000","last_undegraded":"2023-01-02T18:17:47.652601+0000","last_fullsized":"2023-01-02T18:17:47.652601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652217+0000","last_change":"2023-01-02T18:17:09.307508+0000","last_active":"2023-01-02T18:17:47.652217+0000","last_peered":"2023-01-02T18:17:47.652217+0000","last_clean":"2023-01-02T18:17:47.652217+0000","last_became_active":"2023-01-02T18:17:07.344914+0000","last_became_peered":"2023-01-02T18:17:07.344914+0000","last_unstale":"2023-01-02T18:17:47.652217+0000","last_undegraded":"2023-01-02T18:17:47.652217+0000","last_fullsized":"2023-01-02T18:17:47.652217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"69'1","reported_seq":76,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651719+0000","last_change":"2023-01-02T18:17:29.365036+0000","last_active":"2023-01-02T18:17:47.651719+0000","last_peered":"2023-01-02T18:17:47.651719+0000","last_clean":"2023-01-02T18:17:47.651719+0000","last_became_active":"2023-01-02T18:17:29.334847+0000","last_became_peered":"2023-01-02T18:17:29.334847+0000","last_unstale":"2023-01-02T18:17:47.651719+0000","last_undegraded":"2023-01-02T18:17:47.651719+0000","last_fullsized":"2023-01-02T18:17:47.651719+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654774+0000","last_change":"2023-01-02T18:16:44.307239+0000","last_active":"2023-01-02T18:17:47.654774+0000","last_peered":"2023-01-02T18:17:47.654774+0000","last_clean":"2023-01-02T18:17:47.654774+0000","last_became_active":"2023-01-02T18:16:41.447671+0000","last_became_peered":"2023-01-02T18:16:41.447671+0000","last_unstale":"2023-01-02T18:17:47.654774+0000","last_undegraded":"2023-01-02T18:17:47.654774+0000","last_fullsized":"2023-01-02T18:17:47.654774+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'20","reported_seq":225,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665131+0000","last_change":"2023-01-02T18:17:30.334708+0000","last_active":"2023-01-02T18:17:47.665131+0000","last_peered":"2023-01-02T18:17:47.665131+0000","last_clean":"2023-01-02T18:17:47.665131+0000","last_became_active":"2023-01-02T18:16:48.322940+0000","last_became_peered":"2023-01-02T18:16:48.322940+0000","last_unstale":"2023-01-02T18:17:47.665131+0000","last_undegraded":"2023-01-02T18:17:47.665131+0000","last_fullsized":"2023-01-02T18:17:47.665131+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":200,"num_write":27,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655511+0000","last_change":"2023-01-02T18:17:29.329761+0000","last_active":"2023-01-02T18:17:47.655511+0000","last_peered":"2023-01-02T18:17:47.655511+0000","last_clean":"2023-01-02T18:17:47.655511+0000","last_became_active":"2023-01-02T18:17:29.327470+0000","last_became_peered":"2023-01-02T18:17:29.327470+0000","last_unstale":"2023-01-02T18:17:47.655511+0000","last_undegraded":"2023-01-02T18:17:47.655511+0000","last_fullsized":"2023-01-02T18:17:47.655511+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":66,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662617+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:17:47.662617+0000","last_peered":"2023-01-02T18:17:47.662617+0000","last_clean":"2023-01-02T18:17:47.662617+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:17:47.662617+0000","last_undegraded":"2023-01-02T18:17:47.662617+0000","last_fullsized":"2023-01-02T18:17:47.662617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":70,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665722+0000","last_change":"2023-01-02T18:17:29.340931+0000","last_active":"2023-01-02T18:17:47.665722+0000","last_peered":"2023-01-02T18:17:47.665722+0000","last_clean":"2023-01-02T18:17:47.665722+0000","last_became_active":"2023-01-02T18:17:29.340602+0000","last_became_peered":"2023-01-02T18:17:29.340602+0000","last_unstale":"2023-01-02T18:17:47.665722+0000","last_undegraded":"2023-01-02T18:17:47.665722+0000","last_fullsized":"2023-01-02T18:17:47.665722+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"105'11","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654467+0000","last_change":"2023-01-02T18:17:38.460374+0000","last_active":"2023-01-02T18:17:47.654467+0000","last_peered":"2023-01-02T18:17:47.654467+0000","last_clean":"2023-01-02T18:17:47.654467+0000","last_became_active":"2023-01-02T18:17:36.443934+0000","last_became_peered":"2023-01-02T18:17:36.443934+0000","last_unstale":"2023-01-02T18:17:47.654467+0000","last_undegraded":"2023-01-02T18:17:47.654467+0000","last_fullsized":"2023-01-02T18:17:47.654467+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"101'8","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652945+0000","last_change":"2023-01-02T18:17:34.327085+0000","last_active":"2023-01-02T18:17:47.652945+0000","last_peered":"2023-01-02T18:17:47.652945+0000","last_clean":"2023-01-02T18:17:47.652945+0000","last_became_active":"2023-01-02T18:17:32.343328+0000","last_became_peered":"2023-01-02T18:17:32.343328+0000","last_unstale":"2023-01-02T18:17:47.652945+0000","last_undegraded":"2023-01-02T18:17:47.652945+0000","last_fullsized":"2023-01-02T18:17:47.652945+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648271+0000","last_change":"2023-01-02T18:17:09.325339+0000","last_active":"2023-01-02T18:17:47.648271+0000","last_peered":"2023-01-02T18:17:47.648271+0000","last_clean":"2023-01-02T18:17:47.648271+0000","last_became_active":"2023-01-02T18:17:07.341155+0000","last_became_peered":"2023-01-02T18:17:07.341155+0000","last_unstale":"2023-01-02T18:17:47.648271+0000","last_undegraded":"2023-01-02T18:17:47.648271+0000","last_fullsized":"2023-01-02T18:17:47.648271+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":79,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648416+0000","last_change":"2023-01-02T18:17:29.343403+0000","last_active":"2023-01-02T18:17:47.648416+0000","last_peered":"2023-01-02T18:17:47.648416+0000","last_clean":"2023-01-02T18:17:47.648416+0000","last_became_active":"2023-01-02T18:17:29.320060+0000","last_became_peered":"2023-01-02T18:17:29.320060+0000","last_unstale":"2023-01-02T18:17:47.648416+0000","last_undegraded":"2023-01-02T18:17:47.648416+0000","last_fullsized":"2023-01-02T18:17:47.648416+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":69,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653560+0000","last_change":"2023-01-02T18:16:48.329830+0000","last_active":"2023-01-02T18:17:47.653560+0000","last_peered":"2023-01-02T18:17:47.653560+0000","last_clean":"2023-01-02T18:17:47.653560+0000","last_became_active":"2023-01-02T18:16:48.329469+0000","last_became_peered":"2023-01-02T18:16:48.329469+0000","last_unstale":"2023-01-02T18:17:47.653560+0000","last_undegraded":"2023-01-02T18:17:47.653560+0000","last_fullsized":"2023-01-02T18:17:47.653560+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":125,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664277+0000","last_change":"2023-01-02T18:17:30.334813+0000","last_active":"2023-01-02T18:17:47.664277+0000","last_peered":"2023-01-02T18:17:47.664277+0000","last_clean":"2023-01-02T18:17:47.664277+0000","last_became_active":"2023-01-02T18:16:48.326351+0000","last_became_peered":"2023-01-02T18:16:48.326351+0000","last_unstale":"2023-01-02T18:17:47.664277+0000","last_undegraded":"2023-01-02T18:17:47.664277+0000","last_fullsized":"2023-01-02T18:17:47.664277+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655934+0000","last_change":"2023-01-02T18:17:29.333748+0000","last_active":"2023-01-02T18:17:47.655934+0000","last_peered":"2023-01-02T18:17:47.655934+0000","last_clean":"2023-01-02T18:17:47.655934+0000","last_became_active":"2023-01-02T18:17:29.330002+0000","last_became_peered":"2023-01-02T18:17:29.330002+0000","last_unstale":"2023-01-02T18:17:47.655934+0000","last_undegraded":"2023-01-02T18:17:47.655934+0000","last_fullsized":"2023-01-02T18:17:47.655934+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652370+0000","last_change":"2023-01-02T18:16:53.342357+0000","last_active":"2023-01-02T18:17:47.652370+0000","last_peered":"2023-01-02T18:17:47.652370+0000","last_clean":"2023-01-02T18:17:47.652370+0000","last_became_active":"2023-01-02T18:16:51.341254+0000","last_became_peered":"2023-01-02T18:16:51.341254+0000","last_unstale":"2023-01-02T18:17:47.652370+0000","last_undegraded":"2023-01-02T18:17:47.652370+0000","last_fullsized":"2023-01-02T18:17:47.652370+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.644930+0000","last_change":"2023-01-02T18:17:36.438593+0000","last_active":"2023-01-02T18:17:47.644930+0000","last_peered":"2023-01-02T18:17:47.644930+0000","last_clean":"2023-01-02T18:17:47.644930+0000","last_became_active":"2023-01-02T18:17:36.438305+0000","last_became_peered":"2023-01-02T18:17:36.438305+0000","last_unstale":"2023-01-02T18:17:47.644930+0000","last_undegraded":"2023-01-02T18:17:47.644930+0000","last_fullsized":"2023-01-02T18:17:47.644930+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665154+0000","last_change":"2023-01-02T18:17:38.464600+0000","last_active":"2023-01-02T18:17:47.665154+0000","last_peered":"2023-01-02T18:17:47.665154+0000","last_clean":"2023-01-02T18:17:47.665154+0000","last_became_active":"2023-01-02T18:17:36.445763+0000","last_became_peered":"2023-01-02T18:17:36.445763+0000","last_unstale":"2023-01-02T18:17:47.665154+0000","last_undegraded":"2023-01-02T18:17:47.665154+0000","last_fullsized":"2023-01-02T18:17:47.665154+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"101'10","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652936+0000","last_change":"2023-01-02T18:17:34.326274+0000","last_active":"2023-01-02T18:17:47.652936+0000","last_peered":"2023-01-02T18:17:47.652936+0000","last_clean":"2023-01-02T18:17:47.652936+0000","last_became_active":"2023-01-02T18:17:32.339630+0000","last_became_peered":"2023-01-02T18:17:32.339630+0000","last_unstale":"2023-01-02T18:17:47.652936+0000","last_undegraded":"2023-01-02T18:17:47.652936+0000","last_fullsized":"2023-01-02T18:17:47.652936+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":51,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656372+0000","last_change":"2023-01-02T18:17:09.308664+0000","last_active":"2023-01-02T18:17:47.656372+0000","last_peered":"2023-01-02T18:17:47.656372+0000","last_clean":"2023-01-02T18:17:47.656372+0000","last_became_active":"2023-01-02T18:17:07.344272+0000","last_became_peered":"2023-01-02T18:17:07.344272+0000","last_unstale":"2023-01-02T18:17:47.656372+0000","last_undegraded":"2023-01-02T18:17:47.656372+0000","last_fullsized":"2023-01-02T18:17:47.656372+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654820+0000","last_change":"2023-01-02T18:17:01.311474+0000","last_active":"2023-01-02T18:17:47.654820+0000","last_peered":"2023-01-02T18:17:47.654820+0000","last_clean":"2023-01-02T18:17:47.654820+0000","last_became_active":"2023-01-02T18:16:59.314245+0000","last_became_peered":"2023-01-02T18:16:59.314245+0000","last_unstale":"2023-01-02T18:17:47.654820+0000","last_undegraded":"2023-01-02T18:17:47.654820+0000","last_fullsized":"2023-01-02T18:17:47.654820+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":93,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.662639+0000","last_change":"2023-01-02T18:17:48.662639+0000","last_active":"2023-01-02T18:17:48.662639+0000","last_peered":"2023-01-02T18:17:48.662639+0000","last_clean":"2023-01-02T18:17:48.662639+0000","last_became_active":"2023-01-02T18:17:48.662288+0000","last_became_peered":"2023-01-02T18:17:48.662288+0000","last_unstale":"2023-01-02T18:17:48.662639+0000","last_undegraded":"2023-01-02T18:17:48.662639+0000","last_fullsized":"2023-01-02T18:17:48.662639+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"86'18","reported_seq":217,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665166+0000","last_change":"2023-01-02T18:17:30.335050+0000","last_active":"2023-01-02T18:17:47.665166+0000","last_peered":"2023-01-02T18:17:47.665166+0000","last_clean":"2023-01-02T18:17:47.665166+0000","last_became_active":"2023-01-02T18:16:37.436152+0000","last_became_peered":"2023-01-02T18:16:37.436152+0000","last_unstale":"2023-01-02T18:17:47.665166+0000","last_undegraded":"2023-01-02T18:17:47.665166+0000","last_fullsized":"2023-01-02T18:17:47.665166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":192,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655645+0000","last_change":"2023-01-02T18:16:49.309763+0000","last_active":"2023-01-02T18:17:47.655645+0000","last_peered":"2023-01-02T18:17:47.655645+0000","last_clean":"2023-01-02T18:17:47.655645+0000","last_became_active":"2023-01-02T18:16:46.308336+0000","last_became_peered":"2023-01-02T18:16:46.308336+0000","last_unstale":"2023-01-02T18:17:47.655645+0000","last_undegraded":"2023-01-02T18:17:47.655645+0000","last_fullsized":"2023-01-02T18:17:47.655645+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":75,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646930+0000","last_change":"2023-01-02T18:17:29.320574+0000","last_active":"2023-01-02T18:17:47.646930+0000","last_peered":"2023-01-02T18:17:47.646930+0000","last_clean":"2023-01-02T18:17:47.646930+0000","last_became_active":"2023-01-02T18:17:29.320274+0000","last_became_peered":"2023-01-02T18:17:29.320274+0000","last_unstale":"2023-01-02T18:17:47.646930+0000","last_undegraded":"2023-01-02T18:17:47.646930+0000","last_fullsized":"2023-01-02T18:17:47.646930+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":62,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663170+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:17:47.663170+0000","last_peered":"2023-01-02T18:17:47.663170+0000","last_clean":"2023-01-02T18:17:47.663170+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:17:47.663170+0000","last_undegraded":"2023-01-02T18:17:47.663170+0000","last_fullsized":"2023-01-02T18:17:47.663170+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665389+0000","last_change":"2023-01-02T18:17:38.464884+0000","last_active":"2023-01-02T18:17:47.665389+0000","last_peered":"2023-01-02T18:17:47.665389+0000","last_clean":"2023-01-02T18:17:47.665389+0000","last_became_active":"2023-01-02T18:17:36.445153+0000","last_became_peered":"2023-01-02T18:17:36.445153+0000","last_unstale":"2023-01-02T18:17:47.665389+0000","last_undegraded":"2023-01-02T18:17:47.665389+0000","last_fullsized":"2023-01-02T18:17:47.665389+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.665485+0000","last_change":"2023-01-02T18:17:34.343843+0000","last_active":"2023-01-02T18:17:47.665485+0000","last_peered":"2023-01-02T18:17:47.665485+0000","last_clean":"2023-01-02T18:17:47.665485+0000","last_became_active":"2023-01-02T18:17:32.344716+0000","last_became_peered":"2023-01-02T18:17:32.344716+0000","last_unstale":"2023-01-02T18:17:47.665485+0000","last_undegraded":"2023-01-02T18:17:47.665485+0000","last_fullsized":"2023-01-02T18:17:47.665485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"76'3","reported_seq":60,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654127+0000","last_change":"2023-01-02T18:17:09.308316+0000","last_active":"2023-01-02T18:17:47.654127+0000","last_peered":"2023-01-02T18:17:47.654127+0000","last_clean":"2023-01-02T18:17:47.654127+0000","last_became_active":"2023-01-02T18:17:07.339700+0000","last_became_peered":"2023-01-02T18:17:07.339700+0000","last_unstale":"2023-01-02T18:17:47.654127+0000","last_undegraded":"2023-01-02T18:17:47.654127+0000","last_fullsized":"2023-01-02T18:17:47.654127+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":65,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647942+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:17:47.647942+0000","last_peered":"2023-01-02T18:17:47.647942+0000","last_clean":"2023-01-02T18:17:47.647942+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:17:47.647942+0000","last_undegraded":"2023-01-02T18:17:47.647942+0000","last_fullsized":"2023-01-02T18:17:47.647942+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656820+0000","last_change":"2023-01-02T18:16:44.306989+0000","last_active":"2023-01-02T18:17:47.656820+0000","last_peered":"2023-01-02T18:17:47.656820+0000","last_clean":"2023-01-02T18:17:47.656820+0000","last_became_active":"2023-01-02T18:16:41.448619+0000","last_became_peered":"2023-01-02T18:16:41.448619+0000","last_unstale":"2023-01-02T18:17:47.656820+0000","last_undegraded":"2023-01-02T18:17:47.656820+0000","last_fullsized":"2023-01-02T18:17:47.656820+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"46'1","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656308+0000","last_change":"2023-01-02T18:17:30.331472+0000","last_active":"2023-01-02T18:17:47.656308+0000","last_peered":"2023-01-02T18:17:47.656308+0000","last_clean":"2023-01-02T18:17:47.656308+0000","last_became_active":"2023-01-02T18:17:29.333176+0000","last_became_peered":"2023-01-02T18:17:29.333176+0000","last_unstale":"2023-01-02T18:17:47.656308+0000","last_undegraded":"2023-01-02T18:17:47.656308+0000","last_fullsized":"2023-01-02T18:17:47.656308+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":79,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663240+0000","last_change":"2023-01-02T18:16:49.304745+0000","last_active":"2023-01-02T18:17:47.663240+0000","last_peered":"2023-01-02T18:17:47.663240+0000","last_clean":"2023-01-02T18:17:47.663240+0000","last_became_active":"2023-01-02T18:16:48.325920+0000","last_became_peered":"2023-01-02T18:16:48.325920+0000","last_unstale":"2023-01-02T18:17:47.663240+0000","last_undegraded":"2023-01-02T18:17:47.663240+0000","last_fullsized":"2023-01-02T18:17:47.663240+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":68,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655819+0000","last_change":"2023-01-02T18:16:53.342417+0000","last_active":"2023-01-02T18:17:47.655819+0000","last_peered":"2023-01-02T18:17:47.655819+0000","last_clean":"2023-01-02T18:17:47.655819+0000","last_became_active":"2023-01-02T18:16:51.341971+0000","last_became_peered":"2023-01-02T18:16:51.341971+0000","last_unstale":"2023-01-02T18:17:47.655819+0000","last_undegraded":"2023-01-02T18:17:47.655819+0000","last_fullsized":"2023-01-02T18:17:47.655819+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653929+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:17:47.653929+0000","last_peered":"2023-01-02T18:17:47.653929+0000","last_clean":"2023-01-02T18:17:47.653929+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:17:47.653929+0000","last_undegraded":"2023-01-02T18:17:47.653929+0000","last_fullsized":"2023-01-02T18:17:47.653929+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655417+0000","last_change":"2023-01-02T18:17:38.451111+0000","last_active":"2023-01-02T18:17:47.655417+0000","last_peered":"2023-01-02T18:17:47.655417+0000","last_clean":"2023-01-02T18:17:47.655417+0000","last_became_active":"2023-01-02T18:17:36.442712+0000","last_became_peered":"2023-01-02T18:17:36.442712+0000","last_unstale":"2023-01-02T18:17:47.655417+0000","last_undegraded":"2023-01-02T18:17:47.655417+0000","last_fullsized":"2023-01-02T18:17:47.655417+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1e","version":"101'8","reported_seq":49,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648273+0000","last_change":"2023-01-02T18:17:34.316857+0000","last_active":"2023-01-02T18:17:47.648273+0000","last_peered":"2023-01-02T18:17:47.648273+0000","last_clean":"2023-01-02T18:17:47.648273+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:17:47.648273+0000","last_undegraded":"2023-01-02T18:17:47.648273+0000","last_fullsized":"2023-01-02T18:17:47.648273+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.647844+0000","last_change":"2023-01-02T18:17:29.320212+0000","last_active":"2023-01-02T18:17:47.647844+0000","last_peered":"2023-01-02T18:17:47.647844+0000","last_clean":"2023-01-02T18:17:47.647844+0000","last_became_active":"2023-01-02T18:17:29.319459+0000","last_became_peered":"2023-01-02T18:17:29.319459+0000","last_unstale":"2023-01-02T18:17:47.647844+0000","last_undegraded":"2023-01-02T18:17:47.647844+0000","last_fullsized":"2023-01-02T18:17:47.647844+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"71'6","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655996+0000","last_change":"2023-01-02T18:17:29.380260+0000","last_active":"2023-01-02T18:17:47.655996+0000","last_peered":"2023-01-02T18:17:47.655996+0000","last_clean":"2023-01-02T18:17:47.655996+0000","last_became_active":"2023-01-02T18:17:29.334697+0000","last_became_peered":"2023-01-02T18:17:29.334697+0000","last_unstale":"2023-01-02T18:17:47.655996+0000","last_undegraded":"2023-01-02T18:17:47.655996+0000","last_fullsized":"2023-01-02T18:17:47.655996+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652902+0000","last_change":"2023-01-02T18:16:44.306689+0000","last_active":"2023-01-02T18:17:47.652902+0000","last_peered":"2023-01-02T18:17:47.652902+0000","last_clean":"2023-01-02T18:17:47.652902+0000","last_became_active":"2023-01-02T18:16:41.448162+0000","last_became_peered":"2023-01-02T18:16:41.448162+0000","last_unstale":"2023-01-02T18:17:47.652902+0000","last_undegraded":"2023-01-02T18:17:47.652902+0000","last_fullsized":"2023-01-02T18:17:47.652902+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656808+0000","last_change":"2023-01-02T18:17:30.331763+0000","last_active":"2023-01-02T18:17:47.656808+0000","last_peered":"2023-01-02T18:17:47.656808+0000","last_clean":"2023-01-02T18:17:47.656808+0000","last_became_active":"2023-01-02T18:17:29.327892+0000","last_became_peered":"2023-01-02T18:17:29.327892+0000","last_unstale":"2023-01-02T18:17:47.656808+0000","last_undegraded":"2023-01-02T18:17:47.656808+0000","last_fullsized":"2023-01-02T18:17:47.656808+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":80,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652684+0000","last_change":"2023-01-02T18:16:49.318037+0000","last_active":"2023-01-02T18:17:47.652684+0000","last_peered":"2023-01-02T18:17:47.652684+0000","last_clean":"2023-01-02T18:17:47.652684+0000","last_became_active":"2023-01-02T18:16:48.330758+0000","last_became_peered":"2023-01-02T18:16:48.330758+0000","last_unstale":"2023-01-02T18:17:47.652684+0000","last_undegraded":"2023-01-02T18:17:47.652684+0000","last_fullsized":"2023-01-02T18:17:47.652684+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":164,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662465+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:17:47.662465+0000","last_peered":"2023-01-02T18:17:47.662465+0000","last_clean":"2023-01-02T18:17:47.662465+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:17:47.662465+0000","last_undegraded":"2023-01-02T18:17:47.662465+0000","last_fullsized":"2023-01-02T18:17:47.662465+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":63,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646769+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:17:47.646769+0000","last_peered":"2023-01-02T18:17:47.646769+0000","last_clean":"2023-01-02T18:17:47.646769+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:17:47.646769+0000","last_undegraded":"2023-01-02T18:17:47.646769+0000","last_fullsized":"2023-01-02T18:17:47.646769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.646373+0000","last_change":"2023-01-02T18:17:38.444061+0000","last_active":"2023-01-02T18:17:47.646373+0000","last_peered":"2023-01-02T18:17:47.646373+0000","last_clean":"2023-01-02T18:17:47.646373+0000","last_became_active":"2023-01-02T18:17:36.437329+0000","last_became_peered":"2023-01-02T18:17:36.437329+0000","last_unstale":"2023-01-02T18:17:47.646373+0000","last_undegraded":"2023-01-02T18:17:47.646373+0000","last_fullsized":"2023-01-02T18:17:47.646373+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":38,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654052+0000","last_change":"2023-01-02T18:17:34.316239+0000","last_active":"2023-01-02T18:17:47.654052+0000","last_peered":"2023-01-02T18:17:47.654052+0000","last_clean":"2023-01-02T18:17:47.654052+0000","last_became_active":"2023-01-02T18:17:32.337541+0000","last_became_peered":"2023-01-02T18:17:32.337541+0000","last_unstale":"2023-01-02T18:17:47.654052+0000","last_undegraded":"2023-01-02T18:17:47.654052+0000","last_fullsized":"2023-01-02T18:17:47.654052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655862+0000","last_change":"2023-01-02T18:17:29.332434+0000","last_active":"2023-01-02T18:17:47.655862+0000","last_peered":"2023-01-02T18:17:47.655862+0000","last_clean":"2023-01-02T18:17:47.655862+0000","last_became_active":"2023-01-02T18:17:29.329956+0000","last_became_peered":"2023-01-02T18:17:29.329956+0000","last_unstale":"2023-01-02T18:17:47.655862+0000","last_undegraded":"2023-01-02T18:17:47.655862+0000","last_fullsized":"2023-01-02T18:17:47.655862+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655454+0000","last_change":"2023-01-02T18:17:01.311515+0000","last_active":"2023-01-02T18:17:47.655454+0000","last_peered":"2023-01-02T18:17:47.655454+0000","last_clean":"2023-01-02T18:17:47.655454+0000","last_became_active":"2023-01-02T18:16:59.322412+0000","last_became_peered":"2023-01-02T18:16:59.322412+0000","last_unstale":"2023-01-02T18:17:47.655454+0000","last_undegraded":"2023-01-02T18:17:47.655454+0000","last_fullsized":"2023-01-02T18:17:47.655454+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":86,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653740+0000","last_change":"2023-01-02T18:17:29.338927+0000","last_active":"2023-01-02T18:17:47.653740+0000","last_peered":"2023-01-02T18:17:47.653740+0000","last_clean":"2023-01-02T18:17:47.653740+0000","last_became_active":"2023-01-02T18:17:29.338639+0000","last_became_peered":"2023-01-02T18:17:29.338639+0000","last_unstale":"2023-01-02T18:17:47.653740+0000","last_undegraded":"2023-01-02T18:17:47.653740+0000","last_fullsized":"2023-01-02T18:17:47.653740+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":164,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652733+0000","last_change":"2023-01-02T18:17:30.433577+0000","last_active":"2023-01-02T18:17:47.652733+0000","last_peered":"2023-01-02T18:17:47.652733+0000","last_clean":"2023-01-02T18:17:47.652733+0000","last_became_active":"2023-01-02T18:16:37.415177+0000","last_became_peered":"2023-01-02T18:16:37.415177+0000","last_unstale":"2023-01-02T18:17:47.652733+0000","last_undegraded":"2023-01-02T18:17:47.652733+0000","last_fullsized":"2023-01-02T18:17:47.652733+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":72,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648908+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:17:47.648908+0000","last_peered":"2023-01-02T18:17:47.648908+0000","last_clean":"2023-01-02T18:17:47.648908+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:17:47.648908+0000","last_undegraded":"2023-01-02T18:17:47.648908+0000","last_fullsized":"2023-01-02T18:17:47.648908+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":25,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655923+0000","last_change":"2023-01-02T18:17:29.329770+0000","last_active":"2023-01-02T18:17:47.655923+0000","last_peered":"2023-01-02T18:17:47.655923+0000","last_clean":"2023-01-02T18:17:47.655923+0000","last_became_active":"2023-01-02T18:17:29.328232+0000","last_became_peered":"2023-01-02T18:17:29.328232+0000","last_unstale":"2023-01-02T18:17:47.655923+0000","last_undegraded":"2023-01-02T18:17:47.655923+0000","last_fullsized":"2023-01-02T18:17:47.655923+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655036+0000","last_change":"2023-01-02T18:17:29.384506+0000","last_active":"2023-01-02T18:17:47.655036+0000","last_peered":"2023-01-02T18:17:47.655036+0000","last_clean":"2023-01-02T18:17:47.655036+0000","last_became_active":"2023-01-02T18:17:29.335526+0000","last_became_peered":"2023-01-02T18:17:29.335526+0000","last_unstale":"2023-01-02T18:17:47.655036+0000","last_undegraded":"2023-01-02T18:17:47.655036+0000","last_fullsized":"2023-01-02T18:17:47.655036+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":22,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652517+0000","last_change":"2023-01-02T18:17:38.450093+0000","last_active":"2023-01-02T18:17:47.652517+0000","last_peered":"2023-01-02T18:17:47.652517+0000","last_clean":"2023-01-02T18:17:47.652517+0000","last_became_active":"2023-01-02T18:17:36.449051+0000","last_became_peered":"2023-01-02T18:17:36.449051+0000","last_unstale":"2023-01-02T18:17:47.652517+0000","last_undegraded":"2023-01-02T18:17:47.652517+0000","last_fullsized":"2023-01-02T18:17:47.652517+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":37,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663828+0000","last_change":"2023-01-02T18:17:34.343018+0000","last_active":"2023-01-02T18:17:47.663828+0000","last_peered":"2023-01-02T18:17:47.663828+0000","last_clean":"2023-01-02T18:17:47.663828+0000","last_became_active":"2023-01-02T18:17:32.345232+0000","last_became_peered":"2023-01-02T18:17:32.345232+0000","last_unstale":"2023-01-02T18:17:47.663828+0000","last_undegraded":"2023-01-02T18:17:47.663828+0000","last_fullsized":"2023-01-02T18:17:47.663828+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663049+0000","last_change":"2023-01-02T18:17:09.323079+0000","last_active":"2023-01-02T18:17:47.663049+0000","last_peered":"2023-01-02T18:17:47.663049+0000","last_clean":"2023-01-02T18:17:47.663049+0000","last_became_active":"2023-01-02T18:17:07.344746+0000","last_became_peered":"2023-01-02T18:17:07.344746+0000","last_unstale":"2023-01-02T18:17:47.663049+0000","last_undegraded":"2023-01-02T18:17:47.663049+0000","last_fullsized":"2023-01-02T18:17:47.663049+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":59,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654385+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:17:47.654385+0000","last_peered":"2023-01-02T18:17:47.654385+0000","last_clean":"2023-01-02T18:17:47.654385+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:17:47.654385+0000","last_undegraded":"2023-01-02T18:17:47.654385+0000","last_fullsized":"2023-01-02T18:17:47.654385+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.664224+0000","last_change":"2023-01-02T18:17:48.664224+0000","last_active":"2023-01-02T18:17:48.664224+0000","last_peered":"2023-01-02T18:17:48.664224+0000","last_clean":"2023-01-02T18:17:48.664224+0000","last_became_active":"2023-01-02T18:17:48.663942+0000","last_became_peered":"2023-01-02T18:17:48.663942+0000","last_unstale":"2023-01-02T18:17:48.664224+0000","last_undegraded":"2023-01-02T18:17:48.664224+0000","last_fullsized":"2023-01-02T18:17:48.664224+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":77,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.648625+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:17:47.648625+0000","last_peered":"2023-01-02T18:17:47.648625+0000","last_clean":"2023-01-02T18:17:47.648625+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:17:47.648625+0000","last_undegraded":"2023-01-02T18:17:47.648625+0000","last_fullsized":"2023-01-02T18:17:47.648625+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":145,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.651361+0000","last_change":"2023-01-02T18:17:30.330120+0000","last_active":"2023-01-02T18:17:47.651361+0000","last_peered":"2023-01-02T18:17:47.651361+0000","last_clean":"2023-01-02T18:17:47.651361+0000","last_became_active":"2023-01-02T18:16:37.416142+0000","last_became_peered":"2023-01-02T18:16:37.416142+0000","last_unstale":"2023-01-02T18:17:47.651361+0000","last_undegraded":"2023-01-02T18:17:47.651361+0000","last_fullsized":"2023-01-02T18:17:47.651361+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"56'15","reported_seq":138,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.653661+0000","last_change":"2023-01-02T18:16:49.319188+0000","last_active":"2023-01-02T18:17:47.653661+0000","last_peered":"2023-01-02T18:17:47.653661+0000","last_clean":"2023-01-02T18:17:47.653661+0000","last_became_active":"2023-01-02T18:16:48.329016+0000","last_became_peered":"2023-01-02T18:16:48.329016+0000","last_unstale":"2023-01-02T18:17:47.653661+0000","last_undegraded":"2023-01-02T18:17:47.653661+0000","last_fullsized":"2023-01-02T18:17:47.653661+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":184,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664421+0000","last_change":"2023-01-02T18:17:29.354782+0000","last_active":"2023-01-02T18:17:47.664421+0000","last_peered":"2023-01-02T18:17:47.664421+0000","last_clean":"2023-01-02T18:17:47.664421+0000","last_became_active":"2023-01-02T18:17:29.340734+0000","last_became_peered":"2023-01-02T18:17:29.340734+0000","last_unstale":"2023-01-02T18:17:47.664421+0000","last_undegraded":"2023-01-02T18:17:47.664421+0000","last_fullsized":"2023-01-02T18:17:47.664421+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":84,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":21,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.663943+0000","last_change":"2023-01-02T18:17:38.462825+0000","last_active":"2023-01-02T18:17:47.663943+0000","last_peered":"2023-01-02T18:17:47.663943+0000","last_clean":"2023-01-02T18:17:47.663943+0000","last_became_active":"2023-01-02T18:17:36.449207+0000","last_became_peered":"2023-01-02T18:17:36.449207+0000","last_unstale":"2023-01-02T18:17:47.663943+0000","last_undegraded":"2023-01-02T18:17:47.663943+0000","last_fullsized":"2023-01-02T18:17:47.663943+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"101'2","reported_seq":39,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.664269+0000","last_change":"2023-01-02T18:17:34.343730+0000","last_active":"2023-01-02T18:17:47.664269+0000","last_peered":"2023-01-02T18:17:47.664269+0000","last_clean":"2023-01-02T18:17:47.664269+0000","last_became_active":"2023-01-02T18:17:32.346354+0000","last_became_peered":"2023-01-02T18:17:32.346354+0000","last_unstale":"2023-01-02T18:17:47.664269+0000","last_undegraded":"2023-01-02T18:17:47.664269+0000","last_fullsized":"2023-01-02T18:17:47.664269+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":50,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.662640+0000","last_change":"2023-01-02T18:17:09.322935+0000","last_active":"2023-01-02T18:17:47.662640+0000","last_peered":"2023-01-02T18:17:47.662640+0000","last_clean":"2023-01-02T18:17:47.662640+0000","last_became_active":"2023-01-02T18:17:07.346620+0000","last_became_peered":"2023-01-02T18:17:07.346620+0000","last_unstale":"2023-01-02T18:17:47.662640+0000","last_undegraded":"2023-01-02T18:17:47.662640+0000","last_fullsized":"2023-01-02T18:17:47.662640+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"72'4","reported_seq":29,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654305+0000","last_change":"2023-01-02T18:17:29.382390+0000","last_active":"2023-01-02T18:17:47.654305+0000","last_peered":"2023-01-02T18:17:47.654305+0000","last_clean":"2023-01-02T18:17:47.654305+0000","last_became_active":"2023-01-02T18:17:29.335369+0000","last_became_peered":"2023-01-02T18:17:29.335369+0000","last_unstale":"2023-01-02T18:17:47.654305+0000","last_undegraded":"2023-01-02T18:17:47.654305+0000","last_fullsized":"2023-01-02T18:17:47.654305+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-01-02T18:17:48.664412+0000","last_change":"2023-01-02T18:17:48.664412+0000","last_active":"2023-01-02T18:17:48.664412+0000","last_peered":"2023-01-02T18:17:48.664412+0000","last_clean":"2023-01-02T18:17:48.664412+0000","last_became_active":"2023-01-02T18:17:48.655335+0000","last_became_peered":"2023-01-02T18:17:48.655335+0000","last_unstale":"2023-01-02T18:17:48.664412+0000","last_undegraded":"2023-01-02T18:17:48.664412+0000","last_fullsized":"2023-01-02T18:17:48.664412+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":88,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.654652+0000","last_change":"2023-01-02T18:16:44.308144+0000","last_active":"2023-01-02T18:17:47.654652+0000","last_peered":"2023-01-02T18:17:47.654652+0000","last_clean":"2023-01-02T18:17:47.654652+0000","last_became_active":"2023-01-02T18:16:41.446839+0000","last_became_peered":"2023-01-02T18:16:41.446839+0000","last_unstale":"2023-01-02T18:17:47.654652+0000","last_undegraded":"2023-01-02T18:17:47.654652+0000","last_fullsized":"2023-01-02T18:17:47.654652+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"84'5","reported_seq":190,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.652082+0000","last_change":"2023-01-02T18:17:30.325949+0000","last_active":"2023-01-02T18:17:47.652082+0000","last_peered":"2023-01-02T18:17:47.652082+0000","last_clean":"2023-01-02T18:17:47.652082+0000","last_became_active":"2023-01-02T18:16:48.329379+0000","last_became_peered":"2023-01-02T18:16:48.329379+0000","last_unstale":"2023-01-02T18:17:47.652082+0000","last_undegraded":"2023-01-02T18:17:47.652082+0000","last_fullsized":"2023-01-02T18:17:47.652082+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":85,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.656461+0000","last_change":"2023-01-02T18:16:49.310230+0000","last_active":"2023-01-02T18:17:47.656461+0000","last_peered":"2023-01-02T18:17:47.656461+0000","last_clean":"2023-01-02T18:17:47.656461+0000","last_became_active":"2023-01-02T18:16:48.324944+0000","last_became_peered":"2023-01-02T18:16:48.324944+0000","last_unstale":"2023-01-02T18:17:47.656461+0000","last_undegraded":"2023-01-02T18:17:47.656461+0000","last_fullsized":"2023-01-02T18:17:47.656461+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":67,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-01-02T18:17:47.655996+0000","last_change":"2023-01-02T18:16:53.345118+0000","last_active":"2023-01-02T18:17:47.655996+0000","last_peered":"2023-01-02T18:17:47.655996+0000","last_clean":"2023-01-02T18:17:47.655996+0000","last_became_active":"2023-01-02T18:16:51.341889+0000","last_became_peered":"2023-01-02T18:16:51.341889+0000","last_unstale":"2023-01-02T18:17:47.655996+0000","last_undegraded":"2023-01-02T18:17:47.655996+0000","last_fullsized":"2023-01-02T18:17:47.655996+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":11534409,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":179,"num_read_kb":145,"num_write":50,"num_write_kb":11283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":23093248,"data_stored":23068818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":56,"ondisk_log_size":56,"up":64,"acting":64,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":472,"num_read_kb":400,"num_write":105,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":64,"acting":64,"num_store_stats":7},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":171,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1456,"num_read_kb":1306,"num_write":98,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":465,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2428,"num_read_kb":2178,"num_write":146,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":363,"num_keys_recovered":250,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":7},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1498,"num_read_kb":1362,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":124,"num_keys_recovered":6,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1078,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1918,"num_read_kb":1551,"num_write":240,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":726,"num_keys_recovered":150,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":102,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":70,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":109,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1496,"num_read_kb":1361,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":70,"num_keys_recovered":162,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12672,"kb_used_data":1464,"kb_used_omap":0,"kb_used_meta":11200,"kb_avail":94359168,"statfs":{"total":96636764160,"available":96623788032,"internally_reserved":0,"allocated":1499136,"data_stored":766835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11468800},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.34699999999999998}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.45000000000000001,"15min":0.42899999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.41699999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.39600000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.434},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.503}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.48499999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.55500000000000005}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.34499999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":23028,"kb_used_data":11692,"kb_used_omap":0,"kb_used_meta":11328,"kb_avail":94348812,"statfs":{"total":96636764160,"available":96613183488,"internally_reserved":0,"allocated":11972608,"data_stored":11252529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11599872},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":2.109,"15min":2.109},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.443}]},{"osd":1,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45700000000000002,"15min":0.44900000000000001},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.34699999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.282,"15min":1.282},"last":0.36399999999999999}]},{"osd":3,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72499999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.377}]},{"osd":4,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.29599999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.624,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.435},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.54100000000000004}]},{"osd":7,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":1.3,"15min":1.3},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.32000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":16844,"kb_used_data":5572,"kb_used_omap":0,"kb_used_meta":11264,"kb_avail":94354996,"statfs":{"total":96636764160,"available":96619515904,"internally_reserved":0,"allocated":5705728,"data_stored":4961256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11534336},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.434,"15min":0.44900000000000001},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":0.46200000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.443},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45500000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.499}]},{"osd":2,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.43099999999999999,"5min":1.258,"15min":1.258},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.371,"5min":0.441,"15min":0.45300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48299999999999998,"5min":1.028,"15min":1.028},"last":0.51000000000000001}]},{"osd":3,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.46500000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51700000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42799999999999999,"15min":0.439},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56399999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53900000000000003}]},{"osd":4,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67700000000000005,"5min":1.321,"15min":1.321},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57299999999999995}]},{"osd":5,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79000000000000004,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76700000000000002,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.63800000000000001}]},{"osd":6,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.64600000000000002,"15min":0.66400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70099999999999996,"5min":1.371,"15min":1.371},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.73699999999999999}]},{"osd":7,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.755,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67200000000000004,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.75900000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.71599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12556,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":11072,"kb_avail":94359284,"statfs":{"total":96636764160,"available":96623906816,"internally_reserved":0,"allocated":1511424,"data_stored":766956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11337728},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.503,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.48199999999999998,"15min":0.504},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":1.841,"15min":1.841},"last":0.30599999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61499999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.51500000000000001,"15min":0.54300000000000004},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52000000000000002,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.28699999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55000000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53300000000000003,"5min":1.875,"15min":1.875},"last":0.46700000000000003}]},{"osd":4,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6180000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.48699999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78900000000000003,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.56499999999999995}]},{"osd":6,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.73199999999999998,"15min":0.752},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.583,"5min":1.903,"15min":1.903},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81299999999999994,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81399999999999995,"5min":1.139,"15min":1.139},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8024,"kb_used_data":1424,"kb_used_omap":0,"kb_used_meta":6592,"kb_avail":94363816,"statfs":{"total":96636764160,"available":96628547584,"internally_reserved":0,"allocated":1458176,"data_stored":766536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6750208},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.46600000000000003,"15min":0.49299999999999999},"min":{"1min":0.24399999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":2.665,"15min":2.665},"last":0.374},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.44,"15min":0.45800000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42099999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.29799999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.498,"15min":0.52500000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.47799999999999998,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.252},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.45800000000000002,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.38800000000000001}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.443,"15min":0.45900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50600000000000001,"5min":1.359,"15min":1.359},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.46700000000000003,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.34899999999999998}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":2.601,"15min":2.601},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":1.25,"15min":1.25},"last":0.443},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.76300000000000001,"15min":0.79800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68899999999999995,"5min":2.637,"15min":2.637},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65900000000000003,"15min":0.67600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.69599999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81599999999999995,"5min":1.321,"15min":1.321},"last":0.497}]},{"osd":7,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73899999999999999,"5min":1.478,"15min":1.478},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78800000000000003,"5min":1.286,"15min":1.286},"last":0.54100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20016,"kb_used_data":8680,"kb_used_omap":0,"kb_used_meta":11328,"kb_avail":94351824,"statfs":{"total":96636764160,"available":96616267776,"internally_reserved":0,"allocated":8888320,"data_stored":8107286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11599872},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47999999999999998,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53500000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.40200000000000002}]},{"osd":1,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63600000000000001,"5min":1.766,"15min":1.766},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.51700000000000002,"15min":0.54300000000000004},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56699999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.315},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.42199999999999999}]},{"osd":4,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63200000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.505,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.63100000000000001,"15min":0.65300000000000002},"min":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70699999999999996,"5min":1.847,"15min":1.847},"last":0.498},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70099999999999996,"5min":1.615,"15min":1.615},"last":0.50900000000000001}]},{"osd":6,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.69799999999999995,"15min":0.72199999999999998},"min":{"1min":0.40400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82699999999999996,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69699999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.45500000000000002}]},{"osd":7,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.754,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80100000000000005,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.46700000000000003}]}]},{"osd":4,"up_from":0,"seq":55834574877,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":78,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7944,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":6464,"kb_avail":94363896,"statfs":{"total":96636764160,"available":96628629504,"internally_reserved":0,"allocated":1507328,"data_stored":766916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6619136},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.496,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.47599999999999998}]},{"osd":1,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.50600000000000001}]},{"osd":3,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.625}]},{"osd":4,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81399999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.65600000000000003}]},{"osd":6,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79300000000000004,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.878,"15min":0.878},"last":0.751}]},{"osd":7,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":1.044},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90300000000000002,"5min":1.359,"15min":1.359},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":83,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":50,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7348224,"data_stored":7340089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11542528,"data_stored":11534390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:17:53.724 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-01-02T18:17:53.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:17:53.725 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:17:53.726 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-01-02T18:17:53.726 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-01-02T18:17:53.798 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:53.798+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:53.878 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:53.878 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:53.878 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:53.879 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:53.889 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:53.940 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:53.941+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:53.999 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:54.000+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:54.015 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:54.015 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:54.015 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:54.016 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:54.016 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:54.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:54.056 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:54.056 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:54.056 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 116, 2023-01-02T18:17:54.056 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "4e320929-c4bb-4ea9-9e1c-d8479b7e40b1", 2023-01-02T18:17:54.057 INFO:teuthology.orchestra.run.smithi007.stdout: "created": "2023-01-02T18:15:29.542145+0000", 2023-01-02T18:17:54.057 INFO:teuthology.orchestra.run.smithi007.stdout: "modified": "2023-01-02T18:17:52.695290+0000", 2023-01-02T18:17:54.057 INFO:teuthology.orchestra.run.smithi007.stdout: "last_up_change": "2023-01-02T18:15:38.537792+0000", 2023-01-02T18:17:54.057 INFO:teuthology.orchestra.run.smithi007.stdout: "last_in_change": "2023-01-02T18:17:28.375365+0000", 2023-01-02T18:17:54.057 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-01-02T18:17:54.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_num": 5801984, 2023-01-02T18:17:54.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_set": [ 2023-01-02T18:17:54.058 INFO:teuthology.orchestra.run.smithi007.stdout: "noscrub", 2023-01-02T18:17:54.058 INFO:teuthology.orchestra.run.smithi007.stdout: "pglog_hardlimit", 2023-01-02T18:17:54.058 INFO:teuthology.orchestra.run.smithi007.stdout: "purged_snapdirs", 2023-01-02T18:17:54.059 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_deletes", 2023-01-02T18:17:54.059 INFO:teuthology.orchestra.run.smithi007.stdout: "sortbitwise" 2023-01-02T18:17:54.059 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:54.059 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_version": 4, 2023-01-02T18:17:54.059 INFO:teuthology.orchestra.run.smithi007.stdout: "full_ratio": 0.94999998807907104, 2023-01-02T18:17:54.059 INFO:teuthology.orchestra.run.smithi007.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-01-02T18:17:54.060 INFO:teuthology.orchestra.run.smithi007.stdout: "nearfull_ratio": 0.85000002384185791, 2023-01-02T18:17:54.060 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_snapshot": "", 2023-01-02T18:17:54.060 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_max": 11, 2023-01-02T18:17:54.060 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd": 8, 2023-01-02T18:17:54.060 INFO:teuthology.orchestra.run.smithi007.stdout: "require_min_compat_client": "luminous", 2023-01-02T18:17:54.061 INFO:teuthology.orchestra.run.smithi007.stdout: "min_compat_client": "luminous", 2023-01-02T18:17:54.061 INFO:teuthology.orchestra.run.smithi007.stdout: "require_osd_release": "pacific", 2023-01-02T18:17:54.061 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": [ 2023-01-02T18:17:54.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.061 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 1, 2023-01-02T18:17:54.062 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "device_health_metrics", 2023-01-02T18:17:54.062 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:38.598445+0000", 2023-01-02T18:17:54.062 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:17:54.062 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:17:54.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.063 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.063 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.063 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.063 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.063 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.064 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.064 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.064 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.064 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.064 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 1, 2023-01-02T18:17:54.065 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 1, 2023-01-02T18:17:54.065 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 1, 2023-01-02T18:17:54.065 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 1, 2023-01-02T18:17:54.065 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 1, 2023-01-02T18:17:54.065 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.066 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.066 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.066 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.066 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.066 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "16", 2023-01-02T18:17:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.067 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.068 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.068 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.068 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:17:54.068 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:17:54.068 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.069 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.069 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.069 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.069 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.069 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.070 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.070 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.070 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.070 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.070 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.071 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.071 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.071 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.071 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.071 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.072 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.072 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.072 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.072 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.073 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.073 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.073 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.073 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.073 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.074 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.074 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.074 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.074 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.074 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-01-02T18:17:54.074 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_max": 32, 2023-01-02T18:17:54.075 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 1 2023-01-02T18:17:54.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.075 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.075 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_devicehealth": {} 2023-01-02T18:17:54.075 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.076 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 2, 2023-01-02T18:17:54.076 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "rbd", 2023-01-02T18:17:54.076 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:40.853543+0000", 2023-01-02T18:17:54.076 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:17:54.077 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:17:54.077 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.077 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.077 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.077 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.078 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.078 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.078 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.078 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.078 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 8, 2023-01-02T18:17:54.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 8, 2023-01-02T18:17:54.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 8, 2023-01-02T18:17:54.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 8, 2023-01-02T18:17:54.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 8, 2023-01-02T18:17:54.080 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.080 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.080 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.080 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.080 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.081 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.081 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.081 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "18", 2023-01-02T18:17:54.081 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.082 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.082 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.082 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.082 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.082 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:17:54.082 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:17:54.083 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.083 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.083 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.083 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.084 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.084 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.084 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.084 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.085 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.086 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.086 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.086 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.086 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.087 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.087 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.087 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.087 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.087 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.088 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.088 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.088 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.088 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.088 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.089 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.089 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd": {} 2023-01-02T18:17:54.089 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.089 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-01-02T18:17:54.090 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-1", 2023-01-02T18:17:54.090 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:36.229953+0000", 2023-01-02T18:17:54.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.091 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.091 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.091 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.091 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.092 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.092 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.092 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.092 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.092 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.093 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.093 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.093 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.093 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.093 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.093 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.094 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.094 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.094 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.094 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.094 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.095 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "97", 2023-01-02T18:17:54.095 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.095 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.095 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.095 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.096 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.096 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 23, 2023-01-02T18:17:54.096 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 97, 2023-01-02T18:17:54.096 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.096 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.097 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.097 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.097 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.097 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.097 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.098 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.098 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.098 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.099 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.099 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.099 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.099 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.099 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.099 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.100 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.100 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.100 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.100 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.101 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.101 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.101 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.101 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.101 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.102 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.102 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.102 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.102 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.102 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.103 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 4, 2023-01-02T18:17:54.103 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-2", 2023-01-02T18:17:54.103 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:39.906131+0000", 2023-01-02T18:17:54.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.104 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.104 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.104 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.104 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.105 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.105 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.105 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.105 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.105 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.106 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.106 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.106 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.106 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.106 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.107 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.107 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.107 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.107 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.107 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.107 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.108 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.108 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.108 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.108 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "51", 2023-01-02T18:17:54.109 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.109 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.109 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.109 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.109 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.110 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:54.110 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 51, 2023-01-02T18:17:54.110 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.110 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.110 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.110 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.111 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.111 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.111 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.111 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.111 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.112 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.112 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.112 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.112 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.112 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.113 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.113 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.113 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.113 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.114 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.114 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.114 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.114 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.115 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.115 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.115 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.115 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.115 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.115 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.116 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.116 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.116 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.116 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.117 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 5, 2023-01-02T18:17:54.117 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-3", 2023-01-02T18:17:54.117 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:44.455124+0000", 2023-01-02T18:17:54.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.118 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.118 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.118 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.118 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.118 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.118 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.119 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.119 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.119 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.119 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.119 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.119 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.120 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.121 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.121 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.121 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.121 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.121 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.122 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.122 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "56", 2023-01-02T18:17:54.122 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.122 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.122 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.123 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.123 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.123 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:54.123 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 56, 2023-01-02T18:17:54.123 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.124 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.124 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.124 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.124 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.124 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.124 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.125 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.125 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.125 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.125 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.125 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.126 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.126 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.126 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.126 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.126 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.126 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.127 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.127 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.127 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.128 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.128 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.128 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.128 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.128 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.129 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.129 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.129 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.129 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.129 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.130 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.130 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.130 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 6, 2023-01-02T18:17:54.130 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-4", 2023-01-02T18:17:54.131 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:49.454047+0000", 2023-01-02T18:17:54.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.131 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.131 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.132 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.132 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.132 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.132 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.132 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.133 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.133 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.133 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.133 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.133 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.134 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.134 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.134 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.134 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.134 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.134 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.135 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.135 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.135 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.135 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.136 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "60", 2023-01-02T18:17:54.136 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.136 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.136 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.136 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.137 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.137 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:54.137 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 60, 2023-01-02T18:17:54.137 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.137 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.138 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.138 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.138 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.139 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.139 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.139 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.139 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.139 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.139 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.140 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.140 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.140 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.140 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.140 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.141 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.141 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.141 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.141 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.141 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.142 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.142 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.142 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.142 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.142 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.143 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.143 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.143 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.143 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.143 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.144 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.144 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 7, 2023-01-02T18:17:54.144 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-5", 2023-01-02T18:17:54.145 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:53.843144+0000", 2023-01-02T18:17:54.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.145 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.145 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.145 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.146 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.146 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.146 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.146 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.146 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.146 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.147 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.148 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.148 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.148 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.148 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.148 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.148 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.149 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.149 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.149 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "64", 2023-01-02T18:17:54.149 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.150 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.150 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.150 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.150 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.150 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:54.150 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 64, 2023-01-02T18:17:54.151 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.151 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.151 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.151 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.152 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.152 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.152 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.152 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.152 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.153 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.153 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.153 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.153 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.153 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.154 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.154 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.154 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.154 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.155 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.155 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.155 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.155 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.156 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.156 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.156 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.156 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.156 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.157 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.157 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.157 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.158 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 8, 2023-01-02T18:17:54.158 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-6", 2023-01-02T18:17:54.158 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:57.794651+0000", 2023-01-02T18:17:54.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.159 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.159 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.159 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.159 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.159 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.160 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.160 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.160 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.160 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.160 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.162 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.162 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.162 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.162 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.162 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.163 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.163 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.163 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "72", 2023-01-02T18:17:54.163 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.164 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.164 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.164 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.164 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.165 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 7, 2023-01-02T18:17:54.165 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 72, 2023-01-02T18:17:54.165 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.165 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.165 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.166 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.166 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.166 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.167 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.167 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.167 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.167 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.167 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.168 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.168 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.168 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.168 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.168 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.169 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.169 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.169 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.170 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.170 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.170 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.171 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.171 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.171 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.171 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.171 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.172 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.172 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.172 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 9, 2023-01-02T18:17:54.172 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-7", 2023-01-02T18:17:54.173 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:05.454247+0000", 2023-01-02T18:17:54.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.173 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.173 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.174 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.174 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.174 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.174 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.174 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.175 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.175 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.175 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.175 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.175 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.176 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.176 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.176 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.176 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.176 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.177 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.177 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.177 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.177 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.177 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.178 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "76", 2023-01-02T18:17:54.178 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.178 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.178 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.179 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.179 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.179 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:54.179 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 76, 2023-01-02T18:17:54.179 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.180 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.180 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.180 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.180 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.181 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.181 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.181 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.181 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.181 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.183 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.183 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.183 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.184 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.184 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.184 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.184 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.184 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.185 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.185 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.185 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.185 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.185 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.186 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.186 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.186 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.186 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.187 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 10, 2023-01-02T18:17:54.187 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-8", 2023-01-02T18:17:54.187 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:30.404991+0000", 2023-01-02T18:17:54.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.187 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.188 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.188 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.188 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.188 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.188 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.189 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.189 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.189 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.189 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.189 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.190 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.190 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.190 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.190 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.190 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.191 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.191 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.191 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.191 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.191 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.191 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "101", 2023-01-02T18:17:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.192 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.193 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.193 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 9, 2023-01-02T18:17:54.193 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 101, 2023-01-02T18:17:54.193 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.194 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.194 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:17:54.194 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.194 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.194 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.194 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.195 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.195 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.195 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.195 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.195 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.196 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.196 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.196 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.196 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.196 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.197 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.197 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.197 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.197 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.198 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.198 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.198 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.198 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.198 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.198 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.199 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.199 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.199 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.199 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.199 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.199 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.200 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.200 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 11, 2023-01-02T18:17:54.200 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-9", 2023-01-02T18:17:54.201 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:34.668757+0000", 2023-01-02T18:17:54.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:17:54.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:17:54.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:17:54.201 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:17:54.202 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:17:54.202 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:17:54.202 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:17:54.202 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:17:54.202 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:17:54.202 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:17:54.203 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:17:54.203 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:17:54.203 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:17:54.203 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:17:54.203 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:17:54.204 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:17:54.204 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:17:54.204 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:17:54.204 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:17:54.204 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:17:54.205 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:17:54.205 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:17:54.205 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:17:54.205 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:17:54.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.206 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "106", 2023-01-02T18:17:54.206 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:17:54.206 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:17:54.206 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:17:54.206 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:17:54.207 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:17:54.207 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:17:54.207 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 105, 2023-01-02T18:17:54.207 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:17:54.207 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:17:54.208 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 10485760, 2023-01-02T18:17:54.208 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:17:54.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:17:54.208 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:17:54.208 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:17:54.208 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:17:54.209 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:17:54.209 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:17:54.209 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:17:54.209 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:17:54.209 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:17:54.210 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:17:54.210 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:17:54.210 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:17:54.210 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:17:54.210 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:17:54.210 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:17:54.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.211 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:17:54.211 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:17:54.211 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:17:54.211 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:17:54.211 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:17:54.212 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:17:54.212 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:17:54.212 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:17:54.212 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:17:54.212 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:17:54.212 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:17:54.213 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:17:54.213 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:17:54.213 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:17:54.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.213 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.214 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:54.214 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:17:54.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.214 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:17:54.214 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "69e18813-bd8e-4b22-9c40-d702ff3a5efd", 2023-01-02T18:17:54.215 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:54.215 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:54.215 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:54.215 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.6576995849609375, 2023-01-02T18:17:54.215 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:54.216 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:54.216 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:54.216 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 102, 2023-01-02T18:17:54.216 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:54.216 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:54.216 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:54.217 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.217 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6808", 2023-01-02T18:17:54.217 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:54.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.218 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6809", 2023-01-02T18:17:54.218 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:54.218 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.219 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.219 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:54.219 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.220 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6810", 2023-01-02T18:17:54.220 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:54.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.221 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6811", 2023-01-02T18:17:54.221 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:54.221 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.221 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.221 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:54.222 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.222 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.222 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6814", 2023-01-02T18:17:54.222 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:54.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.223 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6815", 2023-01-02T18:17:54.223 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:54.224 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.224 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.224 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:54.224 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.225 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6812", 2023-01-02T18:17:54.225 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:54.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.226 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.226 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6813", 2023-01-02T18:17:54.226 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:17:54.226 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.227 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.227 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6809/107063", 2023-01-02T18:17:54.227 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6811/107063", 2023-01-02T18:17:54.227 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6815/107063", 2023-01-02T18:17:54.227 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6813/107063", 2023-01-02T18:17:54.228 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:54.228 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:54.228 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:54.228 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.229 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:17:54.229 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "aa04dec6-4607-4f2a-85a3-a6278832fef3", 2023-01-02T18:17:54.229 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:54.229 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:54.230 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:54.230 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.3902130126953125, 2023-01-02T18:17:54.230 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:54.230 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:54.230 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:54.231 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 111, 2023-01-02T18:17:54.231 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:54.231 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:54.231 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:54.231 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.232 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.232 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6824", 2023-01-02T18:17:54.232 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:54.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.233 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6825", 2023-01-02T18:17:54.233 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:54.233 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.234 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.234 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:54.234 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.235 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.235 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6826", 2023-01-02T18:17:54.235 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:54.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.236 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6827", 2023-01-02T18:17:54.236 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:54.236 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.236 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.237 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:54.237 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.237 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.238 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6830", 2023-01-02T18:17:54.238 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:54.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.238 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6831", 2023-01-02T18:17:54.239 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:54.239 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.239 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.239 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:54.239 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.240 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.240 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6828", 2023-01-02T18:17:54.240 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:54.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.241 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6829", 2023-01-02T18:17:54.241 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:17:54.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.241 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.242 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6825/107066", 2023-01-02T18:17:54.242 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6827/107066", 2023-01-02T18:17:54.242 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6831/107066", 2023-01-02T18:17:54.242 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6829/107066", 2023-01-02T18:17:54.243 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:54.243 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:54.243 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:54.243 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.244 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:17:54.244 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "c98a28fb-d910-4601-a229-d4318259ab9b", 2023-01-02T18:17:54.244 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:54.244 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:54.244 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:54.245 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.14453125, 2023-01-02T18:17:54.245 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:54.245 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:54.245 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:54.245 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 102, 2023-01-02T18:17:54.246 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:54.246 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:54.246 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:54.246 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.247 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6816", 2023-01-02T18:17:54.247 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:54.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.247 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6817", 2023-01-02T18:17:54.248 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:54.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.248 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.248 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:54.249 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.249 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6818", 2023-01-02T18:17:54.249 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:54.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.250 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.250 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6819", 2023-01-02T18:17:54.250 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:54.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.251 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.251 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:54.251 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.252 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6822", 2023-01-02T18:17:54.252 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:54.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.253 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6823", 2023-01-02T18:17:54.253 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:54.253 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.253 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.254 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:54.254 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.255 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6820", 2023-01-02T18:17:54.255 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:54.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.255 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.256 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6821", 2023-01-02T18:17:54.256 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:17:54.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.256 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.257 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6817/107065", 2023-01-02T18:17:54.257 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6819/107065", 2023-01-02T18:17:54.257 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6823/107065", 2023-01-02T18:17:54.257 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6821/107065", 2023-01-02T18:17:54.257 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:54.258 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:54.258 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:54.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:17:54.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "3c5d48f4-5384-4563-8acb-11d866b85ef4", 2023-01-02T18:17:54.259 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:54.259 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:54.259 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:54.260 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:54.260 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:54.260 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:54.260 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:54.261 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 113, 2023-01-02T18:17:54.261 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:54.261 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:54.261 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:54.261 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.262 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2023-01-02T18:17:54.262 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:54.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.263 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2023-01-02T18:17:54.263 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:54.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.263 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.264 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:54.264 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.265 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6802", 2023-01-02T18:17:54.265 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:54.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.266 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6803", 2023-01-02T18:17:54.266 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:54.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.266 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.267 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:54.267 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.267 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6806", 2023-01-02T18:17:54.267 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:54.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.268 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.268 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6807", 2023-01-02T18:17:54.268 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:54.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.269 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.269 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:54.269 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.270 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.270 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6804", 2023-01-02T18:17:54.270 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:54.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.271 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6805", 2023-01-02T18:17:54.271 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:17:54.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.272 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.272 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6801/107064", 2023-01-02T18:17:54.272 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6803/107064", 2023-01-02T18:17:54.272 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6807/107064", 2023-01-02T18:17:54.273 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6805/107064", 2023-01-02T18:17:54.273 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:54.273 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:54.273 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:54.273 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.274 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:17:54.274 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "2476d495-4979-4679-a7e9-12652c270092", 2023-01-02T18:17:54.274 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:54.274 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 0, 2023-01-02T18:17:54.275 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 0, 2023-01-02T18:17:54.275 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:54.275 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:54.275 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:54.275 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:54.275 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 52, 2023-01-02T18:17:54.276 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:54.276 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:54.276 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:54.276 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6800", 2023-01-02T18:17:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6801", 2023-01-02T18:17:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.279 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6802", 2023-01-02T18:17:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.280 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6803", 2023-01-02T18:17:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:54.281 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6806", 2023-01-02T18:17:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6807", 2023-01-02T18:17:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.283 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.284 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6804", 2023-01-02T18:17:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.285 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6805", 2023-01-02T18:17:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:17:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.286 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6801/106900", 2023-01-02T18:17:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6803/106900", 2023-01-02T18:17:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6807/106900", 2023-01-02T18:17:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6805/106900", 2023-01-02T18:17:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:54.287 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:17:54.288 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "38d57e5e-b6c1-445f-b181-23fb518698f9", 2023-01-02T18:17:54.289 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:54.289 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:54.289 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:54.289 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:54.289 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:54.290 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:54.290 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:54.290 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 111, 2023-01-02T18:17:54.290 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:54.290 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:54.291 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:54.291 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.291 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.291 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6816", 2023-01-02T18:17:54.291 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:54.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.292 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.292 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6817", 2023-01-02T18:17:54.292 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:54.293 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.293 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.293 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:54.293 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.294 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6818", 2023-01-02T18:17:54.294 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:54.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.295 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6819", 2023-01-02T18:17:54.295 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:54.295 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.295 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.296 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:54.296 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.296 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6822", 2023-01-02T18:17:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.297 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6823", 2023-01-02T18:17:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.299 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6820", 2023-01-02T18:17:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.300 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6821", 2023-01-02T18:17:54.301 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:17:54.301 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.301 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.301 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6817/106930", 2023-01-02T18:17:54.302 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6819/106930", 2023-01-02T18:17:54.302 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6823/106930", 2023-01-02T18:17:54.302 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6821/106930", 2023-01-02T18:17:54.302 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:54.302 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:54.303 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:54.303 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.303 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:17:54.303 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "6c78f25a-2a65-47fe-b101-e47c00a5b2f6", 2023-01-02T18:17:54.304 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:54.304 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:54.304 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:54.304 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:54.304 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:54.305 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:54.305 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:54.305 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 115, 2023-01-02T18:17:54.305 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:54.305 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:54.306 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:54.306 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.306 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6808", 2023-01-02T18:17:54.307 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:54.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.307 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.307 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6809", 2023-01-02T18:17:54.307 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:54.308 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.308 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.308 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:54.308 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.309 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.309 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6810", 2023-01-02T18:17:54.309 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:54.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.310 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.310 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6811", 2023-01-02T18:17:54.310 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:54.310 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.311 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.311 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:54.311 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.312 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.312 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6814", 2023-01-02T18:17:54.312 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:54.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.313 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.313 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6815", 2023-01-02T18:17:54.313 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:54.313 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.313 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.314 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6812", 2023-01-02T18:17:54.315 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:54.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.315 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.315 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6813", 2023-01-02T18:17:54.316 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:17:54.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.316 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.316 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6809/106901", 2023-01-02T18:17:54.317 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6811/106901", 2023-01-02T18:17:54.317 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6815/106901", 2023-01-02T18:17:54.317 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6813/106901", 2023-01-02T18:17:54.317 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:54.317 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:54.318 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:54.318 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.318 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:17:54.319 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "b094706d-7145-4865-ae95-e5cd7e40d23b", 2023-01-02T18:17:54.319 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:17:54.319 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:17:54.319 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:17:54.319 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:17:54.319 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:17:54.320 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:17:54.320 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:17:54.320 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 115, 2023-01-02T18:17:54.320 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:17:54.320 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:17:54.321 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:17:54.321 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.321 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.321 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6824", 2023-01-02T18:17:54.322 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:54.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.322 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.322 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6825", 2023-01-02T18:17:54.323 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:54.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.323 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.323 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:17:54.324 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.324 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.324 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6826", 2023-01-02T18:17:54.324 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:54.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.325 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6827", 2023-01-02T18:17:54.325 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:54.325 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.326 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.326 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:17:54.326 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.327 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6830", 2023-01-02T18:17:54.327 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:54.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.328 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6831", 2023-01-02T18:17:54.328 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:54.328 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.328 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.329 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:17:54.329 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:17:54.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.329 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:17:54.329 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6828", 2023-01-02T18:17:54.330 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:54.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.330 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:17:54.330 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6829", 2023-01-02T18:17:54.330 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:17:54.331 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.331 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.331 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6825/106931", 2023-01-02T18:17:54.331 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6827/106931", 2023-01-02T18:17:54.332 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6831/106931", 2023-01-02T18:17:54.332 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6829/106931", 2023-01-02T18:17:54.332 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:17:54.332 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:17:54.332 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:17:54.333 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.333 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.333 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:54.333 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_xinfo": [ 2023-01-02T18:17:54.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.334 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:17:54.334 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:54.334 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:54.334 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:54.334 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:54.334 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:54.335 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.290083+0000", 2023-01-02T18:17:54.335 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:54.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.335 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:17:54.336 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:54.336 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:54.336 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:54.336 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:54.336 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:54.337 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.303022+0000", 2023-01-02T18:17:54.337 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:54.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.337 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:17:54.338 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:54.338 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:54.338 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:54.338 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:54.338 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:54.339 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.292245+0000", 2023-01-02T18:17:54.339 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:54.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.339 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:17:54.340 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:54.340 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:54.340 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:54.340 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:54.340 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:54.341 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.210530+0000", 2023-01-02T18:17:54.341 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:54.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.341 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:17:54.342 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:54.342 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:54.342 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:54.342 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:54.342 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 65536, 2023-01-02T18:17:54.343 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.282212+0000", 2023-01-02T18:17:54.343 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:54.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.343 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:17:54.344 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:54.344 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:54.344 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:54.344 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:54.344 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:54.345 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.237376+0000", 2023-01-02T18:17:54.345 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:54.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.345 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:17:54.346 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:54.346 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:54.346 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:54.346 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:54.347 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:54.347 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.239974+0000", 2023-01-02T18:17:54.347 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:54.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:17:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:17:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:17:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:17:54.348 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:17:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:17:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.276340+0000", 2023-01-02T18:17:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:17:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.349 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap": [ 2023-01-02T18:17:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "2.0", 2023-01-02T18:17:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:17:54.350 INFO:teuthology.orchestra.run.smithi007.stdout: 2, 2023-01-02T18:17:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: 3 2023-01-02T18:17:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:17:54.351 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_items": [], 2023-01-02T18:17:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_temp": [], 2023-01-02T18:17:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_temp": [], 2023-01-02T18:17:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklist": {}, 2023-01-02T18:17:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: "range_blocklist": {}, 2023-01-02T18:17:54.352 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profiles": { 2023-01-02T18:17:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "default": { 2023-01-02T18:17:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-failure-domain": "osd", 2023-01-02T18:17:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "k": "2", 2023-01-02T18:17:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "m": "1", 2023-01-02T18:17:54.353 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin": "jerasure", 2023-01-02T18:17:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: "ruleset-failure-domain": "osd", 2023-01-02T18:17:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: "technique": "reed_sol_van" 2023-01-02T18:17:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps_queue": [], 2023-01-02T18:17:54.354 INFO:teuthology.orchestra.run.smithi007.stdout: "new_removed_snaps": [], 2023-01-02T18:17:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "new_purged_snaps": [], 2023-01-02T18:17:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_node_flags": {}, 2023-01-02T18:17:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "device_class_flags": {}, 2023-01-02T18:17:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode": { 2023-01-02T18:17:54.355 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_enabled": false, 2023-01-02T18:17:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_bucket_count": 0, 2023-01-02T18:17:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: "degraded_stretch_mode": 0, 2023-01-02T18:17:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: "recovering_stretch_mode": 0, 2023-01-02T18:17:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_bucket": 0 2023-01-02T18:17:54.356 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.357 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:54.359 INFO:tasks.thrashosds.thrasher:j is {'epoch': 116, 'fsid': '4e320929-c4bb-4ea9-9e1c-d8479b7e40b1', 'created': '2023-01-02T18:15:29.542145+0000', 'modified': '2023-01-02T18:17:52.695290+0000', 'last_up_change': '2023-01-02T18:15:38.537792+0000', 'last_in_change': '2023-01-02T18:17:28.375365+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 11, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-02T18:15:38.598445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-01-02T18:15:40.853543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'test-librbd-smithi007-118686-1', 'create_time': '2023-01-02T18:16:36.229953+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'test-librbd-smithi007-118686-2', 'create_time': '2023-01-02T18:16:39.906131+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 5, 'pool_name': 'test-librbd-smithi007-118686-3', 'create_time': '2023-01-02T18:16:44.455124+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 56, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 6, 'pool_name': 'test-librbd-smithi007-118686-4', 'create_time': '2023-01-02T18:16:49.454047+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 60, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 7, 'pool_name': 'test-librbd-smithi007-118686-5', 'create_time': '2023-01-02T18:16:53.843144+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 64, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 8, 'pool_name': 'test-librbd-smithi007-118686-6', 'create_time': '2023-01-02T18:16:57.794651+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 9, 'pool_name': 'test-librbd-smithi007-118686-7', 'create_time': '2023-01-02T18:17:05.454247+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 10, 'pool_name': 'test-librbd-smithi007-118686-8', 'create_time': '2023-01-02T18:17:30.404991+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 11, 'pool_name': 'test-librbd-smithi007-118686-9', 'create_time': '2023-01-02T18:17:34.668757+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 10485760, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '69e18813-bd8e-4b22-9c40-d702ff3a5efd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6576995849609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 102, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6808', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6809', 'nonce': 107063}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6810', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6811', 'nonce': 107063}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6814', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6815', 'nonce': 107063}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6812', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6813', 'nonce': 107063}]}, 'public_addr': '172.21.15.7:6809/107063', 'cluster_addr': '172.21.15.7:6811/107063', 'heartbeat_back_addr': '172.21.15.7:6815/107063', 'heartbeat_front_addr': '172.21.15.7:6813/107063', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa04dec6-4607-4f2a-85a3-a6278832fef3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3902130126953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 111, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6824', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6825', 'nonce': 107066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6826', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6827', 'nonce': 107066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6830', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6831', 'nonce': 107066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6828', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6829', 'nonce': 107066}]}, 'public_addr': '172.21.15.7:6825/107066', 'cluster_addr': '172.21.15.7:6827/107066', 'heartbeat_back_addr': '172.21.15.7:6831/107066', 'heartbeat_front_addr': '172.21.15.7:6829/107066', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'c98a28fb-d910-4601-a229-d4318259ab9b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.14453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 102, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6816', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6817', 'nonce': 107065}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6818', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6819', 'nonce': 107065}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6822', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6823', 'nonce': 107065}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6820', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6821', 'nonce': 107065}]}, 'public_addr': '172.21.15.7:6817/107065', 'cluster_addr': '172.21.15.7:6819/107065', 'heartbeat_back_addr': '172.21.15.7:6823/107065', 'heartbeat_front_addr': '172.21.15.7:6821/107065', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3c5d48f4-5384-4563-8acb-11d866b85ef4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 113, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6800', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6801', 'nonce': 107064}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6802', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6803', 'nonce': 107064}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6806', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6807', 'nonce': 107064}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6804', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6805', 'nonce': 107064}]}, 'public_addr': '172.21.15.7:6801/107064', 'cluster_addr': '172.21.15.7:6803/107064', 'heartbeat_back_addr': '172.21.15.7:6807/107064', 'heartbeat_front_addr': '172.21.15.7:6805/107064', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '2476d495-4979-4679-a7e9-12652c270092', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 52, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 106900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 106900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 106900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 106900}]}, 'public_addr': '172.21.15.57:6801/106900', 'cluster_addr': '172.21.15.57:6803/106900', 'heartbeat_back_addr': '172.21.15.57:6807/106900', 'heartbeat_front_addr': '172.21.15.57:6805/106900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '38d57e5e-b6c1-445f-b181-23fb518698f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 111, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6816', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6817', 'nonce': 106930}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6818', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 106930}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6822', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6823', 'nonce': 106930}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6820', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6821', 'nonce': 106930}]}, 'public_addr': '172.21.15.57:6817/106930', 'cluster_addr': '172.21.15.57:6819/106930', 'heartbeat_back_addr': '172.21.15.57:6823/106930', 'heartbeat_front_addr': '172.21.15.57:6821/106930', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6c78f25a-2a65-47fe-b101-e47c00a5b2f6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6808', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6809', 'nonce': 106901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6810', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6811', 'nonce': 106901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6814', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6815', 'nonce': 106901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6812', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6813', 'nonce': 106901}]}, 'public_addr': '172.21.15.57:6809/106901', 'cluster_addr': '172.21.15.57:6811/106901', 'heartbeat_back_addr': '172.21.15.57:6815/106901', 'heartbeat_front_addr': '172.21.15.57:6813/106901', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'b094706d-7145-4865-ae95-e5cd7e40d23b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 115, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6824', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6825', 'nonce': 106931}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6826', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6827', 'nonce': 106931}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6830', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6831', 'nonce': 106931}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6828', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6829', 'nonce': 106931}]}, 'public_addr': '172.21.15.57:6825/106931', 'cluster_addr': '172.21.15.57:6827/106931', 'heartbeat_back_addr': '172.21.15.57:6831/106931', 'heartbeat_front_addr': '172.21.15.57:6829/106931', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.290083+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.303022+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.292245+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.210530+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.282212+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.237376+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.239974+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.276340+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [2, 3]}], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-01-02T18:17:54.360 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:17:54.361 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:17:54.362 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:54.360+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:54.459 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:54.460+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:54.487 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:54.487 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:54.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:54.488 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:54.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.488 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:54.488 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:54.489 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.002825224000006, 2023-01-02T18:17:54.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:54.489 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.489 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.489 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:54.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:54.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:54.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:54.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:54.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:54.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:54.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:54.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:54.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:54.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:54.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:54.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:54.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:54.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:54.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:54.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:54.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:54.499 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.499 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.500 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:403 6.1c e60/57 6:3831950c:::rbd_directory:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:54.500 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:54.501 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.138758694000003, 2023-01-02T18:17:54.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003, 2023-01-02T18:17:54.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.501 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:54.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:54.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347731+0000", 2023-01-02T18:17:54.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2909999999999998e-06 2023-01-02T18:17:54.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347736+0000", 2023-01-02T18:17:54.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2136999999999999e-05 2023-01-02T18:17:54.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347749+0000", 2023-01-02T18:17:54.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8850000000000005e-06 2023-01-02T18:17:54.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347757+0000", 2023-01-02T18:17:54.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3576999999999999e-05 2023-01-02T18:17:54.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347811+0000", 2023-01-02T18:17:54.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0483e-05 2023-01-02T18:17:54.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.347831+0000", 2023-01-02T18:17:54.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070535400000000005 2023-01-02T18:17:54.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348537+0000", 2023-01-02T18:17:54.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0312e-05 2023-01-02T18:17:54.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.348567+0000", 2023-01-02T18:17:54.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00083576500000000003 2023-01-02T18:17:54.511 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.511 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.511 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.512 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:54.512 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:54.512 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.137079081000003, 2023-01-02T18:17:54.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:54.513 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.513 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.513 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:54.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:54.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:54.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:54.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:54.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:54.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:54.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:54.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:54.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:54.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:54.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:54.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:54.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:54.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:54.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:54.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:54.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:54.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:54.522 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.523 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.523 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:54.524 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:54.524 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.170251196999999, 2023-01-02T18:17:54.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:54.524 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.524 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.525 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:54.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:54.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:54.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:54.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:54.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:54.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:54.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:54.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:54.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:54.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:54.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:54.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:54.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:54.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:54.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:54.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:54.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:54.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.534 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.535 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:964 7.14 e64/61 7:2d7624f7:::rbd_id.image26:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:54.535 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:54.536 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.840113653000003, 2023-01-02T18:17:54.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999, 2023-01-02T18:17:54.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.536 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:54.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:54.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646376+0000", 2023-01-02T18:17:54.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1199999999999999e-06 2023-01-02T18:17:54.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646382+0000", 2023-01-02T18:17:54.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6942000000000001e-05 2023-01-02T18:17:54.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646399+0000", 2023-01-02T18:17:54.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:17:54.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646407+0000", 2023-01-02T18:17:54.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3714000000000001e-05 2023-01-02T18:17:54.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646461+0000", 2023-01-02T18:17:54.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7014e-05 2023-01-02T18:17:54.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.646478+0000", 2023-01-02T18:17:54.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068420500000000001 2023-01-02T18:17:54.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647162+0000", 2023-01-02T18:17:54.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4091999999999999e-05 2023-01-02T18:17:54.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.647186+0000", 2023-01-02T18:17:54.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00080940999999999999 2023-01-02T18:17:54.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.546 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.546 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.547 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:54.547 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:54.547 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.162760949999999, 2023-01-02T18:17:54.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:54.547 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.548 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.548 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:54.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:54.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:54.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:54.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:54.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:54.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:54.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:54.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:54.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:54.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:54.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:54.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:54.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:54.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:54.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:54.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:54.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:54.557 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.557 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.558 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.558 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:54.558 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:54.558 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.160967865000003, 2023-01-02T18:17:54.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:54.559 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.559 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.559 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:54.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:54.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:54.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:54.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:54.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:54.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:54.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:54.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:54.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:54.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:54.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:54.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:54.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:54.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:54.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.569 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.570 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:54.570 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:54.570 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.158076520999998, 2023-01-02T18:17:54.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:54.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.571 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:54.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:54.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:54.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:54.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:54.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:54.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:54.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:54.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:54.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:54.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:54.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:54.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:54.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:54.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:54.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:54.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:54.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:54.581 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.581 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.581 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.582 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:54.582 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:54.582 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.143877981000003, 2023-01-02T18:17:54.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:54.582 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.583 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.583 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:54.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:54.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:54.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:54.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:54.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:54.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:54.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:54.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:54.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:54.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:54.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:54.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:54.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:54.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:54.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:54.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:54.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:54.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:54.592 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.592 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.592 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.593 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:17:54.593 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:54.593 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.121795706999997, 2023-01-02T18:17:54.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:17:54.594 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.594 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.594 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:54.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:54.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:17:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:17:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:17:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:17:54.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:17:54.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:17:54.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:17:54.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:17:54.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:17:54.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:17:54.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:17:54.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:17:54.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:17:54.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:17:54.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:17:54.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.604 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.604 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2226 3.13 e89/54 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head v 89'2, mlcod=0'0)", 2023-01-02T18:17:54.605 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:54.605 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.119375597000001, 2023-01-02T18:17:54.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005, 2023-01-02T18:17:54.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.606 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:54.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:54.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:54.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:54.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0959999999999997e-06 2023-01-02T18:17:54.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367120+0000", 2023-01-02T18:17:54.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4494e-05 2023-01-02T18:17:54.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367135+0000", 2023-01-02T18:17:54.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5700000000000004e-06 2023-01-02T18:17:54.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367142+0000", 2023-01-02T18:17:54.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9985000000000003e-05 2023-01-02T18:17:54.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367192+0000", 2023-01-02T18:17:54.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8598e-05 2023-01-02T18:17:54.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367211+0000", 2023-01-02T18:17:54.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072699899999999998 2023-01-02T18:17:54.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367938+0000", 2023-01-02T18:17:54.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8569999999999998e-05 2023-01-02T18:17:54.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367977+0000", 2023-01-02T18:17:54.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005 2023-01-02T18:17:54.615 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.615 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.615 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.616 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:17:54.616 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:54.616 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.146160842, 2023-01-02T18:17:54.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:17:54.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.617 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.617 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:54.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:54.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:54.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:54.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:17:54.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:17:54.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:17:54.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:17:54.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:17:54.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:17:54.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:17:54.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:17:54.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:17:54.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:17:54.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:17:54.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:17:54.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:17:54.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:17:54.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:17:54.626 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.627 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.627 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.627 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:17:54.628 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:54.628 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.144421993000002, 2023-01-02T18:17:54.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:17:54.628 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.628 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.629 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:54.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:54.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:54.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:17:54.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:17:54.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:17:54.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:17:54.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:17:54.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:17:54.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:17:54.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:17:54.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:17:54.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:17:54.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:17:54.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:17:54.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:17:54.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:17:54.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:17:54.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:17:54.638 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.638 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.639 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.639 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:17:54.639 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:54.640 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.152096739000001, 2023-01-02T18:17:54.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:17:54.640 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.640 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.640 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:54.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:54.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:54.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:54.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:17:54.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:17:54.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:17:54.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:17:54.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:17:54.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:17:54.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:17:54.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:17:54.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:17:54.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:17:54.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:17:54.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:17:54.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:17:54.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:17:54.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:17:54.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.650 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.651 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:54.651 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:54.651 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.150953896000001, 2023-01-02T18:17:54.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:17:54.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.652 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.652 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:54.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:54.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:54.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:17:54.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:17:54.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:17:54.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:17:54.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:17:54.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:17:54.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:17:54.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:17:54.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:17:54.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:17:54.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:17:54.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:17:54.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:17:54.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:17:54.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:17:54.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.662 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.663 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:54.663 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:54.663 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.138400101999999, 2023-01-02T18:17:54.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:17:54.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.664 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.664 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:54.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:54.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:54.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:54.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:17:54.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:17:54.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:17:54.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:17:54.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:17:54.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:17:54.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:17:54.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:17:54.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:17:54.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:17:54.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:17:54.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:17:54.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:17:54.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:17:54.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:17:54.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.674 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.674 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.674 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2827 10.1e e101/98 10:7803159c:::rbd_object_map.12a2d48fcbc5:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:54.675 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:54.675 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.137463187000002, 2023-01-02T18:17:54.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004, 2023-01-02T18:17:54.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.676 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:54.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:54.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:54.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349026+0000", 2023-01-02T18:17:54.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5660000000000001e-06 2023-01-02T18:17:54.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349034+0000", 2023-01-02T18:17:54.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0851e-05 2023-01-02T18:17:54.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349044+0000", 2023-01-02T18:17:54.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5415000000000001e-05 2023-01-02T18:17:54.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349060+0000", 2023-01-02T18:17:54.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7527000000000002e-05 2023-01-02T18:17:54.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349097+0000", 2023-01-02T18:17:54.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3733999999999999e-05 2023-01-02T18:17:54.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349111+0000", 2023-01-02T18:17:54.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075968200000000002 2023-01-02T18:17:54.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349871+0000", 2023-01-02T18:17:54.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3843000000000001e-05 2023-01-02T18:17:54.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349905+0000", 2023-01-02T18:17:54.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004 2023-01-02T18:17:54.685 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.685 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.686 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.686 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:54.686 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:54.686 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.120997793000001, 2023-01-02T18:17:54.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:17:54.687 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.687 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.687 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:54.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:54.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:54.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:17:54.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:17:54.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:17:54.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:17:54.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:17:54.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:17:54.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:17:54.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:17:54.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:17:54.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:17:54.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:17:54.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:17:54.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:17:54.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:17:54.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:17:54.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:17:54.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.697 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.698 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:17:54.698 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:54.698 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.070944247, 2023-01-02T18:17:54.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:17:54.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.699 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:54.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:54.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:54.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:17:54.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:17:54.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:17:54.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:17:54.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:17:54.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:17:54.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:17:54.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:17:54.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:17:54.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:17:54.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:17:54.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:17:54.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:17:54.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:17:54.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:17:54.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:17:54.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.709 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.710 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:17:54.710 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:17:54.710 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.0502864679999999, 2023-01-02T18:17:54.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:17:54.710 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:54.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:54.711 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:54.711 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:54.711 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:54.711 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:17:54.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.712 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:54.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:54.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:17:54.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:54.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:54.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:17:54.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:54.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:54.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:17:54.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:17:54.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:54.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:17:54.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:17:54.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:54.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:17:54.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:17:54.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:54.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:17:54.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:17:54.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:54.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:17:54.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:17:54.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:54.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:17:54.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:17:54.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:54.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:17:54.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:17:54.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:54.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:17:54.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:17:54.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:54.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:17:54.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:17:54.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:54.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:17:54.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:17:54.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:54.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:54.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:54.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:17:54.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:17:54.724 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.725 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:54.725 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:54.725 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:54.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:54.733 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:17:54.736 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:54.726+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:54.743 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:17:54.743 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2023-01-02T18:17:54.544847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":16779506,"num_objects":147,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":147,"num_whiteouts":0,"num_read":9712,"num_read_kb":8519,"num_write":888,"num_write_kb":17034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":1369,"num_keys_recovered":670,"num_objects_omap":53,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1044,"ondisk_log_size":1044,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":112156,"kb_used_data":42468,"kb_used_omap":0,"kb_used_meta":69632,"kb_avail":660490724,"statfs":{"total":676457349120,"available":676342501376,"internally_reserved":0,"allocated":43487232,"data_stored":38126081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":71303168},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":7,"num_write_kb":5122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000882"},"pg_stats":[{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.708234+0000","last_change":"2023-01-02T18:17:52.708234+0000","last_active":"2023-01-02T18:17:52.708234+0000","last_peered":"2023-01-02T18:17:52.708234+0000","last_clean":"2023-01-02T18:17:52.708234+0000","last_became_active":"2023-01-02T18:17:52.707885+0000","last_became_peered":"2023-01-02T18:17:52.707885+0000","last_unstale":"2023-01-02T18:17:52.708234+0000","last_undegraded":"2023-01-02T18:17:52.708234+0000","last_fullsized":"2023-01-02T18:17:52.708234+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702289+0000","last_change":"2023-01-02T18:17:34.327371+0000","last_active":"2023-01-02T18:17:51.702289+0000","last_peered":"2023-01-02T18:17:51.702289+0000","last_clean":"2023-01-02T18:17:51.702289+0000","last_became_active":"2023-01-02T18:17:32.345158+0000","last_became_peered":"2023-01-02T18:17:32.345158+0000","last_unstale":"2023-01-02T18:17:51.702289+0000","last_undegraded":"2023-01-02T18:17:51.702289+0000","last_fullsized":"2023-01-02T18:17:51.702289+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":53,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697946+0000","last_change":"2023-01-02T18:17:09.324265+0000","last_active":"2023-01-02T18:17:51.697946+0000","last_peered":"2023-01-02T18:17:51.697946+0000","last_clean":"2023-01-02T18:17:51.697946+0000","last_became_active":"2023-01-02T18:17:07.348058+0000","last_became_peered":"2023-01-02T18:17:07.348058+0000","last_unstale":"2023-01-02T18:17:51.697946+0000","last_undegraded":"2023-01-02T18:17:51.697946+0000","last_fullsized":"2023-01-02T18:17:51.697946+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":64,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703966+0000","last_change":"2023-01-02T18:17:01.320137+0000","last_active":"2023-01-02T18:17:52.703966+0000","last_peered":"2023-01-02T18:17:52.703966+0000","last_clean":"2023-01-02T18:17:52.703966+0000","last_became_active":"2023-01-02T18:16:59.324809+0000","last_became_peered":"2023-01-02T18:16:59.324809+0000","last_unstale":"2023-01-02T18:17:52.703966+0000","last_undegraded":"2023-01-02T18:17:52.703966+0000","last_fullsized":"2023-01-02T18:17:52.703966+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700648+0000","last_change":"2023-01-02T18:16:48.330409+0000","last_active":"2023-01-02T18:17:51.700648+0000","last_peered":"2023-01-02T18:17:51.700648+0000","last_clean":"2023-01-02T18:17:51.700648+0000","last_became_active":"2023-01-02T18:16:48.329903+0000","last_became_peered":"2023-01-02T18:16:48.329903+0000","last_unstale":"2023-01-02T18:17:51.700648+0000","last_undegraded":"2023-01-02T18:17:51.700648+0000","last_fullsized":"2023-01-02T18:17:51.700648+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":142,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701775+0000","last_change":"2023-01-02T18:17:30.328135+0000","last_active":"2023-01-02T18:17:52.701775+0000","last_peered":"2023-01-02T18:17:52.701775+0000","last_clean":"2023-01-02T18:17:52.701775+0000","last_became_active":"2023-01-02T18:17:29.335258+0000","last_became_peered":"2023-01-02T18:17:29.335258+0000","last_unstale":"2023-01-02T18:17:52.701775+0000","last_undegraded":"2023-01-02T18:17:52.701775+0000","last_fullsized":"2023-01-02T18:17:52.701775+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776840+0000","last_change":"2023-01-02T18:17:29.327043+0000","last_active":"2023-01-02T18:17:52.776840+0000","last_peered":"2023-01-02T18:17:52.776840+0000","last_clean":"2023-01-02T18:17:52.776840+0000","last_became_active":"2023-01-02T18:17:29.326459+0000","last_became_peered":"2023-01-02T18:17:29.326459+0000","last_unstale":"2023-01-02T18:17:52.776840+0000","last_undegraded":"2023-01-02T18:17:52.776840+0000","last_fullsized":"2023-01-02T18:17:52.776840+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":38,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777159+0000","last_change":"2023-01-02T18:17:29.370303+0000","last_active":"2023-01-02T18:17:52.777159+0000","last_peered":"2023-01-02T18:17:52.777159+0000","last_clean":"2023-01-02T18:17:52.777159+0000","last_became_active":"2023-01-02T18:17:29.329505+0000","last_became_peered":"2023-01-02T18:17:29.329505+0000","last_unstale":"2023-01-02T18:17:52.777159+0000","last_undegraded":"2023-01-02T18:17:52.777159+0000","last_fullsized":"2023-01-02T18:17:52.777159+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":76,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":166,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701757+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:17:52.701757+0000","last_peered":"2023-01-02T18:17:52.701757+0000","last_clean":"2023-01-02T18:17:52.701757+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:17:52.701757+0000","last_undegraded":"2023-01-02T18:17:52.701757+0000","last_fullsized":"2023-01-02T18:17:52.701757+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":27,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777513+0000","last_change":"2023-01-02T18:17:38.446984+0000","last_active":"2023-01-02T18:17:52.777513+0000","last_peered":"2023-01-02T18:17:52.777513+0000","last_clean":"2023-01-02T18:17:52.777513+0000","last_became_active":"2023-01-02T18:17:36.442630+0000","last_became_peered":"2023-01-02T18:17:36.442630+0000","last_unstale":"2023-01-02T18:17:52.777513+0000","last_undegraded":"2023-01-02T18:17:52.777513+0000","last_fullsized":"2023-01-02T18:17:52.777513+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"101'15","reported_seq":100,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878521+0000","last_change":"2023-01-02T18:17:34.347463+0000","last_active":"2023-01-02T18:17:51.878521+0000","last_peered":"2023-01-02T18:17:51.878521+0000","last_clean":"2023-01-02T18:17:51.878521+0000","last_became_active":"2023-01-02T18:17:32.344665+0000","last_became_peered":"2023-01-02T18:17:32.344665+0000","last_unstale":"2023-01-02T18:17:51.878521+0000","last_undegraded":"2023-01-02T18:17:51.878521+0000","last_fullsized":"2023-01-02T18:17:51.878521+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691592+0000","last_change":"2023-01-02T18:17:09.308994+0000","last_active":"2023-01-02T18:17:51.691592+0000","last_peered":"2023-01-02T18:17:51.691592+0000","last_clean":"2023-01-02T18:17:51.691592+0000","last_became_active":"2023-01-02T18:17:07.339263+0000","last_became_peered":"2023-01-02T18:17:07.339263+0000","last_unstale":"2023-01-02T18:17:51.691592+0000","last_undegraded":"2023-01-02T18:17:51.691592+0000","last_fullsized":"2023-01-02T18:17:51.691592+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"72'22","reported_seq":283,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697716+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:17:51.697716+0000","last_peered":"2023-01-02T18:17:51.697716+0000","last_clean":"2023-01-02T18:17:51.697716+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:17:51.697716+0000","last_undegraded":"2023-01-02T18:17:51.697716+0000","last_fullsized":"2023-01-02T18:17:51.697716+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":276,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878579+0000","last_change":"2023-01-02T18:16:44.306676+0000","last_active":"2023-01-02T18:17:51.878579+0000","last_peered":"2023-01-02T18:17:51.878579+0000","last_clean":"2023-01-02T18:17:51.878579+0000","last_became_active":"2023-01-02T18:16:41.446794+0000","last_became_peered":"2023-01-02T18:16:41.446794+0000","last_unstale":"2023-01-02T18:17:51.878579+0000","last_undegraded":"2023-01-02T18:17:51.878579+0000","last_fullsized":"2023-01-02T18:17:51.878579+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"92'24","reported_seq":229,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878409+0000","last_change":"2023-01-02T18:17:30.435534+0000","last_active":"2023-01-02T18:17:51.878409+0000","last_peered":"2023-01-02T18:17:51.878409+0000","last_clean":"2023-01-02T18:17:51.878409+0000","last_became_active":"2023-01-02T18:16:37.427175+0000","last_became_peered":"2023-01-02T18:16:37.427175+0000","last_unstale":"2023-01-02T18:17:51.878409+0000","last_undegraded":"2023-01-02T18:17:51.878409+0000","last_fullsized":"2023-01-02T18:17:51.878409+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":270,"num_read_kb":225,"num_write":35,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":77,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700885+0000","last_change":"2023-01-02T18:16:49.318455+0000","last_active":"2023-01-02T18:17:51.700885+0000","last_peered":"2023-01-02T18:17:51.700885+0000","last_clean":"2023-01-02T18:17:51.700885+0000","last_became_active":"2023-01-02T18:16:48.329597+0000","last_became_peered":"2023-01-02T18:16:48.329597+0000","last_unstale":"2023-01-02T18:17:51.700885+0000","last_undegraded":"2023-01-02T18:17:51.700885+0000","last_fullsized":"2023-01-02T18:17:51.700885+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878574+0000","last_change":"2023-01-02T18:16:53.344973+0000","last_active":"2023-01-02T18:17:51.878574+0000","last_peered":"2023-01-02T18:17:51.878574+0000","last_clean":"2023-01-02T18:17:51.878574+0000","last_became_active":"2023-01-02T18:16:51.341196+0000","last_became_peered":"2023-01-02T18:16:51.341196+0000","last_unstale":"2023-01-02T18:17:51.878574+0000","last_undegraded":"2023-01-02T18:17:51.878574+0000","last_fullsized":"2023-01-02T18:17:51.878574+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":159,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701083+0000","last_change":"2023-01-02T18:17:29.345837+0000","last_active":"2023-01-02T18:17:51.701083+0000","last_peered":"2023-01-02T18:17:51.701083+0000","last_clean":"2023-01-02T18:17:51.701083+0000","last_became_active":"2023-01-02T18:17:29.339458+0000","last_became_peered":"2023-01-02T18:17:29.339458+0000","last_unstale":"2023-01-02T18:17:51.701083+0000","last_undegraded":"2023-01-02T18:17:51.701083+0000","last_fullsized":"2023-01-02T18:17:51.701083+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.15","version":"116'4","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:53.440370+0000","last_change":"2023-01-02T18:17:38.542677+0000","last_active":"2023-01-02T18:17:53.440370+0000","last_peered":"2023-01-02T18:17:53.440370+0000","last_clean":"2023-01-02T18:17:53.440370+0000","last_became_active":"2023-01-02T18:17:36.441682+0000","last_became_peered":"2023-01-02T18:17:36.441682+0000","last_unstale":"2023-01-02T18:17:53.440370+0000","last_undegraded":"2023-01-02T18:17:53.440370+0000","last_fullsized":"2023-01-02T18:17:53.440370+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691671+0000","last_change":"2023-01-02T18:17:34.333930+0000","last_active":"2023-01-02T18:17:51.691671+0000","last_peered":"2023-01-02T18:17:51.691671+0000","last_clean":"2023-01-02T18:17:51.691671+0000","last_became_active":"2023-01-02T18:17:32.340028+0000","last_became_peered":"2023-01-02T18:17:32.340028+0000","last_unstale":"2023-01-02T18:17:51.691671+0000","last_undegraded":"2023-01-02T18:17:51.691671+0000","last_fullsized":"2023-01-02T18:17:51.691671+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"76'1","reported_seq":56,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697606+0000","last_change":"2023-01-02T18:17:09.324016+0000","last_active":"2023-01-02T18:17:51.697606+0000","last_peered":"2023-01-02T18:17:51.697606+0000","last_clean":"2023-01-02T18:17:51.697606+0000","last_became_active":"2023-01-02T18:17:07.347854+0000","last_became_peered":"2023-01-02T18:17:07.347854+0000","last_unstale":"2023-01-02T18:17:51.697606+0000","last_undegraded":"2023-01-02T18:17:51.697606+0000","last_fullsized":"2023-01-02T18:17:51.697606+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"72'4","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878359+0000","last_change":"2023-01-02T18:17:01.311706+0000","last_active":"2023-01-02T18:17:51.878359+0000","last_peered":"2023-01-02T18:17:51.878359+0000","last_clean":"2023-01-02T18:17:51.878359+0000","last_became_active":"2023-01-02T18:16:59.313908+0000","last_became_peered":"2023-01-02T18:16:59.313908+0000","last_unstale":"2023-01-02T18:17:51.878359+0000","last_undegraded":"2023-01-02T18:17:51.878359+0000","last_fullsized":"2023-01-02T18:17:51.878359+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"51'2","reported_seq":89,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877910+0000","last_change":"2023-01-02T18:16:48.343757+0000","last_active":"2023-01-02T18:17:51.877910+0000","last_peered":"2023-01-02T18:17:51.877910+0000","last_clean":"2023-01-02T18:17:51.877910+0000","last_became_active":"2023-01-02T18:16:48.326121+0000","last_became_peered":"2023-01-02T18:16:48.326121+0000","last_unstale":"2023-01-02T18:17:51.877910+0000","last_undegraded":"2023-01-02T18:17:51.877910+0000","last_fullsized":"2023-01-02T18:17:51.877910+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"86'2","reported_seq":46,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777687+0000","last_change":"2023-01-02T18:17:30.331220+0000","last_active":"2023-01-02T18:17:52.777687+0000","last_peered":"2023-01-02T18:17:52.777687+0000","last_clean":"2023-01-02T18:17:52.777687+0000","last_became_active":"2023-01-02T18:17:29.331135+0000","last_became_peered":"2023-01-02T18:17:29.331135+0000","last_unstale":"2023-01-02T18:17:52.777687+0000","last_undegraded":"2023-01-02T18:17:52.777687+0000","last_fullsized":"2023-01-02T18:17:52.777687+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":86,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"56'1","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777226+0000","last_change":"2023-01-02T18:17:29.356376+0000","last_active":"2023-01-02T18:17:52.777226+0000","last_peered":"2023-01-02T18:17:52.777226+0000","last_clean":"2023-01-02T18:17:52.777226+0000","last_became_active":"2023-01-02T18:17:29.327003+0000","last_became_peered":"2023-01-02T18:17:29.327003+0000","last_unstale":"2023-01-02T18:17:52.777226+0000","last_undegraded":"2023-01-02T18:17:52.777226+0000","last_fullsized":"2023-01-02T18:17:52.777226+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":72,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701284+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:17:52.701284+0000","last_peered":"2023-01-02T18:17:52.701284+0000","last_clean":"2023-01-02T18:17:52.701284+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:17:52.701284+0000","last_undegraded":"2023-01-02T18:17:52.701284+0000","last_fullsized":"2023-01-02T18:17:52.701284+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701243+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:17:51.701243+0000","last_peered":"2023-01-02T18:17:51.701243+0000","last_clean":"2023-01-02T18:17:51.701243+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:17:51.701243+0000","last_undegraded":"2023-01-02T18:17:51.701243+0000","last_fullsized":"2023-01-02T18:17:51.701243+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"109'4","reported_seq":30,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701276+0000","last_change":"2023-01-02T18:17:38.459353+0000","last_active":"2023-01-02T18:17:51.701276+0000","last_peered":"2023-01-02T18:17:51.701276+0000","last_clean":"2023-01-02T18:17:51.701276+0000","last_became_active":"2023-01-02T18:17:36.439601+0000","last_became_peered":"2023-01-02T18:17:36.439601+0000","last_unstale":"2023-01-02T18:17:51.701276+0000","last_undegraded":"2023-01-02T18:17:51.701276+0000","last_fullsized":"2023-01-02T18:17:51.701276+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"101'8","reported_seq":53,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877973+0000","last_change":"2023-01-02T18:17:34.347450+0000","last_active":"2023-01-02T18:17:51.877973+0000","last_peered":"2023-01-02T18:17:51.877973+0000","last_clean":"2023-01-02T18:17:51.877973+0000","last_became_active":"2023-01-02T18:17:32.337265+0000","last_became_peered":"2023-01-02T18:17:32.337265+0000","last_unstale":"2023-01-02T18:17:51.877973+0000","last_undegraded":"2023-01-02T18:17:51.877973+0000","last_fullsized":"2023-01-02T18:17:51.877973+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"76'1","reported_seq":60,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.693110+0000","last_change":"2023-01-02T18:17:09.308912+0000","last_active":"2023-01-02T18:17:51.693110+0000","last_peered":"2023-01-02T18:17:51.693110+0000","last_clean":"2023-01-02T18:17:51.693110+0000","last_became_active":"2023-01-02T18:17:07.339397+0000","last_became_peered":"2023-01-02T18:17:07.339397+0000","last_unstale":"2023-01-02T18:17:51.693110+0000","last_undegraded":"2023-01-02T18:17:51.693110+0000","last_fullsized":"2023-01-02T18:17:51.693110+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":61,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697707+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:17:51.697707+0000","last_peered":"2023-01-02T18:17:51.697707+0000","last_clean":"2023-01-02T18:17:51.697707+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:17:51.697707+0000","last_undegraded":"2023-01-02T18:17:51.697707+0000","last_fullsized":"2023-01-02T18:17:51.697707+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878702+0000","last_change":"2023-01-02T18:16:48.330072+0000","last_active":"2023-01-02T18:17:51.878702+0000","last_peered":"2023-01-02T18:17:51.878702+0000","last_clean":"2023-01-02T18:17:51.878702+0000","last_became_active":"2023-01-02T18:16:48.329697+0000","last_became_peered":"2023-01-02T18:16:48.329697+0000","last_unstale":"2023-01-02T18:17:51.878702+0000","last_undegraded":"2023-01-02T18:17:51.878702+0000","last_fullsized":"2023-01-02T18:17:51.878702+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1c","version":"97'33","reported_seq":52,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777898+0000","last_change":"2023-01-02T18:17:30.331571+0000","last_active":"2023-01-02T18:17:52.777898+0000","last_peered":"2023-01-02T18:17:52.777898+0000","last_clean":"2023-01-02T18:17:52.777898+0000","last_became_active":"2023-01-02T18:17:29.326006+0000","last_became_peered":"2023-01-02T18:17:29.326006+0000","last_unstale":"2023-01-02T18:17:52.777898+0000","last_undegraded":"2023-01-02T18:17:52.777898+0000","last_fullsized":"2023-01-02T18:17:52.777898+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":33,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":86,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":73,"num_read_kb":58,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":137,"num_keys_recovered":70,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"56'2","reported_seq":90,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696353+0000","last_change":"2023-01-02T18:16:49.305216+0000","last_active":"2023-01-02T18:17:51.696353+0000","last_peered":"2023-01-02T18:17:51.696353+0000","last_clean":"2023-01-02T18:17:51.696353+0000","last_became_active":"2023-01-02T18:16:48.327069+0000","last_became_peered":"2023-01-02T18:16:48.327069+0000","last_unstale":"2023-01-02T18:17:51.696353+0000","last_undegraded":"2023-01-02T18:17:51.696353+0000","last_fullsized":"2023-01-02T18:17:51.696353+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776918+0000","last_change":"2023-01-02T18:17:29.326893+0000","last_active":"2023-01-02T18:17:52.776918+0000","last_peered":"2023-01-02T18:17:52.776918+0000","last_clean":"2023-01-02T18:17:52.776918+0000","last_became_active":"2023-01-02T18:17:29.326037+0000","last_became_peered":"2023-01-02T18:17:29.326037+0000","last_unstale":"2023-01-02T18:17:52.776918+0000","last_undegraded":"2023-01-02T18:17:52.776918+0000","last_fullsized":"2023-01-02T18:17:52.776918+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":585,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700933+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:17:51.700933+0000","last_peered":"2023-01-02T18:17:51.700933+0000","last_clean":"2023-01-02T18:17:51.700933+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:17:51.700933+0000","last_undegraded":"2023-01-02T18:17:51.700933+0000","last_fullsized":"2023-01-02T18:17:51.700933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":27,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777319+0000","last_change":"2023-01-02T18:17:38.445785+0000","last_active":"2023-01-02T18:17:52.777319+0000","last_peered":"2023-01-02T18:17:52.777319+0000","last_clean":"2023-01-02T18:17:52.777319+0000","last_became_active":"2023-01-02T18:17:36.435481+0000","last_became_peered":"2023-01-02T18:17:36.435481+0000","last_unstale":"2023-01-02T18:17:52.777319+0000","last_undegraded":"2023-01-02T18:17:52.777319+0000","last_fullsized":"2023-01-02T18:17:52.777319+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701309+0000","last_change":"2023-01-02T18:17:34.326763+0000","last_active":"2023-01-02T18:17:51.701309+0000","last_peered":"2023-01-02T18:17:51.701309+0000","last_clean":"2023-01-02T18:17:51.701309+0000","last_became_active":"2023-01-02T18:17:32.347186+0000","last_became_peered":"2023-01-02T18:17:32.347186+0000","last_unstale":"2023-01-02T18:17:51.701309+0000","last_undegraded":"2023-01-02T18:17:51.701309+0000","last_fullsized":"2023-01-02T18:17:51.701309+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"76'79","reported_seq":575,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696733+0000","last_change":"2023-01-02T18:17:09.321800+0000","last_active":"2023-01-02T18:17:51.696733+0000","last_peered":"2023-01-02T18:17:51.696733+0000","last_clean":"2023-01-02T18:17:51.696733+0000","last_became_active":"2023-01-02T18:17:07.340907+0000","last_became_peered":"2023-01-02T18:17:07.340907+0000","last_unstale":"2023-01-02T18:17:51.696733+0000","last_undegraded":"2023-01-02T18:17:51.696733+0000","last_fullsized":"2023-01-02T18:17:51.696733+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1144,"num_read_kb":1037,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"72'17","reported_seq":200,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696697+0000","last_change":"2023-01-02T18:17:29.368980+0000","last_active":"2023-01-02T18:17:51.696697+0000","last_peered":"2023-01-02T18:17:51.696697+0000","last_clean":"2023-01-02T18:17:51.696697+0000","last_became_active":"2023-01-02T18:17:29.341397+0000","last_became_peered":"2023-01-02T18:17:29.341397+0000","last_unstale":"2023-01-02T18:17:51.696697+0000","last_undegraded":"2023-01-02T18:17:51.696697+0000","last_fullsized":"2023-01-02T18:17:51.696697+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702547+0000","last_change":"2023-01-02T18:16:57.307585+0000","last_active":"2023-01-02T18:17:51.702547+0000","last_peered":"2023-01-02T18:17:51.702547+0000","last_clean":"2023-01-02T18:17:51.702547+0000","last_became_active":"2023-01-02T18:16:55.315726+0000","last_became_peered":"2023-01-02T18:16:55.315726+0000","last_unstale":"2023-01-02T18:17:51.702547+0000","last_undegraded":"2023-01-02T18:17:51.702547+0000","last_fullsized":"2023-01-02T18:17:51.702547+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":95,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.706243+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:17:51.706243+0000","last_peered":"2023-01-02T18:17:51.706243+0000","last_clean":"2023-01-02T18:17:51.706243+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:17:51.706243+0000","last_undegraded":"2023-01-02T18:17:51.706243+0000","last_fullsized":"2023-01-02T18:17:51.706243+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":142,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.705552+0000","last_change":"2023-01-02T18:17:30.328445+0000","last_active":"2023-01-02T18:17:52.705552+0000","last_peered":"2023-01-02T18:17:52.705552+0000","last_clean":"2023-01-02T18:17:52.705552+0000","last_became_active":"2023-01-02T18:16:48.331845+0000","last_became_peered":"2023-01-02T18:16:48.331845+0000","last_unstale":"2023-01-02T18:17:52.705552+0000","last_undegraded":"2023-01-02T18:17:52.705552+0000","last_fullsized":"2023-01-02T18:17:52.705552+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":76,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703563+0000","last_change":"2023-01-02T18:16:49.324534+0000","last_active":"2023-01-02T18:17:52.703563+0000","last_peered":"2023-01-02T18:17:52.703563+0000","last_clean":"2023-01-02T18:17:52.703563+0000","last_became_active":"2023-01-02T18:16:48.327014+0000","last_became_peered":"2023-01-02T18:16:48.327014+0000","last_unstale":"2023-01-02T18:17:52.703563+0000","last_undegraded":"2023-01-02T18:17:52.703563+0000","last_fullsized":"2023-01-02T18:17:52.703563+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702569+0000","last_change":"2023-01-02T18:17:29.338016+0000","last_active":"2023-01-02T18:17:51.702569+0000","last_peered":"2023-01-02T18:17:51.702569+0000","last_clean":"2023-01-02T18:17:51.702569+0000","last_became_active":"2023-01-02T18:17:29.337654+0000","last_became_peered":"2023-01-02T18:17:29.337654+0000","last_unstale":"2023-01-02T18:17:51.702569+0000","last_undegraded":"2023-01-02T18:17:51.702569+0000","last_fullsized":"2023-01-02T18:17:51.702569+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.693366+0000","last_change":"2023-01-02T18:17:38.469074+0000","last_active":"2023-01-02T18:17:51.693366+0000","last_peered":"2023-01-02T18:17:51.693366+0000","last_clean":"2023-01-02T18:17:51.693366+0000","last_became_active":"2023-01-02T18:17:36.439327+0000","last_became_peered":"2023-01-02T18:17:36.439327+0000","last_unstale":"2023-01-02T18:17:51.693366+0000","last_undegraded":"2023-01-02T18:17:51.693366+0000","last_fullsized":"2023-01-02T18:17:51.693366+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702597+0000","last_change":"2023-01-02T18:17:34.327801+0000","last_active":"2023-01-02T18:17:51.702597+0000","last_peered":"2023-01-02T18:17:51.702597+0000","last_clean":"2023-01-02T18:17:51.702597+0000","last_became_active":"2023-01-02T18:17:32.346998+0000","last_became_peered":"2023-01-02T18:17:32.346998+0000","last_unstale":"2023-01-02T18:17:51.702597+0000","last_undegraded":"2023-01-02T18:17:51.702597+0000","last_fullsized":"2023-01-02T18:17:51.702597+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878094+0000","last_change":"2023-01-02T18:17:09.310675+0000","last_active":"2023-01-02T18:17:51.878094+0000","last_peered":"2023-01-02T18:17:51.878094+0000","last_clean":"2023-01-02T18:17:51.878094+0000","last_became_active":"2023-01-02T18:17:07.345963+0000","last_became_peered":"2023-01-02T18:17:07.345963+0000","last_unstale":"2023-01-02T18:17:51.878094+0000","last_undegraded":"2023-01-02T18:17:51.878094+0000","last_fullsized":"2023-01-02T18:17:51.878094+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777868+0000","last_change":"2023-01-02T18:17:29.335050+0000","last_active":"2023-01-02T18:17:52.777868+0000","last_peered":"2023-01-02T18:17:52.777868+0000","last_clean":"2023-01-02T18:17:52.777868+0000","last_became_active":"2023-01-02T18:17:29.333986+0000","last_became_peered":"2023-01-02T18:17:29.333986+0000","last_unstale":"2023-01-02T18:17:52.777868+0000","last_undegraded":"2023-01-02T18:17:52.777868+0000","last_fullsized":"2023-01-02T18:17:52.777868+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878153+0000","last_change":"2023-01-02T18:16:49.309259+0000","last_active":"2023-01-02T18:17:51.878153+0000","last_peered":"2023-01-02T18:17:51.878153+0000","last_clean":"2023-01-02T18:17:51.878153+0000","last_became_active":"2023-01-02T18:16:46.313760+0000","last_became_peered":"2023-01-02T18:16:46.313760+0000","last_unstale":"2023-01-02T18:17:51.878153+0000","last_undegraded":"2023-01-02T18:17:51.878153+0000","last_fullsized":"2023-01-02T18:17:51.878153+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777006+0000","last_change":"2023-01-02T18:17:29.372464+0000","last_active":"2023-01-02T18:17:52.777006+0000","last_peered":"2023-01-02T18:17:52.777006+0000","last_clean":"2023-01-02T18:17:52.777006+0000","last_became_active":"2023-01-02T18:17:29.332091+0000","last_became_peered":"2023-01-02T18:17:29.332091+0000","last_unstale":"2023-01-02T18:17:52.777006+0000","last_undegraded":"2023-01-02T18:17:52.777006+0000","last_fullsized":"2023-01-02T18:17:52.777006+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":137,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.704591+0000","last_change":"2023-01-02T18:17:30.328637+0000","last_active":"2023-01-02T18:17:52.704591+0000","last_peered":"2023-01-02T18:17:52.704591+0000","last_clean":"2023-01-02T18:17:52.704591+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:17:52.704591+0000","last_undegraded":"2023-01-02T18:17:52.704591+0000","last_fullsized":"2023-01-02T18:17:52.704591+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":121,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.712767+0000","last_change":"2023-01-02T18:17:52.712767+0000","last_active":"2023-01-02T18:17:52.712767+0000","last_peered":"2023-01-02T18:17:52.712767+0000","last_clean":"2023-01-02T18:17:52.712767+0000","last_became_active":"2023-01-02T18:17:52.712430+0000","last_became_peered":"2023-01-02T18:17:52.712430+0000","last_unstale":"2023-01-02T18:17:52.712767+0000","last_undegraded":"2023-01-02T18:17:52.712767+0000","last_fullsized":"2023-01-02T18:17:52.712767+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696934+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:17:51.696934+0000","last_peered":"2023-01-02T18:17:51.696934+0000","last_clean":"2023-01-02T18:17:51.696934+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:17:51.696934+0000","last_undegraded":"2023-01-02T18:17:51.696934+0000","last_fullsized":"2023-01-02T18:17:51.696934+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878146+0000","last_change":"2023-01-02T18:16:57.312949+0000","last_active":"2023-01-02T18:17:51.878146+0000","last_peered":"2023-01-02T18:17:51.878146+0000","last_clean":"2023-01-02T18:17:51.878146+0000","last_became_active":"2023-01-02T18:16:55.315334+0000","last_became_peered":"2023-01-02T18:16:55.315334+0000","last_unstale":"2023-01-02T18:17:51.878146+0000","last_undegraded":"2023-01-02T18:17:51.878146+0000","last_fullsized":"2023-01-02T18:17:51.878146+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":24,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697765+0000","last_change":"2023-01-02T18:17:38.465060+0000","last_active":"2023-01-02T18:17:51.697765+0000","last_peered":"2023-01-02T18:17:51.697765+0000","last_clean":"2023-01-02T18:17:51.697765+0000","last_became_active":"2023-01-02T18:17:36.442117+0000","last_became_peered":"2023-01-02T18:17:36.442117+0000","last_unstale":"2023-01-02T18:17:51.697765+0000","last_undegraded":"2023-01-02T18:17:51.697765+0000","last_fullsized":"2023-01-02T18:17:51.697765+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"101'15","reported_seq":100,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702481+0000","last_change":"2023-01-02T18:17:34.328115+0000","last_active":"2023-01-02T18:17:51.702481+0000","last_peered":"2023-01-02T18:17:51.702481+0000","last_clean":"2023-01-02T18:17:51.702481+0000","last_became_active":"2023-01-02T18:17:32.347252+0000","last_became_peered":"2023-01-02T18:17:32.347252+0000","last_unstale":"2023-01-02T18:17:51.702481+0000","last_undegraded":"2023-01-02T18:17:51.702481+0000","last_fullsized":"2023-01-02T18:17:51.702481+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697869+0000","last_change":"2023-01-02T18:17:48.662784+0000","last_active":"2023-01-02T18:17:51.697869+0000","last_peered":"2023-01-02T18:17:51.697869+0000","last_clean":"2023-01-02T18:17:51.697869+0000","last_became_active":"2023-01-02T18:17:48.662397+0000","last_became_peered":"2023-01-02T18:17:48.662397+0000","last_unstale":"2023-01-02T18:17:51.697869+0000","last_undegraded":"2023-01-02T18:17:51.697869+0000","last_fullsized":"2023-01-02T18:17:51.697869+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":64,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703897+0000","last_change":"2023-01-02T18:17:01.319510+0000","last_active":"2023-01-02T18:17:52.703897+0000","last_peered":"2023-01-02T18:17:52.703897+0000","last_clean":"2023-01-02T18:17:52.703897+0000","last_became_active":"2023-01-02T18:16:59.327716+0000","last_became_peered":"2023-01-02T18:16:59.327716+0000","last_unstale":"2023-01-02T18:17:52.703897+0000","last_undegraded":"2023-01-02T18:17:52.703897+0000","last_fullsized":"2023-01-02T18:17:52.703897+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":77,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878679+0000","last_change":"2023-01-02T18:16:49.310704+0000","last_active":"2023-01-02T18:17:51.878679+0000","last_peered":"2023-01-02T18:17:51.878679+0000","last_clean":"2023-01-02T18:17:51.878679+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:51.878679+0000","last_undegraded":"2023-01-02T18:17:51.878679+0000","last_fullsized":"2023-01-02T18:17:51.878679+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877791+0000","last_change":"2023-01-02T18:16:44.307480+0000","last_active":"2023-01-02T18:17:51.877791+0000","last_peered":"2023-01-02T18:17:51.877791+0000","last_clean":"2023-01-02T18:17:51.877791+0000","last_became_active":"2023-01-02T18:16:41.447912+0000","last_became_peered":"2023-01-02T18:16:41.447912+0000","last_unstale":"2023-01-02T18:17:51.877791+0000","last_undegraded":"2023-01-02T18:17:51.877791+0000","last_fullsized":"2023-01-02T18:17:51.877791+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":106,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.693580+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:17:51.693580+0000","last_peered":"2023-01-02T18:17:51.693580+0000","last_clean":"2023-01-02T18:17:51.693580+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:17:51.693580+0000","last_undegraded":"2023-01-02T18:17:51.693580+0000","last_fullsized":"2023-01-02T18:17:51.693580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"92'13","reported_seq":152,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878907+0000","last_change":"2023-01-02T18:17:30.435879+0000","last_active":"2023-01-02T18:17:51.878907+0000","last_peered":"2023-01-02T18:17:51.878907+0000","last_clean":"2023-01-02T18:17:51.878907+0000","last_became_active":"2023-01-02T18:16:37.431863+0000","last_became_peered":"2023-01-02T18:16:37.431863+0000","last_unstale":"2023-01-02T18:17:51.878907+0000","last_undegraded":"2023-01-02T18:17:51.878907+0000","last_fullsized":"2023-01-02T18:17:51.878907+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878097+0000","last_change":"2023-01-02T18:16:53.344851+0000","last_active":"2023-01-02T18:17:51.878097+0000","last_peered":"2023-01-02T18:17:51.878097+0000","last_clean":"2023-01-02T18:17:51.878097+0000","last_became_active":"2023-01-02T18:16:51.341804+0000","last_became_peered":"2023-01-02T18:16:51.341804+0000","last_unstale":"2023-01-02T18:17:51.878097+0000","last_undegraded":"2023-01-02T18:17:51.878097+0000","last_fullsized":"2023-01-02T18:17:51.878097+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878803+0000","last_change":"2023-01-02T18:16:57.313134+0000","last_active":"2023-01-02T18:17:51.878803+0000","last_peered":"2023-01-02T18:17:51.878803+0000","last_clean":"2023-01-02T18:17:51.878803+0000","last_became_active":"2023-01-02T18:16:55.311645+0000","last_became_peered":"2023-01-02T18:16:55.311645+0000","last_unstale":"2023-01-02T18:17:51.878803+0000","last_undegraded":"2023-01-02T18:17:51.878803+0000","last_fullsized":"2023-01-02T18:17:51.878803+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.692145+0000","last_change":"2023-01-02T18:17:38.469077+0000","last_active":"2023-01-02T18:17:51.692145+0000","last_peered":"2023-01-02T18:17:51.692145+0000","last_clean":"2023-01-02T18:17:51.692145+0000","last_became_active":"2023-01-02T18:17:36.436242+0000","last_became_peered":"2023-01-02T18:17:36.436242+0000","last_unstale":"2023-01-02T18:17:51.692145+0000","last_undegraded":"2023-01-02T18:17:51.692145+0000","last_fullsized":"2023-01-02T18:17:51.692145+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701967+0000","last_change":"2023-01-02T18:17:34.327358+0000","last_active":"2023-01-02T18:17:51.701967+0000","last_peered":"2023-01-02T18:17:51.701967+0000","last_clean":"2023-01-02T18:17:51.701967+0000","last_became_active":"2023-01-02T18:17:32.339808+0000","last_became_peered":"2023-01-02T18:17:32.339808+0000","last_unstale":"2023-01-02T18:17:51.701967+0000","last_undegraded":"2023-01-02T18:17:51.701967+0000","last_fullsized":"2023-01-02T18:17:51.701967+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":53,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697001+0000","last_change":"2023-01-02T18:17:09.323298+0000","last_active":"2023-01-02T18:17:51.697001+0000","last_peered":"2023-01-02T18:17:51.697001+0000","last_clean":"2023-01-02T18:17:51.697001+0000","last_became_active":"2023-01-02T18:17:07.342742+0000","last_became_peered":"2023-01-02T18:17:07.342742+0000","last_unstale":"2023-01-02T18:17:51.697001+0000","last_undegraded":"2023-01-02T18:17:51.697001+0000","last_fullsized":"2023-01-02T18:17:51.697001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":66,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878699+0000","last_change":"2023-01-02T18:17:01.310492+0000","last_active":"2023-01-02T18:17:51.878699+0000","last_peered":"2023-01-02T18:17:51.878699+0000","last_clean":"2023-01-02T18:17:51.878699+0000","last_became_active":"2023-01-02T18:16:59.313793+0000","last_became_peered":"2023-01-02T18:16:59.313793+0000","last_unstale":"2023-01-02T18:17:51.878699+0000","last_undegraded":"2023-01-02T18:17:51.878699+0000","last_fullsized":"2023-01-02T18:17:51.878699+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"56'1","reported_seq":77,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701398+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:17:51.701398+0000","last_peered":"2023-01-02T18:17:51.701398+0000","last_clean":"2023-01-02T18:17:51.701398+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:17:51.701398+0000","last_undegraded":"2023-01-02T18:17:51.701398+0000","last_fullsized":"2023-01-02T18:17:51.701398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":36,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777364+0000","last_change":"2023-01-02T18:17:29.344997+0000","last_active":"2023-01-02T18:17:52.777364+0000","last_peered":"2023-01-02T18:17:52.777364+0000","last_clean":"2023-01-02T18:17:52.777364+0000","last_became_active":"2023-01-02T18:17:29.323459+0000","last_became_peered":"2023-01-02T18:17:29.323459+0000","last_unstale":"2023-01-02T18:17:52.777364+0000","last_undegraded":"2023-01-02T18:17:52.777364+0000","last_fullsized":"2023-01-02T18:17:52.777364+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":81,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.4","version":"46'2","reported_seq":132,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.692230+0000","last_change":"2023-01-02T18:17:30.330076+0000","last_active":"2023-01-02T18:17:51.692230+0000","last_peered":"2023-01-02T18:17:51.692230+0000","last_clean":"2023-01-02T18:17:51.692230+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:17:51.692230+0000","last_undegraded":"2023-01-02T18:17:51.692230+0000","last_fullsized":"2023-01-02T18:17:51.692230+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":104,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697268+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:17:51.697268+0000","last_peered":"2023-01-02T18:17:51.697268+0000","last_clean":"2023-01-02T18:17:51.697268+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:17:51.697268+0000","last_undegraded":"2023-01-02T18:17:51.697268+0000","last_fullsized":"2023-01-02T18:17:51.697268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701158+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:17:51.701158+0000","last_peered":"2023-01-02T18:17:51.701158+0000","last_clean":"2023-01-02T18:17:51.701158+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:17:51.701158+0000","last_undegraded":"2023-01-02T18:17:51.701158+0000","last_fullsized":"2023-01-02T18:17:51.701158+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776839+0000","last_change":"2023-01-02T18:17:29.326283+0000","last_active":"2023-01-02T18:17:52.776839+0000","last_peered":"2023-01-02T18:17:52.776839+0000","last_clean":"2023-01-02T18:17:52.776839+0000","last_became_active":"2023-01-02T18:17:29.325965+0000","last_became_peered":"2023-01-02T18:17:29.325965+0000","last_unstale":"2023-01-02T18:17:52.776839+0000","last_undegraded":"2023-01-02T18:17:52.776839+0000","last_fullsized":"2023-01-02T18:17:52.776839+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"106'4","reported_seq":30,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878766+0000","last_change":"2023-01-02T18:17:38.450921+0000","last_active":"2023-01-02T18:17:51.878766+0000","last_peered":"2023-01-02T18:17:51.878766+0000","last_clean":"2023-01-02T18:17:51.878766+0000","last_became_active":"2023-01-02T18:17:36.444808+0000","last_became_peered":"2023-01-02T18:17:36.444808+0000","last_unstale":"2023-01-02T18:17:51.878766+0000","last_undegraded":"2023-01-02T18:17:51.878766+0000","last_fullsized":"2023-01-02T18:17:51.878766+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":43,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701520+0000","last_change":"2023-01-02T18:17:34.316738+0000","last_active":"2023-01-02T18:17:52.701520+0000","last_peered":"2023-01-02T18:17:52.701520+0000","last_clean":"2023-01-02T18:17:52.701520+0000","last_became_active":"2023-01-02T18:17:32.340483+0000","last_became_peered":"2023-01-02T18:17:32.340483+0000","last_unstale":"2023-01-02T18:17:52.701520+0000","last_undegraded":"2023-01-02T18:17:52.701520+0000","last_fullsized":"2023-01-02T18:17:52.701520+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":56,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701667+0000","last_change":"2023-01-02T18:17:09.321395+0000","last_active":"2023-01-02T18:17:52.701667+0000","last_peered":"2023-01-02T18:17:52.701667+0000","last_clean":"2023-01-02T18:17:52.701667+0000","last_became_active":"2023-01-02T18:17:07.344789+0000","last_became_peered":"2023-01-02T18:17:07.344789+0000","last_unstale":"2023-01-02T18:17:52.701667+0000","last_undegraded":"2023-01-02T18:17:52.701667+0000","last_fullsized":"2023-01-02T18:17:52.701667+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"71'3","reported_seq":66,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691634+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:17:51.691634+0000","last_peered":"2023-01-02T18:17:51.691634+0000","last_clean":"2023-01-02T18:17:51.691634+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:17:51.691634+0000","last_undegraded":"2023-01-02T18:17:51.691634+0000","last_fullsized":"2023-01-02T18:17:51.691634+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"51'2","reported_seq":84,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.704609+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:17:52.704609+0000","last_peered":"2023-01-02T18:17:52.704609+0000","last_clean":"2023-01-02T18:17:52.704609+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:17:52.704609+0000","last_undegraded":"2023-01-02T18:17:52.704609+0000","last_fullsized":"2023-01-02T18:17:52.704609+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"94'15","reported_seq":200,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703874+0000","last_change":"2023-01-02T18:17:30.328344+0000","last_active":"2023-01-02T18:17:52.703874+0000","last_peered":"2023-01-02T18:17:52.703874+0000","last_clean":"2023-01-02T18:17:52.703874+0000","last_became_active":"2023-01-02T18:16:48.330867+0000","last_became_peered":"2023-01-02T18:16:48.330867+0000","last_unstale":"2023-01-02T18:17:52.703874+0000","last_undegraded":"2023-01-02T18:17:52.703874+0000","last_fullsized":"2023-01-02T18:17:52.703874+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":93,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":99,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878180+0000","last_change":"2023-01-02T18:16:06.413865+0000","last_active":"2023-01-02T18:17:51.878180+0000","last_peered":"2023-01-02T18:17:51.878180+0000","last_clean":"2023-01-02T18:17:51.878180+0000","last_became_active":"2023-01-02T18:16:06.413499+0000","last_became_peered":"2023-01-02T18:16:06.413499+0000","last_unstale":"2023-01-02T18:17:51.878180+0000","last_undegraded":"2023-01-02T18:17:51.878180+0000","last_fullsized":"2023-01-02T18:17:51.878180+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.778045+0000","last_change":"2023-01-02T18:17:29.326478+0000","last_active":"2023-01-02T18:17:52.778045+0000","last_peered":"2023-01-02T18:17:52.778045+0000","last_clean":"2023-01-02T18:17:52.778045+0000","last_became_active":"2023-01-02T18:17:29.325843+0000","last_became_peered":"2023-01-02T18:17:29.325843+0000","last_unstale":"2023-01-02T18:17:52.778045+0000","last_undegraded":"2023-01-02T18:17:52.778045+0000","last_fullsized":"2023-01-02T18:17:52.778045+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":79,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691870+0000","last_change":"2023-01-02T18:17:29.318734+0000","last_active":"2023-01-02T18:17:51.691870+0000","last_peered":"2023-01-02T18:17:51.691870+0000","last_clean":"2023-01-02T18:17:51.691870+0000","last_became_active":"2023-01-02T18:17:29.318419+0000","last_became_peered":"2023-01-02T18:17:29.318419+0000","last_unstale":"2023-01-02T18:17:51.691870+0000","last_undegraded":"2023-01-02T18:17:51.691870+0000","last_fullsized":"2023-01-02T18:17:51.691870+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":65,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697642+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:17:51.697642+0000","last_peered":"2023-01-02T18:17:51.697642+0000","last_clean":"2023-01-02T18:17:51.697642+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:17:51.697642+0000","last_undegraded":"2023-01-02T18:17:51.697642+0000","last_fullsized":"2023-01-02T18:17:51.697642+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877961+0000","last_change":"2023-01-02T18:17:38.450765+0000","last_active":"2023-01-02T18:17:51.877961+0000","last_peered":"2023-01-02T18:17:51.877961+0000","last_clean":"2023-01-02T18:17:51.877961+0000","last_became_active":"2023-01-02T18:17:36.444834+0000","last_became_peered":"2023-01-02T18:17:36.444834+0000","last_unstale":"2023-01-02T18:17:51.877961+0000","last_undegraded":"2023-01-02T18:17:51.877961+0000","last_fullsized":"2023-01-02T18:17:51.877961+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701179+0000","last_change":"2023-01-02T18:17:34.327117+0000","last_active":"2023-01-02T18:17:51.701179+0000","last_peered":"2023-01-02T18:17:51.701179+0000","last_clean":"2023-01-02T18:17:51.701179+0000","last_became_active":"2023-01-02T18:17:32.340616+0000","last_became_peered":"2023-01-02T18:17:32.340616+0000","last_unstale":"2023-01-02T18:17:51.701179+0000","last_undegraded":"2023-01-02T18:17:51.701179+0000","last_fullsized":"2023-01-02T18:17:51.701179+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877474+0000","last_change":"2023-01-02T18:17:50.682223+0000","last_active":"2023-01-02T18:17:51.877474+0000","last_peered":"2023-01-02T18:17:51.877474+0000","last_clean":"2023-01-02T18:17:51.877474+0000","last_became_active":"2023-01-02T18:17:50.681459+0000","last_became_peered":"2023-01-02T18:17:50.681459+0000","last_unstale":"2023-01-02T18:17:51.877474+0000","last_undegraded":"2023-01-02T18:17:51.877474+0000","last_fullsized":"2023-01-02T18:17:51.877474+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701004+0000","last_change":"2023-01-02T18:17:29.338386+0000","last_active":"2023-01-02T18:17:51.701004+0000","last_peered":"2023-01-02T18:17:51.701004+0000","last_clean":"2023-01-02T18:17:51.701004+0000","last_became_active":"2023-01-02T18:17:29.337596+0000","last_became_peered":"2023-01-02T18:17:29.337596+0000","last_unstale":"2023-01-02T18:17:51.701004+0000","last_undegraded":"2023-01-02T18:17:51.701004+0000","last_fullsized":"2023-01-02T18:17:51.701004+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697203+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:17:51.697203+0000","last_peered":"2023-01-02T18:17:51.697203+0000","last_clean":"2023-01-02T18:17:51.697203+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:17:51.697203+0000","last_undegraded":"2023-01-02T18:17:51.697203+0000","last_fullsized":"2023-01-02T18:17:51.697203+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":94,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702229+0000","last_change":"2023-01-02T18:16:48.345373+0000","last_active":"2023-01-02T18:17:51.702229+0000","last_peered":"2023-01-02T18:17:51.702229+0000","last_clean":"2023-01-02T18:17:51.702229+0000","last_became_active":"2023-01-02T18:16:48.328041+0000","last_became_peered":"2023-01-02T18:16:48.328041+0000","last_unstale":"2023-01-02T18:17:51.702229+0000","last_undegraded":"2023-01-02T18:17:51.702229+0000","last_fullsized":"2023-01-02T18:17:51.702229+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"96'9","reported_seq":179,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878010+0000","last_change":"2023-01-02T18:17:30.434525+0000","last_active":"2023-01-02T18:17:51.878010+0000","last_peered":"2023-01-02T18:17:51.878010+0000","last_clean":"2023-01-02T18:17:51.878010+0000","last_became_active":"2023-01-02T18:17:29.334562+0000","last_became_peered":"2023-01-02T18:17:29.334562+0000","last_unstale":"2023-01-02T18:17:51.878010+0000","last_undegraded":"2023-01-02T18:17:51.878010+0000","last_fullsized":"2023-01-02T18:17:51.878010+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":70,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":106,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696389+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:17:51.696389+0000","last_peered":"2023-01-02T18:17:51.696389+0000","last_clean":"2023-01-02T18:17:51.696389+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:17:51.696389+0000","last_undegraded":"2023-01-02T18:17:51.696389+0000","last_fullsized":"2023-01-02T18:17:51.696389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777135+0000","last_change":"2023-01-02T18:17:29.323754+0000","last_active":"2023-01-02T18:17:52.777135+0000","last_peered":"2023-01-02T18:17:52.777135+0000","last_clean":"2023-01-02T18:17:52.777135+0000","last_became_active":"2023-01-02T18:17:29.320497+0000","last_became_peered":"2023-01-02T18:17:29.320497+0000","last_unstale":"2023-01-02T18:17:52.777135+0000","last_undegraded":"2023-01-02T18:17:52.777135+0000","last_fullsized":"2023-01-02T18:17:52.777135+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777597+0000","last_change":"2023-01-02T18:17:29.389087+0000","last_active":"2023-01-02T18:17:52.777597+0000","last_peered":"2023-01-02T18:17:52.777597+0000","last_clean":"2023-01-02T18:17:52.777597+0000","last_became_active":"2023-01-02T18:17:29.337136+0000","last_became_peered":"2023-01-02T18:17:29.337136+0000","last_unstale":"2023-01-02T18:17:52.777597+0000","last_undegraded":"2023-01-02T18:17:52.777597+0000","last_fullsized":"2023-01-02T18:17:52.777597+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":68,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.704688+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:17:52.704688+0000","last_peered":"2023-01-02T18:17:52.704688+0000","last_clean":"2023-01-02T18:17:52.704688+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:17:52.704688+0000","last_undegraded":"2023-01-02T18:17:52.704688+0000","last_fullsized":"2023-01-02T18:17:52.704688+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877978+0000","last_change":"2023-01-02T18:17:38.450620+0000","last_active":"2023-01-02T18:17:51.877978+0000","last_peered":"2023-01-02T18:17:51.877978+0000","last_clean":"2023-01-02T18:17:51.877978+0000","last_became_active":"2023-01-02T18:17:36.443497+0000","last_became_peered":"2023-01-02T18:17:36.443497+0000","last_unstale":"2023-01-02T18:17:51.877978+0000","last_undegraded":"2023-01-02T18:17:51.877978+0000","last_fullsized":"2023-01-02T18:17:51.877978+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":43,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776749+0000","last_change":"2023-01-02T18:17:34.316527+0000","last_active":"2023-01-02T18:17:52.776749+0000","last_peered":"2023-01-02T18:17:52.776749+0000","last_clean":"2023-01-02T18:17:52.776749+0000","last_became_active":"2023-01-02T18:17:32.342303+0000","last_became_peered":"2023-01-02T18:17:32.342303+0000","last_unstale":"2023-01-02T18:17:52.776749+0000","last_undegraded":"2023-01-02T18:17:52.776749+0000","last_fullsized":"2023-01-02T18:17:52.776749+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"76'9","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777063+0000","last_change":"2023-01-02T18:17:29.361212+0000","last_active":"2023-01-02T18:17:52.777063+0000","last_peered":"2023-01-02T18:17:52.777063+0000","last_clean":"2023-01-02T18:17:52.777063+0000","last_became_active":"2023-01-02T18:17:29.328070+0000","last_became_peered":"2023-01-02T18:17:29.328070+0000","last_unstale":"2023-01-02T18:17:52.777063+0000","last_undegraded":"2023-01-02T18:17:52.777063+0000","last_fullsized":"2023-01-02T18:17:52.777063+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"72'1","reported_seq":88,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878200+0000","last_change":"2023-01-02T18:17:48.660556+0000","last_active":"2023-01-02T18:17:51.878200+0000","last_peered":"2023-01-02T18:17:51.878200+0000","last_clean":"2023-01-02T18:17:51.878200+0000","last_became_active":"2023-01-02T18:17:48.656706+0000","last_became_peered":"2023-01-02T18:17:48.656706+0000","last_unstale":"2023-01-02T18:17:51.878200+0000","last_undegraded":"2023-01-02T18:17:51.878200+0000","last_fullsized":"2023-01-02T18:17:51.878200+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.693752+0000","last_change":"2023-01-02T18:17:48.654077+0000","last_active":"2023-01-02T18:17:51.693752+0000","last_peered":"2023-01-02T18:17:51.693752+0000","last_clean":"2023-01-02T18:17:51.693752+0000","last_became_active":"2023-01-02T18:17:48.653707+0000","last_became_peered":"2023-01-02T18:17:48.653707+0000","last_unstale":"2023-01-02T18:17:51.693752+0000","last_undegraded":"2023-01-02T18:17:51.693752+0000","last_fullsized":"2023-01-02T18:17:51.693752+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"90'10","reported_seq":170,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691144+0000","last_change":"2023-01-02T18:17:30.324702+0000","last_active":"2023-01-02T18:17:51.691144+0000","last_peered":"2023-01-02T18:17:51.691144+0000","last_clean":"2023-01-02T18:17:51.691144+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:17:51.691144+0000","last_undegraded":"2023-01-02T18:17:51.691144+0000","last_fullsized":"2023-01-02T18:17:51.691144+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":84,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":105,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878574+0000","last_change":"2023-01-02T18:15:59.012839+0000","last_active":"2023-01-02T18:17:51.878574+0000","last_peered":"2023-01-02T18:17:51.878574+0000","last_clean":"2023-01-02T18:17:51.878574+0000","last_became_active":"2023-01-02T18:15:59.012534+0000","last_became_peered":"2023-01-02T18:15:59.012534+0000","last_unstale":"2023-01-02T18:17:51.878574+0000","last_undegraded":"2023-01-02T18:17:51.878574+0000","last_fullsized":"2023-01-02T18:17:51.878574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":85,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.706591+0000","last_change":"2023-01-02T18:17:29.328315+0000","last_active":"2023-01-02T18:17:51.706591+0000","last_peered":"2023-01-02T18:17:51.706591+0000","last_clean":"2023-01-02T18:17:51.706591+0000","last_became_active":"2023-01-02T18:17:29.328011+0000","last_became_peered":"2023-01-02T18:17:29.328011+0000","last_unstale":"2023-01-02T18:17:51.706591+0000","last_undegraded":"2023-01-02T18:17:51.706591+0000","last_fullsized":"2023-01-02T18:17:51.706591+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697549+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:17:51.697549+0000","last_peered":"2023-01-02T18:17:51.697549+0000","last_clean":"2023-01-02T18:17:51.697549+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:17:51.697549+0000","last_undegraded":"2023-01-02T18:17:51.697549+0000","last_fullsized":"2023-01-02T18:17:51.697549+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":68,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703749+0000","last_change":"2023-01-02T18:16:57.306312+0000","last_active":"2023-01-02T18:17:52.703749+0000","last_peered":"2023-01-02T18:17:52.703749+0000","last_clean":"2023-01-02T18:17:52.703749+0000","last_became_active":"2023-01-02T18:16:55.314537+0000","last_became_peered":"2023-01-02T18:16:55.314537+0000","last_unstale":"2023-01-02T18:17:52.703749+0000","last_undegraded":"2023-01-02T18:17:52.703749+0000","last_fullsized":"2023-01-02T18:17:52.703749+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877855+0000","last_change":"2023-01-02T18:17:38.449874+0000","last_active":"2023-01-02T18:17:51.877855+0000","last_peered":"2023-01-02T18:17:51.877855+0000","last_clean":"2023-01-02T18:17:51.877855+0000","last_became_active":"2023-01-02T18:17:36.445029+0000","last_became_peered":"2023-01-02T18:17:36.445029+0000","last_unstale":"2023-01-02T18:17:51.877855+0000","last_undegraded":"2023-01-02T18:17:51.877855+0000","last_fullsized":"2023-01-02T18:17:51.877855+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700665+0000","last_change":"2023-01-02T18:17:34.326569+0000","last_active":"2023-01-02T18:17:51.700665+0000","last_peered":"2023-01-02T18:17:51.700665+0000","last_clean":"2023-01-02T18:17:51.700665+0000","last_became_active":"2023-01-02T18:17:32.341143+0000","last_became_peered":"2023-01-02T18:17:32.341143+0000","last_unstale":"2023-01-02T18:17:51.700665+0000","last_undegraded":"2023-01-02T18:17:51.700665+0000","last_fullsized":"2023-01-02T18:17:51.700665+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"76'4","reported_seq":59,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697207+0000","last_change":"2023-01-02T18:17:09.322082+0000","last_active":"2023-01-02T18:17:51.697207+0000","last_peered":"2023-01-02T18:17:51.697207+0000","last_clean":"2023-01-02T18:17:51.697207+0000","last_became_active":"2023-01-02T18:17:07.340751+0000","last_became_peered":"2023-01-02T18:17:07.340751+0000","last_unstale":"2023-01-02T18:17:51.697207+0000","last_undegraded":"2023-01-02T18:17:51.697207+0000","last_fullsized":"2023-01-02T18:17:51.697207+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776738+0000","last_change":"2023-01-02T18:17:29.386698+0000","last_active":"2023-01-02T18:17:52.776738+0000","last_peered":"2023-01-02T18:17:52.776738+0000","last_clean":"2023-01-02T18:17:52.776738+0000","last_became_active":"2023-01-02T18:17:29.336976+0000","last_became_peered":"2023-01-02T18:17:29.336976+0000","last_unstale":"2023-01-02T18:17:52.776738+0000","last_undegraded":"2023-01-02T18:17:52.776738+0000","last_fullsized":"2023-01-02T18:17:52.776738+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.692000+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:17:51.692000+0000","last_peered":"2023-01-02T18:17:51.692000+0000","last_clean":"2023-01-02T18:17:51.692000+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:17:51.692000+0000","last_undegraded":"2023-01-02T18:17:51.692000+0000","last_fullsized":"2023-01-02T18:17:51.692000+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"85'12","reported_seq":131,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701629+0000","last_change":"2023-01-02T18:17:30.503301+0000","last_active":"2023-01-02T18:17:51.701629+0000","last_peered":"2023-01-02T18:17:51.701629+0000","last_clean":"2023-01-02T18:17:51.701629+0000","last_became_active":"2023-01-02T18:16:48.335418+0000","last_became_peered":"2023-01-02T18:16:48.335418+0000","last_unstale":"2023-01-02T18:17:51.701629+0000","last_undegraded":"2023-01-02T18:17:51.701629+0000","last_fullsized":"2023-01-02T18:17:51.701629+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":12,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777273+0000","last_change":"2023-01-02T18:17:29.331000+0000","last_active":"2023-01-02T18:17:52.777273+0000","last_peered":"2023-01-02T18:17:52.777273+0000","last_clean":"2023-01-02T18:17:52.777273+0000","last_became_active":"2023-01-02T18:17:29.329297+0000","last_became_peered":"2023-01-02T18:17:29.329297+0000","last_unstale":"2023-01-02T18:17:52.777273+0000","last_undegraded":"2023-01-02T18:17:52.777273+0000","last_fullsized":"2023-01-02T18:17:52.777273+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703346+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:17:52.703346+0000","last_peered":"2023-01-02T18:17:52.703346+0000","last_clean":"2023-01-02T18:17:52.703346+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:17:52.703346+0000","last_undegraded":"2023-01-02T18:17:52.703346+0000","last_fullsized":"2023-01-02T18:17:52.703346+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878510+0000","last_change":"2023-01-02T18:16:53.345663+0000","last_active":"2023-01-02T18:17:51.878510+0000","last_peered":"2023-01-02T18:17:51.878510+0000","last_clean":"2023-01-02T18:17:51.878510+0000","last_became_active":"2023-01-02T18:16:51.341075+0000","last_became_peered":"2023-01-02T18:16:51.341075+0000","last_unstale":"2023-01-02T18:17:51.878510+0000","last_undegraded":"2023-01-02T18:17:51.878510+0000","last_fullsized":"2023-01-02T18:17:51.878510+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702903+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:17:51.702903+0000","last_peered":"2023-01-02T18:17:51.702903+0000","last_clean":"2023-01-02T18:17:51.702903+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:17:51.702903+0000","last_undegraded":"2023-01-02T18:17:51.702903+0000","last_fullsized":"2023-01-02T18:17:51.702903+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701806+0000","last_change":"2023-01-02T18:17:38.459459+0000","last_active":"2023-01-02T18:17:51.701806+0000","last_peered":"2023-01-02T18:17:51.701806+0000","last_clean":"2023-01-02T18:17:51.701806+0000","last_became_active":"2023-01-02T18:17:36.442021+0000","last_became_peered":"2023-01-02T18:17:36.442021+0000","last_unstale":"2023-01-02T18:17:51.701806+0000","last_undegraded":"2023-01-02T18:17:51.701806+0000","last_fullsized":"2023-01-02T18:17:51.701806+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":40,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696665+0000","last_change":"2023-01-02T18:17:34.343439+0000","last_active":"2023-01-02T18:17:51.696665+0000","last_peered":"2023-01-02T18:17:51.696665+0000","last_clean":"2023-01-02T18:17:51.696665+0000","last_became_active":"2023-01-02T18:17:32.344028+0000","last_became_peered":"2023-01-02T18:17:32.344028+0000","last_unstale":"2023-01-02T18:17:51.696665+0000","last_undegraded":"2023-01-02T18:17:51.696665+0000","last_fullsized":"2023-01-02T18:17:51.696665+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777948+0000","last_change":"2023-01-02T18:17:29.326591+0000","last_active":"2023-01-02T18:17:52.777948+0000","last_peered":"2023-01-02T18:17:52.777948+0000","last_clean":"2023-01-02T18:17:52.777948+0000","last_became_active":"2023-01-02T18:17:29.326222+0000","last_became_peered":"2023-01-02T18:17:29.326222+0000","last_unstale":"2023-01-02T18:17:52.777948+0000","last_undegraded":"2023-01-02T18:17:52.777948+0000","last_fullsized":"2023-01-02T18:17:52.777948+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":64,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703633+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:17:52.703633+0000","last_peered":"2023-01-02T18:17:52.703633+0000","last_clean":"2023-01-02T18:17:52.703633+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:17:52.703633+0000","last_undegraded":"2023-01-02T18:17:52.703633+0000","last_fullsized":"2023-01-02T18:17:52.703633+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"56'4","reported_seq":85,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701481+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:17:51.701481+0000","last_peered":"2023-01-02T18:17:51.701481+0000","last_clean":"2023-01-02T18:17:51.701481+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:51.701481+0000","last_undegraded":"2023-01-02T18:17:51.701481+0000","last_fullsized":"2023-01-02T18:17:51.701481+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":98,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.692337+0000","last_change":"2023-01-02T18:17:29.319612+0000","last_active":"2023-01-02T18:17:51.692337+0000","last_peered":"2023-01-02T18:17:51.692337+0000","last_clean":"2023-01-02T18:17:51.692337+0000","last_became_active":"2023-01-02T18:17:29.319276+0000","last_became_peered":"2023-01-02T18:17:29.319276+0000","last_unstale":"2023-01-02T18:17:51.692337+0000","last_undegraded":"2023-01-02T18:17:51.692337+0000","last_fullsized":"2023-01-02T18:17:51.692337+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"82'2","reported_seq":46,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.778101+0000","last_change":"2023-01-02T18:17:30.331827+0000","last_active":"2023-01-02T18:17:52.778101+0000","last_peered":"2023-01-02T18:17:52.778101+0000","last_clean":"2023-01-02T18:17:52.778101+0000","last_became_active":"2023-01-02T18:17:29.335527+0000","last_became_peered":"2023-01-02T18:17:29.335527+0000","last_unstale":"2023-01-02T18:17:52.778101+0000","last_undegraded":"2023-01-02T18:17:52.778101+0000","last_fullsized":"2023-01-02T18:17:52.778101+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":48,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":106,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.692072+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:17:51.692072+0000","last_peered":"2023-01-02T18:17:51.692072+0000","last_clean":"2023-01-02T18:17:51.692072+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:17:51.692072+0000","last_undegraded":"2023-01-02T18:17:51.692072+0000","last_fullsized":"2023-01-02T18:17:51.692072+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701371+0000","last_change":"2023-01-02T18:16:53.685845+0000","last_active":"2023-01-02T18:17:52.701371+0000","last_peered":"2023-01-02T18:17:52.701371+0000","last_clean":"2023-01-02T18:17:52.701371+0000","last_became_active":"2023-01-02T18:16:51.345111+0000","last_became_peered":"2023-01-02T18:16:51.345111+0000","last_unstale":"2023-01-02T18:17:52.701371+0000","last_undegraded":"2023-01-02T18:17:52.701371+0000","last_fullsized":"2023-01-02T18:17:52.701371+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":15,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877756+0000","last_change":"2023-01-02T18:17:50.689054+0000","last_active":"2023-01-02T18:17:51.877756+0000","last_peered":"2023-01-02T18:17:51.877756+0000","last_clean":"2023-01-02T18:17:51.877756+0000","last_became_active":"2023-01-02T18:17:50.684347+0000","last_became_peered":"2023-01-02T18:17:50.684347+0000","last_unstale":"2023-01-02T18:17:51.877756+0000","last_undegraded":"2023-01-02T18:17:51.877756+0000","last_fullsized":"2023-01-02T18:17:51.877756+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877699+0000","last_change":"2023-01-02T18:17:38.449421+0000","last_active":"2023-01-02T18:17:51.877699+0000","last_peered":"2023-01-02T18:17:51.877699+0000","last_clean":"2023-01-02T18:17:51.877699+0000","last_became_active":"2023-01-02T18:17:36.446175+0000","last_became_peered":"2023-01-02T18:17:36.446175+0000","last_unstale":"2023-01-02T18:17:51.877699+0000","last_undegraded":"2023-01-02T18:17:51.877699+0000","last_fullsized":"2023-01-02T18:17:51.877699+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":40,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696645+0000","last_change":"2023-01-02T18:17:34.343264+0000","last_active":"2023-01-02T18:17:51.696645+0000","last_peered":"2023-01-02T18:17:51.696645+0000","last_clean":"2023-01-02T18:17:51.696645+0000","last_became_active":"2023-01-02T18:17:32.345763+0000","last_became_peered":"2023-01-02T18:17:32.345763+0000","last_unstale":"2023-01-02T18:17:51.696645+0000","last_undegraded":"2023-01-02T18:17:51.696645+0000","last_fullsized":"2023-01-02T18:17:51.696645+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2","version":"76'12","reported_seq":165,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877801+0000","last_change":"2023-01-02T18:17:09.308235+0000","last_active":"2023-01-02T18:17:51.877801+0000","last_peered":"2023-01-02T18:17:51.877801+0000","last_clean":"2023-01-02T18:17:51.877801+0000","last_became_active":"2023-01-02T18:17:07.340498+0000","last_became_peered":"2023-01-02T18:17:07.340498+0000","last_unstale":"2023-01-02T18:17:51.877801+0000","last_undegraded":"2023-01-02T18:17:51.877801+0000","last_fullsized":"2023-01-02T18:17:51.877801+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"69'1","reported_seq":58,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777133+0000","last_change":"2023-01-02T18:17:48.664153+0000","last_active":"2023-01-02T18:17:52.777133+0000","last_peered":"2023-01-02T18:17:52.777133+0000","last_clean":"2023-01-02T18:17:52.777133+0000","last_became_active":"2023-01-02T18:17:48.656642+0000","last_became_peered":"2023-01-02T18:17:48.656642+0000","last_unstale":"2023-01-02T18:17:52.777133+0000","last_undegraded":"2023-01-02T18:17:52.777133+0000","last_fullsized":"2023-01-02T18:17:52.777133+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.694252+0000","last_change":"2023-01-02T18:16:44.298243+0000","last_active":"2023-01-02T18:17:51.694252+0000","last_peered":"2023-01-02T18:17:51.694252+0000","last_clean":"2023-01-02T18:17:51.694252+0000","last_became_active":"2023-01-02T18:16:41.448643+0000","last_became_peered":"2023-01-02T18:16:41.448643+0000","last_unstale":"2023-01-02T18:17:51.694252+0000","last_undegraded":"2023-01-02T18:17:51.694252+0000","last_fullsized":"2023-01-02T18:17:51.694252+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"76'8","reported_seq":139,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877735+0000","last_change":"2023-01-02T18:17:30.433551+0000","last_active":"2023-01-02T18:17:51.877735+0000","last_peered":"2023-01-02T18:17:51.877735+0000","last_clean":"2023-01-02T18:17:51.877735+0000","last_became_active":"2023-01-02T18:16:37.414106+0000","last_became_peered":"2023-01-02T18:16:37.414106+0000","last_unstale":"2023-01-02T18:17:51.877735+0000","last_undegraded":"2023-01-02T18:17:51.877735+0000","last_fullsized":"2023-01-02T18:17:51.877735+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777894+0000","last_change":"2023-01-02T18:17:29.325726+0000","last_active":"2023-01-02T18:17:52.777894+0000","last_peered":"2023-01-02T18:17:52.777894+0000","last_clean":"2023-01-02T18:17:52.777894+0000","last_became_active":"2023-01-02T18:17:29.325418+0000","last_became_peered":"2023-01-02T18:17:29.325418+0000","last_unstale":"2023-01-02T18:17:52.777894+0000","last_undegraded":"2023-01-02T18:17:52.777894+0000","last_fullsized":"2023-01-02T18:17:52.777894+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777676+0000","last_change":"2023-01-02T18:17:29.329378+0000","last_active":"2023-01-02T18:17:52.777676+0000","last_peered":"2023-01-02T18:17:52.777676+0000","last_clean":"2023-01-02T18:17:52.777676+0000","last_became_active":"2023-01-02T18:17:29.327709+0000","last_became_peered":"2023-01-02T18:17:29.327709+0000","last_unstale":"2023-01-02T18:17:52.777676+0000","last_undegraded":"2023-01-02T18:17:52.777676+0000","last_fullsized":"2023-01-02T18:17:52.777676+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701712+0000","last_change":"2023-01-02T18:16:57.307540+0000","last_active":"2023-01-02T18:17:51.701712+0000","last_peered":"2023-01-02T18:17:51.701712+0000","last_clean":"2023-01-02T18:17:51.701712+0000","last_became_active":"2023-01-02T18:16:55.319082+0000","last_became_peered":"2023-01-02T18:16:55.319082+0000","last_unstale":"2023-01-02T18:17:51.701712+0000","last_undegraded":"2023-01-02T18:17:51.701712+0000","last_fullsized":"2023-01-02T18:17:51.701712+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"114'10","reported_seq":37,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700652+0000","last_change":"2023-01-02T18:17:38.459021+0000","last_active":"2023-01-02T18:17:51.700652+0000","last_peered":"2023-01-02T18:17:51.700652+0000","last_clean":"2023-01-02T18:17:51.700652+0000","last_became_active":"2023-01-02T18:17:36.440780+0000","last_became_peered":"2023-01-02T18:17:36.440780+0000","last_unstale":"2023-01-02T18:17:51.700652+0000","last_undegraded":"2023-01-02T18:17:51.700652+0000","last_fullsized":"2023-01-02T18:17:51.700652+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4194342,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":14,"num_write_kb":4105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700485+0000","last_change":"2023-01-02T18:17:34.324670+0000","last_active":"2023-01-02T18:17:51.700485+0000","last_peered":"2023-01-02T18:17:51.700485+0000","last_clean":"2023-01-02T18:17:51.700485+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:17:51.700485+0000","last_undegraded":"2023-01-02T18:17:51.700485+0000","last_fullsized":"2023-01-02T18:17:51.700485+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"76'4","reported_seq":59,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696708+0000","last_change":"2023-01-02T18:17:09.323147+0000","last_active":"2023-01-02T18:17:51.696708+0000","last_peered":"2023-01-02T18:17:51.696708+0000","last_clean":"2023-01-02T18:17:51.696708+0000","last_became_active":"2023-01-02T18:17:07.341052+0000","last_became_peered":"2023-01-02T18:17:07.341052+0000","last_unstale":"2023-01-02T18:17:51.696708+0000","last_undegraded":"2023-01-02T18:17:51.696708+0000","last_fullsized":"2023-01-02T18:17:51.696708+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":72,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703691+0000","last_change":"2023-01-02T18:17:29.319986+0000","last_active":"2023-01-02T18:17:52.703691+0000","last_peered":"2023-01-02T18:17:52.703691+0000","last_clean":"2023-01-02T18:17:52.703691+0000","last_became_active":"2023-01-02T18:17:29.319682+0000","last_became_peered":"2023-01-02T18:17:29.319682+0000","last_unstale":"2023-01-02T18:17:52.703691+0000","last_undegraded":"2023-01-02T18:17:52.703691+0000","last_fullsized":"2023-01-02T18:17:52.703691+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"51'1","reported_seq":115,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702523+0000","last_change":"2023-01-02T18:17:48.666369+0000","last_active":"2023-01-02T18:17:51.702523+0000","last_peered":"2023-01-02T18:17:51.702523+0000","last_clean":"2023-01-02T18:17:51.702523+0000","last_became_active":"2023-01-02T18:17:48.662204+0000","last_became_peered":"2023-01-02T18:17:48.662204+0000","last_unstale":"2023-01-02T18:17:51.702523+0000","last_undegraded":"2023-01-02T18:17:51.702523+0000","last_fullsized":"2023-01-02T18:17:51.702523+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":109,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.698000+0000","last_change":"2023-01-02T18:17:30.333300+0000","last_active":"2023-01-02T18:17:51.698000+0000","last_peered":"2023-01-02T18:17:51.698000+0000","last_clean":"2023-01-02T18:17:51.698000+0000","last_became_active":"2023-01-02T18:16:48.322710+0000","last_became_peered":"2023-01-02T18:16:48.322710+0000","last_unstale":"2023-01-02T18:17:51.698000+0000","last_undegraded":"2023-01-02T18:17:51.698000+0000","last_fullsized":"2023-01-02T18:17:51.698000+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777704+0000","last_change":"2023-01-02T18:17:29.333377+0000","last_active":"2023-01-02T18:17:52.777704+0000","last_peered":"2023-01-02T18:17:52.777704+0000","last_clean":"2023-01-02T18:17:52.777704+0000","last_became_active":"2023-01-02T18:17:29.332106+0000","last_became_peered":"2023-01-02T18:17:29.332106+0000","last_unstale":"2023-01-02T18:17:52.777704+0000","last_undegraded":"2023-01-02T18:17:52.777704+0000","last_fullsized":"2023-01-02T18:17:52.777704+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878913+0000","last_change":"2023-01-02T18:16:53.345390+0000","last_active":"2023-01-02T18:17:51.878913+0000","last_peered":"2023-01-02T18:17:51.878913+0000","last_clean":"2023-01-02T18:17:51.878913+0000","last_became_active":"2023-01-02T18:16:51.339020+0000","last_became_peered":"2023-01-02T18:16:51.339020+0000","last_unstale":"2023-01-02T18:17:51.878913+0000","last_undegraded":"2023-01-02T18:17:51.878913+0000","last_fullsized":"2023-01-02T18:17:51.878913+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702402+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:17:51.702402+0000","last_peered":"2023-01-02T18:17:51.702402+0000","last_clean":"2023-01-02T18:17:51.702402+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:17:51.702402+0000","last_undegraded":"2023-01-02T18:17:51.702402+0000","last_fullsized":"2023-01-02T18:17:51.702402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877703+0000","last_change":"2023-01-02T18:17:38.449658+0000","last_active":"2023-01-02T18:17:51.877703+0000","last_peered":"2023-01-02T18:17:51.877703+0000","last_clean":"2023-01-02T18:17:51.877703+0000","last_became_active":"2023-01-02T18:17:36.450509+0000","last_became_peered":"2023-01-02T18:17:36.450509+0000","last_unstale":"2023-01-02T18:17:51.877703+0000","last_undegraded":"2023-01-02T18:17:51.877703+0000","last_fullsized":"2023-01-02T18:17:51.877703+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"101'31","reported_seq":133,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777260+0000","last_change":"2023-01-02T18:17:34.318218+0000","last_active":"2023-01-02T18:17:52.777260+0000","last_peered":"2023-01-02T18:17:52.777260+0000","last_clean":"2023-01-02T18:17:52.777260+0000","last_became_active":"2023-01-02T18:17:32.342244+0000","last_became_peered":"2023-01-02T18:17:32.342244+0000","last_unstale":"2023-01-02T18:17:52.777260+0000","last_undegraded":"2023-01-02T18:17:52.777260+0000","last_fullsized":"2023-01-02T18:17:52.777260+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":99,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700601+0000","last_change":"2023-01-02T18:17:09.330500+0000","last_active":"2023-01-02T18:17:51.700601+0000","last_peered":"2023-01-02T18:17:51.700601+0000","last_clean":"2023-01-02T18:17:51.700601+0000","last_became_active":"2023-01-02T18:17:07.345902+0000","last_became_peered":"2023-01-02T18:17:07.345902+0000","last_unstale":"2023-01-02T18:17:51.700601+0000","last_undegraded":"2023-01-02T18:17:51.700601+0000","last_fullsized":"2023-01-02T18:17:51.700601+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":63,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.692658+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:17:51.692658+0000","last_peered":"2023-01-02T18:17:51.692658+0000","last_clean":"2023-01-02T18:17:51.692658+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:17:51.692658+0000","last_undegraded":"2023-01-02T18:17:51.692658+0000","last_fullsized":"2023-01-02T18:17:51.692658+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.695148+0000","last_change":"2023-01-02T18:16:48.329052+0000","last_active":"2023-01-02T18:17:51.695148+0000","last_peered":"2023-01-02T18:17:51.695148+0000","last_clean":"2023-01-02T18:17:51.695148+0000","last_became_active":"2023-01-02T18:16:48.327662+0000","last_became_peered":"2023-01-02T18:16:48.327662+0000","last_unstale":"2023-01-02T18:17:51.695148+0000","last_undegraded":"2023-01-02T18:17:51.695148+0000","last_fullsized":"2023-01-02T18:17:51.695148+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"46'4","reported_seq":154,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701568+0000","last_change":"2023-01-02T18:17:30.503114+0000","last_active":"2023-01-02T18:17:51.701568+0000","last_peered":"2023-01-02T18:17:51.701568+0000","last_clean":"2023-01-02T18:17:51.701568+0000","last_became_active":"2023-01-02T18:16:48.329461+0000","last_became_peered":"2023-01-02T18:16:48.329461+0000","last_unstale":"2023-01-02T18:17:51.701568+0000","last_undegraded":"2023-01-02T18:17:51.701568+0000","last_fullsized":"2023-01-02T18:17:51.701568+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":30,"num_read_kb":23,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":76,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703593+0000","last_change":"2023-01-02T18:16:49.323150+0000","last_active":"2023-01-02T18:17:52.703593+0000","last_peered":"2023-01-02T18:17:52.703593+0000","last_clean":"2023-01-02T18:17:52.703593+0000","last_became_active":"2023-01-02T18:16:48.326635+0000","last_became_peered":"2023-01-02T18:16:48.326635+0000","last_unstale":"2023-01-02T18:17:52.703593+0000","last_undegraded":"2023-01-02T18:17:52.703593+0000","last_fullsized":"2023-01-02T18:17:52.703593+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878815+0000","last_change":"2023-01-02T18:16:53.345223+0000","last_active":"2023-01-02T18:17:51.878815+0000","last_peered":"2023-01-02T18:17:51.878815+0000","last_clean":"2023-01-02T18:17:51.878815+0000","last_became_active":"2023-01-02T18:16:51.341580+0000","last_became_peered":"2023-01-02T18:16:51.341580+0000","last_unstale":"2023-01-02T18:17:51.878815+0000","last_undegraded":"2023-01-02T18:17:51.878815+0000","last_fullsized":"2023-01-02T18:17:51.878815+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.706727+0000","last_change":"2023-01-02T18:17:29.325884+0000","last_active":"2023-01-02T18:17:51.706727+0000","last_peered":"2023-01-02T18:17:51.706727+0000","last_clean":"2023-01-02T18:17:51.706727+0000","last_became_active":"2023-01-02T18:17:29.325539+0000","last_became_peered":"2023-01-02T18:17:29.325539+0000","last_unstale":"2023-01-02T18:17:51.706727+0000","last_undegraded":"2023-01-02T18:17:51.706727+0000","last_fullsized":"2023-01-02T18:17:51.706727+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"105'7","reported_seq":39,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701088+0000","last_change":"2023-01-02T18:17:38.459018+0000","last_active":"2023-01-02T18:17:51.701088+0000","last_peered":"2023-01-02T18:17:51.701088+0000","last_clean":"2023-01-02T18:17:51.701088+0000","last_became_active":"2023-01-02T18:17:36.442139+0000","last_became_peered":"2023-01-02T18:17:36.442139+0000","last_unstale":"2023-01-02T18:17:51.701088+0000","last_undegraded":"2023-01-02T18:17:51.701088+0000","last_fullsized":"2023-01-02T18:17:51.701088+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691903+0000","last_change":"2023-01-02T18:17:34.332222+0000","last_active":"2023-01-02T18:17:51.691903+0000","last_peered":"2023-01-02T18:17:51.691903+0000","last_clean":"2023-01-02T18:17:51.691903+0000","last_became_active":"2023-01-02T18:17:32.337498+0000","last_became_peered":"2023-01-02T18:17:32.337498+0000","last_unstale":"2023-01-02T18:17:51.691903+0000","last_undegraded":"2023-01-02T18:17:51.691903+0000","last_fullsized":"2023-01-02T18:17:51.691903+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877654+0000","last_change":"2023-01-02T18:17:09.307789+0000","last_active":"2023-01-02T18:17:51.877654+0000","last_peered":"2023-01-02T18:17:51.877654+0000","last_clean":"2023-01-02T18:17:51.877654+0000","last_became_active":"2023-01-02T18:17:07.345090+0000","last_became_peered":"2023-01-02T18:17:07.345090+0000","last_unstale":"2023-01-02T18:17:51.877654+0000","last_undegraded":"2023-01-02T18:17:51.877654+0000","last_fullsized":"2023-01-02T18:17:51.877654+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"72'11","reported_seq":126,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877587+0000","last_change":"2023-01-02T18:17:29.350765+0000","last_active":"2023-01-02T18:17:51.877587+0000","last_peered":"2023-01-02T18:17:51.877587+0000","last_clean":"2023-01-02T18:17:51.877587+0000","last_became_active":"2023-01-02T18:17:29.334376+0000","last_became_peered":"2023-01-02T18:17:29.334376+0000","last_unstale":"2023-01-02T18:17:51.877587+0000","last_undegraded":"2023-01-02T18:17:51.877587+0000","last_fullsized":"2023-01-02T18:17:51.877587+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":64,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878996+0000","last_change":"2023-01-02T18:16:48.328829+0000","last_active":"2023-01-02T18:17:51.878996+0000","last_peered":"2023-01-02T18:17:51.878996+0000","last_clean":"2023-01-02T18:17:51.878996+0000","last_became_active":"2023-01-02T18:16:48.328372+0000","last_became_peered":"2023-01-02T18:16:48.328372+0000","last_unstale":"2023-01-02T18:17:51.878996+0000","last_undegraded":"2023-01-02T18:17:51.878996+0000","last_fullsized":"2023-01-02T18:17:51.878996+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":139,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878387+0000","last_change":"2023-01-02T18:17:30.434777+0000","last_active":"2023-01-02T18:17:51.878387+0000","last_peered":"2023-01-02T18:17:51.878387+0000","last_clean":"2023-01-02T18:17:51.878387+0000","last_became_active":"2023-01-02T18:16:37.415896+0000","last_became_peered":"2023-01-02T18:16:37.415896+0000","last_unstale":"2023-01-02T18:17:51.878387+0000","last_undegraded":"2023-01-02T18:17:51.878387+0000","last_fullsized":"2023-01-02T18:17:51.878387+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"56'3","reported_seq":77,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696932+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:17:51.696932+0000","last_peered":"2023-01-02T18:17:51.696932+0000","last_clean":"2023-01-02T18:17:51.696932+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:17:51.696932+0000","last_undegraded":"2023-01-02T18:17:51.696932+0000","last_fullsized":"2023-01-02T18:17:51.696932+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.693284+0000","last_change":"2023-01-02T18:16:53.344544+0000","last_active":"2023-01-02T18:17:51.693284+0000","last_peered":"2023-01-02T18:17:51.693284+0000","last_clean":"2023-01-02T18:17:51.693284+0000","last_became_active":"2023-01-02T18:16:51.339073+0000","last_became_peered":"2023-01-02T18:16:51.339073+0000","last_unstale":"2023-01-02T18:17:51.693284+0000","last_undegraded":"2023-01-02T18:17:51.693284+0000","last_fullsized":"2023-01-02T18:17:51.693284+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":163,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701697+0000","last_change":"2023-01-02T18:16:57.307483+0000","last_active":"2023-01-02T18:17:52.701697+0000","last_peered":"2023-01-02T18:17:52.701697+0000","last_clean":"2023-01-02T18:17:52.701697+0000","last_became_active":"2023-01-02T18:16:55.316680+0000","last_became_peered":"2023-01-02T18:16:55.316680+0000","last_unstale":"2023-01-02T18:17:52.701697+0000","last_undegraded":"2023-01-02T18:17:52.701697+0000","last_fullsized":"2023-01-02T18:17:52.701697+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":24,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696492+0000","last_change":"2023-01-02T18:17:38.463731+0000","last_active":"2023-01-02T18:17:51.696492+0000","last_peered":"2023-01-02T18:17:51.696492+0000","last_clean":"2023-01-02T18:17:51.696492+0000","last_became_active":"2023-01-02T18:17:36.444543+0000","last_became_peered":"2023-01-02T18:17:36.444543+0000","last_unstale":"2023-01-02T18:17:51.696492+0000","last_undegraded":"2023-01-02T18:17:51.696492+0000","last_fullsized":"2023-01-02T18:17:51.696492+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"101'2","reported_seq":45,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703140+0000","last_change":"2023-01-02T18:17:34.316134+0000","last_active":"2023-01-02T18:17:52.703140+0000","last_peered":"2023-01-02T18:17:52.703140+0000","last_clean":"2023-01-02T18:17:52.703140+0000","last_became_active":"2023-01-02T18:17:32.340596+0000","last_became_peered":"2023-01-02T18:17:32.340596+0000","last_unstale":"2023-01-02T18:17:52.703140+0000","last_undegraded":"2023-01-02T18:17:52.703140+0000","last_fullsized":"2023-01-02T18:17:52.703140+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777800+0000","last_change":"2023-01-02T18:17:29.323882+0000","last_active":"2023-01-02T18:17:52.777800+0000","last_peered":"2023-01-02T18:17:52.777800+0000","last_clean":"2023-01-02T18:17:52.777800+0000","last_became_active":"2023-01-02T18:17:29.323226+0000","last_became_peered":"2023-01-02T18:17:29.323226+0000","last_unstale":"2023-01-02T18:17:52.777800+0000","last_undegraded":"2023-01-02T18:17:52.777800+0000","last_fullsized":"2023-01-02T18:17:52.777800+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":63,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878597+0000","last_change":"2023-01-02T18:17:01.310439+0000","last_active":"2023-01-02T18:17:51.878597+0000","last_peered":"2023-01-02T18:17:51.878597+0000","last_clean":"2023-01-02T18:17:51.878597+0000","last_became_active":"2023-01-02T18:16:59.315925+0000","last_became_peered":"2023-01-02T18:16:59.315925+0000","last_unstale":"2023-01-02T18:17:51.878597+0000","last_undegraded":"2023-01-02T18:17:51.878597+0000","last_fullsized":"2023-01-02T18:17:51.878597+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":82,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.702225+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:17:52.702225+0000","last_peered":"2023-01-02T18:17:52.702225+0000","last_clean":"2023-01-02T18:17:52.702225+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:17:52.702225+0000","last_undegraded":"2023-01-02T18:17:52.702225+0000","last_fullsized":"2023-01-02T18:17:52.702225+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"46'5","reported_seq":44,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777823+0000","last_change":"2023-01-02T18:17:30.331199+0000","last_active":"2023-01-02T18:17:52.777823+0000","last_peered":"2023-01-02T18:17:52.777823+0000","last_clean":"2023-01-02T18:17:52.777823+0000","last_became_active":"2023-01-02T18:17:29.337008+0000","last_became_peered":"2023-01-02T18:17:29.337008+0000","last_unstale":"2023-01-02T18:17:52.777823+0000","last_undegraded":"2023-01-02T18:17:52.777823+0000","last_fullsized":"2023-01-02T18:17:52.777823+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878050+0000","last_change":"2023-01-02T18:16:49.309370+0000","last_active":"2023-01-02T18:17:51.878050+0000","last_peered":"2023-01-02T18:17:51.878050+0000","last_clean":"2023-01-02T18:17:51.878050+0000","last_became_active":"2023-01-02T18:16:48.323683+0000","last_became_peered":"2023-01-02T18:16:48.323683+0000","last_unstale":"2023-01-02T18:17:51.878050+0000","last_undegraded":"2023-01-02T18:17:51.878050+0000","last_fullsized":"2023-01-02T18:17:51.878050+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697695+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:17:51.697695+0000","last_peered":"2023-01-02T18:17:51.697695+0000","last_clean":"2023-01-02T18:17:51.697695+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:17:51.697695+0000","last_undegraded":"2023-01-02T18:17:51.697695+0000","last_fullsized":"2023-01-02T18:17:51.697695+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":65,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696471+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:17:51.696471+0000","last_peered":"2023-01-02T18:17:51.696471+0000","last_clean":"2023-01-02T18:17:51.696471+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:17:51.696471+0000","last_undegraded":"2023-01-02T18:17:51.696471+0000","last_fullsized":"2023-01-02T18:17:51.696471+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.5","version":"106'3","reported_seq":41,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697365+0000","last_change":"2023-01-02T18:17:38.464795+0000","last_active":"2023-01-02T18:17:51.697365+0000","last_peered":"2023-01-02T18:17:51.697365+0000","last_clean":"2023-01-02T18:17:51.697365+0000","last_became_active":"2023-01-02T18:17:36.442539+0000","last_became_peered":"2023-01-02T18:17:36.442539+0000","last_unstale":"2023-01-02T18:17:51.697365+0000","last_undegraded":"2023-01-02T18:17:51.697365+0000","last_fullsized":"2023-01-02T18:17:51.697365+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":43,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703503+0000","last_change":"2023-01-02T18:17:34.316365+0000","last_active":"2023-01-02T18:17:52.703503+0000","last_peered":"2023-01-02T18:17:52.703503+0000","last_clean":"2023-01-02T18:17:52.703503+0000","last_became_active":"2023-01-02T18:17:32.336309+0000","last_became_peered":"2023-01-02T18:17:32.336309+0000","last_unstale":"2023-01-02T18:17:52.703503+0000","last_undegraded":"2023-01-02T18:17:52.703503+0000","last_fullsized":"2023-01-02T18:17:52.703503+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777951+0000","last_change":"2023-01-02T18:17:29.333481+0000","last_active":"2023-01-02T18:17:52.777951+0000","last_peered":"2023-01-02T18:17:52.777951+0000","last_clean":"2023-01-02T18:17:52.777951+0000","last_became_active":"2023-01-02T18:17:29.333173+0000","last_became_peered":"2023-01-02T18:17:29.333173+0000","last_unstale":"2023-01-02T18:17:52.777951+0000","last_undegraded":"2023-01-02T18:17:52.777951+0000","last_fullsized":"2023-01-02T18:17:52.777951+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":64,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.704513+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:17:52.704513+0000","last_peered":"2023-01-02T18:17:52.704513+0000","last_clean":"2023-01-02T18:17:52.704513+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:17:52.704513+0000","last_undegraded":"2023-01-02T18:17:52.704513+0000","last_fullsized":"2023-01-02T18:17:52.704513+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701232+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:17:51.701232+0000","last_peered":"2023-01-02T18:17:51.701232+0000","last_clean":"2023-01-02T18:17:51.701232+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:17:51.701232+0000","last_undegraded":"2023-01-02T18:17:51.701232+0000","last_fullsized":"2023-01-02T18:17:51.701232+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"46'4","reported_seq":163,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697461+0000","last_change":"2023-01-02T18:17:30.335368+0000","last_active":"2023-01-02T18:17:51.697461+0000","last_peered":"2023-01-02T18:17:51.697461+0000","last_clean":"2023-01-02T18:17:51.697461+0000","last_became_active":"2023-01-02T18:17:29.341233+0000","last_became_peered":"2023-01-02T18:17:29.341233+0000","last_unstale":"2023-01-02T18:17:51.697461+0000","last_undegraded":"2023-01-02T18:17:51.697461+0000","last_fullsized":"2023-01-02T18:17:51.697461+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"56'8","reported_seq":87,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.705940+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:17:51.705940+0000","last_peered":"2023-01-02T18:17:51.705940+0000","last_clean":"2023-01-02T18:17:51.705940+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:17:51.705940+0000","last_undegraded":"2023-01-02T18:17:51.705940+0000","last_fullsized":"2023-01-02T18:17:51.705940+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696873+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:17:51.696873+0000","last_peered":"2023-01-02T18:17:51.696873+0000","last_clean":"2023-01-02T18:17:51.696873+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:17:51.696873+0000","last_undegraded":"2023-01-02T18:17:51.696873+0000","last_fullsized":"2023-01-02T18:17:51.696873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":69,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703970+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:17:52.703970+0000","last_peered":"2023-01-02T18:17:52.703970+0000","last_clean":"2023-01-02T18:17:52.703970+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:17:52.703970+0000","last_undegraded":"2023-01-02T18:17:52.703970+0000","last_fullsized":"2023-01-02T18:17:52.703970+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"105'1","reported_seq":28,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.702009+0000","last_change":"2023-01-02T18:17:38.446055+0000","last_active":"2023-01-02T18:17:52.702009+0000","last_peered":"2023-01-02T18:17:52.702009+0000","last_clean":"2023-01-02T18:17:52.702009+0000","last_became_active":"2023-01-02T18:17:36.428938+0000","last_became_peered":"2023-01-02T18:17:36.428938+0000","last_unstale":"2023-01-02T18:17:52.702009+0000","last_undegraded":"2023-01-02T18:17:52.702009+0000","last_fullsized":"2023-01-02T18:17:52.702009+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"101'8","reported_seq":53,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702512+0000","last_change":"2023-01-02T18:17:34.327745+0000","last_active":"2023-01-02T18:17:51.702512+0000","last_peered":"2023-01-02T18:17:51.702512+0000","last_clean":"2023-01-02T18:17:51.702512+0000","last_became_active":"2023-01-02T18:17:32.347316+0000","last_became_peered":"2023-01-02T18:17:32.347316+0000","last_unstale":"2023-01-02T18:17:51.702512+0000","last_undegraded":"2023-01-02T18:17:51.702512+0000","last_fullsized":"2023-01-02T18:17:51.702512+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691745+0000","last_change":"2023-01-02T18:17:09.308354+0000","last_active":"2023-01-02T18:17:51.691745+0000","last_peered":"2023-01-02T18:17:51.691745+0000","last_clean":"2023-01-02T18:17:51.691745+0000","last_became_active":"2023-01-02T18:17:07.339211+0000","last_became_peered":"2023-01-02T18:17:07.339211+0000","last_unstale":"2023-01-02T18:17:51.691745+0000","last_undegraded":"2023-01-02T18:17:51.691745+0000","last_fullsized":"2023-01-02T18:17:51.691745+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"71'2","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702253+0000","last_change":"2023-01-02T18:17:01.317443+0000","last_active":"2023-01-02T18:17:51.702253+0000","last_peered":"2023-01-02T18:17:51.702253+0000","last_clean":"2023-01-02T18:17:51.702253+0000","last_became_active":"2023-01-02T18:16:59.311550+0000","last_became_peered":"2023-01-02T18:16:59.311550+0000","last_unstale":"2023-01-02T18:17:51.702253+0000","last_undegraded":"2023-01-02T18:17:51.702253+0000","last_fullsized":"2023-01-02T18:17:51.702253+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"51'3","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878273+0000","last_change":"2023-01-02T18:16:48.345208+0000","last_active":"2023-01-02T18:17:51.878273+0000","last_peered":"2023-01-02T18:17:51.878273+0000","last_clean":"2023-01-02T18:17:51.878273+0000","last_became_active":"2023-01-02T18:16:48.327080+0000","last_became_peered":"2023-01-02T18:16:48.327080+0000","last_unstale":"2023-01-02T18:17:51.878273+0000","last_undegraded":"2023-01-02T18:17:51.878273+0000","last_fullsized":"2023-01-02T18:17:51.878273+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":168,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697450+0000","last_change":"2023-01-02T18:17:30.335149+0000","last_active":"2023-01-02T18:17:51.697450+0000","last_peered":"2023-01-02T18:17:51.697450+0000","last_clean":"2023-01-02T18:17:51.697450+0000","last_became_active":"2023-01-02T18:16:48.327374+0000","last_became_peered":"2023-01-02T18:16:48.327374+0000","last_unstale":"2023-01-02T18:17:51.697450+0000","last_undegraded":"2023-01-02T18:17:51.697450+0000","last_fullsized":"2023-01-02T18:17:51.697450+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701313+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:17:52.701313+0000","last_peered":"2023-01-02T18:17:52.701313+0000","last_clean":"2023-01-02T18:17:52.701313+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:17:52.701313+0000","last_undegraded":"2023-01-02T18:17:52.701313+0000","last_fullsized":"2023-01-02T18:17:52.701313+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878894+0000","last_change":"2023-01-02T18:16:53.342610+0000","last_active":"2023-01-02T18:17:51.878894+0000","last_peered":"2023-01-02T18:17:51.878894+0000","last_clean":"2023-01-02T18:17:51.878894+0000","last_became_active":"2023-01-02T18:16:51.341683+0000","last_became_peered":"2023-01-02T18:16:51.341683+0000","last_unstale":"2023-01-02T18:17:51.878894+0000","last_undegraded":"2023-01-02T18:17:51.878894+0000","last_fullsized":"2023-01-02T18:17:51.878894+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877857+0000","last_change":"2023-01-02T18:16:57.312289+0000","last_active":"2023-01-02T18:17:51.877857+0000","last_peered":"2023-01-02T18:17:51.877857+0000","last_clean":"2023-01-02T18:17:51.877857+0000","last_became_active":"2023-01-02T18:16:55.317023+0000","last_became_peered":"2023-01-02T18:16:55.317023+0000","last_unstale":"2023-01-02T18:17:51.877857+0000","last_undegraded":"2023-01-02T18:17:51.877857+0000","last_fullsized":"2023-01-02T18:17:51.877857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"105'15","reported_seq":85,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777442+0000","last_change":"2023-01-02T18:17:38.447587+0000","last_active":"2023-01-02T18:17:52.777442+0000","last_peered":"2023-01-02T18:17:52.777442+0000","last_clean":"2023-01-02T18:17:52.777442+0000","last_became_active":"2023-01-02T18:17:36.439633+0000","last_became_peered":"2023-01-02T18:17:36.439633+0000","last_unstale":"2023-01-02T18:17:52.777442+0000","last_undegraded":"2023-01-02T18:17:52.777442+0000","last_fullsized":"2023-01-02T18:17:52.777442+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"101'19","reported_seq":105,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777616+0000","last_change":"2023-01-02T18:17:34.318618+0000","last_active":"2023-01-02T18:17:52.777616+0000","last_peered":"2023-01-02T18:17:52.777616+0000","last_clean":"2023-01-02T18:17:52.777616+0000","last_became_active":"2023-01-02T18:17:32.337685+0000","last_became_peered":"2023-01-02T18:17:32.337685+0000","last_unstale":"2023-01-02T18:17:52.777616+0000","last_undegraded":"2023-01-02T18:17:52.777616+0000","last_fullsized":"2023-01-02T18:17:52.777616+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777955+0000","last_change":"2023-01-02T18:17:29.329576+0000","last_active":"2023-01-02T18:17:52.777955+0000","last_peered":"2023-01-02T18:17:52.777955+0000","last_clean":"2023-01-02T18:17:52.777955+0000","last_became_active":"2023-01-02T18:17:29.328074+0000","last_became_peered":"2023-01-02T18:17:29.328074+0000","last_unstale":"2023-01-02T18:17:52.777955+0000","last_undegraded":"2023-01-02T18:17:52.777955+0000","last_fullsized":"2023-01-02T18:17:52.777955+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"72'10","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777784+0000","last_change":"2023-01-02T18:17:29.331966+0000","last_active":"2023-01-02T18:17:52.777784+0000","last_peered":"2023-01-02T18:17:52.777784+0000","last_clean":"2023-01-02T18:17:52.777784+0000","last_became_active":"2023-01-02T18:17:29.322773+0000","last_became_peered":"2023-01-02T18:17:29.322773+0000","last_unstale":"2023-01-02T18:17:52.777784+0000","last_undegraded":"2023-01-02T18:17:52.777784+0000","last_fullsized":"2023-01-02T18:17:52.777784+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"51'1","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776730+0000","last_change":"2023-01-02T18:17:29.334624+0000","last_active":"2023-01-02T18:17:52.776730+0000","last_peered":"2023-01-02T18:17:52.776730+0000","last_clean":"2023-01-02T18:17:52.776730+0000","last_became_active":"2023-01-02T18:17:29.332434+0000","last_became_peered":"2023-01-02T18:17:29.332434+0000","last_unstale":"2023-01-02T18:17:52.776730+0000","last_undegraded":"2023-01-02T18:17:52.776730+0000","last_fullsized":"2023-01-02T18:17:52.776730+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"82'14","reported_seq":207,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697876+0000","last_change":"2023-01-02T18:17:30.335393+0000","last_active":"2023-01-02T18:17:51.697876+0000","last_peered":"2023-01-02T18:17:51.697876+0000","last_clean":"2023-01-02T18:17:51.697876+0000","last_became_active":"2023-01-02T18:16:48.324242+0000","last_became_peered":"2023-01-02T18:16:48.324242+0000","last_unstale":"2023-01-02T18:17:51.697876+0000","last_undegraded":"2023-01-02T18:17:51.697876+0000","last_fullsized":"2023-01-02T18:17:51.697876+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":122,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":46,"num_keys_recovered":8,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":74,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697961+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:17:51.697961+0000","last_peered":"2023-01-02T18:17:51.697961+0000","last_clean":"2023-01-02T18:17:51.697961+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:17:51.697961+0000","last_undegraded":"2023-01-02T18:17:51.697961+0000","last_fullsized":"2023-01-02T18:17:51.697961+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777059+0000","last_change":"2023-01-02T18:17:29.335316+0000","last_active":"2023-01-02T18:17:52.777059+0000","last_peered":"2023-01-02T18:17:52.777059+0000","last_clean":"2023-01-02T18:17:52.777059+0000","last_became_active":"2023-01-02T18:17:29.333739+0000","last_became_peered":"2023-01-02T18:17:29.333739+0000","last_unstale":"2023-01-02T18:17:52.777059+0000","last_undegraded":"2023-01-02T18:17:52.777059+0000","last_fullsized":"2023-01-02T18:17:52.777059+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":75,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691370+0000","last_change":"2023-01-02T18:17:29.319062+0000","last_active":"2023-01-02T18:17:51.691370+0000","last_peered":"2023-01-02T18:17:51.691370+0000","last_clean":"2023-01-02T18:17:51.691370+0000","last_became_active":"2023-01-02T18:17:29.318747+0000","last_became_peered":"2023-01-02T18:17:29.318747+0000","last_unstale":"2023-01-02T18:17:51.691370+0000","last_undegraded":"2023-01-02T18:17:51.691370+0000","last_fullsized":"2023-01-02T18:17:51.691370+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700792+0000","last_change":"2023-01-02T18:17:38.460254+0000","last_active":"2023-01-02T18:17:51.700792+0000","last_peered":"2023-01-02T18:17:51.700792+0000","last_clean":"2023-01-02T18:17:51.700792+0000","last_became_active":"2023-01-02T18:17:36.446522+0000","last_became_peered":"2023-01-02T18:17:36.446522+0000","last_unstale":"2023-01-02T18:17:51.700792+0000","last_undegraded":"2023-01-02T18:17:51.700792+0000","last_fullsized":"2023-01-02T18:17:51.700792+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.692535+0000","last_change":"2023-01-02T18:17:34.331749+0000","last_active":"2023-01-02T18:17:51.692535+0000","last_peered":"2023-01-02T18:17:51.692535+0000","last_clean":"2023-01-02T18:17:51.692535+0000","last_became_active":"2023-01-02T18:17:32.337737+0000","last_became_peered":"2023-01-02T18:17:32.337737+0000","last_unstale":"2023-01-02T18:17:51.692535+0000","last_undegraded":"2023-01-02T18:17:51.692535+0000","last_fullsized":"2023-01-02T18:17:51.692535+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"76'3","reported_seq":140,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877765+0000","last_change":"2023-01-02T18:17:09.308112+0000","last_active":"2023-01-02T18:17:51.877765+0000","last_peered":"2023-01-02T18:17:51.877765+0000","last_clean":"2023-01-02T18:17:51.877765+0000","last_became_active":"2023-01-02T18:17:07.336295+0000","last_became_peered":"2023-01-02T18:17:07.336295+0000","last_unstale":"2023-01-02T18:17:51.877765+0000","last_undegraded":"2023-01-02T18:17:51.877765+0000","last_fullsized":"2023-01-02T18:17:51.877765+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":80,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"72'85","reported_seq":722,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701386+0000","last_change":"2023-01-02T18:17:01.316472+0000","last_active":"2023-01-02T18:17:51.701386+0000","last_peered":"2023-01-02T18:17:51.701386+0000","last_clean":"2023-01-02T18:17:51.701386+0000","last_became_active":"2023-01-02T18:16:59.310142+0000","last_became_peered":"2023-01-02T18:16:59.310142+0000","last_unstale":"2023-01-02T18:17:51.701386+0000","last_undegraded":"2023-01-02T18:17:51.701386+0000","last_fullsized":"2023-01-02T18:17:51.701386+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1544,"num_read_kb":1398,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878867+0000","last_change":"2023-01-02T18:16:44.308280+0000","last_active":"2023-01-02T18:17:51.878867+0000","last_peered":"2023-01-02T18:17:51.878867+0000","last_clean":"2023-01-02T18:17:51.878867+0000","last_became_active":"2023-01-02T18:16:41.446391+0000","last_became_peered":"2023-01-02T18:16:41.446391+0000","last_unstale":"2023-01-02T18:17:51.878867+0000","last_undegraded":"2023-01-02T18:17:51.878867+0000","last_fullsized":"2023-01-02T18:17:51.878867+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"80'15","reported_seq":203,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700810+0000","last_change":"2023-01-02T18:17:30.502618+0000","last_active":"2023-01-02T18:17:51.700810+0000","last_peered":"2023-01-02T18:17:51.700810+0000","last_clean":"2023-01-02T18:17:51.700810+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:17:51.700810+0000","last_undegraded":"2023-01-02T18:17:51.700810+0000","last_fullsized":"2023-01-02T18:17:51.700810+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":151,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777938+0000","last_change":"2023-01-02T18:17:29.337167+0000","last_active":"2023-01-02T18:17:52.777938+0000","last_peered":"2023-01-02T18:17:52.777938+0000","last_clean":"2023-01-02T18:17:52.777938+0000","last_became_active":"2023-01-02T18:17:29.335412+0000","last_became_peered":"2023-01-02T18:17:29.335412+0000","last_unstale":"2023-01-02T18:17:52.777938+0000","last_undegraded":"2023-01-02T18:17:52.777938+0000","last_fullsized":"2023-01-02T18:17:52.777938+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697600+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:17:51.697600+0000","last_peered":"2023-01-02T18:17:51.697600+0000","last_clean":"2023-01-02T18:17:51.697600+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:17:51.697600+0000","last_undegraded":"2023-01-02T18:17:51.697600+0000","last_fullsized":"2023-01-02T18:17:51.697600+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":72,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878513+0000","last_change":"2023-01-02T18:16:57.313875+0000","last_active":"2023-01-02T18:17:51.878513+0000","last_peered":"2023-01-02T18:17:51.878513+0000","last_clean":"2023-01-02T18:17:51.878513+0000","last_became_active":"2023-01-02T18:16:55.318719+0000","last_became_peered":"2023-01-02T18:16:55.318719+0000","last_unstale":"2023-01-02T18:17:51.878513+0000","last_undegraded":"2023-01-02T18:17:51.878513+0000","last_fullsized":"2023-01-02T18:17:51.878513+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":27,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703710+0000","last_change":"2023-01-02T18:17:38.444327+0000","last_active":"2023-01-02T18:17:52.703710+0000","last_peered":"2023-01-02T18:17:52.703710+0000","last_clean":"2023-01-02T18:17:52.703710+0000","last_became_active":"2023-01-02T18:17:36.443020+0000","last_became_peered":"2023-01-02T18:17:36.443020+0000","last_unstale":"2023-01-02T18:17:52.703710+0000","last_undegraded":"2023-01-02T18:17:52.703710+0000","last_fullsized":"2023-01-02T18:17:52.703710+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.705132+0000","last_change":"2023-01-02T18:17:34.343511+0000","last_active":"2023-01-02T18:17:51.705132+0000","last_peered":"2023-01-02T18:17:51.705132+0000","last_clean":"2023-01-02T18:17:51.705132+0000","last_became_active":"2023-01-02T18:17:32.340038+0000","last_became_peered":"2023-01-02T18:17:32.340038+0000","last_unstale":"2023-01-02T18:17:51.705132+0000","last_undegraded":"2023-01-02T18:17:51.705132+0000","last_fullsized":"2023-01-02T18:17:51.705132+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878048+0000","last_change":"2023-01-02T18:17:09.307476+0000","last_active":"2023-01-02T18:17:51.878048+0000","last_peered":"2023-01-02T18:17:51.878048+0000","last_clean":"2023-01-02T18:17:51.878048+0000","last_became_active":"2023-01-02T18:17:07.336526+0000","last_became_peered":"2023-01-02T18:17:07.336526+0000","last_unstale":"2023-01-02T18:17:51.878048+0000","last_undegraded":"2023-01-02T18:17:51.878048+0000","last_fullsized":"2023-01-02T18:17:51.878048+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"68'2","reported_seq":170,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701771+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:17:51.701771+0000","last_peered":"2023-01-02T18:17:51.701771+0000","last_clean":"2023-01-02T18:17:51.701771+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:17:51.701771+0000","last_undegraded":"2023-01-02T18:17:51.701771+0000","last_fullsized":"2023-01-02T18:17:51.701771+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878241+0000","last_change":"2023-01-02T18:16:44.307606+0000","last_active":"2023-01-02T18:17:51.878241+0000","last_peered":"2023-01-02T18:17:51.878241+0000","last_clean":"2023-01-02T18:17:51.878241+0000","last_became_active":"2023-01-02T18:16:41.449266+0000","last_became_peered":"2023-01-02T18:16:41.449266+0000","last_unstale":"2023-01-02T18:17:51.878241+0000","last_undegraded":"2023-01-02T18:17:51.878241+0000","last_fullsized":"2023-01-02T18:17:51.878241+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":147,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697853+0000","last_change":"2023-01-02T18:17:30.333872+0000","last_active":"2023-01-02T18:17:51.697853+0000","last_peered":"2023-01-02T18:17:51.697853+0000","last_clean":"2023-01-02T18:17:51.697853+0000","last_became_active":"2023-01-02T18:16:48.329249+0000","last_became_peered":"2023-01-02T18:16:48.329249+0000","last_unstale":"2023-01-02T18:17:51.697853+0000","last_undegraded":"2023-01-02T18:17:51.697853+0000","last_fullsized":"2023-01-02T18:17:51.697853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878945+0000","last_change":"2023-01-02T18:16:49.311129+0000","last_active":"2023-01-02T18:17:51.878945+0000","last_peered":"2023-01-02T18:17:51.878945+0000","last_clean":"2023-01-02T18:17:51.878945+0000","last_became_active":"2023-01-02T18:16:46.312301+0000","last_became_peered":"2023-01-02T18:16:46.312301+0000","last_unstale":"2023-01-02T18:17:51.878945+0000","last_undegraded":"2023-01-02T18:17:51.878945+0000","last_fullsized":"2023-01-02T18:17:51.878945+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.706353+0000","last_change":"2023-01-02T18:16:53.350359+0000","last_active":"2023-01-02T18:17:51.706353+0000","last_peered":"2023-01-02T18:17:51.706353+0000","last_clean":"2023-01-02T18:17:51.706353+0000","last_became_active":"2023-01-02T18:16:51.338043+0000","last_became_peered":"2023-01-02T18:16:51.338043+0000","last_unstale":"2023-01-02T18:17:51.706353+0000","last_undegraded":"2023-01-02T18:17:51.706353+0000","last_fullsized":"2023-01-02T18:17:51.706353+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":70,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696839+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:17:51.696839+0000","last_peered":"2023-01-02T18:17:51.696839+0000","last_clean":"2023-01-02T18:17:51.696839+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:17:51.696839+0000","last_undegraded":"2023-01-02T18:17:51.696839+0000","last_fullsized":"2023-01-02T18:17:51.696839+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1a","version":"105'3","reported_seq":39,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777168+0000","last_change":"2023-01-02T18:17:38.449366+0000","last_active":"2023-01-02T18:17:52.777168+0000","last_peered":"2023-01-02T18:17:52.777168+0000","last_clean":"2023-01-02T18:17:52.777168+0000","last_became_active":"2023-01-02T18:17:36.440502+0000","last_became_peered":"2023-01-02T18:17:36.440502+0000","last_unstale":"2023-01-02T18:17:52.777168+0000","last_undegraded":"2023-01-02T18:17:52.777168+0000","last_fullsized":"2023-01-02T18:17:52.777168+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":8,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"101'2","reported_seq":44,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877959+0000","last_change":"2023-01-02T18:17:34.347105+0000","last_active":"2023-01-02T18:17:51.877959+0000","last_peered":"2023-01-02T18:17:51.877959+0000","last_clean":"2023-01-02T18:17:51.877959+0000","last_became_active":"2023-01-02T18:17:32.344891+0000","last_became_peered":"2023-01-02T18:17:32.344891+0000","last_unstale":"2023-01-02T18:17:51.877959+0000","last_undegraded":"2023-01-02T18:17:51.877959+0000","last_fullsized":"2023-01-02T18:17:51.877959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700517+0000","last_change":"2023-01-02T18:17:09.330482+0000","last_active":"2023-01-02T18:17:51.700517+0000","last_peered":"2023-01-02T18:17:51.700517+0000","last_clean":"2023-01-02T18:17:51.700517+0000","last_became_active":"2023-01-02T18:17:07.344261+0000","last_became_peered":"2023-01-02T18:17:07.344261+0000","last_unstale":"2023-01-02T18:17:51.700517+0000","last_undegraded":"2023-01-02T18:17:51.700517+0000","last_fullsized":"2023-01-02T18:17:51.700517+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"68'4","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776950+0000","last_change":"2023-01-02T18:17:29.353714+0000","last_active":"2023-01-02T18:17:52.776950+0000","last_peered":"2023-01-02T18:17:52.776950+0000","last_clean":"2023-01-02T18:17:52.776950+0000","last_became_active":"2023-01-02T18:17:29.325542+0000","last_became_peered":"2023-01-02T18:17:29.325542+0000","last_unstale":"2023-01-02T18:17:52.776950+0000","last_undegraded":"2023-01-02T18:17:52.776950+0000","last_fullsized":"2023-01-02T18:17:52.776950+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777840+0000","last_change":"2023-01-02T18:17:29.335193+0000","last_active":"2023-01-02T18:17:52.777840+0000","last_peered":"2023-01-02T18:17:52.777840+0000","last_clean":"2023-01-02T18:17:52.777840+0000","last_became_active":"2023-01-02T18:17:29.334681+0000","last_became_peered":"2023-01-02T18:17:29.334681+0000","last_unstale":"2023-01-02T18:17:52.777840+0000","last_undegraded":"2023-01-02T18:17:52.777840+0000","last_fullsized":"2023-01-02T18:17:52.777840+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":127,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696858+0000","last_change":"2023-01-02T18:17:30.333125+0000","last_active":"2023-01-02T18:17:51.696858+0000","last_peered":"2023-01-02T18:17:51.696858+0000","last_clean":"2023-01-02T18:17:51.696858+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:17:51.696858+0000","last_undegraded":"2023-01-02T18:17:51.696858+0000","last_fullsized":"2023-01-02T18:17:51.696858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878766+0000","last_change":"2023-01-02T18:16:49.310391+0000","last_active":"2023-01-02T18:17:51.878766+0000","last_peered":"2023-01-02T18:17:51.878766+0000","last_clean":"2023-01-02T18:17:51.878766+0000","last_became_active":"2023-01-02T18:16:46.316328+0000","last_became_peered":"2023-01-02T18:16:46.316328+0000","last_unstale":"2023-01-02T18:17:51.878766+0000","last_undegraded":"2023-01-02T18:17:51.878766+0000","last_fullsized":"2023-01-02T18:17:51.878766+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777719+0000","last_change":"2023-01-02T18:17:29.324721+0000","last_active":"2023-01-02T18:17:52.777719+0000","last_peered":"2023-01-02T18:17:52.777719+0000","last_clean":"2023-01-02T18:17:52.777719+0000","last_became_active":"2023-01-02T18:17:29.323897+0000","last_became_peered":"2023-01-02T18:17:29.323897+0000","last_unstale":"2023-01-02T18:17:52.777719+0000","last_undegraded":"2023-01-02T18:17:52.777719+0000","last_fullsized":"2023-01-02T18:17:52.777719+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":68,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.704498+0000","last_change":"2023-01-02T18:16:57.306845+0000","last_active":"2023-01-02T18:17:52.704498+0000","last_peered":"2023-01-02T18:17:52.704498+0000","last_clean":"2023-01-02T18:17:52.704498+0000","last_became_active":"2023-01-02T18:16:55.318612+0000","last_became_peered":"2023-01-02T18:16:55.318612+0000","last_unstale":"2023-01-02T18:17:52.704498+0000","last_undegraded":"2023-01-02T18:17:52.704498+0000","last_fullsized":"2023-01-02T18:17:52.704498+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":24,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696972+0000","last_change":"2023-01-02T18:17:38.463630+0000","last_active":"2023-01-02T18:17:51.696972+0000","last_peered":"2023-01-02T18:17:51.696972+0000","last_clean":"2023-01-02T18:17:51.696972+0000","last_became_active":"2023-01-02T18:17:36.449160+0000","last_became_peered":"2023-01-02T18:17:36.449160+0000","last_unstale":"2023-01-02T18:17:51.696972+0000","last_undegraded":"2023-01-02T18:17:51.696972+0000","last_fullsized":"2023-01-02T18:17:51.696972+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1a","version":"101'8","reported_seq":66,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700676+0000","last_change":"2023-01-02T18:17:34.325778+0000","last_active":"2023-01-02T18:17:51.700676+0000","last_peered":"2023-01-02T18:17:51.700676+0000","last_clean":"2023-01-02T18:17:51.700676+0000","last_became_active":"2023-01-02T18:17:32.340683+0000","last_became_peered":"2023-01-02T18:17:32.340683+0000","last_unstale":"2023-01-02T18:17:51.700676+0000","last_undegraded":"2023-01-02T18:17:51.700676+0000","last_fullsized":"2023-01-02T18:17:51.700676+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878474+0000","last_change":"2023-01-02T18:17:09.307508+0000","last_active":"2023-01-02T18:17:51.878474+0000","last_peered":"2023-01-02T18:17:51.878474+0000","last_clean":"2023-01-02T18:17:51.878474+0000","last_became_active":"2023-01-02T18:17:07.344914+0000","last_became_peered":"2023-01-02T18:17:07.344914+0000","last_unstale":"2023-01-02T18:17:51.878474+0000","last_undegraded":"2023-01-02T18:17:51.878474+0000","last_fullsized":"2023-01-02T18:17:51.878474+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"69'1","reported_seq":80,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877511+0000","last_change":"2023-01-02T18:17:29.365036+0000","last_active":"2023-01-02T18:17:51.877511+0000","last_peered":"2023-01-02T18:17:51.877511+0000","last_clean":"2023-01-02T18:17:51.877511+0000","last_became_active":"2023-01-02T18:17:29.334847+0000","last_became_peered":"2023-01-02T18:17:29.334847+0000","last_unstale":"2023-01-02T18:17:51.877511+0000","last_undegraded":"2023-01-02T18:17:51.877511+0000","last_fullsized":"2023-01-02T18:17:51.877511+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878610+0000","last_change":"2023-01-02T18:16:44.307239+0000","last_active":"2023-01-02T18:17:51.878610+0000","last_peered":"2023-01-02T18:17:51.878610+0000","last_clean":"2023-01-02T18:17:51.878610+0000","last_became_active":"2023-01-02T18:16:41.447671+0000","last_became_peered":"2023-01-02T18:16:41.447671+0000","last_unstale":"2023-01-02T18:17:51.878610+0000","last_undegraded":"2023-01-02T18:17:51.878610+0000","last_fullsized":"2023-01-02T18:17:51.878610+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"97'20","reported_seq":228,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697028+0000","last_change":"2023-01-02T18:17:30.334708+0000","last_active":"2023-01-02T18:17:51.697028+0000","last_peered":"2023-01-02T18:17:51.697028+0000","last_clean":"2023-01-02T18:17:51.697028+0000","last_became_active":"2023-01-02T18:16:48.322940+0000","last_became_peered":"2023-01-02T18:16:48.322940+0000","last_unstale":"2023-01-02T18:17:51.697028+0000","last_undegraded":"2023-01-02T18:17:51.697028+0000","last_fullsized":"2023-01-02T18:17:51.697028+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":242,"num_read_kb":200,"num_write":27,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777584+0000","last_change":"2023-01-02T18:17:29.329761+0000","last_active":"2023-01-02T18:17:52.777584+0000","last_peered":"2023-01-02T18:17:52.777584+0000","last_clean":"2023-01-02T18:17:52.777584+0000","last_became_active":"2023-01-02T18:17:29.327470+0000","last_became_peered":"2023-01-02T18:17:29.327470+0000","last_unstale":"2023-01-02T18:17:52.777584+0000","last_undegraded":"2023-01-02T18:17:52.777584+0000","last_fullsized":"2023-01-02T18:17:52.777584+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":69,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697262+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:17:51.697262+0000","last_peered":"2023-01-02T18:17:51.697262+0000","last_clean":"2023-01-02T18:17:51.697262+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:17:51.697262+0000","last_undegraded":"2023-01-02T18:17:51.697262+0000","last_fullsized":"2023-01-02T18:17:51.697262+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697979+0000","last_change":"2023-01-02T18:17:29.340931+0000","last_active":"2023-01-02T18:17:51.697979+0000","last_peered":"2023-01-02T18:17:51.697979+0000","last_clean":"2023-01-02T18:17:51.697979+0000","last_became_active":"2023-01-02T18:17:29.340602+0000","last_became_peered":"2023-01-02T18:17:29.340602+0000","last_unstale":"2023-01-02T18:17:51.697979+0000","last_undegraded":"2023-01-02T18:17:51.697979+0000","last_fullsized":"2023-01-02T18:17:51.697979+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1c","version":"105'11","reported_seq":43,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701571+0000","last_change":"2023-01-02T18:17:38.460374+0000","last_active":"2023-01-02T18:17:51.701571+0000","last_peered":"2023-01-02T18:17:51.701571+0000","last_clean":"2023-01-02T18:17:51.701571+0000","last_became_active":"2023-01-02T18:17:36.443934+0000","last_became_peered":"2023-01-02T18:17:36.443934+0000","last_unstale":"2023-01-02T18:17:51.701571+0000","last_undegraded":"2023-01-02T18:17:51.701571+0000","last_fullsized":"2023-01-02T18:17:51.701571+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"101'8","reported_seq":53,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701892+0000","last_change":"2023-01-02T18:17:34.327085+0000","last_active":"2023-01-02T18:17:51.701892+0000","last_peered":"2023-01-02T18:17:51.701892+0000","last_clean":"2023-01-02T18:17:51.701892+0000","last_became_active":"2023-01-02T18:17:32.343328+0000","last_became_peered":"2023-01-02T18:17:32.343328+0000","last_unstale":"2023-01-02T18:17:51.701892+0000","last_undegraded":"2023-01-02T18:17:51.701892+0000","last_fullsized":"2023-01-02T18:17:51.701892+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":56,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.702198+0000","last_change":"2023-01-02T18:17:09.325339+0000","last_active":"2023-01-02T18:17:52.702198+0000","last_peered":"2023-01-02T18:17:52.702198+0000","last_clean":"2023-01-02T18:17:52.702198+0000","last_became_active":"2023-01-02T18:17:07.341155+0000","last_became_peered":"2023-01-02T18:17:07.341155+0000","last_unstale":"2023-01-02T18:17:52.702198+0000","last_undegraded":"2023-01-02T18:17:52.702198+0000","last_fullsized":"2023-01-02T18:17:52.702198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":84,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701607+0000","last_change":"2023-01-02T18:17:29.343403+0000","last_active":"2023-01-02T18:17:52.701607+0000","last_peered":"2023-01-02T18:17:52.701607+0000","last_clean":"2023-01-02T18:17:52.701607+0000","last_became_active":"2023-01-02T18:17:29.320060+0000","last_became_peered":"2023-01-02T18:17:29.320060+0000","last_unstale":"2023-01-02T18:17:52.701607+0000","last_undegraded":"2023-01-02T18:17:52.701607+0000","last_fullsized":"2023-01-02T18:17:52.701607+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":73,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701561+0000","last_change":"2023-01-02T18:16:48.329830+0000","last_active":"2023-01-02T18:17:51.701561+0000","last_peered":"2023-01-02T18:17:51.701561+0000","last_clean":"2023-01-02T18:17:51.701561+0000","last_became_active":"2023-01-02T18:16:48.329469+0000","last_became_peered":"2023-01-02T18:16:48.329469+0000","last_unstale":"2023-01-02T18:17:51.701561+0000","last_undegraded":"2023-01-02T18:17:51.701561+0000","last_fullsized":"2023-01-02T18:17:51.701561+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":128,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696770+0000","last_change":"2023-01-02T18:17:30.334813+0000","last_active":"2023-01-02T18:17:51.696770+0000","last_peered":"2023-01-02T18:17:51.696770+0000","last_clean":"2023-01-02T18:17:51.696770+0000","last_became_active":"2023-01-02T18:16:48.326351+0000","last_became_peered":"2023-01-02T18:16:48.326351+0000","last_unstale":"2023-01-02T18:17:51.696770+0000","last_undegraded":"2023-01-02T18:17:51.696770+0000","last_fullsized":"2023-01-02T18:17:51.696770+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777424+0000","last_change":"2023-01-02T18:17:29.333748+0000","last_active":"2023-01-02T18:17:52.777424+0000","last_peered":"2023-01-02T18:17:52.777424+0000","last_clean":"2023-01-02T18:17:52.777424+0000","last_became_active":"2023-01-02T18:17:29.330002+0000","last_became_peered":"2023-01-02T18:17:29.330002+0000","last_unstale":"2023-01-02T18:17:52.777424+0000","last_undegraded":"2023-01-02T18:17:52.777424+0000","last_fullsized":"2023-01-02T18:17:52.777424+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877849+0000","last_change":"2023-01-02T18:16:53.342357+0000","last_active":"2023-01-02T18:17:51.877849+0000","last_peered":"2023-01-02T18:17:51.877849+0000","last_clean":"2023-01-02T18:17:51.877849+0000","last_became_active":"2023-01-02T18:16:51.341254+0000","last_became_peered":"2023-01-02T18:16:51.341254+0000","last_unstale":"2023-01-02T18:17:51.877849+0000","last_undegraded":"2023-01-02T18:17:51.877849+0000","last_fullsized":"2023-01-02T18:17:51.877849+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877615+0000","last_change":"2023-01-02T18:17:50.681964+0000","last_active":"2023-01-02T18:17:51.877615+0000","last_peered":"2023-01-02T18:17:51.877615+0000","last_clean":"2023-01-02T18:17:51.877615+0000","last_became_active":"2023-01-02T18:17:50.681636+0000","last_became_peered":"2023-01-02T18:17:50.681636+0000","last_unstale":"2023-01-02T18:17:51.877615+0000","last_undegraded":"2023-01-02T18:17:51.877615+0000","last_fullsized":"2023-01-02T18:17:51.877615+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":24,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697013+0000","last_change":"2023-01-02T18:17:38.464600+0000","last_active":"2023-01-02T18:17:51.697013+0000","last_peered":"2023-01-02T18:17:51.697013+0000","last_clean":"2023-01-02T18:17:51.697013+0000","last_became_active":"2023-01-02T18:17:36.445763+0000","last_became_peered":"2023-01-02T18:17:36.445763+0000","last_unstale":"2023-01-02T18:17:51.697013+0000","last_undegraded":"2023-01-02T18:17:51.697013+0000","last_fullsized":"2023-01-02T18:17:51.697013+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"101'10","reported_seq":64,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701371+0000","last_change":"2023-01-02T18:17:34.326274+0000","last_active":"2023-01-02T18:17:51.701371+0000","last_peered":"2023-01-02T18:17:51.701371+0000","last_clean":"2023-01-02T18:17:51.701371+0000","last_became_active":"2023-01-02T18:17:32.339630+0000","last_became_peered":"2023-01-02T18:17:32.339630+0000","last_unstale":"2023-01-02T18:17:51.701371+0000","last_undegraded":"2023-01-02T18:17:51.701371+0000","last_fullsized":"2023-01-02T18:17:51.701371+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":55,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.694119+0000","last_change":"2023-01-02T18:17:09.308664+0000","last_active":"2023-01-02T18:17:51.694119+0000","last_peered":"2023-01-02T18:17:51.694119+0000","last_clean":"2023-01-02T18:17:51.694119+0000","last_became_active":"2023-01-02T18:17:07.344272+0000","last_became_peered":"2023-01-02T18:17:07.344272+0000","last_unstale":"2023-01-02T18:17:51.694119+0000","last_undegraded":"2023-01-02T18:17:51.694119+0000","last_fullsized":"2023-01-02T18:17:51.694119+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":63,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878089+0000","last_change":"2023-01-02T18:17:01.311474+0000","last_active":"2023-01-02T18:17:51.878089+0000","last_peered":"2023-01-02T18:17:51.878089+0000","last_clean":"2023-01-02T18:17:51.878089+0000","last_became_active":"2023-01-02T18:16:59.314245+0000","last_became_peered":"2023-01-02T18:16:59.314245+0000","last_unstale":"2023-01-02T18:17:51.878089+0000","last_undegraded":"2023-01-02T18:17:51.878089+0000","last_fullsized":"2023-01-02T18:17:51.878089+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":97,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701644+0000","last_change":"2023-01-02T18:17:48.662639+0000","last_active":"2023-01-02T18:17:51.701644+0000","last_peered":"2023-01-02T18:17:51.701644+0000","last_clean":"2023-01-02T18:17:51.701644+0000","last_became_active":"2023-01-02T18:17:48.662288+0000","last_became_peered":"2023-01-02T18:17:48.662288+0000","last_unstale":"2023-01-02T18:17:51.701644+0000","last_undegraded":"2023-01-02T18:17:51.701644+0000","last_fullsized":"2023-01-02T18:17:51.701644+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"86'18","reported_seq":220,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697102+0000","last_change":"2023-01-02T18:17:30.335050+0000","last_active":"2023-01-02T18:17:51.697102+0000","last_peered":"2023-01-02T18:17:51.697102+0000","last_clean":"2023-01-02T18:17:51.697102+0000","last_became_active":"2023-01-02T18:16:37.436152+0000","last_became_peered":"2023-01-02T18:16:37.436152+0000","last_unstale":"2023-01-02T18:17:51.697102+0000","last_undegraded":"2023-01-02T18:17:51.697102+0000","last_fullsized":"2023-01-02T18:17:51.697102+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":192,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":76,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878485+0000","last_change":"2023-01-02T18:16:49.309763+0000","last_active":"2023-01-02T18:17:51.878485+0000","last_peered":"2023-01-02T18:17:51.878485+0000","last_clean":"2023-01-02T18:17:51.878485+0000","last_became_active":"2023-01-02T18:16:46.308336+0000","last_became_peered":"2023-01-02T18:16:46.308336+0000","last_unstale":"2023-01-02T18:17:51.878485+0000","last_undegraded":"2023-01-02T18:17:51.878485+0000","last_fullsized":"2023-01-02T18:17:51.878485+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":80,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701461+0000","last_change":"2023-01-02T18:17:29.320574+0000","last_active":"2023-01-02T18:17:52.701461+0000","last_peered":"2023-01-02T18:17:52.701461+0000","last_clean":"2023-01-02T18:17:52.701461+0000","last_became_active":"2023-01-02T18:17:29.320274+0000","last_became_peered":"2023-01-02T18:17:29.320274+0000","last_unstale":"2023-01-02T18:17:52.701461+0000","last_undegraded":"2023-01-02T18:17:52.701461+0000","last_fullsized":"2023-01-02T18:17:52.701461+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":65,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697603+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:17:51.697603+0000","last_peered":"2023-01-02T18:17:51.697603+0000","last_clean":"2023-01-02T18:17:51.697603+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:17:51.697603+0000","last_undegraded":"2023-01-02T18:17:51.697603+0000","last_fullsized":"2023-01-02T18:17:51.697603+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":24,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697472+0000","last_change":"2023-01-02T18:17:38.464884+0000","last_active":"2023-01-02T18:17:51.697472+0000","last_peered":"2023-01-02T18:17:51.697472+0000","last_clean":"2023-01-02T18:17:51.697472+0000","last_became_active":"2023-01-02T18:17:36.445153+0000","last_became_peered":"2023-01-02T18:17:36.445153+0000","last_unstale":"2023-01-02T18:17:51.697472+0000","last_undegraded":"2023-01-02T18:17:51.697472+0000","last_fullsized":"2023-01-02T18:17:51.697472+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":40,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697787+0000","last_change":"2023-01-02T18:17:34.343843+0000","last_active":"2023-01-02T18:17:51.697787+0000","last_peered":"2023-01-02T18:17:51.697787+0000","last_clean":"2023-01-02T18:17:51.697787+0000","last_became_active":"2023-01-02T18:17:32.344716+0000","last_became_peered":"2023-01-02T18:17:32.344716+0000","last_unstale":"2023-01-02T18:17:51.697787+0000","last_undegraded":"2023-01-02T18:17:51.697787+0000","last_fullsized":"2023-01-02T18:17:51.697787+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"76'3","reported_seq":64,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691511+0000","last_change":"2023-01-02T18:17:09.308316+0000","last_active":"2023-01-02T18:17:51.691511+0000","last_peered":"2023-01-02T18:17:51.691511+0000","last_clean":"2023-01-02T18:17:51.691511+0000","last_became_active":"2023-01-02T18:17:07.339700+0000","last_became_peered":"2023-01-02T18:17:07.339700+0000","last_unstale":"2023-01-02T18:17:51.691511+0000","last_undegraded":"2023-01-02T18:17:51.691511+0000","last_fullsized":"2023-01-02T18:17:51.691511+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":70,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703428+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:17:52.703428+0000","last_peered":"2023-01-02T18:17:52.703428+0000","last_clean":"2023-01-02T18:17:52.703428+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:17:52.703428+0000","last_undegraded":"2023-01-02T18:17:52.703428+0000","last_fullsized":"2023-01-02T18:17:52.703428+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878667+0000","last_change":"2023-01-02T18:16:44.306989+0000","last_active":"2023-01-02T18:17:51.878667+0000","last_peered":"2023-01-02T18:17:51.878667+0000","last_clean":"2023-01-02T18:17:51.878667+0000","last_became_active":"2023-01-02T18:16:41.448619+0000","last_became_peered":"2023-01-02T18:16:41.448619+0000","last_unstale":"2023-01-02T18:17:51.878667+0000","last_undegraded":"2023-01-02T18:17:51.878667+0000","last_fullsized":"2023-01-02T18:17:51.878667+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"46'1","reported_seq":44,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777764+0000","last_change":"2023-01-02T18:17:30.331472+0000","last_active":"2023-01-02T18:17:52.777764+0000","last_peered":"2023-01-02T18:17:52.777764+0000","last_clean":"2023-01-02T18:17:52.777764+0000","last_became_active":"2023-01-02T18:17:29.333176+0000","last_became_peered":"2023-01-02T18:17:29.333176+0000","last_unstale":"2023-01-02T18:17:52.777764+0000","last_undegraded":"2023-01-02T18:17:52.777764+0000","last_fullsized":"2023-01-02T18:17:52.777764+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":82,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696783+0000","last_change":"2023-01-02T18:16:49.304745+0000","last_active":"2023-01-02T18:17:51.696783+0000","last_peered":"2023-01-02T18:17:51.696783+0000","last_clean":"2023-01-02T18:17:51.696783+0000","last_became_active":"2023-01-02T18:16:48.325920+0000","last_became_peered":"2023-01-02T18:16:48.325920+0000","last_unstale":"2023-01-02T18:17:51.696783+0000","last_undegraded":"2023-01-02T18:17:51.696783+0000","last_fullsized":"2023-01-02T18:17:51.696783+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":72,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878902+0000","last_change":"2023-01-02T18:16:53.342417+0000","last_active":"2023-01-02T18:17:51.878902+0000","last_peered":"2023-01-02T18:17:51.878902+0000","last_clean":"2023-01-02T18:17:51.878902+0000","last_became_active":"2023-01-02T18:16:51.341971+0000","last_became_peered":"2023-01-02T18:16:51.341971+0000","last_unstale":"2023-01-02T18:17:51.878902+0000","last_undegraded":"2023-01-02T18:17:51.878902+0000","last_fullsized":"2023-01-02T18:17:51.878902+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":67,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700830+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:17:51.700830+0000","last_peered":"2023-01-02T18:17:51.700830+0000","last_clean":"2023-01-02T18:17:51.700830+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:17:51.700830+0000","last_undegraded":"2023-01-02T18:17:51.700830+0000","last_fullsized":"2023-01-02T18:17:51.700830+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878283+0000","last_change":"2023-01-02T18:17:38.451111+0000","last_active":"2023-01-02T18:17:51.878283+0000","last_peered":"2023-01-02T18:17:51.878283+0000","last_clean":"2023-01-02T18:17:51.878283+0000","last_became_active":"2023-01-02T18:17:36.442712+0000","last_became_peered":"2023-01-02T18:17:36.442712+0000","last_unstale":"2023-01-02T18:17:51.878283+0000","last_undegraded":"2023-01-02T18:17:51.878283+0000","last_fullsized":"2023-01-02T18:17:51.878283+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1e","version":"101'8","reported_seq":54,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.702153+0000","last_change":"2023-01-02T18:17:34.316857+0000","last_active":"2023-01-02T18:17:52.702153+0000","last_peered":"2023-01-02T18:17:52.702153+0000","last_clean":"2023-01-02T18:17:52.702153+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:17:52.702153+0000","last_undegraded":"2023-01-02T18:17:52.702153+0000","last_fullsized":"2023-01-02T18:17:52.702153+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":64,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.703271+0000","last_change":"2023-01-02T18:17:29.320212+0000","last_active":"2023-01-02T18:17:52.703271+0000","last_peered":"2023-01-02T18:17:52.703271+0000","last_clean":"2023-01-02T18:17:52.703271+0000","last_became_active":"2023-01-02T18:17:29.319459+0000","last_became_peered":"2023-01-02T18:17:29.319459+0000","last_unstale":"2023-01-02T18:17:52.703271+0000","last_undegraded":"2023-01-02T18:17:52.703271+0000","last_fullsized":"2023-01-02T18:17:52.703271+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"71'6","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777559+0000","last_change":"2023-01-02T18:17:29.380260+0000","last_active":"2023-01-02T18:17:52.777559+0000","last_peered":"2023-01-02T18:17:52.777559+0000","last_clean":"2023-01-02T18:17:52.777559+0000","last_became_active":"2023-01-02T18:17:29.334697+0000","last_became_peered":"2023-01-02T18:17:29.334697+0000","last_unstale":"2023-01-02T18:17:52.777559+0000","last_undegraded":"2023-01-02T18:17:52.777559+0000","last_fullsized":"2023-01-02T18:17:52.777559+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":81,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878066+0000","last_change":"2023-01-02T18:16:44.306689+0000","last_active":"2023-01-02T18:17:51.878066+0000","last_peered":"2023-01-02T18:17:51.878066+0000","last_clean":"2023-01-02T18:17:51.878066+0000","last_became_active":"2023-01-02T18:16:41.448162+0000","last_became_peered":"2023-01-02T18:16:41.448162+0000","last_unstale":"2023-01-02T18:17:51.878066+0000","last_undegraded":"2023-01-02T18:17:51.878066+0000","last_fullsized":"2023-01-02T18:17:51.878066+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":44,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777834+0000","last_change":"2023-01-02T18:17:30.331763+0000","last_active":"2023-01-02T18:17:52.777834+0000","last_peered":"2023-01-02T18:17:52.777834+0000","last_clean":"2023-01-02T18:17:52.777834+0000","last_became_active":"2023-01-02T18:17:29.327892+0000","last_became_peered":"2023-01-02T18:17:29.327892+0000","last_unstale":"2023-01-02T18:17:52.777834+0000","last_undegraded":"2023-01-02T18:17:52.777834+0000","last_fullsized":"2023-01-02T18:17:52.777834+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":84,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.700845+0000","last_change":"2023-01-02T18:16:49.318037+0000","last_active":"2023-01-02T18:17:51.700845+0000","last_peered":"2023-01-02T18:17:51.700845+0000","last_clean":"2023-01-02T18:17:51.700845+0000","last_became_active":"2023-01-02T18:16:48.330758+0000","last_became_peered":"2023-01-02T18:16:48.330758+0000","last_unstale":"2023-01-02T18:17:51.700845+0000","last_undegraded":"2023-01-02T18:17:51.700845+0000","last_fullsized":"2023-01-02T18:17:51.700845+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":167,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696463+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:17:51.696463+0000","last_peered":"2023-01-02T18:17:51.696463+0000","last_clean":"2023-01-02T18:17:51.696463+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:17:51.696463+0000","last_undegraded":"2023-01-02T18:17:51.696463+0000","last_fullsized":"2023-01-02T18:17:51.696463+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":68,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701835+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:17:52.701835+0000","last_peered":"2023-01-02T18:17:52.701835+0000","last_clean":"2023-01-02T18:17:52.701835+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:17:52.701835+0000","last_undegraded":"2023-01-02T18:17:52.701835+0000","last_fullsized":"2023-01-02T18:17:52.701835+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":27,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.701203+0000","last_change":"2023-01-02T18:17:38.444061+0000","last_active":"2023-01-02T18:17:52.701203+0000","last_peered":"2023-01-02T18:17:52.701203+0000","last_clean":"2023-01-02T18:17:52.701203+0000","last_became_active":"2023-01-02T18:17:36.437329+0000","last_became_peered":"2023-01-02T18:17:36.437329+0000","last_unstale":"2023-01-02T18:17:52.701203+0000","last_undegraded":"2023-01-02T18:17:52.701203+0000","last_fullsized":"2023-01-02T18:17:52.701203+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":43,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776728+0000","last_change":"2023-01-02T18:17:34.316239+0000","last_active":"2023-01-02T18:17:52.776728+0000","last_peered":"2023-01-02T18:17:52.776728+0000","last_clean":"2023-01-02T18:17:52.776728+0000","last_became_active":"2023-01-02T18:17:32.337541+0000","last_became_peered":"2023-01-02T18:17:32.337541+0000","last_unstale":"2023-01-02T18:17:52.776728+0000","last_undegraded":"2023-01-02T18:17:52.776728+0000","last_fullsized":"2023-01-02T18:17:52.776728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777329+0000","last_change":"2023-01-02T18:17:29.332434+0000","last_active":"2023-01-02T18:17:52.777329+0000","last_peered":"2023-01-02T18:17:52.777329+0000","last_clean":"2023-01-02T18:17:52.777329+0000","last_became_active":"2023-01-02T18:17:29.329956+0000","last_became_peered":"2023-01-02T18:17:29.329956+0000","last_unstale":"2023-01-02T18:17:52.777329+0000","last_undegraded":"2023-01-02T18:17:52.777329+0000","last_fullsized":"2023-01-02T18:17:52.777329+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":63,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878208+0000","last_change":"2023-01-02T18:17:01.311515+0000","last_active":"2023-01-02T18:17:51.878208+0000","last_peered":"2023-01-02T18:17:51.878208+0000","last_clean":"2023-01-02T18:17:51.878208+0000","last_became_active":"2023-01-02T18:16:59.322412+0000","last_became_peered":"2023-01-02T18:16:59.322412+0000","last_unstale":"2023-01-02T18:17:51.878208+0000","last_undegraded":"2023-01-02T18:17:51.878208+0000","last_fullsized":"2023-01-02T18:17:51.878208+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":90,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702765+0000","last_change":"2023-01-02T18:17:29.338927+0000","last_active":"2023-01-02T18:17:51.702765+0000","last_peered":"2023-01-02T18:17:51.702765+0000","last_clean":"2023-01-02T18:17:51.702765+0000","last_became_active":"2023-01-02T18:17:29.338639+0000","last_became_peered":"2023-01-02T18:17:29.338639+0000","last_unstale":"2023-01-02T18:17:51.702765+0000","last_undegraded":"2023-01-02T18:17:51.702765+0000","last_fullsized":"2023-01-02T18:17:51.702765+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":168,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.877889+0000","last_change":"2023-01-02T18:17:30.433577+0000","last_active":"2023-01-02T18:17:51.877889+0000","last_peered":"2023-01-02T18:17:51.877889+0000","last_clean":"2023-01-02T18:17:51.877889+0000","last_became_active":"2023-01-02T18:16:37.415177+0000","last_became_peered":"2023-01-02T18:16:37.415177+0000","last_unstale":"2023-01-02T18:17:51.877889+0000","last_undegraded":"2023-01-02T18:17:51.877889+0000","last_fullsized":"2023-01-02T18:17:51.877889+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":77,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.704754+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:17:52.704754+0000","last_peered":"2023-01-02T18:17:52.704754+0000","last_clean":"2023-01-02T18:17:52.704754+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:17:52.704754+0000","last_undegraded":"2023-01-02T18:17:52.704754+0000","last_fullsized":"2023-01-02T18:17:52.704754+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":30,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.778039+0000","last_change":"2023-01-02T18:17:29.329770+0000","last_active":"2023-01-02T18:17:52.778039+0000","last_peered":"2023-01-02T18:17:52.778039+0000","last_clean":"2023-01-02T18:17:52.778039+0000","last_became_active":"2023-01-02T18:17:29.328232+0000","last_became_peered":"2023-01-02T18:17:29.328232+0000","last_unstale":"2023-01-02T18:17:52.778039+0000","last_undegraded":"2023-01-02T18:17:52.778039+0000","last_fullsized":"2023-01-02T18:17:52.778039+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.777663+0000","last_change":"2023-01-02T18:17:29.384506+0000","last_active":"2023-01-02T18:17:52.777663+0000","last_peered":"2023-01-02T18:17:52.777663+0000","last_clean":"2023-01-02T18:17:52.777663+0000","last_became_active":"2023-01-02T18:17:29.335526+0000","last_became_peered":"2023-01-02T18:17:29.335526+0000","last_unstale":"2023-01-02T18:17:52.777663+0000","last_undegraded":"2023-01-02T18:17:52.777663+0000","last_fullsized":"2023-01-02T18:17:52.777663+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":26,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878359+0000","last_change":"2023-01-02T18:17:38.450093+0000","last_active":"2023-01-02T18:17:51.878359+0000","last_peered":"2023-01-02T18:17:51.878359+0000","last_clean":"2023-01-02T18:17:51.878359+0000","last_became_active":"2023-01-02T18:17:36.449051+0000","last_became_peered":"2023-01-02T18:17:36.449051+0000","last_unstale":"2023-01-02T18:17:51.878359+0000","last_undegraded":"2023-01-02T18:17:51.878359+0000","last_fullsized":"2023-01-02T18:17:51.878359+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":40,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696052+0000","last_change":"2023-01-02T18:17:34.343018+0000","last_active":"2023-01-02T18:17:51.696052+0000","last_peered":"2023-01-02T18:17:51.696052+0000","last_clean":"2023-01-02T18:17:51.696052+0000","last_became_active":"2023-01-02T18:17:32.345232+0000","last_became_peered":"2023-01-02T18:17:32.345232+0000","last_unstale":"2023-01-02T18:17:51.696052+0000","last_undegraded":"2023-01-02T18:17:51.696052+0000","last_fullsized":"2023-01-02T18:17:51.696052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":53,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696607+0000","last_change":"2023-01-02T18:17:09.323079+0000","last_active":"2023-01-02T18:17:51.696607+0000","last_peered":"2023-01-02T18:17:51.696607+0000","last_clean":"2023-01-02T18:17:51.696607+0000","last_became_active":"2023-01-02T18:17:07.344746+0000","last_became_peered":"2023-01-02T18:17:07.344746+0000","last_unstale":"2023-01-02T18:17:51.696607+0000","last_undegraded":"2023-01-02T18:17:51.696607+0000","last_fullsized":"2023-01-02T18:17:51.696607+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":63,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.701481+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:17:51.701481+0000","last_peered":"2023-01-02T18:17:51.701481+0000","last_clean":"2023-01-02T18:17:51.701481+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:17:51.701481+0000","last_undegraded":"2023-01-02T18:17:51.701481+0000","last_fullsized":"2023-01-02T18:17:51.701481+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.695066+0000","last_change":"2023-01-02T18:17:48.664224+0000","last_active":"2023-01-02T18:17:51.695066+0000","last_peered":"2023-01-02T18:17:51.695066+0000","last_clean":"2023-01-02T18:17:51.695066+0000","last_became_active":"2023-01-02T18:17:48.663942+0000","last_became_peered":"2023-01-02T18:17:48.663942+0000","last_unstale":"2023-01-02T18:17:51.695066+0000","last_undegraded":"2023-01-02T18:17:51.695066+0000","last_fullsized":"2023-01-02T18:17:51.695066+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":82,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.704638+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:17:52.704638+0000","last_peered":"2023-01-02T18:17:52.704638+0000","last_clean":"2023-01-02T18:17:52.704638+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:17:52.704638+0000","last_undegraded":"2023-01-02T18:17:52.704638+0000","last_fullsized":"2023-01-02T18:17:52.704638+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":149,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.692742+0000","last_change":"2023-01-02T18:17:30.330120+0000","last_active":"2023-01-02T18:17:51.692742+0000","last_peered":"2023-01-02T18:17:51.692742+0000","last_clean":"2023-01-02T18:17:51.692742+0000","last_became_active":"2023-01-02T18:16:37.416142+0000","last_became_peered":"2023-01-02T18:16:37.416142+0000","last_unstale":"2023-01-02T18:17:51.692742+0000","last_undegraded":"2023-01-02T18:17:51.692742+0000","last_fullsized":"2023-01-02T18:17:51.692742+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"56'15","reported_seq":142,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.702682+0000","last_change":"2023-01-02T18:16:49.319188+0000","last_active":"2023-01-02T18:17:51.702682+0000","last_peered":"2023-01-02T18:17:51.702682+0000","last_clean":"2023-01-02T18:17:51.702682+0000","last_became_active":"2023-01-02T18:16:48.329016+0000","last_became_peered":"2023-01-02T18:16:48.329016+0000","last_unstale":"2023-01-02T18:17:51.702682+0000","last_undegraded":"2023-01-02T18:17:51.702682+0000","last_fullsized":"2023-01-02T18:17:51.702682+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":187,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.697122+0000","last_change":"2023-01-02T18:17:29.354782+0000","last_active":"2023-01-02T18:17:51.697122+0000","last_peered":"2023-01-02T18:17:51.697122+0000","last_clean":"2023-01-02T18:17:51.697122+0000","last_became_active":"2023-01-02T18:17:29.340734+0000","last_became_peered":"2023-01-02T18:17:29.340734+0000","last_unstale":"2023-01-02T18:17:51.697122+0000","last_undegraded":"2023-01-02T18:17:51.697122+0000","last_fullsized":"2023-01-02T18:17:51.697122+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":84,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":24,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696312+0000","last_change":"2023-01-02T18:17:38.462825+0000","last_active":"2023-01-02T18:17:51.696312+0000","last_peered":"2023-01-02T18:17:51.696312+0000","last_clean":"2023-01-02T18:17:51.696312+0000","last_became_active":"2023-01-02T18:17:36.449207+0000","last_became_peered":"2023-01-02T18:17:36.449207+0000","last_unstale":"2023-01-02T18:17:51.696312+0000","last_undegraded":"2023-01-02T18:17:51.696312+0000","last_fullsized":"2023-01-02T18:17:51.696312+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"101'2","reported_seq":42,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696526+0000","last_change":"2023-01-02T18:17:34.343730+0000","last_active":"2023-01-02T18:17:51.696526+0000","last_peered":"2023-01-02T18:17:51.696526+0000","last_clean":"2023-01-02T18:17:51.696526+0000","last_became_active":"2023-01-02T18:17:32.346354+0000","last_became_peered":"2023-01-02T18:17:32.346354+0000","last_unstale":"2023-01-02T18:17:51.696526+0000","last_undegraded":"2023-01-02T18:17:51.696526+0000","last_fullsized":"2023-01-02T18:17:51.696526+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":53,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.696180+0000","last_change":"2023-01-02T18:17:09.322935+0000","last_active":"2023-01-02T18:17:51.696180+0000","last_peered":"2023-01-02T18:17:51.696180+0000","last_clean":"2023-01-02T18:17:51.696180+0000","last_became_active":"2023-01-02T18:17:07.346620+0000","last_became_peered":"2023-01-02T18:17:07.346620+0000","last_unstale":"2023-01-02T18:17:51.696180+0000","last_undegraded":"2023-01-02T18:17:51.696180+0000","last_fullsized":"2023-01-02T18:17:51.696180+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"72'4","reported_seq":34,"reported_epoch":116,"state":"active+clean","last_fresh":"2023-01-02T18:17:52.776890+0000","last_change":"2023-01-02T18:17:29.382390+0000","last_active":"2023-01-02T18:17:52.776890+0000","last_peered":"2023-01-02T18:17:52.776890+0000","last_clean":"2023-01-02T18:17:52.776890+0000","last_became_active":"2023-01-02T18:17:29.335369+0000","last_became_peered":"2023-01-02T18:17:29.335369+0000","last_unstale":"2023-01-02T18:17:52.776890+0000","last_undegraded":"2023-01-02T18:17:52.776890+0000","last_fullsized":"2023-01-02T18:17:52.776890+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":17,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.693199+0000","last_change":"2023-01-02T18:17:48.664412+0000","last_active":"2023-01-02T18:17:51.693199+0000","last_peered":"2023-01-02T18:17:51.693199+0000","last_clean":"2023-01-02T18:17:51.693199+0000","last_became_active":"2023-01-02T18:17:48.655335+0000","last_became_peered":"2023-01-02T18:17:48.655335+0000","last_unstale":"2023-01-02T18:17:51.693199+0000","last_undegraded":"2023-01-02T18:17:51.693199+0000","last_fullsized":"2023-01-02T18:17:51.693199+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":92,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878188+0000","last_change":"2023-01-02T18:16:44.308144+0000","last_active":"2023-01-02T18:17:51.878188+0000","last_peered":"2023-01-02T18:17:51.878188+0000","last_clean":"2023-01-02T18:17:51.878188+0000","last_became_active":"2023-01-02T18:16:41.446839+0000","last_became_peered":"2023-01-02T18:16:41.446839+0000","last_unstale":"2023-01-02T18:17:51.878188+0000","last_undegraded":"2023-01-02T18:17:51.878188+0000","last_fullsized":"2023-01-02T18:17:51.878188+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"84'5","reported_seq":194,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.691988+0000","last_change":"2023-01-02T18:17:30.325949+0000","last_active":"2023-01-02T18:17:51.691988+0000","last_peered":"2023-01-02T18:17:51.691988+0000","last_clean":"2023-01-02T18:17:51.691988+0000","last_became_active":"2023-01-02T18:16:48.329379+0000","last_became_peered":"2023-01-02T18:16:48.329379+0000","last_unstale":"2023-01-02T18:17:51.691988+0000","last_undegraded":"2023-01-02T18:17:51.691988+0000","last_fullsized":"2023-01-02T18:17:51.691988+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":41,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":89,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.879394+0000","last_change":"2023-01-02T18:16:49.310230+0000","last_active":"2023-01-02T18:17:51.879394+0000","last_peered":"2023-01-02T18:17:51.879394+0000","last_clean":"2023-01-02T18:17:51.879394+0000","last_became_active":"2023-01-02T18:16:48.324944+0000","last_became_peered":"2023-01-02T18:16:48.324944+0000","last_unstale":"2023-01-02T18:17:51.879394+0000","last_undegraded":"2023-01-02T18:17:51.879394+0000","last_fullsized":"2023-01-02T18:17:51.879394+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":71,"reported_epoch":115,"state":"active+clean","last_fresh":"2023-01-02T18:17:51.878792+0000","last_change":"2023-01-02T18:16:53.345118+0000","last_active":"2023-01-02T18:17:51.878792+0000","last_peered":"2023-01-02T18:17:51.878792+0000","last_clean":"2023-01-02T18:17:51.878792+0000","last_became_active":"2023-01-02T18:16:51.341889+0000","last_became_peered":"2023-01-02T18:16:51.341889+0000","last_unstale":"2023-01-02T18:17:51.878792+0000","last_undegraded":"2023-01-02T18:17:51.878792+0000","last_fullsized":"2023-01-02T18:17:51.878792+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":16777289,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":185,"num_read_kb":150,"num_write":57,"num_write_kb":16405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33579008,"data_stored":33554578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62,"ondisk_log_size":62,"up":64,"acting":64,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":472,"num_read_kb":400,"num_write":105,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":64,"acting":64,"num_store_stats":7},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":171,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1456,"num_read_kb":1306,"num_write":98,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":7},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":465,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2428,"num_read_kb":2178,"num_write":146,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":363,"num_keys_recovered":250,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":7},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1498,"num_read_kb":1362,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":124,"num_keys_recovered":6,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":7},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1078,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1918,"num_read_kb":1551,"num_write":240,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":726,"num_keys_recovered":150,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":2466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":261,"ondisk_log_size":261,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":102,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":70,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":133,"num_read_kb":109,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1496,"num_read_kb":1361,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":70,"num_keys_recovered":162,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":95,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12800,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":11264,"kb_avail":94359040,"statfs":{"total":96636764160,"available":96623656960,"internally_reserved":0,"allocated":1564672,"data_stored":802836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11534336},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.45000000000000001,"15min":0.42899999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.745},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.79700000000000004}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.34499999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.72399999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":25204,"kb_used_data":13804,"kb_used_omap":0,"kb_used_meta":11392,"kb_avail":94346636,"statfs":{"total":96636764160,"available":96610955264,"internally_reserved":0,"allocated":14135296,"data_stored":13385682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11665408},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":2.109,"15min":2.109},"last":0.372},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.35199999999999998}]},{"osd":1,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45700000000000002,"15min":0.44900000000000001},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.29599999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.282,"15min":1.282},"last":0.40100000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72499999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.33600000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.255},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.27800000000000002}]},{"osd":5,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.624,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.38}]},{"osd":7,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":1.3,"15min":1.3},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.438}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":20040,"kb_used_data":8704,"kb_used_omap":0,"kb_used_meta":11328,"kb_avail":94351800,"statfs":{"total":96636764160,"available":96616243200,"internally_reserved":0,"allocated":8912896,"data_stored":8142950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11599872},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.434,"15min":0.44900000000000001},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":0.46200000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45500000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.73499999999999999}]},{"osd":2,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.43099999999999999,"5min":1.258,"15min":1.258},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.371,"5min":0.441,"15min":0.45300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48299999999999998,"5min":1.028,"15min":1.028},"last":0.60699999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.46500000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51700000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42799999999999999,"15min":0.439},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56399999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.752}]},{"osd":4,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67700000000000005,"5min":1.321,"15min":1.321},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.52000000000000002}]},{"osd":5,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79000000000000004,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76700000000000002,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.64600000000000002,"15min":0.66400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70099999999999996,"5min":1.371,"15min":1.371},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.96699999999999997}]},{"osd":7,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.755,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67200000000000004,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.75900000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":1.0269999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12620,"kb_used_data":1540,"kb_used_omap":0,"kb_used_meta":11072,"kb_avail":94359220,"statfs":{"total":96636764160,"available":96623841280,"internally_reserved":0,"allocated":1576960,"data_stored":802957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11337728},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.503,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.48199999999999998,"15min":0.504},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":1.841,"15min":1.841},"last":0.33200000000000002}]},{"osd":2,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61499999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.51500000000000001,"15min":0.54300000000000004},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52000000000000002,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.34899999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55000000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53300000000000003,"5min":1.875,"15min":1.875},"last":0.307}]},{"osd":4,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6180000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.56699999999999995}]},{"osd":5,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78900000000000003,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.60899999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.73199999999999998,"15min":0.752},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.583,"5min":1.903,"15min":1.903},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81299999999999994,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.629}]},{"osd":7,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81399999999999995,"5min":1.139,"15min":1.139},"last":0.57599999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12248,"kb_used_data":5584,"kb_used_omap":0,"kb_used_meta":6656,"kb_avail":94359592,"statfs":{"total":96636764160,"available":96624222208,"internally_reserved":0,"allocated":5718016,"data_stored":4996841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6815744},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.46600000000000003,"15min":0.49299999999999999},"min":{"1min":0.24399999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":2.665,"15min":2.665},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.44,"15min":0.45800000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42099999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.45700000000000002}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.498,"15min":0.52500000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.47799999999999998,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.376},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.45800000000000002,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.48999999999999999}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.443,"15min":0.45900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50600000000000001,"5min":1.359,"15min":1.359},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.46700000000000003,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":2.601,"15min":2.601},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.64200000000000002}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":1.25,"15min":1.25},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.76300000000000001,"15min":0.79800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68899999999999995,"5min":2.637,"15min":2.637},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65900000000000003,"15min":0.67600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.69599999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81599999999999995,"5min":1.321,"15min":1.321},"last":0.84699999999999998}]},{"osd":7,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73899999999999999,"5min":1.478,"15min":1.478},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78800000000000003,"5min":1.286,"15min":1.286},"last":0.66400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":94,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":21172,"kb_used_data":9772,"kb_used_omap":0,"kb_used_meta":11392,"kb_avail":94350668,"statfs":{"total":96636764160,"available":96615084032,"internally_reserved":0,"allocated":10006528,"data_stored":9191898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11665408},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.48999999999999999,"15min":0.51600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.47999999999999998,"5min":1.7170000000000001,"15min":1.7170000000000001},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.39000000000000001,"15min":0.39600000000000002},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.53500000000000003,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.29399999999999998}]},{"osd":1,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.26100000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63600000000000001,"5min":1.766,"15min":1.766},"last":0.311},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.51700000000000002,"15min":0.54300000000000004},"min":{"1min":0.27500000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.56699999999999995,"5min":1.8740000000000001,"15min":1.8740000000000001},"last":0.32000000000000001}]},{"osd":2,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.59299999999999997,"15min":0.61099999999999999},"min":{"1min":0.30499999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.53100000000000003,"15min":0.54100000000000004},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":0.39400000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.56999999999999995,"15min":0.58399999999999996},"min":{"1min":0.315,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.63200000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.505,"5min":0.63500000000000001,"15min":0.65700000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72199999999999998,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.504}]},{"osd":5,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.63100000000000001,"15min":0.65300000000000002},"min":{"1min":0.35399999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70699999999999996,"5min":1.847,"15min":1.847},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.60799999999999998,"15min":0.625},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70099999999999996,"5min":1.615,"15min":1.615},"last":0.48499999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.69799999999999995,"15min":0.72199999999999998},"min":{"1min":0.40400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82699999999999996,"5min":1.7989999999999999,"15min":1.7989999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57799999999999996,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.69699999999999995,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.55500000000000005}]},{"osd":7,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.58999999999999997,"15min":0.60099999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.754,"5min":1.6359999999999999,"15min":1.6359999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.73799999999999999,"15min":0.76400000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.80100000000000005,"5min":1.9279999999999999,"15min":1.9279999999999999},"last":0.53000000000000003}]}]},{"osd":4,"up_from":0,"seq":55834574878,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":75,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":6528,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":1572864,"data_stored":802917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6684672},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.435},{"interface":"front","average":{"1min":0.496,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.38400000000000001}]},{"osd":1,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.372}]},{"osd":2,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.496},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.34000000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.48499999999999999}]},{"osd":4,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81399999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.42299999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79300000000000004,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.878,"15min":0.878},"last":0.44600000000000001}]},{"osd":7,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":1.044},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90300000000000002,"5min":1.359,"15min":1.359},"last":0.46899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":83,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":67,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":50,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8396800,"data_stored":8388665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12591104,"data_stored":12582966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:17:54.757 INFO:tasks.thrashosds.thrasher:Setting 8.12 to [0, 5, 2, 1] 2023-01-02T18:17:54.758 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '8.12', '0', '5', '2', '1'] 2023-01-02T18:17:54.758 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 8.12 0 5 2 1 2023-01-02T18:17:54.827 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:54.828+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:54.908 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:54.909 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:54.909 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:54.909 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:54.922 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:54.928 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:54.928+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:55.028 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:55.028+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:55.050 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:55.051 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:55.051 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:55.051 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:55.051 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:55.060 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:55.130 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:55.130+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:55.227 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.228 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:55.229 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:55.229 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.790751931000003, 2023-01-02T18:17:55.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:55.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:55.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.231 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:55.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:55.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:55.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:55.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:55.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:55.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:55.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:55.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:55.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:55.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:55.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:55.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:55.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:55.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:55.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:55.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:55.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:55.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:55.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:55.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:55.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:55.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:55.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:55.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:55.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:55.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:55.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:55.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:55.245 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.245 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.245 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.246 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:55.246 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:55.246 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.917211821999999, 2023-01-02T18:17:55.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:55.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:55.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:55.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:55.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.248 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:55.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:55.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:55.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:55.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:55.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:55.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:55.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:55.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:55.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:55.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:55.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:55.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:55.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:55.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:55.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:55.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:55.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:55.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:55.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:55.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:55.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:55.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:55.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:55.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:55.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:55.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:55.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:55.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:55.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:55.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.264 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.265 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:55.265 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:55.265 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.611251867, 2023-01-02T18:17:55.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:55.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.266 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:55.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.267 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:55.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:55.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:55.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:55.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:55.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:55.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:55.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:55.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:55.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:55.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:55.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:55.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:55.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:55.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:55.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:55.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:55.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:55.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:55.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:55.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:55.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:55.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:55.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:55.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:55.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:55.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.282 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:55.282 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:55.282 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.896780053000001, 2023-01-02T18:17:55.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:55.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:55.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.283 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:55.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:55.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:55.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:55.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:55.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:55.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:55.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:55.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:55.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:55.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:55.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:55.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:55.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:55.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:55.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:55.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:55.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:55.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:55.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:55.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:55.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:55.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:55.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:55.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:55.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:55.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:55.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:55.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:55.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:55.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.297 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.298 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:55.298 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:55.298 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.887678651999998, 2023-01-02T18:17:55.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:55.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:55.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:55.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:55.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:55.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.300 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:55.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:55.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:55.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:55.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:55.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:55.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:55.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:55.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:55.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:55.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:55.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:55.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:55.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:55.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:55.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:55.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:55.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:55.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:55.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:55.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.309 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.310 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:55.310 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:55.310 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.616322359999998, 2023-01-02T18:17:55.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:55.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:55.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.311 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:55.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.312 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:55.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:55.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:55.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:55.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:55.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:55.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:55.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:55.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:55.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:55.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:55.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:55.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:55.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:55.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:55.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:55.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:55.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:55.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:55.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:55.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:55.322 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.322 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.322 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.323 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:55.323 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:55.323 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.898953036000002, 2023-01-02T18:17:55.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:55.323 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.324 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.324 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.324 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:55.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.325 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:55.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:55.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:55.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:55.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:55.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:55.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:55.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:55.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:55.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:55.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:55.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:55.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:55.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:55.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:55.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:55.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:55.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:55.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:55.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:55.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:55.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:55.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:55.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.338 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.339 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:55.339 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:55.339 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.872216794000003, 2023-01-02T18:17:55.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:55.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:55.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:55.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:55.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.341 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:55.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:55.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:55.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:55.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:55.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:55.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:55.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:55.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:55.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:55.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:55.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:55.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:55.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:55.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:55.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:55.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:55.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:55.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:55.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:55.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:55.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:55.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:55.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:55.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:55.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:55.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:55.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:55.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:55.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.354 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.355 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:55.355 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:55.355 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.872169198000002, 2023-01-02T18:17:55.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:17:55.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.356 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:55.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:55.356 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:17:55.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.357 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:55.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:55.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:55.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:17:55.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:17:55.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:17:55.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:17:55.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:17:55.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:17:55.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:17:55.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:17:55.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:17:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:17:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:17:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:17:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:17:55.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:17:55.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:17:55.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:17:55.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:17:55.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:17:55.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:17:55.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:17:55.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:17:55.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:17:55.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:17:55.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:17:55.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:17:55.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:17:55.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.371 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.371 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2238 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_trash_add in=21b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:55.372 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:55.372 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.851974603000002, 2023-01-02T18:17:55.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002, 2023-01-02T18:17:55.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.372 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.373 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:55.373 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:55.373 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2238 2023-01-02T18:17:55.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.373 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:55.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374626+0000", 2023-01-02T18:17:55.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:55.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374625+0000", 2023-01-02T18:17:55.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9540000000000003e-06 2023-01-02T18:17:55.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374630+0000", 2023-01-02T18:17:55.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0295000000000001e-05 2023-01-02T18:17:55.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374641+0000", 2023-01-02T18:17:55.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3980000000000001e-06 2023-01-02T18:17:55.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374645+0000", 2023-01-02T18:17:55.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0728999999999997e-05 2023-01-02T18:17:55.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374676+0000", 2023-01-02T18:17:55.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8452000000000003e-05 2023-01-02T18:17:55.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374724+0000", 2023-01-02T18:17:55.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019847300000000001 2023-01-02T18:17:55.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.374923+0000", 2023-01-02T18:17:55.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054292499999999998 2023-01-02T18:17:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.375466+0000", 2023-01-02T18:17:55.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025375240000000002 2023-01-02T18:17:55.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378003+0000", 2023-01-02T18:17:55.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1505e-05 2023-01-02T18:17:55.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378085+0000", 2023-01-02T18:17:55.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2633000000000002e-05 2023-01-02T18:17:55.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.378107+0000", 2023-01-02T18:17:55.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034810930000000002 2023-01-02T18:17:55.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.385 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.386 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:55.386 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:55.386 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.909100112000001, 2023-01-02T18:17:55.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:17:55.387 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.387 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:55.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:55.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:17:55.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.388 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:55.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:55.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:55.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:17:55.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:17:55.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:17:55.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:17:55.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:17:55.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:17:55.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:17:55.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:17:55.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:17:55.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:17:55.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:17:55.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:17:55.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:17:55.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:17:55.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:17:55.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:17:55.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:17:55.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:17:55.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:17:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:17:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:17:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:17:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:17:55.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:17:55.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:17:55.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:17:55.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.402 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.403 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:55.403 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:55.403 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.892993849, 2023-01-02T18:17:55.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:17:55.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:17:55.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.405 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:55.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:55.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:55.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:17:55.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:17:55.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:17:55.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:17:55.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:17:55.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:17:55.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:17:55.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:17:55.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:17:55.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:17:55.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:55.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:17:55.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:17:55.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:17:55.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:17:55.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:17:55.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:17:55.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:55.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:17:55.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:17:55.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:17:55.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:17:55.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:17:55.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:17:55.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:17:55.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:17:55.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:17:55.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:17:55.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.418 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.419 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.419 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:55.419 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:55.419 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.887671664999999, 2023-01-02T18:17:55.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:17:55.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.420 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.420 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.421 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:17:55.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.421 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:55.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:55.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:55.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:17:55.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:17:55.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:17:55.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:17:55.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:17:55.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:17:55.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:17:55.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:17:55.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:17:55.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:17:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:17:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:17:55.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:17:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:17:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:17:55.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:17:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:17:55.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:17:55.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:17:55.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:17:55.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:17:55.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:17:55.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:17:55.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.433 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.434 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.434 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:17:55.434 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:55.434 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.884118600000001, 2023-01-02T18:17:55.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:17:55.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:55.435 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:55.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:55.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:55.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:17:55.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:17:55.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:17:55.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:17:55.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:17:55.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:17:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:17:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:17:55.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:17:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:17:55.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:17:55.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:17:55.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:17:55.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:17:55.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.444 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.444 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.444 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:55.445 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:55.445 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.882486556, 2023-01-02T18:17:55.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:17:55.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.446 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:17:55.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.446 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:55.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:55.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:55.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:17:55.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:17:55.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:17:55.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:17:55.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:17:55.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:17:55.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:17:55.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:17:55.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:17:55.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:17:55.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:17:55.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:17:55.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:17:55.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:17:55.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:17:55.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:17:55.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:17:55.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:17:55.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:17:55.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:17:55.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:17:55.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:17:55.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.459 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.460 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:55.460 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:55.460 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.882292979000001, 2023-01-02T18:17:55.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:17:55.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.461 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.461 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.461 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:17:55.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.462 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:55.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:55.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:55.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:17:55.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:17:55.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:17:55.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:17:55.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:17:55.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:17:55.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:17:55.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:17:55.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:17:55.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:17:55.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:17:55.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:17:55.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:17:55.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:17:55.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:17:55.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:17:55.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:17:55.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:17:55.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:17:55.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:17:55.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:17:55.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:17:55.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.474 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.475 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:55.475 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:55.475 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.876877099, 2023-01-02T18:17:55.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:17:55.476 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.476 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.477 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:55.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.477 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:55.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:55.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:55.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:17:55.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:17:55.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:17:55.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:17:55.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:17:55.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:17:55.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:17:55.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:17:55.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:17:55.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:17:55.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:17:55.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:17:55.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:55.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:17:55.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:17:55.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:17:55.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:17:55.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:17:55.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:17:55.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:17:55.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:17:55.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:17:55.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.489 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.490 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:55.490 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:55.491 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.87633737, 2023-01-02T18:17:55.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:17:55.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:17:55.491 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.492 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.492 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.492 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:55.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.492 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:55.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:17:55.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:55.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:17:55.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:17:55.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:17:55.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:17:55.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:55.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:17:55.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:17:55.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:17:55.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:17:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:17:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:17:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:17:55.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:17:55.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:17:55.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:17:55.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.501 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.502 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:55.502 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:55.502 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.870322077999999, 2023-01-02T18:17:55.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:17:55.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:55.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:55.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:55.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:17:55.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.504 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:55.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:17:55.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:55.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:17:55.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:17:55.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:17:55.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:17:55.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:17:55.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:17:55.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:17:55.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:17:55.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:17:55.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:17:55.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:17:55.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:17:55.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:55.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:17:55.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:17:55.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:55.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:17:55.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:17:55.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:55.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:17:55.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:17:55.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:17:55.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:17:55.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:17:55.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:17:55.516 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.516 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.516 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.517 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3341 11.1 e113/102 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head v 113'9, mlcod=111'7)", 2023-01-02T18:17:55.517 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:50.421032+0000", 2023-01-02T18:17:55.517 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.8055687760000003, 2023-01-02T18:17:55.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032088540000000001, 2023-01-02T18:17:55.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:55.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:55.518 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:55.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:55.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.421032+0000", 2023-01-02T18:17:55.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:55.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:55.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.421032+0000", 2023-01-02T18:17:55.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:55.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:55.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.421030+0000", 2023-01-02T18:17:55.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001166236 2023-01-02T18:17:55.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:55.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.422196+0000", 2023-01-02T18:17:55.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3472000000000001e-05 2023-01-02T18:17:55.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:55.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.422210+0000", 2023-01-02T18:17:55.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9460000000000003e-06 2023-01-02T18:17:55.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:55.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.422216+0000", 2023-01-02T18:17:55.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2038e-05 2023-01-02T18:17:55.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:55.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.422258+0000", 2023-01-02T18:17:55.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9454e-05 2023-01-02T18:17:55.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:55.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.422277+0000", 2023-01-02T18:17:55.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019355520000000001 2023-01-02T18:17:55.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:55.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.424213+0000", 2023-01-02T18:17:55.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8282000000000001e-05 2023-01-02T18:17:55.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:55.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:55.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:55.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:50.424241+0000", 2023-01-02T18:17:55.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032088540000000001 2023-01-02T18:17:55.527 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.527 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.527 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.527 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:55.528 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:55.528 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:55.528 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:17:55.530 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:17:55.531 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:55.529+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:55.549 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.RemoveFullTry (20939 ms) 2023-01-02T18:17:55.549 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.RemoveFullTryDataPool 2023-01-02T18:17:55.630 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:55.630+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:55.663 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:17:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:17:55.663 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:17:55.663 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:17:55.673 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:17:55.691 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:55.718 INFO:teuthology.orchestra.run.smithi007.stderr:set 8.12 pg_upmap_items mapping to [0->5,2->1] 2023-01-02T18:17:55.719 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:55.731 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:55.732+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:55.737 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:55.755 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:55.773 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:55.792 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:55.804 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:55.804 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:55.809 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:55.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:17:55.828 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:55.829 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:17:55.829 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:17:55.829 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:17:55.829 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:17:55.830 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:17:55.830 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:17:55.830 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:17:55.830 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:17:55.832 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:55.832+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:55.933 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:55.933+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:55.980 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:55.980 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:55.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:17:56.034 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:56.035+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:56.115 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:56.116 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:56.125 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:17:56.135 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:17:56.135+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:17:56.236 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:56.236+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:56.291 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:56.292 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:56.301 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:17:56.337 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:56.337+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:56.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:17:56.438 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:56.439+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:56.466 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:56.466 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:56.476 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:17:56.538 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:56.539+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:56.639 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:56.639+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:56.642 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:56.642 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:56.652 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:17:56.731 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:17:56.740 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:56.740+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:56.785 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:56.786 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:56.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:17:56.842 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:56.842+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:56.920 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:56.921 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:56.930 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:17:56.974 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:56.975+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:57.044 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:57.044+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:57.059 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:57.060 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:57.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:17:57.145 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:57.145+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:57.230 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:57.231 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:57.240 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:17:57.283 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:57.284+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:57.347 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:57.347+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:57.365 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:57.366 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:57.375 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:17:57.447 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:57.448+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:57.509 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:57.510 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:57.520 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:17:57.569 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:57.569+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:57.647 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:57.647 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:57.649 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:57.649+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:57.657 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:17:57.751 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:57.750+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:57.831 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:57.831 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:57.840 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:17:57.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:17:57.885 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:57.884+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:57.955 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:57.955+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:58.018 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:17:58.018 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:17:58.028 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:17:58.031 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:17:58.049 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:17:58.055 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:58.055+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:58.067 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:17:58.085 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:17:58.103 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:17:58.121 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:17:58.139 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:17:58.155 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:58.156+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:58.158 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:17:58.159 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:17:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:17:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:17:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:17:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:17:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:17:58.160 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:17:58.161 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:17:58.161 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:58.161 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:58.162 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:58.162 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:58.162 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:58.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:17:58.256 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:58.256+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:58.339 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.340 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 78.855808553000003, 2023-01-02T18:17:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:17:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:17:58.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:58.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:17:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:58.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:17:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:17:58.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:17:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:17:58.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:17:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:17:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:17:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:17:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:17:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:17:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:17:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:17:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:17:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:17:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:17:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:17:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:17:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:17:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:17:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:17:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:17:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:17:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:17:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 70.010447712000001, 2023-01-02T18:17:58.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:17:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:17:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:17:58.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:17:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:17:58.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:17:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:17:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:17:58.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:17:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:17:58.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:17:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:17:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:17:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:17:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:17:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:17:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:17:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:17:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.366 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:444 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'6, mlcod=60'4)", 2023-01-02T18:17:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:58.367 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.963339172000005, 2023-01-02T18:17:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482, 2023-01-02T18:17:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375636+0000", 2023-01-02T18:17:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375635+0000", 2023-01-02T18:17:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0436e-05 2023-01-02T18:17:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375645+0000", 2023-01-02T18:17:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5947000000000002e-05 2023-01-02T18:17:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375661+0000", 2023-01-02T18:17:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:17:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375668+0000", 2023-01-02T18:17:58.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0303000000000003e-05 2023-01-02T18:17:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375718+0000", 2023-01-02T18:17:58.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4159999999999999e-05 2023-01-02T18:17:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.375743+0000", 2023-01-02T18:17:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010848399999999999 2023-01-02T18:17:58.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376827+0000", 2023-01-02T18:17:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1185e-05 2023-01-02T18:17:58.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.376869+0000", 2023-01-02T18:17:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001232482 2023-01-02T18:17:58.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:17:58.378 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.953062153000005, 2023-01-02T18:17:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:17:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.379 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:17:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:58.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:17:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:17:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:17:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:17:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:17:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:17:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:17:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:17:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:17:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:17:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:17:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:17:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:17:58.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:17:58.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:17:58.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:17:58.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.389 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.389 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.390 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:17:58.390 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:58.390 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.705493986999997, 2023-01-02T18:17:58.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:17:58.390 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:58.391 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:58.391 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:58.391 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:58.391 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:17:58.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.392 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:58.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:17:58.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:58.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:17:58.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:17:58.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:17:58.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:17:58.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:17:58.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:17:58.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:17:58.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:17:58.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:17:58.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:17:58.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:58.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:17:58.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:17:58.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:17:58.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:17:58.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:17:58.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:17:58.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:17:58.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:17:58.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.402 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.403 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:17:58.403 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:58.403 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.000952316999999, 2023-01-02T18:17:58.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:17:58.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.404 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:58.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:58.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:58.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:58.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:17:58.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.405 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:58.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:17:58.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:58.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:17:58.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:17:58.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:17:58.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:17:58.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:17:58.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:17:58.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:17:58.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:17:58.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:17:58.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:17:58.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:58.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:17:58.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:17:58.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:17:58.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:17:58.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:17:58.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:17:58.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:17:58.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:17:58.415 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.415 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.415 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.416 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:17:58.416 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:58.416 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.011220581000003, 2023-01-02T18:17:58.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:17:58.416 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.417 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.417 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:58.417 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:58.417 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:58.417 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:17:58.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.418 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:58.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:17:58.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:58.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:17:58.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:17:58.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:17:58.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:17:58.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:17:58.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:17:58.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:17:58.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:17:58.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:17:58.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:17:58.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:17:58.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:17:58.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:58.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:17:58.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:17:58.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:58.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:17:58.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:17:58.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:58.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:17:58.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:17:58.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:17:58.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:17:58.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:17:58.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:17:58.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.430 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.431 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:17:58.431 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:58.431 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.987894726, 2023-01-02T18:17:58.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:17:58.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.432 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:58.432 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:58.432 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:58.432 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:58.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:17:58.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.433 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:58.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:17:58.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:58.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:17:58.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:17:58.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:17:58.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:17:58.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:17:58.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:17:58.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:17:58.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:17:58.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:17:58.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:17:58.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:58.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:17:58.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:17:58.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:17:58.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:17:58.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:17:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:17:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:17:58.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:17:58.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.443 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.444 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:58.444 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:58.444 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.977819496000002, 2023-01-02T18:17:58.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:17:58.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.445 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.445 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:58.445 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:58.445 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:58.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:17:58.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.446 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:58.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:17:58.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:58.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:17:58.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:17:58.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:17:58.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:17:58.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:17:58.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:17:58.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:17:58.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:17:58.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:17:58.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:17:58.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:58.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:17:58.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:17:58.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:17:58.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:17:58.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:17:58.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:17:58.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:17:58.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:17:58.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:17:58.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:58.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:17:58.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:17:58.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:58.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:17:58.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:17:58.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:17:58.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:17:58.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:17:58.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:17:58.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.460 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.461 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:17:58.461 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:58.461 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.014669712, 2023-01-02T18:17:58.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:17:58.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:58.462 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:58.462 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:58.462 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:58.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:17:58.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.463 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:58.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:17:58.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:17:58.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:17:58.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:17:58.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:17:58.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:17:58.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:17:58.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:17:58.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:17:58.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:17:58.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:17:58.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:58.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:17:58.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:17:58.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:17:58.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:17:58.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:17:58.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:17:58.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:17:58.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:17:58.473 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.473 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.473 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.474 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:58.474 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:58.474 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.009906247, 2023-01-02T18:17:58.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:17:58.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.475 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:58.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:17:58.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:58.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:17:58.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:17:58.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:17:58.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:17:58.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:17:58.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:17:58.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:17:58.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:17:58.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:17:58.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:17:58.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:17:58.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:17:58.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:17:58.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:17:58.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:17:58.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:17:58.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.484 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.485 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:17:58.485 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:58.485 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.009373021999998, 2023-01-02T18:17:58.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:17:58.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.486 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:58.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:58.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:17:58.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:17:58.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:17:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:17:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:17:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:17:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:17:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:17:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:17:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:17:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:17:58.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:17:58.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:17:58.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:17:58.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:17:58.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:17:58.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.495 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.496 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:58.496 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:58.496 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.998354748000001, 2023-01-02T18:17:58.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:17:58.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.497 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:58.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:17:58.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:58.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:17:58.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:17:58.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:17:58.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:17:58.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:17:58.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:17:58.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:17:58.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:17:58.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:17:58.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:17:58.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:17:58.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:17:58.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:17:58.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:17:58.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:17:58.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:17:58.506 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.506 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.506 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.507 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:17:58.507 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:58.507 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.994010194000001, 2023-01-02T18:17:58.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:17:58.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.508 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:58.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:17:58.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:58.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:17:58.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:17:58.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:17:58.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:17:58.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:17:58.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:17:58.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:17:58.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:17:58.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:17:58.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:17:58.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:17:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:17:58.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:17:58.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:17:58.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:17:58.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:17:58.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.518 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.518 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:17:58.518 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:58.518 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.956924204, 2023-01-02T18:17:58.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:17:58.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.519 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:58.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:17:58.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:58.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:17:58.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:17:58.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:17:58.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:17:58.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:17:58.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:17:58.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:17:58.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:17:58.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:17:58.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:17:58.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:17:58.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:17:58.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:17:58.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:17:58.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:17:58.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:17:58.528 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.528 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.528 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.529 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:17:58.529 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:58.529 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.949443316, 2023-01-02T18:17:58.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:17:58.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.530 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:17:58.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:58.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:17:58.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:17:58.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:17:58.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:17:58.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:17:58.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:17:58.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:17:58.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:17:58.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:17:58.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:17:58.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:17:58.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:17:58.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:17:58.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:17:58.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:17:58.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:17:58.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.539 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.539 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.540 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:17:58.540 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:17:58.540 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.9017906609999997, 2023-01-02T18:17:58.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:17:58.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.541 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.541 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:17:58.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:17:58.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:58.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:17:58.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:17:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:17:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:17:58.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:17:58.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:17:58.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:17:58.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:17:58.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:17:58.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:17:58.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:17:58.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:17:58.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:17:58.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:17:58.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:17:58.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:17:58.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.550 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.551 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:17:58.551 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:17:58.551 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.8974180829999998, 2023-01-02T18:17:58.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:17:58.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.552 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:17:58.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:17:58.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:58.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:17:58.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:17:58.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:17:58.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:17:58.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:17:58.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:17:58.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:17:58.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:17:58.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:17:58.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:17:58.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:17:58.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:17:58.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:17:58.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:17:58.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:17:58.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:17:58.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.561 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.561 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.562 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3438 11.15 e117/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 117'5, mlcod=116'3)", 2023-01-02T18:17:58.562 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:17:58.562 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.8056835850000001, 2023-01-02T18:17:58.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987, 2023-01-02T18:17:58.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.563 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.563 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:17:58.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:17:58.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:58.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533291+0000", 2023-01-02T18:17:58.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4139999999999997e-06 2023-01-02T18:17:58.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533299+0000", 2023-01-02T18:17:58.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1438e-05 2023-01-02T18:17:58.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533310+0000", 2023-01-02T18:17:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5089999999999996e-06 2023-01-02T18:17:58.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533318+0000", 2023-01-02T18:17:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6567999999999998e-05 2023-01-02T18:17:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533374+0000", 2023-01-02T18:17:58.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5011000000000002e-05 2023-01-02T18:17:58.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533399+0000", 2023-01-02T18:17:58.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024056519999999999 2023-01-02T18:17:58.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535805+0000", 2023-01-02T18:17:58.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5862000000000003e-05 2023-01-02T18:17:58.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535841+0000", 2023-01-02T18:17:58.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987 2023-01-02T18:17:58.572 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.572 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.572 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.573 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3436 11.14 e117/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 117'5, mlcod=108'3)", 2023-01-02T18:17:58.573 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:17:58.573 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.8055925560000001, 2023-01-02T18:17:58.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999, 2023-01-02T18:17:58.573 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:58.574 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:58.574 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:58.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:58.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:17:58.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:58.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:58.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:17:58.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:58.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:58.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533382+0000", 2023-01-02T18:17:58.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.476e-06 2023-01-02T18:17:58.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:58.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533387+0000", 2023-01-02T18:17:58.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0322999999999999e-05 2023-01-02T18:17:58.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:58.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533397+0000", 2023-01-02T18:17:58.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2950000000000001e-06 2023-01-02T18:17:58.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:58.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533403+0000", 2023-01-02T18:17:58.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1789000000000002e-05 2023-01-02T18:17:58.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:58.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533454+0000", 2023-01-02T18:17:58.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9650999999999999e-05 2023-01-02T18:17:58.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:58.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533474+0000", 2023-01-02T18:17:58.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019917419999999999 2023-01-02T18:17:58.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:58.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535466+0000", 2023-01-02T18:17:58.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4618999999999999e-05 2023-01-02T18:17:58.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:58.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:58.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:58.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535490+0000", 2023-01-02T18:17:58.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999 2023-01-02T18:17:58.582 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.583 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.583 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.583 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:58.583 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:58.583 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:58.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:17:58.585 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:17:58.584+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:17:58.686 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:58.686+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:58.745 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:17:58.746 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:17:58.765 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:58.766 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:58.766 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:58.766 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:58.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:17:58.817 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:17:58.817+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:17:58.888 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:17:58.888+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:17:58.946 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:58.946 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:58.946 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:58.947 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:58.947 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:58.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:17:58.988 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:58.989+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:59.083 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:59.084 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:59.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:59.085 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:59.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.085 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:17:59.085 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:59.085 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 79.599073140000002, 2023-01-02T18:17:59.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:17:59.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.086 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:59.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:17:59.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:59.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:17:59.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:17:59.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:17:59.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:17:59.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:17:59.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:17:59.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:17:59.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:17:59.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:17:59.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:17:59.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:17:59.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:17:59.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:17:59.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:17:59.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:17:59.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:17:59.096 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.097 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.097 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:17:59.098 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:59.098 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 65.733326997000006, 2023-01-02T18:17:59.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:17:59.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.098 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.099 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:59.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:17:59.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:59.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:17:59.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:17:59.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:17:59.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:17:59.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:17:59.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:17:59.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:17:59.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:17:59.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:17:59.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:17:59.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:17:59.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:17:59.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:17:59.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:17:59.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:17:59.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:17:59.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.109 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.110 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:17:59.110 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:59.110 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.766499113000002, 2023-01-02T18:17:59.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:17:59.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.111 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.111 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:59.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:59.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:59.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:17:59.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:17:59.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:17:59.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:17:59.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:17:59.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:17:59.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:17:59.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:17:59.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:17:59.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:17:59.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:17:59.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:17:59.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:17:59.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:17:59.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:17:59.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:17:59.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.121 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.122 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:17:59.122 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:59.122 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.759008866000002, 2023-01-02T18:17:59.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:17:59.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.123 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.123 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:59.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:59.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:59.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:17:59.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:17:59.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:17:59.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:17:59.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:17:59.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:17:59.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:17:59.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:17:59.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:17:59.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:17:59.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:17:59.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:17:59.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:17:59.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:17:59.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:17:59.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:17:59.133 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.134 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.134 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:17:59.135 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:59.135 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.757215780999999, 2023-01-02T18:17:59.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:17:59.135 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.135 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.135 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:59.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:17:59.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:59.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:17:59.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:17:59.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:17:59.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:17:59.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:17:59.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:17:59.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:17:59.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:17:59.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:17:59.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:17:59.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:17:59.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:17:59.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:17:59.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:17:59.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:17:59.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:17:59.145 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.145 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.146 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.146 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:17:59.146 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:59.146 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.754324437000001, 2023-01-02T18:17:59.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:17:59.147 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.147 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.147 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:17:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:17:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:17:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:17:59.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:17:59.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:17:59.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:17:59.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:17:59.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:17:59.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:17:59.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:17:59.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:17:59.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:17:59.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:17:59.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:17:59.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:17:59.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:17:59.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.157 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.158 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.158 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:17:59.158 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:59.159 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.740125896999999, 2023-01-02T18:17:59.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:17:59.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.159 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.159 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:59.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:59.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:59.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:17:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:17:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:17:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:17:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:17:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:17:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:17:59.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:17:59.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:17:59.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:17:59.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:17:59.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:17:59.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:17:59.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:17:59.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:17:59.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:17:59.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.170 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.170 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.170 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:17:59.171 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:59.171 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.718043623, 2023-01-02T18:17:59.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:17:59.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.172 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:59.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:59.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:59.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:17:59.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:17:59.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:17:59.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:17:59.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:17:59.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:17:59.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:17:59.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:17:59.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:17:59.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:17:59.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:17:59.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:17:59.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:17:59.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:17:59.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:17:59.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:17:59.181 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.181 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.182 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.182 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2226 3.13 e89/54 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head v 89'2, mlcod=0'0)", 2023-01-02T18:17:59.182 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:59.182 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.715623512999997, 2023-01-02T18:17:59.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005, 2023-01-02T18:17:59.183 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.183 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.183 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:59.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:59.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:59.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367114+0000", 2023-01-02T18:17:59.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0959999999999997e-06 2023-01-02T18:17:59.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367120+0000", 2023-01-02T18:17:59.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4494e-05 2023-01-02T18:17:59.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367135+0000", 2023-01-02T18:17:59.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5700000000000004e-06 2023-01-02T18:17:59.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367142+0000", 2023-01-02T18:17:59.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9985000000000003e-05 2023-01-02T18:17:59.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367192+0000", 2023-01-02T18:17:59.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8598e-05 2023-01-02T18:17:59.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367211+0000", 2023-01-02T18:17:59.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072699899999999998 2023-01-02T18:17:59.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367938+0000", 2023-01-02T18:17:59.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8569999999999998e-05 2023-01-02T18:17:59.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.367977+0000", 2023-01-02T18:17:59.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086209800000000005 2023-01-02T18:17:59.193 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.193 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.193 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.194 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:17:59.194 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:59.194 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.742408758000003, 2023-01-02T18:17:59.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:17:59.195 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.195 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.195 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:59.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:59.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:59.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:17:59.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:17:59.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:17:59.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:17:59.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:17:59.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:17:59.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:17:59.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:17:59.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:17:59.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:17:59.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:17:59.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:17:59.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:17:59.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:17:59.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:17:59.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:17:59.206 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.206 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.206 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:17:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.740669908999998, 2023-01-02T18:17:59.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:17:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:17:59.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:59.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:17:59.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:17:59.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:17:59.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:17:59.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:17:59.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:17:59.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:17:59.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:17:59.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:17:59.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:17:59.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:17:59.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:17:59.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:17:59.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:17:59.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:17:59.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:17:59.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.217 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.218 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.218 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:17:59.218 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:59.218 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.748344655, 2023-01-02T18:17:59.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:17:59.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.219 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.219 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:59.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:59.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:17:59.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:17:59.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:17:59.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:17:59.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:17:59.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:17:59.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:17:59.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:17:59.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:17:59.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:17:59.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:17:59.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:17:59.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:17:59.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:17:59.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:17:59.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:17:59.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:17:59.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.229 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.229 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:59.230 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:59.230 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.747201812, 2023-01-02T18:17:59.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:17:59.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.231 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:59.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:59.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:59.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:17:59.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:17:59.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:17:59.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:17:59.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:17:59.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:17:59.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:17:59.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:17:59.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:17:59.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:17:59.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:17:59.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:17:59.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:17:59.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:17:59.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:17:59.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:17:59.240 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.240 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.240 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.241 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:59.241 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:59.241 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.734648018000001, 2023-01-02T18:17:59.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:17:59.241 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.242 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:59.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:59.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:17:59.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:17:59.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:17:59.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:17:59.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:17:59.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:17:59.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:17:59.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:17:59.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:17:59.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:17:59.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:17:59.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:17:59.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:17:59.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:17:59.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:17:59.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:17:59.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:17:59.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.251 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.252 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2827 10.1e e101/98 10:7803159c:::rbd_object_map.12a2d48fcbc5:head v 101'1, mlcod=0'0)", 2023-01-02T18:17:59.252 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:59.252 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.733711103000001, 2023-01-02T18:17:59.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004, 2023-01-02T18:17:59.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.253 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:59.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:17:59.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:59.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349026+0000", 2023-01-02T18:17:59.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5660000000000001e-06 2023-01-02T18:17:59.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349034+0000", 2023-01-02T18:17:59.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0851e-05 2023-01-02T18:17:59.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349044+0000", 2023-01-02T18:17:59.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5415000000000001e-05 2023-01-02T18:17:59.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349060+0000", 2023-01-02T18:17:59.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7527000000000002e-05 2023-01-02T18:17:59.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349097+0000", 2023-01-02T18:17:59.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3733999999999999e-05 2023-01-02T18:17:59.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349111+0000", 2023-01-02T18:17:59.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075968200000000002 2023-01-02T18:17:59.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349871+0000", 2023-01-02T18:17:59.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3843000000000001e-05 2023-01-02T18:17:59.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349905+0000", 2023-01-02T18:17:59.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004 2023-01-02T18:17:59.262 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.263 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.263 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:17:59.263 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:59.264 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.717245709, 2023-01-02T18:17:59.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:17:59.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.265 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:59.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:17:59.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:59.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:17:59.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:17:59.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:17:59.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:17:59.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:17:59.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:17:59.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:17:59.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:17:59.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:17:59.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:17:59.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:17:59.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:17:59.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:17:59.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:17:59.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:17:59.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:17:59.274 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.274 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.274 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.275 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:17:59.275 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:59.275 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.667192162999999, 2023-01-02T18:17:59.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:17:59.276 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.276 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.276 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:59.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:17:59.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:59.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:17:59.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:17:59.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:17:59.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:17:59.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:17:59.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:17:59.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:17:59.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:17:59.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:17:59.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:17:59.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:17:59.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:17:59.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:17:59.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:17:59.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:17:59.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:17:59.286 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.287 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.287 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.287 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:17:59.287 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:17:59.288 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.6465343839999997, 2023-01-02T18:17:59.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:17:59.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.289 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:17:59.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.290 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:17:59.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:17:59.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:59.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:17:59.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:17:59.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:17:59.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:17:59.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:17:59.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:17:59.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:17:59.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:17:59.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:17:59.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:17:59.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:17:59.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:17:59.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:59.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:17:59.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:17:59.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:17:59.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:17:59.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:17:59.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:17:59.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:17:59.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:17:59.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:17:59.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:17:59.302 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.302 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.303 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.303 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3347 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e116)", 2023-01-02T18:17:59.303 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:17:59.303 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.6420364330000004, 2023-01-02T18:17:59.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004, 2023-01-02T18:17:59.304 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.304 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.304 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.305 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.305 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.305 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3347 2023-01-02T18:17:59.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.306 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:17:59.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:17:59.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:59.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440699+0000", 2023-01-02T18:17:59.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5150000000000001e-05 2023-01-02T18:17:59.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440724+0000", 2023-01-02T18:17:59.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2691e-05 2023-01-02T18:17:59.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440747+0000", 2023-01-02T18:17:59.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9449999999999999e-06 2023-01-02T18:17:59.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440756+0000", 2023-01-02T18:17:59.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0661999999999997e-05 2023-01-02T18:17:59.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440807+0000", 2023-01-02T18:17:59.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4629999999999996e-05 2023-01-02T18:17:59.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440871+0000", 2023-01-02T18:17:59.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034606300000000002 2023-01-02T18:17:59.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:59.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441217+0000", 2023-01-02T18:17:59.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031920429999999999 2023-01-02T18:17:59.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444409+0000", 2023-01-02T18:17:59.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032486499999999997 2023-01-02T18:17:59.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444734+0000", 2023-01-02T18:17:59.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5741000000000002e-05 2023-01-02T18:17:59.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444770+0000", 2023-01-02T18:17:59.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7988e-05 2023-01-02T18:17:59.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444798+0000", 2023-01-02T18:17:59.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004 2023-01-02T18:17:59.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.318 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.319 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3438 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:17:59.319 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:17:59.319 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.5497888460000002, 2023-01-02T18:17:59.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158, 2023-01-02T18:17:59.320 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.320 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.320 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.320 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.320 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.321 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3438 2023-01-02T18:17:59.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.321 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:17:59.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:17:59.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:59.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532948+0000", 2023-01-02T18:17:59.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:17:59.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532956+0000", 2023-01-02T18:17:59.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3448999999999999e-05 2023-01-02T18:17:59.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532969+0000", 2023-01-02T18:17:59.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4170000000000003e-06 2023-01-02T18:17:59.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532977+0000", 2023-01-02T18:17:59.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5679000000000001e-05 2023-01-02T18:17:59.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533023+0000", 2023-01-02T18:17:59.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2023-01-02T18:17:59.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533080+0000", 2023-01-02T18:17:59.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8567999999999997e-05 2023-01-02T18:17:59.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:59.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533159+0000", 2023-01-02T18:17:59.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018926119999999999 2023-01-02T18:17:59.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535051+0000", 2023-01-02T18:17:59.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088907299999999999 2023-01-02T18:17:59.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535940+0000", 2023-01-02T18:17:59.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7307e-05 2023-01-02T18:17:59.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535988+0000", 2023-01-02T18:17:59.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5602e-05 2023-01-02T18:17:59.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536013+0000", 2023-01-02T18:17:59.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158 2023-01-02T18:17:59.333 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.334 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.334 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.334 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.334 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.334 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:59.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:17:59.337 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:17:59.336+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:17:59.437 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:59.437+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:59.464 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:59.464 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:17:59.465 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:59.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:17:59.537 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:17:59.538+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:17:59.599 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:17:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:17:59.600 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:17:59.600 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:17:59.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:17:59.653 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:17:59.653+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:17:59.731 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:17:59.738 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:17:59.739+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:17:59.744 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:17:59.744 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:17:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:17:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:17:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.745 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:17:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.307444438000005, 2023-01-02T18:17:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:17:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.746 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:17:59.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:59.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:17:59.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:17:59.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:17:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:17:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:17:59.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:17:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:17:59.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:17:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:17:59.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:17:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:17:59.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:17:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:17:59.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:17:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:17:59.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:17:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:17:59.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:17:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:17:59.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:17:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:17:59.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:17:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:17:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:17:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:17:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:17:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:17:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.762 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:17:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:59.763 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.433904329000001, 2023-01-02T18:17:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:17:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.764 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:17:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:17:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:17:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:17:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:17:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:17:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:17:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:17:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:17:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:17:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:17:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:17:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:17:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:17:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:17:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:17:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:17:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:17:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:59.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:17:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:17:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:17:59.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:17:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:17:59.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:17:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:17:59.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:17:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:17:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:17:59.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.780 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:17:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.127944374000002, 2023-01-02T18:17:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:17:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:17:59.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:59.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:17:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:59.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:17:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:17:59.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:17:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:17:59.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:17:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:17:59.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:17:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:17:59.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:17:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:17:59.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:17:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:17:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:17:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:17:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:17:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:17:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:17:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:17:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:17:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:17:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:17:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:17:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:17:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:17:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:17:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:17:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:17:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:59.798 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 54.413472560000002, 2023-01-02T18:17:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:17:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:17:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:17:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:17:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:17:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:17:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:17:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:17:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:17:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:17:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:17:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:17:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:17:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:17:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:17:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:17:59.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:17:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:17:59.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:17:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:17:59.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:17:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:17:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:17:59.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:17:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:17:59.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:17:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:17:59.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:17:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:17:59.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:17:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:17:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.404371159, 2023-01-02T18:17:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:17:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:17:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:17:59.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:59.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:17:59.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:59.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:17:59.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:17:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:17:59.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:17:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:17:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:17:59.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:17:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:17:59.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:17:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:17:59.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:17:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:17:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:17:59.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:17:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:17:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:17:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:17:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.827 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:17:59.828 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.133014867, 2023-01-02T18:17:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:17:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:59.829 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:17:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:17:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:17:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:17:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:17:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:17:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:17:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:17:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:17:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:17:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:17:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:17:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:17:59.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:17:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:17:59.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:17:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:17:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:17:59.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:17:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:17:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.840 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:17:59.841 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 44.415645542999997, 2023-01-02T18:17:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:17:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.842 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:17:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:17:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:17:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:17:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:17:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:17:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:17:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:17:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:17:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:17:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:17:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:17:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:17:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:17:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:17:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:17:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:17:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:17:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:17:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:59.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:17:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:17:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:17:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:17:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:17:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:17:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:17:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:17:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:17:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:17:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:17:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.388909300999998, 2023-01-02T18:17:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:17:59.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:59.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:17:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:17:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:17:59.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:17:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:17:59.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:17:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:17:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:17:59.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:17:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:17:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:17:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:17:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:17:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:17:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:17:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:17:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:17:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:17:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:17:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:17:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:17:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:17:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:17:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:17:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:17:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:17:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:17:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:17:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:17:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.388861704999997, 2023-01-02T18:17:59.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:17:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:59.877 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:17:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:17:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:17:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:17:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:17:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:17:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:17:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:17:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:17:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:17:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:17:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:17:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:17:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:17:59.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:17:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:17:59.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:17:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:17:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:17:59.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:17:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:17:59.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:17:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:17:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:17:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:17:59.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:17:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:17:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:17:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:17:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.892 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:17:59.893 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.425792618999999, 2023-01-02T18:17:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:17:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.894 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:17:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:17:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:17:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.895 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:17:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:17:59.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:17:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:17:59.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:17:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:17:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:17:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:17:59.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:17:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:17:59.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:17:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:17:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:17:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:17:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:17:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:17:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:17:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:17:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:17:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:17:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:17:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:17:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:17:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:17:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:17:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:17:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:17:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:17:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.409686356000002, 2023-01-02T18:17:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:17:59.911 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.912 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:17:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:17:59.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:17:59.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:17:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:17:59.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:17:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:17:59.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:17:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:17:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:17:59.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:17:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:17:59.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:17:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:17:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:17:59.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:17:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:17:59.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:17:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:17:59.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:17:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:17:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:17:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:17:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:17:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:17:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:17:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:17:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:17:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:17:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:17:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.404364172000001, 2023-01-02T18:17:59.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:17:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.929 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:17:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:17:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:17:59.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:17:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:17:59.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:17:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:17:59.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:17:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:17:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:17:59.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:17:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:17:59.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:17:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:17:59.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:17:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:17:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:17:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:17:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:17:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:17:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:17:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:17:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:17:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:17:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:17:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.942 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:17:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:59.943 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.400811106999999, 2023-01-02T18:17:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:17:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:17:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:17:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:17:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:17:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:17:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:17:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:17:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:17:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:17:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:17:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:17:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:17:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:17:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:17:59.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:17:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:17:59.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:17:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:17:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 25.399179062999998, 2023-01-02T18:17:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:17:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.954 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:17:59.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:59.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:17:59.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:17:59.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:17:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:17:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:17:59.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:17:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:17:59.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:17:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:17:59.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:17:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:17:59.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:17:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:17:59.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:17:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:17:59.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:17:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:17:59.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:17:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:17:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:17:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:17:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:17:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:17:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.968 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:59.969 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.398985486000001, 2023-01-02T18:17:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:17:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:17:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:17:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:17:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:17:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:17:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:17:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:17:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:17:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:17:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:17:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:17:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:17:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:17:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:17:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:17:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:59.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:17:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:17:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:17:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:17:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:17:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:17:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:17:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:17:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:17:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:17:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:17:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.393569606, 2023-01-02T18:17:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:17:59.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:17:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:17:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:17:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:17:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:17:59.986 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:17:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:17:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:17:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:59.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:17:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:17:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:17:59.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:17:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:17:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:17:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:17:59.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:17:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:17:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:17:59.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:17:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:17:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:17:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:17:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:17:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:17:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:17:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:17:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:17:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:17:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:17:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:17:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:17:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:17:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:17:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:17:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:17:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:17:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:17:59.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:17:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:17:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:17:59.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:17:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:17:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:17:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:17:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:17:59.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:17:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:17:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:17:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:17:59.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.393029877, 2023-01-02T18:18:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:18:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:00.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:18:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:00.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:00.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:00.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:18:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:18:00.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:18:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:18:00.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:18:00.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:18:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:18:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:18:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:18:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:18:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:18:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:18:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:18:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:18:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:00.010 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.387014584999999, 2023-01-02T18:18:00.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:18:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:00.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:18:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:18:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:18:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:00.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:18:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:18:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:00.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:18:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:18:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:00.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:18:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:18:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:18:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:18:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:18:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:18:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:18:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:18:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:18:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:18:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:00.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:18:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:18:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:00.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:18:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:18:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:00.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:18:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:18:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3435 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.210368195, 2023-01-02T18:18:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001, 2023-01-02T18:18:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:00.029 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3435 2023-01-02T18:18:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.030 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532923+0000", 2023-01-02T18:18:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1790000000000008e-06 2023-01-02T18:18:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532931+0000", 2023-01-02T18:18:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.45e-05 2023-01-02T18:18:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:00.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532946+0000", 2023-01-02T18:18:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532952+0000", 2023-01-02T18:18:00.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6125999999999999e-05 2023-01-02T18:18:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532988+0000", 2023-01-02T18:18:00.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3418999999999998e-05 2023-01-02T18:18:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533041+0000", 2023-01-02T18:18:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6446999999999994e-05 2023-01-02T18:18:00.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533128+0000", 2023-01-02T18:18:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025771280000000001 2023-01-02T18:18:00.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535705+0000", 2023-01-02T18:18:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012653530000000001 2023-01-02T18:18:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536970+0000", 2023-01-02T18:18:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0913e-05 2023-01-02T18:18:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537001+0000", 2023-01-02T18:18:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.444e-05 2023-01-02T18:18:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537025+0000", 2023-01-02T18:18:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001 2023-01-02T18:18:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3454 12.1a 12:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e121)", 2023-01-02T18:18:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.0132670020000001, 2023-01-02T18:18:00.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999, 2023-01-02T18:18:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:00.044 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3454 2023-01-02T18:18:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:00.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:00.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730024+0000", 2023-01-02T18:18:00.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0990000000000005e-06 2023-01-02T18:18:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730034+0000", 2023-01-02T18:18:00.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6657e-05 2023-01-02T18:18:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730050+0000", 2023-01-02T18:18:00.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4959999999999996e-06 2023-01-02T18:18:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730059+0000", 2023-01-02T18:18:00.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1004999999999997e-05 2023-01-02T18:18:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730110+0000", 2023-01-02T18:18:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2023-01-02T18:18:00.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730255+0000", 2023-01-02T18:18:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018625 2023-01-02T18:18:00.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730441+0000", 2023-01-02T18:18:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001313771 2023-01-02T18:18:00.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.731755+0000", 2023-01-02T18:18:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0084210629999999995 2023-01-02T18:18:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740176+0000", 2023-01-02T18:18:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4363000000000001e-05 2023-01-02T18:18:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740230+0000", 2023-01-02T18:18:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0450000000000001e-05 2023-01-02T18:18:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:00.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740271+0000", 2023-01-02T18:18:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999 2023-01-02T18:18:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.057 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:00.058 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:00.058 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:00.060 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:00.060 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:00.060+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:00.160 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:00.160+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:00.172 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:00.199 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:00.200 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:00.200 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:00.200 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:00.210 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:00.261 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:00.260+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:00.315 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:00.333 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:00.336 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:00.337 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:00.347 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:00.350 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:00.361 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:00.361+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:00.367 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:00.384 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:00.402 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:00.420 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:00.438 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:00.439 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:00.440 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:00.441 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:00.473 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:00.473 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:00.483 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:00.492 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:00.492+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:00.563 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:00.563+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:00.608 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:00.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:00.664 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:00.664+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:00.731 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7, 5] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:00.732 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:00.732 INFO:tasks.thrashosds.thrasher:Adding osd 4 2023-01-02T18:18:00.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2023-01-02T18:18:00.749 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:00.749 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:00.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:00.778 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:00.778+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:00.865 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:00.865+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:00.884 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:00.885 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:00.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:00.966 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:00.967+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:01.021 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:01.021 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:01.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:01.049 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-01-02T18:18:01.049+0000 7fe18f96e700 -1 mon.a@0(leader).osd e123 definitely_dead 0 2023-01-02T18:18:01.071 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:01.072+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:01.169 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:01.169+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:01.195 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:01.196 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:01.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:01.270 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:01.270+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:01.332 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:01.332 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:01.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:01.371 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:01.371+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:01.467 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:01.468 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:01.472 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:01.472+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:01.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:01.573 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:01.573+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:01.603 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:01.603 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:01.613 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:01.674 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:01.674+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:01.744 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:18:01.762 INFO:teuthology.orchestra.run.smithi007.stderr:marked in osd.4. 2023-01-02T18:18:01.775 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:01.775+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:01.777 INFO:tasks.thrashosds.thrasher:Added osd 4 2023-01-02T18:18:01.798 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:01.799 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:01.809 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:01.875 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:01.875+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:01.951 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:01.952 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:01.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:01.976 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:01.977+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:02.077 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:02.076+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:02.128 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:02.128 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:02.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:02.178 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:02.178+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:02.278 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:02.279+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:02.303 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:02.303 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:02.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:02.379 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:02.380+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:02.439 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:02.439 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:02.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:02.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:02.492 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:02.492+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:02.575 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:02.575 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:02.581 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:02.581+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:02.586 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:02.634 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:02.651 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:02.682 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:02.682+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:02.683 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:02.700 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:02.719 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:02.726 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:02.726 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:02.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:02.727 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:02.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.727 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:02.728 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:18:02.728 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 83.242484477999994, 2023-01-02T18:18:02.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:18:02.728 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.728 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:02.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:02.729 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:02.729 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:18:02.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.730 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:18:02.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:18:02.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:02.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:18:02.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:18:02.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:18:02.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:18:02.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:18:02.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:18:02.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:18:02.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:18:02.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:18:02.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:02.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:18:02.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:18:02.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:02.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:18:02.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:18:02.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:18:02.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:18:02.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:18:02.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:18:02.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:18:02.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:18:02.745 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.745 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.746 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.746 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:02.747 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:02.747 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 74.397123637000007, 2023-01-02T18:18:02.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:02.747 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.748 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:02.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:02.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:02.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:02.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:02.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:02.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:02.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:02.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:02.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:02.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:02.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:02.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:02.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:02.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:02.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:02.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:02.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:02.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:02.758 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.758 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.758 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.759 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:18:02.759 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:18:02.760 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 69.339738077999996, 2023-01-02T18:18:02.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:18:02.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.760 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:18:02.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:18:02.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:02.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:18:02.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:18:02.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:18:02.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:18:02.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:18:02.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:18:02.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:18:02.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:18:02.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:18:02.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:18:02.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:18:02.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:18:02.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:18:02.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:18:02.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:18:02.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:18:02.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.771 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.771 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.772 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:18:02.772 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:02.772 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.092169912000003, 2023-01-02T18:18:02.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:18:02.773 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.773 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:02.773 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:02.773 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:02.774 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:02.774 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:18:02.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.774 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:02.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:02.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:02.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:18:02.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:18:02.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:18:02.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:18:02.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:18:02.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:18:02.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:18:02.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:18:02.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:18:02.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:02.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:02.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:18:02.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:18:02.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:18:02.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:18:02.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:18:02.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:18:02.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:18:02.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:18:02.786 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.786 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.786 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.787 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:02.787 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:02.787 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.387628241999998, 2023-01-02T18:18:02.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:02.788 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.788 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:02.788 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:02.789 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:02.789 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:02.789 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:02.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.789 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:02.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:02.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:02.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:02.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:02.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:02.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:02.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:02.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:02.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:02.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:02.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:02.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:02.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:02.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:02.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:02.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:02.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:02.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:02.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:02.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:02.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:02.801 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.801 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.801 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.802 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:02.802 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:02.802 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.397896506000002, 2023-01-02T18:18:02.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:18:02.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.803 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:02.803 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:02.803 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:02.804 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:18:02.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.804 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:02.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:02.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:02.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:18:02.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:18:02.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:18:02.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:18:02.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:18:02.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:18:02.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:18:02.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:18:02.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:18:02.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:18:02.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:18:02.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:18:02.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:02.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:18:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:18:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:02.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:18:02.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:18:02.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:02.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:18:02.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:18:02.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:18:02.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:18:02.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:18:02.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:18:02.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.817 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.818 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:02.818 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:02.818 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.374570650999999, 2023-01-02T18:18:02.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:02.819 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.819 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:02.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:02.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:02.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:02.820 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:02.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.820 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:02.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:02.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:02.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:02.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:02.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:02.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:02.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:02.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:02.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:02.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:02.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:02.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:02.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:02.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:02.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:02.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:02.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:02.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:02.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:02.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:02.831 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.832 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.833 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:02.833 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:02.833 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.364495421000001, 2023-01-02T18:18:02.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:02.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:02.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:02.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:02.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:02.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.835 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:02.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:02.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:02.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:02.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:02.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:02.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:02.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:02.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:02.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:02.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:02.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:02.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:02.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:02.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:02.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:02.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:02.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:02.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:02.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:02.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:02.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:02.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:02.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:02.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:02.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:02.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:02.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:02.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:02.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:02.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:02.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:02.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:02.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.850 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.851 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:02.851 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:02.851 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.401345636999999, 2023-01-02T18:18:02.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:02.852 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:02.852 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:02.852 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:02.853 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:02.853 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:02.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.853 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:02.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:02.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:02.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:02.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:02.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:02.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:02.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:02.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:02.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:02.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:02.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:02.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:02.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:02.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:02.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:02.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:02.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:02.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:02.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:02.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:02.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:02.865 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.865 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.866 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.866 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:02.866 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:02.867 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.396582171999999, 2023-01-02T18:18:02.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:18:02.867 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.868 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:02.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:02.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:02.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:18:02.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:18:02.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:18:02.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:02.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:18:02.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:18:02.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:18:02.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:18:02.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:18:02.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:18:02.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:18:02.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:18:02.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:18:02.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:18:02.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:18:02.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:18:02.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.878 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.879 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:02.879 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:02.879 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.396048947000001, 2023-01-02T18:18:02.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:02.880 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.880 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.880 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:02.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:02.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:02.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:02.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:02.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:02.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:02.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:02.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:02.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:02.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:02.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:02.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:02.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:02.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:02.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:02.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:02.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:02.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:02.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.890 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.891 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.891 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:02.891 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:02.892 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.385030672999999, 2023-01-02T18:18:02.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:18:02.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.892 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:02.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:02.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:02.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:18:02.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:18:02.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:18:02.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:18:02.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:18:02.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:18:02.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:18:02.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:18:02.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:18:02.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:18:02.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:18:02.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:18:02.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:18:02.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:18:02.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:18:02.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:18:02.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.903 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.904 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:18:02.904 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:02.904 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.380686119, 2023-01-02T18:18:02.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:18:02.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.905 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.905 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:02.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:02.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:02.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:18:02.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:18:02.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:18:02.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:18:02.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:18:02.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:18:02.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:18:02.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:18:02.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:18:02.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:18:02.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:18:02.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:18:02.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:18:02.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:18:02.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:18:02.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:18:02.915 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.915 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.916 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.916 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:02.916 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:02.917 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.343600128999999, 2023-01-02T18:18:02.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:02.917 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.917 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.917 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:02.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:02.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:02.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:02.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:02.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:02.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:02.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:02.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:02.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:02.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:02.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:02.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:02.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:02.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:02.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.928 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.929 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:02.929 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:02.929 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.336119240999999, 2023-01-02T18:18:02.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:02.930 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.930 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.930 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:02.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:02.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:02.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:02.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:02.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:02.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:02.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:02.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:02.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:02.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:02.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:02.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:02.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:02.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:02.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:02.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:02.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:02.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:02.940 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.940 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.941 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.941 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:02.941 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:02.942 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.2884665860000002, 2023-01-02T18:18:02.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:02.942 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.942 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.943 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:02.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:02.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:02.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:02.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:02.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:02.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:02.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:02.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:02.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:02.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:02.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:02.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:02.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:02.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:02.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:02.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:02.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:02.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:02.952 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.952 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.953 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.953 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:02.954 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:02.954 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.2840940080000003, 2023-01-02T18:18:02.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:02.954 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.954 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.955 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:02.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:02.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:02.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:02.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:02.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:02.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:02.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:02.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:02.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:02.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:02.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:02.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:02.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:02.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:02.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.965 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.966 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.966 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3438 11.15 e117/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 117'5, mlcod=116'3)", 2023-01-02T18:18:02.966 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:02.967 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.1923595100000002, 2023-01-02T18:18:02.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987, 2023-01-02T18:18:02.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.968 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:02.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:02.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:02.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533291+0000", 2023-01-02T18:18:02.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4139999999999997e-06 2023-01-02T18:18:02.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533299+0000", 2023-01-02T18:18:02.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1438e-05 2023-01-02T18:18:02.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533310+0000", 2023-01-02T18:18:02.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5089999999999996e-06 2023-01-02T18:18:02.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533318+0000", 2023-01-02T18:18:02.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6567999999999998e-05 2023-01-02T18:18:02.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533374+0000", 2023-01-02T18:18:02.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5011000000000002e-05 2023-01-02T18:18:02.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533399+0000", 2023-01-02T18:18:02.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024056519999999999 2023-01-02T18:18:02.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535805+0000", 2023-01-02T18:18:02.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5862000000000003e-05 2023-01-02T18:18:02.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535841+0000", 2023-01-02T18:18:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987 2023-01-02T18:18:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.979 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3436 11.14 e117/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 117'5, mlcod=108'3)", 2023-01-02T18:18:02.979 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:02.979 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.1922684810000002, 2023-01-02T18:18:02.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999, 2023-01-02T18:18:02.980 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.980 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.980 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:02.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:02.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:02.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533382+0000", 2023-01-02T18:18:02.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.476e-06 2023-01-02T18:18:02.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533387+0000", 2023-01-02T18:18:02.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0322999999999999e-05 2023-01-02T18:18:02.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533397+0000", 2023-01-02T18:18:02.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2950000000000001e-06 2023-01-02T18:18:02.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533403+0000", 2023-01-02T18:18:02.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1789000000000002e-05 2023-01-02T18:18:02.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533454+0000", 2023-01-02T18:18:02.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9650999999999999e-05 2023-01-02T18:18:02.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:02.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533474+0000", 2023-01-02T18:18:02.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019917419999999999 2023-01-02T18:18:02.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:02.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535466+0000", 2023-01-02T18:18:02.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4618999999999999e-05 2023-01-02T18:18:02.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:02.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535490+0000", 2023-01-02T18:18:02.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999 2023-01-02T18:18:02.990 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.990 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:02.991 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:02.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.991 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:02.991 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:02.992 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.9927848799999999, 2023-01-02T18:18:02.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:02.992 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:02.992 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:02.992 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:02.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:02.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:02.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:02.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:02.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:02.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:02.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:02.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:02.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:02.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:02.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:02.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:02.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:02.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:02.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:02.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:02.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:02.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:02.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:02.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:02.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:02.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:03.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:03.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:03.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:03.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:03.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:03.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:03.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:03.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.003 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.003 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.004 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.004 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:03.006 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:03.007 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:18:03.007 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:03.008 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:03.009 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:03.010 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:03.011 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:03.011 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:03.006+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:03.106 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:03.106+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:03.173 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:03.173 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:03.174 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:03.174 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:03.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:03.207 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:03.208+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:03.308 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:03.307+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:03.349 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:03.350 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:03.350 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:03.350 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:03.350 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:03.360 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:03.408 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:03.409+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:03.509 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:03.510+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:03.527 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.528 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 84.043414545000005, 2023-01-02T18:18:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:18:03.529 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:18:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:18:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:18:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:18:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:18:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:18:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:18:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:18:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:18:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:18:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:18:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:18:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:18:03.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:18:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:18:03.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:18:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:18:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 70.177668401999995, 2023-01-02T18:18:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:18:03.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:18:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:18:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:18:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:18:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:18:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:18:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:18:03.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:18:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:18:03.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:18:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:18:03.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:18:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:18:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:18:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:18:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:18:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.552 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:18:03.553 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.210840517999998, 2023-01-02T18:18:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:18:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:18:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:18:03.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:18:03.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:18:03.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:18:03.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:18:03.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:18:03.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:18:03.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:18:03.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:18:03.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:18:03.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:18:03.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:18:03.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:18:03.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:18:03.565 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.565 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.565 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.565 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:18:03.566 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:03.566 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.203350270999998, 2023-01-02T18:18:03.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:18:03.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.566 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.567 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:03.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:03.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:03.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:03.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:18:03.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:18:03.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:18:03.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:18:03.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:18:03.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:18:03.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:18:03.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:18:03.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:18:03.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:18:03.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:18:03.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:18:03.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:18:03.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:18:03.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:18:03.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.577 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.577 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:18:03.578 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:03.578 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.201557186000002, 2023-01-02T18:18:03.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:18:03.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.578 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:03.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:03.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:03.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:18:03.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:18:03.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:18:03.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:18:03.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:18:03.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:18:03.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:18:03.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:18:03.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:18:03.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:18:03.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:18:03.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:18:03.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:18:03.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:18:03.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:18:03.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:18:03.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.588 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.589 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:18:03.589 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:03.589 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.198665841999997, 2023-01-02T18:18:03.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:18:03.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.590 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.590 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:03.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:03.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:03.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:18:03.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:18:03.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:18:03.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:18:03.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:18:03.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:18:03.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:18:03.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:18:03.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:18:03.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:18:03.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:18:03.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:18:03.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:18:03.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:18:03.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:18:03.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:18:03.600 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.600 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.600 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.601 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:18:03.601 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:18:03.601 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.184467302000002, 2023-01-02T18:18:03.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:18:03.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.602 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.602 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:18:03.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:18:03.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:03.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:18:03.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:18:03.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:18:03.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:18:03.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:18:03.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:18:03.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:18:03.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:18:03.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:18:03.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:18:03.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:18:03.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:18:03.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:18:03.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:18:03.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:18:03.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:18:03.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.612 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.612 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.613 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:18:03.613 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:03.613 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.162385028000003, 2023-01-02T18:18:03.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:18:03.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.614 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.614 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:03.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:03.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:03.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:03.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:18:03.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:18:03.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:18:03.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:18:03.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:18:03.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:18:03.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:18:03.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:18:03.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:18:03.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:18:03.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:18:03.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:18:03.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:18:03.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:18:03.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:18:03.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.624 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.624 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:18:03.625 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:03.625 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.186750162999999, 2023-01-02T18:18:03.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:18:03.625 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.625 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.626 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:03.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:03.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:03.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:03.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:18:03.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:18:03.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:18:03.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:18:03.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:18:03.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:18:03.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:18:03.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:18:03.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:18:03.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:18:03.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:18:03.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:18:03.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:18:03.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:18:03.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:18:03.635 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.636 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.636 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:18:03.637 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:03.637 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.185011314, 2023-01-02T18:18:03.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:18:03.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.637 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.638 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:03.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:03.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:03.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:18:03.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:18:03.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:18:03.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:18:03.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:18:03.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:18:03.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:18:03.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:18:03.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:18:03.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:18:03.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:18:03.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:18:03.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:18:03.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:18:03.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:18:03.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:18:03.647 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.647 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.648 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:18:03.648 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:03.648 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.19268606, 2023-01-02T18:18:03.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:18:03.649 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.649 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.649 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:03.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:03.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:03.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:03.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:18:03.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:18:03.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:18:03.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:18:03.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:18:03.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:18:03.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:18:03.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:18:03.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:18:03.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:18:03.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:18:03.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:18:03.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:18:03.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:18:03.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:18:03.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.660 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.661 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:03.661 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:03.661 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.191543217, 2023-01-02T18:18:03.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:18:03.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.662 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:03.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:03.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:03.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:03.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:18:03.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:18:03.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:18:03.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:18:03.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:18:03.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:18:03.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:18:03.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:18:03.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:18:03.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:18:03.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:18:03.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:18:03.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:18:03.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:18:03.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:18:03.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.672 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.673 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:03.673 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:03.673 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.178989423000001, 2023-01-02T18:18:03.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:18:03.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.674 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:03.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:03.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:03.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:03.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:18:03.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:18:03.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:18:03.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:18:03.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:18:03.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:18:03.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:18:03.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:18:03.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:18:03.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:18:03.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:18:03.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:18:03.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:18:03.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:18:03.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:18:03.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.683 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.684 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2827 10.1e e101/98 10:7803159c:::rbd_object_map.12a2d48fcbc5:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:03.684 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:18:03.684 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.178052508, 2023-01-02T18:18:03.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004, 2023-01-02T18:18:03.685 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.685 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.685 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:18:03.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349027+0000", 2023-01-02T18:18:03.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:03.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349026+0000", 2023-01-02T18:18:03.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5660000000000001e-06 2023-01-02T18:18:03.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349034+0000", 2023-01-02T18:18:03.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0851e-05 2023-01-02T18:18:03.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349044+0000", 2023-01-02T18:18:03.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5415000000000001e-05 2023-01-02T18:18:03.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349060+0000", 2023-01-02T18:18:03.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7527000000000002e-05 2023-01-02T18:18:03.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349097+0000", 2023-01-02T18:18:03.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3733999999999999e-05 2023-01-02T18:18:03.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349111+0000", 2023-01-02T18:18:03.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00075968200000000002 2023-01-02T18:18:03.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349871+0000", 2023-01-02T18:18:03.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3843000000000001e-05 2023-01-02T18:18:03.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349905+0000", 2023-01-02T18:18:03.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087773500000000004 2023-01-02T18:18:03.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.695 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.695 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.696 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:03.696 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:03.696 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.161587114, 2023-01-02T18:18:03.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:18:03.696 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.697 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.697 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:03.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:03.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:03.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:18:03.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:18:03.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:18:03.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:18:03.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:18:03.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:18:03.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:18:03.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:18:03.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:18:03.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:18:03.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:18:03.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:18:03.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:18:03.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:18:03.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:18:03.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:18:03.706 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.706 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.707 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.707 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:18:03.707 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:03.707 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.111533567999999, 2023-01-02T18:18:03.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:18:03.708 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.708 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.708 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:03.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:18:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:18:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:18:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:18:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:18:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:18:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:18:03.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:18:03.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:18:03.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:18:03.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:18:03.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:18:03.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:18:03.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:18:03.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:18:03.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:18:03.717 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.718 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.718 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.718 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:18:03.718 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:03.719 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.090875789, 2023-01-02T18:18:03.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:18:03.719 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.719 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.719 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:03.720 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:03.720 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:03.720 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:18:03.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.720 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:03.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:03.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:03.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:18:03.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:18:03.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:18:03.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:18:03.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:18:03.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:18:03.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:18:03.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:18:03.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:18:03.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:18:03.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:18:03.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:18:03.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:03.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:18:03.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:18:03.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:03.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:18:03.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:18:03.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:03.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:18:03.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:18:03.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:18:03.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:18:03.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:18:03.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:18:03.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.733 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.734 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3347 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e116)", 2023-01-02T18:18:03.734 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:03.734 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.0863778380000007, 2023-01-02T18:18:03.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004, 2023-01-02T18:18:03.734 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:03.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:03.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:03.735 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3347 2023-01-02T18:18:03.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.736 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:03.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:03.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:03.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440699+0000", 2023-01-02T18:18:03.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5150000000000001e-05 2023-01-02T18:18:03.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440724+0000", 2023-01-02T18:18:03.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2691e-05 2023-01-02T18:18:03.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440747+0000", 2023-01-02T18:18:03.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9449999999999999e-06 2023-01-02T18:18:03.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440756+0000", 2023-01-02T18:18:03.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0661999999999997e-05 2023-01-02T18:18:03.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440807+0000", 2023-01-02T18:18:03.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4629999999999996e-05 2023-01-02T18:18:03.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440871+0000", 2023-01-02T18:18:03.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034606300000000002 2023-01-02T18:18:03.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:03.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441217+0000", 2023-01-02T18:18:03.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031920429999999999 2023-01-02T18:18:03.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:03.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444409+0000", 2023-01-02T18:18:03.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032486499999999997 2023-01-02T18:18:03.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:03.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444734+0000", 2023-01-02T18:18:03.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5741000000000002e-05 2023-01-02T18:18:03.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444770+0000", 2023-01-02T18:18:03.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7988e-05 2023-01-02T18:18:03.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444798+0000", 2023-01-02T18:18:03.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004 2023-01-02T18:18:03.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.748 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.748 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.749 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3438 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:03.749 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:03.749 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.9941302509999996, 2023-01-02T18:18:03.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158, 2023-01-02T18:18:03.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.750 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.750 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:03.750 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:03.750 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:03.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3438 2023-01-02T18:18:03.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.751 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:03.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:03.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532948+0000", 2023-01-02T18:18:03.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:18:03.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532956+0000", 2023-01-02T18:18:03.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3448999999999999e-05 2023-01-02T18:18:03.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532969+0000", 2023-01-02T18:18:03.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4170000000000003e-06 2023-01-02T18:18:03.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532977+0000", 2023-01-02T18:18:03.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5679000000000001e-05 2023-01-02T18:18:03.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533023+0000", 2023-01-02T18:18:03.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2023-01-02T18:18:03.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533080+0000", 2023-01-02T18:18:03.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8567999999999997e-05 2023-01-02T18:18:03.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:03.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533159+0000", 2023-01-02T18:18:03.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018926119999999999 2023-01-02T18:18:03.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:03.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535051+0000", 2023-01-02T18:18:03.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088907299999999999 2023-01-02T18:18:03.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:03.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535940+0000", 2023-01-02T18:18:03.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7307e-05 2023-01-02T18:18:03.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535988+0000", 2023-01-02T18:18:03.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5602e-05 2023-01-02T18:18:03.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536013+0000", 2023-01-02T18:18:03.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158 2023-01-02T18:18:03.763 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.763 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.764 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.764 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3460 13.1a 13:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e122)", 2023-01-02T18:18:03.764 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:03.765 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.7951511180000002, 2023-01-02T18:18:03.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004, 2023-01-02T18:18:03.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:03.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:03.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:03.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:03.766 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:03.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3460 2023-01-02T18:18:03.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.766 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:03.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:03.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:03.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:03.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:03.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:03.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:03.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:03.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731925+0000", 2023-01-02T18:18:03.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.447e-05 2023-01-02T18:18:03.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:03.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731940+0000", 2023-01-02T18:18:03.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4263e-05 2023-01-02T18:18:03.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:03.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731954+0000", 2023-01-02T18:18:03.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6684000000000002e-05 2023-01-02T18:18:03.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:03.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731971+0000", 2023-01-02T18:18:03.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1316999999999996e-05 2023-01-02T18:18:03.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:03.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732032+0000", 2023-01-02T18:18:03.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012202200000000001 2023-01-02T18:18:03.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:03.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732154+0000", 2023-01-02T18:18:03.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015345800000000001 2023-01-02T18:18:03.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:03.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732308+0000", 2023-01-02T18:18:03.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003479481 2023-01-02T18:18:03.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:03.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735787+0000", 2023-01-02T18:18:03.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087823000000000003 2023-01-02T18:18:03.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:03.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736665+0000", 2023-01-02T18:18:03.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7332000000000001e-05 2023-01-02T18:18:03.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:03.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736703+0000", 2023-01-02T18:18:03.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1186999999999998e-05 2023-01-02T18:18:03.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:03.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:03.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:03.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736734+0000", 2023-01-02T18:18:03.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004 2023-01-02T18:18:03.778 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.778 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.779 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:03.779 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:03.779 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:03.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:03.782 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:03.781+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:03.882 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:03.882+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:03.910 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:03.911 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:03.911 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:03.911 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:03.920 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:03.983 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:03.983+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:04.084 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:04.084+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:04.086 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:04.086 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:04.086 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:04.087 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:04.087 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:04.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:04.185 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:04.184+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:04.223 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:04.223 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:04.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:04.224 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:04.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.224 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:04.224 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:04.225 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 84.786503757999995, 2023-01-02T18:18:04.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:18:04.225 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.225 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.225 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.226 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.226 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:18:04.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.226 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:04.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:04.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:18:04.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:18:04.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:18:04.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:18:04.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:18:04.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:18:04.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:18:04.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:18:04.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:18:04.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:18:04.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:18:04.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:18:04.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:18:04.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:18:04.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:18:04.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:18:04.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:18:04.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:18:04.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:18:04.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:18:04.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:18:04.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:18:04.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:18:04.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:18:04.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:18:04.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:18:04.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.241 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.242 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:18:04.242 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:04.242 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.912963649000005, 2023-01-02T18:18:04.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:18:04.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.243 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:04.244 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:04.244 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:18:04.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.244 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:04.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:04.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:18:04.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:18:04.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:18:04.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:18:04.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:18:04.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:18:04.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:18:04.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:18:04.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:18:04.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:18:04.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:18:04.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:18:04.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:18:04.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:18:04.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:18:04.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:18:04.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:04.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:18:04.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:18:04.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:18:04.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:18:04.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:18:04.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:18:04.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:18:04.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:18:04.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:18:04.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:18:04.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.259 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.259 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:18:04.259 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:04.260 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.607003693999999, 2023-01-02T18:18:04.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:18:04.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.260 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.260 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.261 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.261 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:18:04.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.261 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:04.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:04.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:04.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:18:04.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:18:04.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:18:04.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:18:04.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:18:04.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:18:04.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:18:04.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:18:04.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:18:04.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:18:04.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:18:04.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:18:04.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:18:04.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:18:04.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:18:04.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:18:04.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:04.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:18:04.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:18:04.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:18:04.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:18:04.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:18:04.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:18:04.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:18:04.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:18:04.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:18:04.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:18:04.275 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.276 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.276 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.276 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:18:04.276 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:04.277 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.89253188, 2023-01-02T18:18:04.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:18:04.277 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.277 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.277 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.278 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.278 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:18:04.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.278 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:04.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:04.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:04.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:18:04.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:18:04.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:18:04.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:18:04.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:18:04.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:18:04.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:18:04.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:18:04.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:18:04.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:18:04.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:18:04.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:18:04.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:18:04.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:18:04.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:18:04.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:18:04.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:04.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:18:04.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:18:04.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:18:04.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:18:04.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:18:04.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:18:04.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:18:04.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:18:04.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:18:04.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:18:04.291 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.292 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.292 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:18:04.292 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:04.293 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.883430478999998, 2023-01-02T18:18:04.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:18:04.293 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.293 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:18:04.293 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:04.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:04.294 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:18:04.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.295 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:04.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:04.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:18:04.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:18:04.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:18:04.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:18:04.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:18:04.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:18:04.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:18:04.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:18:04.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:18:04.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:18:04.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:18:04.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:18:04.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:18:04.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:18:04.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:18:04.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:18:04.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:18:04.304 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.304 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.304 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.305 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:18:04.305 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:04.305 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.612074186999997, 2023-01-02T18:18:04.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:18:04.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:04.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.306 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.307 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.307 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:18:04.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.307 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:04.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:04.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:04.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:18:04.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:18:04.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:18:04.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:18:04.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:18:04.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:18:04.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:18:04.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:18:04.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:18:04.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:18:04.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:18:04.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:18:04.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:18:04.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:18:04.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:18:04.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:18:04.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:18:04.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:18:04.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.318 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.318 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.318 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:04.319 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:04.319 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.894704863000001, 2023-01-02T18:18:04.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:18:04.319 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.319 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.320 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.320 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.320 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:18:04.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.320 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:04.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:04.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:04.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:18:04.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:18:04.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:18:04.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:18:04.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:18:04.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:18:04.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:18:04.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:18:04.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:18:04.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:18:04.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:18:04.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:18:04.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:18:04.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:18:04.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:18:04.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:18:04.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:18:04.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:18:04.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:18:04.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:18:04.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:18:04.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:18:04.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:18:04.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:18:04.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:18:04.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:18:04.334 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.334 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.334 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.335 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:04.335 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:04.335 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.867968621000003, 2023-01-02T18:18:04.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:18:04.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.336 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.336 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.336 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:04.336 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:04.336 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:18:04.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.337 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:04.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:04.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:04.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:18:04.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:18:04.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:18:04.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:18:04.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:18:04.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:18:04.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:18:04.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:18:04.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:18:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:18:04.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:18:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:18:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:18:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:18:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:18:04.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:18:04.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:18:04.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:18:04.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:18:04.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:18:04.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:18:04.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:18:04.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:18:04.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:18:04.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:18:04.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:18:04.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.351 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.352 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:04.352 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:04.352 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.867921025000001, 2023-01-02T18:18:04.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:18:04.352 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.352 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.353 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.353 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:04.353 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:04.353 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:18:04.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.354 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:04.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:04.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:04.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:18:04.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:18:04.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:18:04.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:18:04.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:18:04.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:18:04.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:18:04.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:18:04.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:18:04.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:18:04.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:18:04.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:18:04.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:18:04.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:18:04.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:18:04.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:18:04.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:18:04.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:18:04.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:18:04.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:18:04.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:18:04.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:18:04.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:18:04.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:18:04.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:18:04.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:18:04.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.367 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.368 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.368 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:18:04.368 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:04.369 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.904851938999997, 2023-01-02T18:18:04.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:18:04.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.370 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:04.370 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:04.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:18:04.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.370 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:04.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:04.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:04.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:18:04.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:18:04.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:18:04.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:18:04.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:18:04.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:18:04.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:18:04.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:18:04.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:18:04.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:18:04.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:18:04.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:18:04.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:18:04.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:18:04.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:18:04.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:18:04.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:18:04.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:18:04.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:18:04.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:18:04.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:18:04.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:18:04.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:18:04.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:18:04.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:18:04.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:18:04.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.384 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.385 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:04.385 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:04.386 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.888745675999999, 2023-01-02T18:18:04.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:18:04.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.386 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.386 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:18:04.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.387 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:04.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:04.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:18:04.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:18:04.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:18:04.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:18:04.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:18:04.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:18:04.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:18:04.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:18:04.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:18:04.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:18:04.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:04.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:18:04.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:18:04.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:18:04.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:18:04.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:18:04.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:18:04.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:04.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:18:04.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:18:04.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:18:04.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:18:04.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:18:04.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:18:04.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:18:04.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:18:04.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:18:04.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:18:04.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.401 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.402 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:04.402 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:04.403 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.883423491999999, 2023-01-02T18:18:04.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:18:04.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.403 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:18:04.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.404 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:04.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:04.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:18:04.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:18:04.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:18:04.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:18:04.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:18:04.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:18:04.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:18:04.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:18:04.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:18:04.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:18:04.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:18:04.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:18:04.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:04.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:18:04.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:18:04.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:18:04.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:18:04.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:18:04.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:18:04.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:18:04.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:18:04.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:18:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:18:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.416 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:18:04.417 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.879870427, 2023-01-02T18:18:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:18:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:04.418 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:04.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:04.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:04.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:18:04.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:18:04.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:18:04.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:18:04.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:18:04.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:18:04.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:18:04.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:18:04.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:18:04.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:18:04.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:18:04.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:18:04.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:18:04.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:18:04.427 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.427 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.427 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.428 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:04.428 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:04.428 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.878238382999999, 2023-01-02T18:18:04.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:18:04.429 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.429 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.429 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.429 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.429 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.430 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:18:04.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.430 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:04.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:04.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:18:04.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:18:04.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:18:04.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:18:04.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:18:04.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:18:04.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:18:04.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:18:04.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:18:04.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:18:04.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:18:04.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:18:04.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:18:04.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:18:04.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:18:04.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:18:04.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:18:04.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:18:04.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:18:04.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:18:04.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:18:04.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:18:04.442 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.442 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.443 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:04.443 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:04.443 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.878044805999998, 2023-01-02T18:18:04.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:18:04.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.444 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.444 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.445 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:18:04.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.445 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:04.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:04.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:04.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:18:04.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:18:04.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:18:04.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:18:04.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:18:04.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:18:04.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:18:04.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:18:04.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:18:04.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:18:04.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:18:04.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:18:04.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:18:04.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:18:04.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:18:04.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:18:04.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:18:04.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:18:04.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:18:04.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:18:04.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:18:04.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:18:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.459 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:04.459 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:04.459 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.872628926000001, 2023-01-02T18:18:04.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:18:04.459 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.460 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.460 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.460 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.460 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:04.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.461 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:04.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:04.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:18:04.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:18:04.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:18:04.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:18:04.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:18:04.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:18:04.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:18:04.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:18:04.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:18:04.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:18:04.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:18:04.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:18:04.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:04.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:18:04.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:18:04.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:18:04.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:18:04.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:18:04.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:18:04.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:18:04.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:18:04.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:18:04.473 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.473 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.473 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.474 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:04.474 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:04.474 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.872089197000001, 2023-01-02T18:18:04.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:18:04.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:18:04.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:04.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.476 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:04.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:04.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:04.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:18:04.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:18:04.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:18:04.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:18:04.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:04.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:18:04.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:18:04.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:18:04.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:18:04.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:18:04.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:18:04.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:18:04.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:18:04.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:18:04.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:18:04.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.485 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.485 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.485 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:04.486 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:04.486 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.866073905, 2023-01-02T18:18:04.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:18:04.486 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.486 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.487 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.487 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.487 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:18:04.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.487 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:04.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:04.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:04.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:18:04.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:18:04.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:18:04.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:18:04.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:18:04.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:18:04.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:18:04.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:18:04.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:18:04.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:18:04.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:18:04.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:18:04.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:18:04.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:18:04.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:18:04.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:18:04.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:18:04.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:18:04.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:18:04.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:18:04.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:18:04.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:18:04.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.500 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.500 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3435 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:04.501 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:04.501 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.6894275150000002, 2023-01-02T18:18:04.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001, 2023-01-02T18:18:04.501 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.501 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.502 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3435 2023-01-02T18:18:04.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.503 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:04.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:04.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532923+0000", 2023-01-02T18:18:04.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1790000000000008e-06 2023-01-02T18:18:04.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532931+0000", 2023-01-02T18:18:04.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.45e-05 2023-01-02T18:18:04.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532946+0000", 2023-01-02T18:18:04.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:04.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532952+0000", 2023-01-02T18:18:04.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6125999999999999e-05 2023-01-02T18:18:04.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532988+0000", 2023-01-02T18:18:04.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3418999999999998e-05 2023-01-02T18:18:04.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533041+0000", 2023-01-02T18:18:04.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6446999999999994e-05 2023-01-02T18:18:04.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:04.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533128+0000", 2023-01-02T18:18:04.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025771280000000001 2023-01-02T18:18:04.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535705+0000", 2023-01-02T18:18:04.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012653530000000001 2023-01-02T18:18:04.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536970+0000", 2023-01-02T18:18:04.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0913e-05 2023-01-02T18:18:04.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537001+0000", 2023-01-02T18:18:04.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.444e-05 2023-01-02T18:18:04.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537025+0000", 2023-01-02T18:18:04.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001 2023-01-02T18:18:04.515 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.515 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.515 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.516 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3454 12.1a 12:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e121)", 2023-01-02T18:18:04.516 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:04.516 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.4923263220000003, 2023-01-02T18:18:04.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999, 2023-01-02T18:18:04.516 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:04.517 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:04.517 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:04.517 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:04.517 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:04.517 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3454 2023-01-02T18:18:04.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.518 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:04.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:04.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:04.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:04.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:04.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:04.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:04.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:04.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730024+0000", 2023-01-02T18:18:04.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0990000000000005e-06 2023-01-02T18:18:04.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:04.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730034+0000", 2023-01-02T18:18:04.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6657e-05 2023-01-02T18:18:04.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:04.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730050+0000", 2023-01-02T18:18:04.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4959999999999996e-06 2023-01-02T18:18:04.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:04.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730059+0000", 2023-01-02T18:18:04.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1004999999999997e-05 2023-01-02T18:18:04.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:04.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730110+0000", 2023-01-02T18:18:04.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2023-01-02T18:18:04.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:04.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730255+0000", 2023-01-02T18:18:04.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018625 2023-01-02T18:18:04.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:04.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730441+0000", 2023-01-02T18:18:04.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001313771 2023-01-02T18:18:04.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:04.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.731755+0000", 2023-01-02T18:18:04.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0084210629999999995 2023-01-02T18:18:04.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:04.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740176+0000", 2023-01-02T18:18:04.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4363000000000001e-05 2023-01-02T18:18:04.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:04.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740230+0000", 2023-01-02T18:18:04.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0450000000000001e-05 2023-01-02T18:18:04.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:04.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:04.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:04.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740271+0000", 2023-01-02T18:18:04.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999 2023-01-02T18:18:04.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.530 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.530 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:04.530 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:04.531 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:04.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:04.533 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:04.532+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:04.633 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:04.634+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:04.671 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:04.672 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:04.672 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:04.672 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:04.681 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:04.734 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:04.734+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:04.834 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:04.835+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:04.848 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:04.849 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:04.849 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:04.849 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:04.849 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:04.858 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:04.936 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:04.936+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:05.009 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:18:05.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:05.025 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:05.026 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:05.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:05.026 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:05.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.027 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1 3.1a 3:5bdd5772:::image1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:18:05.027 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:18:05.027 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 87.611058, 2023-01-02T18:18:05.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839, 2023-01-02T18:18:05.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.028 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:18:05.028 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:05.028 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:05.028 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:05.028 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1 2023-01-02T18:18:05.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.029 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:18:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:18:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413949+0000", 2023-01-02T18:18:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8359999999999999e-06 2023-01-02T18:18:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413954+0000", 2023-01-02T18:18:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2023-01-02T18:18:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413961+0000", 2023-01-02T18:18:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7519999999999999e-06 2023-01-02T18:18:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413968+0000", 2023-01-02T18:18:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0071999999999999e-05 2023-01-02T18:18:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414008+0000", 2023-01-02T18:18:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1890000000000001e-06 2023-01-02T18:18:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414015+0000", 2023-01-02T18:18:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013744829999999999 2023-01-02T18:18:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415389+0000", 2023-01-02T18:18:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1655000000000003e-05 2023-01-02T18:18:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415471+0000", 2023-01-02T18:18:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839 2023-01-02T18:18:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:18:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:18:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.610108213000004, 2023-01-02T18:18:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:18:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:18:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:18:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:18:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:18:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:18:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:18:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:18:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:18:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:18:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:18:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:18:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:18:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:18:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:18:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:18:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:18:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:18:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:18:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:18:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:05.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:18:05.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:18:05.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:05.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:18:05.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:18:05.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:05.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:18:05.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:18:05.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:18:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:18:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:18:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:18:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.057 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:05.057 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:18:05.057 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.604439951000003, 2023-01-02T18:18:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:18:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:18:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:18:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:18:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:18:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:18:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:18:05.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:18:05.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:18:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:18:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:18:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:18:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:18:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:18:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:18:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:18:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:18:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:18:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:18:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:18:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:18:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:18:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:18:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:18:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:18:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:18:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:18:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:18:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:18:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:18:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:18:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.598906288999999, 2023-01-02T18:18:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:18:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:18:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:18:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:18:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:18:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:18:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:18:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:18:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:18:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:18:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:18:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:18:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:18:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:18:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:18:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:18:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:18:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:18:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:18:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:11 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:18:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.591203289000006, 2023-01-02T18:18:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152, 2023-01-02T18:18:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:18:05.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:18:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:18:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:18:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433810+0000", 2023-01-02T18:18:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1821000000000001e-05 2023-01-02T18:18:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433822+0000", 2023-01-02T18:18:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4549999999999998e-06 2023-01-02T18:18:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433829+0000", 2023-01-02T18:18:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6005000000000003e-05 2023-01-02T18:18:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433885+0000", 2023-01-02T18:18:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.16e-05 2023-01-02T18:18:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433907+0000", 2023-01-02T18:18:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011094480000000001 2023-01-02T18:18:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435016+0000", 2023-01-02T18:18:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8626999999999999e-05 2023-01-02T18:18:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435045+0000", 2023-01-02T18:18:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152 2023-01-02T18:18:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:24 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'2, mlcod=0'0)", 2023-01-02T18:18:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:18:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.575574785000001, 2023-01-02T18:18:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997, 2023-01-02T18:18:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:18:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449433+0000", 2023-01-02T18:18:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449431+0000", 2023-01-02T18:18:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7706e-05 2023-01-02T18:18:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449449+0000", 2023-01-02T18:18:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0883999999999998e-05 2023-01-02T18:18:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449480+0000", 2023-01-02T18:18:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4416000000000001e-05 2023-01-02T18:18:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449494+0000", 2023-01-02T18:18:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6549000000000001e-05 2023-01-02T18:18:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449581+0000", 2023-01-02T18:18:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9669000000000003e-05 2023-01-02T18:18:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.449620+0000", 2023-01-02T18:18:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0006958 2023-01-02T18:18:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450316+0000", 2023-01-02T18:18:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0188e-05 2023-01-02T18:18:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.450346+0000", 2023-01-02T18:18:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00091295199999999997 2023-01-02T18:18:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:30 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'2, mlcod=0'0)", 2023-01-02T18:18:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:18:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.568172278999995, 2023-01-02T18:18:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003, 2023-01-02T18:18:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:18:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456836+0000", 2023-01-02T18:18:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456835+0000", 2023-01-02T18:18:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7504999999999999e-05 2023-01-02T18:18:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456852+0000", 2023-01-02T18:18:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2356e-05 2023-01-02T18:18:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456865+0000", 2023-01-02T18:18:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.421e-06 2023-01-02T18:18:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456871+0000", 2023-01-02T18:18:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8040999999999997e-05 2023-01-02T18:18:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456909+0000", 2023-01-02T18:18:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5384e-05 2023-01-02T18:18:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456925+0000", 2023-01-02T18:18:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074633700000000002 2023-01-02T18:18:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457671+0000", 2023-01-02T18:18:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7826000000000001e-05 2023-01-02T18:18:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457699+0000", 2023-01-02T18:18:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00086298500000000003 2023-01-02T18:18:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:31 3.1c e46/43 3:3d3f3250:::rbd_id.image2:head v 46'3, mlcod=46'1)", 2023-01-02T18:18:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:18:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.566543796000005, 2023-01-02T18:18:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999, 2023-01-02T18:18:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:18:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:18:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458463+0000", 2023-01-02T18:18:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3389999999999998e-06 2023-01-02T18:18:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458470+0000", 2023-01-02T18:18:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.205e-05 2023-01-02T18:18:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458482+0000", 2023-01-02T18:18:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5809999999999996e-06 2023-01-02T18:18:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458487+0000", 2023-01-02T18:18:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8702000000000001e-05 2023-01-02T18:18:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458546+0000", 2023-01-02T18:18:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2495e-05 2023-01-02T18:18:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458559+0000", 2023-01-02T18:18:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001846735 2023-01-02T18:18:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460405+0000", 2023-01-02T18:18:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9183000000000002e-05 2023-01-02T18:18:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460435+0000", 2023-01-02T18:18:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999 2023-01-02T18:18:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:33 3.3 3:c76fae31:::rbd_object_map.12a21ad382ee:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:18:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.562151233999998, 2023-01-02T18:18:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001, 2023-01-02T18:18:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33 2023-01-02T18:18:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:18:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:18:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462856+0000", 2023-01-02T18:18:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4710000000000004e-06 2023-01-02T18:18:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462862+0000", 2023-01-02T18:18:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:18:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462875+0000", 2023-01-02T18:18:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.491e-05 2023-01-02T18:18:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462890+0000", 2023-01-02T18:18:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9657999999999999e-05 2023-01-02T18:18:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462930+0000", 2023-01-02T18:18:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1362999999999999e-05 2023-01-02T18:18:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463021+0000", 2023-01-02T18:18:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015166800000000001 2023-01-02T18:18:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463173+0000", 2023-01-02T18:18:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074740899999999999 2023-01-02T18:18:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463920+0000", 2023-01-02T18:18:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045107699999999998 2023-01-02T18:18:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464372+0000", 2023-01-02T18:18:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6213e-05 2023-01-02T18:18:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464408+0000", 2023-01-02T18:18:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.535e-05 2023-01-02T18:18:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464433+0000", 2023-01-02T18:18:05.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001 2023-01-02T18:18:05.148 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.148 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.149 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.149 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:53 3.f e46/43 3:f5b90545:::rbd_header.12a279b662cb:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:05.149 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:18:05.149 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.515197677000003, 2023-01-02T18:18:05.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082, 2023-01-02T18:18:05.150 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.150 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.150 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:18:05.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:18:05.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:05.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509810+0000", 2023-01-02T18:18:05.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3499999999999996e-06 2023-01-02T18:18:05.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509815+0000", 2023-01-02T18:18:05.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0020999999999999e-05 2023-01-02T18:18:05.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509825+0000", 2023-01-02T18:18:05.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1399999999999997e-06 2023-01-02T18:18:05.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509832+0000", 2023-01-02T18:18:05.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3279999999999999e-05 2023-01-02T18:18:05.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509875+0000", 2023-01-02T18:18:05.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0288e-05 2023-01-02T18:18:05.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509895+0000", 2023-01-02T18:18:05.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000905152 2023-01-02T18:18:05.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510800+0000", 2023-01-02T18:18:05.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1238000000000001e-05 2023-01-02T18:18:05.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510832+0000", 2023-01-02T18:18:05.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001021082 2023-01-02T18:18:05.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.160 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.161 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:18:05.161 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:18:05.161 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.513207136000005, 2023-01-02T18:18:05.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:18:05.162 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.162 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.162 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:18:05.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:18:05.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:18:05.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:18:05.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:18:05.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:18:05.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:18:05.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:18:05.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:18:05.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:18:05.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:18:05.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:18:05.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:18:05.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:18:05.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:18:05.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:18:05.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:18:05.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:18:05.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.172 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.173 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:18:05.173 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:18:05.173 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.591251473, 2023-01-02T18:18:05.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:18:05.174 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.174 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:05.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:05.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:05.174 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:18:05.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.175 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:18:05.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:18:05.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:05.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:18:05.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:18:05.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:18:05.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:18:05.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:18:05.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:18:05.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:18:05.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:18:05.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:18:05.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:05.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:05.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:18:05.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:18:05.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:18:05.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:18:05.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:18:05.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:18:05.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:05.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:18:05.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:18:05.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:05.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:18:05.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:18:05.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:05.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:18:05.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:18:05.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:18:05.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:18:05.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:18:05.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:18:05.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.190 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.191 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:18:05.191 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:18:05.192 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.726470414999994, 2023-01-02T18:18:05.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:18:05.192 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.192 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.192 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:05.193 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:05.193 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:05.193 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:18:05.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.193 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:18:05.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:18:05.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:05.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:18:05.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:18:05.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:18:05.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:18:05.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:18:05.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:18:05.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:18:05.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:18:05.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:18:05.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:18:05.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:05.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:18:05.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:18:05.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:18:05.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:18:05.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:18:05.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:18:05.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:05.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:18:05.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:18:05.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:05.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:18:05.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:18:05.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:05.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:18:05.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:18:05.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:18:05.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:18:05.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:18:05.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:18:05.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.208 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.208 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.209 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:272 4.9 4:911e4614:::rbd_id.image18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:18:05.209 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:18:05.209 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.714841895000006, 2023-01-02T18:18:05.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999, 2023-01-02T18:18:05.210 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.210 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.210 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:05.210 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:05.210 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:05.211 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 272 2023-01-02T18:18:05.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.211 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:18:05.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:18:05.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:05.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310165+0000", 2023-01-02T18:18:05.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.628e-06 2023-01-02T18:18:05.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310174+0000", 2023-01-02T18:18:05.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2023-01-02T18:18:05.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310190+0000", 2023-01-02T18:18:05.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:18:05.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310198+0000", 2023-01-02T18:18:05.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6770000000000001e-05 2023-01-02T18:18:05.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310245+0000", 2023-01-02T18:18:05.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159517 2023-01-02T18:18:05.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310404+0000", 2023-01-02T18:18:05.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023075600000000001 2023-01-02T18:18:05.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:05.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310635+0000", 2023-01-02T18:18:05.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088889700000000004 2023-01-02T18:18:05.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:05.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311524+0000", 2023-01-02T18:18:05.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011021 2023-01-02T18:18:05.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:05.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311634+0000", 2023-01-02T18:18:05.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2626000000000002e-05 2023-01-02T18:18:05.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311667+0000", 2023-01-02T18:18:05.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9774000000000002e-05 2023-01-02T18:18:05.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311706+0000", 2023-01-02T18:18:05.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999 2023-01-02T18:18:05.224 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.224 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.224 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.225 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(8.1b 125/124 [PushOp(8:d8cae014:::rbd_id.image28:head, version: 68'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(8:d8cae014:::rbd_id.image28:head@68'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:05.225 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.780675+0000", 2023-01-02T18:18:05.225 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.24433302, 2023-01-02T18:18:05.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0021783459999999998, 2023-01-02T18:18:05.225 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.226 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:05.226 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780675+0000", 2023-01-02T18:18:05.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780675+0000", 2023-01-02T18:18:05.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780674+0000", 2023-01-02T18:18:05.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2589e-05 2023-01-02T18:18:05.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780697+0000", 2023-01-02T18:18:05.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8652999999999999e-05 2023-01-02T18:18:05.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780715+0000", 2023-01-02T18:18:05.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2925000000000001e-05 2023-01-02T18:18:05.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780728+0000", 2023-01-02T18:18:05.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2286000000000005e-05 2023-01-02T18:18:05.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780810+0000", 2023-01-02T18:18:05.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:18:05.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780822+0000", 2023-01-02T18:18:05.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020315580000000001 2023-01-02T18:18:05.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.782853+0000", 2023-01-02T18:18:05.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0021783459999999998 2023-01-02T18:18:05.234 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.235 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.235 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.235 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(3.1b 125/124 [PushOp(3:def61116:::rbd_id.image17:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:def61116:::rbd_id.image17:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:05.236 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.780801+0000", 2023-01-02T18:18:05.236 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.2442071320000001, 2023-01-02T18:18:05.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028938050000000002, 2023-01-02T18:18:05.236 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.236 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:05.237 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780801+0000", 2023-01-02T18:18:05.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780801+0000", 2023-01-02T18:18:05.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780800+0000", 2023-01-02T18:18:05.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3433e-05 2023-01-02T18:18:05.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780814+0000", 2023-01-02T18:18:05.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5350999999999999e-05 2023-01-02T18:18:05.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780829+0000", 2023-01-02T18:18:05.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.06e-05 2023-01-02T18:18:05.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780840+0000", 2023-01-02T18:18:05.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010008700000000001 2023-01-02T18:18:05.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780940+0000", 2023-01-02T18:18:05.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2119999999999997e-06 2023-01-02T18:18:05.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780947+0000", 2023-01-02T18:18:05.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00274786 2023-01-02T18:18:05.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.783695+0000", 2023-01-02T18:18:05.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028938050000000002 2023-01-02T18:18:05.245 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.245 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.246 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.246 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(12.1a 125/124 [PushOp(12:5cea7035:::rbd_info:head, version: 121'1, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(12:5cea7035:::rbd_info:head@121'1, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:05.246 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.791302+0000", 2023-01-02T18:18:05.247 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.2337062090000002, 2023-01-02T18:18:05.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001210722, 2023-01-02T18:18:05.247 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.247 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:05.247 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791302+0000", 2023-01-02T18:18:05.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791302+0000", 2023-01-02T18:18:05.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:05.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791302+0000", 2023-01-02T18:18:05.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6103000000000002e-05 2023-01-02T18:18:05.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791318+0000", 2023-01-02T18:18:05.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7237000000000001e-05 2023-01-02T18:18:05.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791335+0000", 2023-01-02T18:18:05.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1532000000000001e-05 2023-01-02T18:18:05.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791346+0000", 2023-01-02T18:18:05.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066366999999999999 2023-01-02T18:18:05.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.792010+0000", 2023-01-02T18:18:05.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0825999999999999e-05 2023-01-02T18:18:05.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.792021+0000", 2023-01-02T18:18:05.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049166300000000004 2023-01-02T18:18:05.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.792513+0000", 2023-01-02T18:18:05.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001210722 2023-01-02T18:18:05.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.264 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.266 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(8.1b 125/124 [PushOp(8:debe2b3d:::rbd_header.12a230fb06bc:head, version: 72'85, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 79, attrset_size: 3, recovery_info: ObjectRecoveryInfo(8:debe2b3d:::rbd_header.12a230fb06bc:head@72'85, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:05.266 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.795197+0000", 2023-01-02T18:18:05.266 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.229811169, 2023-01-02T18:18:05.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097200900000000002, 2023-01-02T18:18:05.267 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.267 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:05.268 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.795197+0000", 2023-01-02T18:18:05.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.795197+0000", 2023-01-02T18:18:05.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:05.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.795196+0000", 2023-01-02T18:18:05.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1619999999999999e-05 2023-01-02T18:18:05.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.795228+0000", 2023-01-02T18:18:05.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1916000000000001e-05 2023-01-02T18:18:05.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.795240+0000", 2023-01-02T18:18:05.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1949999999999997e-06 2023-01-02T18:18:05.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.795247+0000", 2023-01-02T18:18:05.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00037700400000000001 2023-01-02T18:18:05.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.795624+0000", 2023-01-02T18:18:05.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:18:05.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.795632+0000", 2023-01-02T18:18:05.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00053727799999999997 2023-01-02T18:18:05.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796169+0000", 2023-01-02T18:18:05.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097200900000000002 2023-01-02T18:18:05.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.281 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.282 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.282 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(8.b 125/124 [PushOp(8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head, version: 72'1, data_included: [0~35], data_size: 35, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head@72'1, size: 35, copy_subset: [0~35], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:35, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:05.282 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.796350+0000", 2023-01-02T18:18:05.283 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.2286577329999999, 2023-01-02T18:18:05.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017453410000000001, 2023-01-02T18:18:05.283 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.283 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:05.283 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796350+0000", 2023-01-02T18:18:05.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796350+0000", 2023-01-02T18:18:05.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796350+0000", 2023-01-02T18:18:05.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3314e-05 2023-01-02T18:18:05.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796363+0000", 2023-01-02T18:18:05.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7924999999999999e-05 2023-01-02T18:18:05.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796381+0000", 2023-01-02T18:18:05.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0920999999999999e-05 2023-01-02T18:18:05.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796392+0000", 2023-01-02T18:18:05.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6407000000000003e-05 2023-01-02T18:18:05.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796458+0000", 2023-01-02T18:18:05.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:18:05.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796466+0000", 2023-01-02T18:18:05.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001629588 2023-01-02T18:18:05.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.798096+0000", 2023-01-02T18:18:05.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017453410000000001 2023-01-02T18:18:05.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.292 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.293 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3484 12.16 e125/124 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head v 125'3, mlcod=123'1)", 2023-01-02T18:18:05.293 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.809621+0000", 2023-01-02T18:18:05.293 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.2153873640000001, 2023-01-02T18:18:05.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002427944, 2023-01-02T18:18:05.294 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:05.294 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:05.294 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:05.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:05.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809621+0000", 2023-01-02T18:18:05.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:05.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:05.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809621+0000", 2023-01-02T18:18:05.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:05.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:05.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809620+0000", 2023-01-02T18:18:05.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8889999999999996e-06 2023-01-02T18:18:05.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:05.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809627+0000", 2023-01-02T18:18:05.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0693000000000001e-05 2023-01-02T18:18:05.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:05.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809638+0000", 2023-01-02T18:18:05.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6469999999999997e-06 2023-01-02T18:18:05.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:05.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809642+0000", 2023-01-02T18:18:05.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5593000000000002e-05 2023-01-02T18:18:05.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:05.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809688+0000", 2023-01-02T18:18:05.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1826000000000001e-05 2023-01-02T18:18:05.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:05.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809710+0000", 2023-01-02T18:18:05.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023060810000000002 2023-01-02T18:18:05.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:05.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812016+0000", 2023-01-02T18:18:05.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2937e-05 2023-01-02T18:18:05.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:05.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:05.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:05.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812049+0000", 2023-01-02T18:18:05.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002427944 2023-01-02T18:18:05.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.304 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:05.305 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:05.305 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:05.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:05.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:05.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:05.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:05.308 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:05.309 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:05.309 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:05.309 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:05.309 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:05.310 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:05.311 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:05.311 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:05.311 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:05.311 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:05.311 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:05.312 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:05.312 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:05.306+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:05.407 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:05.407+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:05.438 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:05.439 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:05.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:05.508 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:05.508+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:05.574 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:05.574 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:05.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:05.609 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:05.609+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:05.710 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:05.710+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:05.750 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:05.751 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:05.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:05.811 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:05.811+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:05.886 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:05.887 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:05.896 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:05.938 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:05.938+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:06.013 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:06.013+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:06.062 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:06.062 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:06.072 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:06.117 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:06.118+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:06.197 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:06.198 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:06.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:06.248 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:06.249+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:06.316 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:06.317+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:06.339 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:18:06.377 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:06.377 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:06.388 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:06.417 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:06.417+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:06.518 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:06.518+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:06.553 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:06.562 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:06.646 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:06.647+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:06.720 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:06.720+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:06.727 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:06.727 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:06.737 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:06.778 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7, 5, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:06.779 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:06.779 INFO:tasks.thrashosds.thrasher:primary_affinity 2023-01-02T18:18:06.779 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.355421 2023-01-02T18:18:06.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0.3554212910298198 2023-01-02T18:18:06.821 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:06.822+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:06.878 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:06.879 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:06.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:06.933 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:06.933+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:07.019 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:07.019 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:07.023 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:07.023+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:07.029 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:07.123 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:07.123+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:07.194 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:07.195 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:07.204 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:07.245 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:07.245+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:07.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:07.341 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.4 primary-affinity to 0.355421 (8232922) 2023-01-02T18:18:07.341 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:07.341+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:07.397 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:07.397 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:07.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:07.449 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:07.449+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:07.478 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:07.511 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:07.527 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:07.527+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:07.528 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:07.546 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:07.565 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:07.583 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:07.586 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:07.587 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:07.587 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:07.587 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:07.587 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:07.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:07.601 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:07.622 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:07.623 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:07.624 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:07.625 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:07.628 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:07.628+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:07.729 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:07.729+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:07.730 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:07.731 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:07.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:07.731 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:07.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.731 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:6 3.4 3:267905b2:::rbd_id.image3:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:07.732 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:18:07.732 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 88.246992503000001, 2023-01-02T18:18:07.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999, 2023-01-02T18:18:07.732 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.732 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.733 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:07.733 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:07.733 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:07.733 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 6 2023-01-02T18:18:07.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.734 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:18:07.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483167+0000", 2023-01-02T18:18:07.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:07.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483164+0000", 2023-01-02T18:18:07.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2828e-05 2023-01-02T18:18:07.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483177+0000", 2023-01-02T18:18:07.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6813999999999999e-05 2023-01-02T18:18:07.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483194+0000", 2023-01-02T18:18:07.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.593e-06 2023-01-02T18:18:07.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483202+0000", 2023-01-02T18:18:07.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7562999999999999e-05 2023-01-02T18:18:07.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483239+0000", 2023-01-02T18:18:07.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010534100000000001 2023-01-02T18:18:07.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483345+0000", 2023-01-02T18:18:07.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016759399999999999 2023-01-02T18:18:07.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:07.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483512+0000", 2023-01-02T18:18:07.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090635100000000001 2023-01-02T18:18:07.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:07.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484419+0000", 2023-01-02T18:18:07.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024122400000000001 2023-01-02T18:18:07.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:07.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484660+0000", 2023-01-02T18:18:07.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2768000000000002e-05 2023-01-02T18:18:07.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484693+0000", 2023-01-02T18:18:07.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1352e-05 2023-01-02T18:18:07.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484734+0000", 2023-01-02T18:18:07.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015671369999999999 2023-01-02T18:18:07.746 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.747 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.747 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.747 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:07.747 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:07.748 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 79.401631662, 2023-01-02T18:18:07.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:07.748 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.748 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.748 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:07.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:07.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:07.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:07.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:07.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:07.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:07.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:07.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:07.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:07.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:07.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:07.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:07.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:07.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:07.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:07.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:07.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:07.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:07.758 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.758 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.759 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.759 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:460 6.7 e60/57 6:e7d57d29:::rbd_header.12a269152854:head v 60'8, mlcod=60'6)", 2023-01-02T18:18:07.759 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:18:07.760 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 74.344246103000003, 2023-01-02T18:18:07.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001, 2023-01-02T18:18:07.760 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.760 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.760 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:18:07.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385913+0000", 2023-01-02T18:18:07.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:07.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385912+0000", 2023-01-02T18:18:07.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2945999999999999e-05 2023-01-02T18:18:07.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385925+0000", 2023-01-02T18:18:07.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0278000000000001e-05 2023-01-02T18:18:07.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385945+0000", 2023-01-02T18:18:07.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3829999999999992e-06 2023-01-02T18:18:07.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.385953+0000", 2023-01-02T18:18:07.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8826999999999997e-05 2023-01-02T18:18:07.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386022+0000", 2023-01-02T18:18:07.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6054000000000002e-05 2023-01-02T18:18:07.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.386048+0000", 2023-01-02T18:18:07.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015603069999999999 2023-01-02T18:18:07.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387608+0000", 2023-01-02T18:18:07.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7868999999999999e-05 2023-01-02T18:18:07.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.387656+0000", 2023-01-02T18:18:07.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017431650000000001 2023-01-02T18:18:07.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.770 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.770 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.771 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:18:07.771 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:07.771 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.096677937000003, 2023-01-02T18:18:07.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:18:07.772 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.772 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:07.772 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:07.772 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:07.772 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:07.773 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:18:07.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.773 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:07.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:07.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:07.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:18:07.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:18:07.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:18:07.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:18:07.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:18:07.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:18:07.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:18:07.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:18:07.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:18:07.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:07.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:07.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:18:07.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:18:07.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:18:07.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:18:07.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:18:07.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:18:07.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:18:07.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:18:07.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.784 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.784 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.784 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:07.785 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:07.785 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.392136266999998, 2023-01-02T18:18:07.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:07.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:07.785 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:07.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:07.786 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:07.786 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:07.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.786 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:07.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:07.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:07.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:07.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:07.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:07.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:07.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:07.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:07.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:07.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:07.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:07.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:07.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:07.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:07.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:07.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:07.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:07.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:07.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:07.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:07.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:07.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.797 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.797 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:07.798 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:07.798 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.402404531000002, 2023-01-02T18:18:07.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:18:07.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:07.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:07.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:07.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:18:07.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.800 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:07.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:07.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:07.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:18:07.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:18:07.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:18:07.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:18:07.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:18:07.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:18:07.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:18:07.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:18:07.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:18:07.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:18:07.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:18:07.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:18:07.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:07.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:18:07.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:18:07.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:07.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:18:07.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:18:07.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:07.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:18:07.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:18:07.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:18:07.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:18:07.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:18:07.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:18:07.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.812 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.813 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.813 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:07.813 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:07.814 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.379078675999999, 2023-01-02T18:18:07.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:07.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:07.814 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:07.814 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:07.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:07.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:07.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.815 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:07.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:07.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:07.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:07.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:07.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:07.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:07.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:07.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:07.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:07.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:07.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:07.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:07.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:07.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:07.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:07.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:07.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:07.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:07.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:07.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:07.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:07.826 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.826 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.826 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.369003446000001, 2023-01-02T18:18:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:07.827 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:07.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:07.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:07.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:07.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:07.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:07.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:07.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:07.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:07.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:07.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:07.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:07.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:07.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.405853661999998, 2023-01-02T18:18:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.844 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:07.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:07.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:07.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.401090197000002, 2023-01-02T18:18:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:18:07.857 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:07.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:07.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:18:07.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:18:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:18:07.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:18:07.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:18:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:18:07.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:18:07.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:18:07.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:18:07.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:18:07.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:18:07.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:18:07.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:18:07.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:18:07.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:18:07.867 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.867 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.868 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.868 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:07.868 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:07.869 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.400556971999997, 2023-01-02T18:18:07.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:07.869 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.869 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.869 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:07.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:07.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:07.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:07.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:07.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:07.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:07.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.389538698000003, 2023-01-02T18:18:07.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:18:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:18:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:18:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:18:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:18:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:18:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:18:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:18:07.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:18:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:18:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:18:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:18:07.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:18:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:18:07.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:18:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:18:07.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:18:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.891 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:18:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.385194144000003, 2023-01-02T18:18:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:18:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:07.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:07.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:18:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:18:07.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:18:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:18:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:18:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:18:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:18:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:18:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:18:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:18:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:18:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:18:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:18:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:18:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:18:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:18:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.348108153999998, 2023-01-02T18:18:07.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:07.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:07.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:07.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:07.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.340627265999998, 2023-01-02T18:18:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:07.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:07.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:07.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:07.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:07.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:07.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:07.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:07.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:07.925 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.926 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.292974611, 2023-01-02T18:18:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:07.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:07.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:07.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:07.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.937 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:07.938 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.288602033, 2023-01-02T18:18:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3438 11.15 e117/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 117'5, mlcod=116'3)", 2023-01-02T18:18:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.196867535000001, 2023-01-02T18:18:07.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987, 2023-01-02T18:18:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533291+0000", 2023-01-02T18:18:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4139999999999997e-06 2023-01-02T18:18:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533299+0000", 2023-01-02T18:18:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1438e-05 2023-01-02T18:18:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533310+0000", 2023-01-02T18:18:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5089999999999996e-06 2023-01-02T18:18:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533318+0000", 2023-01-02T18:18:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6567999999999998e-05 2023-01-02T18:18:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533374+0000", 2023-01-02T18:18:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5011000000000002e-05 2023-01-02T18:18:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533399+0000", 2023-01-02T18:18:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024056519999999999 2023-01-02T18:18:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535805+0000", 2023-01-02T18:18:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5862000000000003e-05 2023-01-02T18:18:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535841+0000", 2023-01-02T18:18:07.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987 2023-01-02T18:18:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3436 11.14 e117/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 117'5, mlcod=108'3)", 2023-01-02T18:18:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.196776506000001, 2023-01-02T18:18:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999, 2023-01-02T18:18:07.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:07.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533382+0000", 2023-01-02T18:18:07.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.476e-06 2023-01-02T18:18:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533387+0000", 2023-01-02T18:18:07.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0322999999999999e-05 2023-01-02T18:18:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533397+0000", 2023-01-02T18:18:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2950000000000001e-06 2023-01-02T18:18:07.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533403+0000", 2023-01-02T18:18:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1789000000000002e-05 2023-01-02T18:18:07.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533454+0000", 2023-01-02T18:18:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9650999999999999e-05 2023-01-02T18:18:07.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533474+0000", 2023-01-02T18:18:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019917419999999999 2023-01-02T18:18:07.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535466+0000", 2023-01-02T18:18:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4618999999999999e-05 2023-01-02T18:18:07.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535490+0000", 2023-01-02T18:18:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999 2023-01-02T18:18:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.972 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:07.973 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.9972929050000001, 2023-01-02T18:18:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:07.974 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:07.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:07.985 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:07.985 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:07.986 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:07.987 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:07.987+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:08.087 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:08.087+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:08.154 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:08.155 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:08.155 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:08.155 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:08.165 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:08.188 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:08.189+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:08.290 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:08.290+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:08.330 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:08.330 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:08.331 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:08.331 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:08.331 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:08.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:08.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:18:08.391 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:08.390+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:08.481 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:08.482 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:08.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:08.482 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:08.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.483 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:08.483 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:08.483 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 88.997248079000002, 2023-01-02T18:18:08.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:18:08.483 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.484 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.484 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:18:08.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:18:08.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:18:08.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:18:08.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:18:08.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:18:08.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:18:08.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:18:08.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:18:08.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:18:08.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:18:08.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:18:08.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:18:08.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:18:08.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:18:08.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:18:08.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.494 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.494 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.494 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:18:08.495 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:08.495 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.131501936000006, 2023-01-02T18:18:08.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:18:08.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.496 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:08.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:08.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:08.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:18:08.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:18:08.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:18:08.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:18:08.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:18:08.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:18:08.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:18:08.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:18:08.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:18:08.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:18:08.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:18:08.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:18:08.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:18:08.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:18:08.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:18:08.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:18:08.505 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.506 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.506 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.506 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:18:08.507 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:08.507 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.164674051999995, 2023-01-02T18:18:08.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:18:08.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.507 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.507 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:08.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:08.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:08.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:08.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:18:08.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:18:08.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:18:08.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:18:08.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:18:08.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:18:08.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:18:08.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:18:08.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:18:08.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:18:08.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:18:08.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:18:08.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:18:08.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:18:08.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:18:08.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.518 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:18:08.518 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:08.518 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.157183805000003, 2023-01-02T18:18:08.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:18:08.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.519 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:08.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:08.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:08.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:08.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:18:08.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:18:08.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:18:08.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:18:08.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:18:08.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:18:08.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:18:08.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:18:08.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:18:08.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:18:08.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:18:08.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:18:08.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:18:08.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:18:08.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:18:08.529 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.529 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.529 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.530 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:18:08.530 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:08.530 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.15539072, 2023-01-02T18:18:08.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:18:08.531 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.531 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.531 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:08.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:08.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:08.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:18:08.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:18:08.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:18:08.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:18:08.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:18:08.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:18:08.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:18:08.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:18:08.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:18:08.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:18:08.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:18:08.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:18:08.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:18:08.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:18:08.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:18:08.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:18:08.541 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.541 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.541 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.542 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:18:08.542 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:08.542 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.152499376000002, 2023-01-02T18:18:08.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:18:08.542 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.543 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.543 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:08.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:08.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:08.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:18:08.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:18:08.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:18:08.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:18:08.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:18:08.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:18:08.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:18:08.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:18:08.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:18:08.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:18:08.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:18:08.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:18:08.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:18:08.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:18:08.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:18:08.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:18:08.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.553 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.554 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2191 3.13 e87/54 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head v 87'1, mlcod=0'0)", 2023-01-02T18:18:08.554 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:18:08.554 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.138300835999999, 2023-01-02T18:18:08.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997, 2023-01-02T18:18:08.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.555 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.555 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:18:08.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:18:08.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:08.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342612+0000", 2023-01-02T18:18:08.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4670000000000003e-06 2023-01-02T18:18:08.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342617+0000", 2023-01-02T18:18:08.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5519000000000002e-05 2023-01-02T18:18:08.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342633+0000", 2023-01-02T18:18:08.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3869999999999997e-06 2023-01-02T18:18:08.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342640+0000", 2023-01-02T18:18:08.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4484999999999998e-05 2023-01-02T18:18:08.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342695+0000", 2023-01-02T18:18:08.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2923000000000001e-05 2023-01-02T18:18:08.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.342718+0000", 2023-01-02T18:18:08.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074367699999999999 2023-01-02T18:18:08.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343461+0000", 2023-01-02T18:18:08.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3426000000000002e-05 2023-01-02T18:18:08.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.343495+0000", 2023-01-02T18:18:08.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088270199999999997 2023-01-02T18:18:08.564 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.565 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.565 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.565 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:18:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.116218562, 2023-01-02T18:18:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:18:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.566 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:08.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:08.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:08.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:08.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:18:08.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:18:08.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:18:08.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:18:08.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:18:08.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:18:08.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:18:08.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:18:08.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:18:08.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:18:08.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:18:08.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:18:08.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:18:08.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:18:08.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:18:08.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.576 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.577 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:18:08.577 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:08.577 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.140583696999997, 2023-01-02T18:18:08.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:18:08.578 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.578 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.578 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:08.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:08.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:08.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:08.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:18:08.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:18:08.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:18:08.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:18:08.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:18:08.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:18:08.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:18:08.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:18:08.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:18:08.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:18:08.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:18:08.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:18:08.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:18:08.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:18:08.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:18:08.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.588 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.588 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:18:08.589 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:08.589 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.138844847999998, 2023-01-02T18:18:08.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:18:08.589 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.589 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.590 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:08.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:08.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:08.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:18:08.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:18:08.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:18:08.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:18:08.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:18:08.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:18:08.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:18:08.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:18:08.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:18:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:18:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:18:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:18:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:18:08.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:18:08.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:18:08.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:18:08.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.599 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.599 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.600 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:18:08.600 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:08.600 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.146519593999997, 2023-01-02T18:18:08.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:18:08.601 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.601 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.601 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:08.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:08.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:08.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:08.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:18:08.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:18:08.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:18:08.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:18:08.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:18:08.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:18:08.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:18:08.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:18:08.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:18:08.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:18:08.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:18:08.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:18:08.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:18:08.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:18:08.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:18:08.611 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.611 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.611 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.612 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:08.612 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:08.612 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.145376751000001, 2023-01-02T18:18:08.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:18:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:18:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:18:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:18:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:18:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:18:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:18:08.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:18:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:18:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:18:08.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:18:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:18:08.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:18:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:18:08.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:18:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:18:08.622 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:08.623 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.132822957000002, 2023-01-02T18:18:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:18:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.624 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:18:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:18:08.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:18:08.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:18:08.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:18:08.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:18:08.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:18:08.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:18:08.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:18:08.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:18:08.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:18:08.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:18:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:18:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:18:08.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:18:08.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.634 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.634 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.635 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:08.635 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:08.635 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.115420647999997, 2023-01-02T18:18:08.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:18:08.636 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.636 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.636 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:08.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:08.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:08.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:18:08.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:18:08.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:18:08.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:18:08.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:18:08.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:18:08.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:18:08.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:18:08.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:18:08.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:18:08.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:18:08.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:18:08.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:18:08.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:18:08.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:18:08.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:18:08.646 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.646 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.646 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.647 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:18:08.647 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:08.647 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.065367102000003, 2023-01-02T18:18:08.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:18:08.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.648 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.648 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:08.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:08.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:08.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:18:08.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:18:08.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:18:08.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:18:08.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:18:08.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:18:08.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:18:08.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:18:08.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:18:08.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:18:08.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:18:08.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:18:08.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:18:08.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:18:08.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:18:08.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:18:08.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.658 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.658 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.658 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:18:08.658 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:08.659 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.044709322999999, 2023-01-02T18:18:08.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:18:08.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.659 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.659 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:08.660 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:08.660 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:08.660 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:18:08.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.660 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:08.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:08.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:08.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:18:08.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:18:08.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:18:08.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:18:08.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:18:08.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:18:08.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:18:08.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:18:08.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:18:08.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:18:08.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:18:08.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:18:08.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:08.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:18:08.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:18:08.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:08.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:18:08.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:18:08.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:08.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:18:08.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:18:08.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:18:08.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:18:08.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:18:08.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:18:08.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.673 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.673 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.674 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3347 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e116)", 2023-01-02T18:18:08.674 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:08.674 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.040211372, 2023-01-02T18:18:08.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004, 2023-01-02T18:18:08.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.675 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.675 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:08.675 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:08.676 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:08.676 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3347 2023-01-02T18:18:08.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.676 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:08.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:08.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:08.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440699+0000", 2023-01-02T18:18:08.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5150000000000001e-05 2023-01-02T18:18:08.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440724+0000", 2023-01-02T18:18:08.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2691e-05 2023-01-02T18:18:08.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440747+0000", 2023-01-02T18:18:08.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9449999999999999e-06 2023-01-02T18:18:08.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440756+0000", 2023-01-02T18:18:08.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0661999999999997e-05 2023-01-02T18:18:08.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440807+0000", 2023-01-02T18:18:08.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4629999999999996e-05 2023-01-02T18:18:08.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440871+0000", 2023-01-02T18:18:08.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034606300000000002 2023-01-02T18:18:08.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:08.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441217+0000", 2023-01-02T18:18:08.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031920429999999999 2023-01-02T18:18:08.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:08.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444409+0000", 2023-01-02T18:18:08.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032486499999999997 2023-01-02T18:18:08.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:08.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444734+0000", 2023-01-02T18:18:08.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5741000000000002e-05 2023-01-02T18:18:08.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444770+0000", 2023-01-02T18:18:08.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7988e-05 2023-01-02T18:18:08.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444798+0000", 2023-01-02T18:18:08.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004 2023-01-02T18:18:08.688 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.688 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.688 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.689 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3438 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:08.689 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:08.689 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.947963785000001, 2023-01-02T18:18:08.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158, 2023-01-02T18:18:08.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.690 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:08.690 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:08.691 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:08.691 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3438 2023-01-02T18:18:08.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.691 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:08.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:08.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:08.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532948+0000", 2023-01-02T18:18:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:18:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532956+0000", 2023-01-02T18:18:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3448999999999999e-05 2023-01-02T18:18:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532969+0000", 2023-01-02T18:18:08.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4170000000000003e-06 2023-01-02T18:18:08.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532977+0000", 2023-01-02T18:18:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5679000000000001e-05 2023-01-02T18:18:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533023+0000", 2023-01-02T18:18:08.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2023-01-02T18:18:08.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533080+0000", 2023-01-02T18:18:08.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8567999999999997e-05 2023-01-02T18:18:08.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:08.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533159+0000", 2023-01-02T18:18:08.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018926119999999999 2023-01-02T18:18:08.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:08.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535051+0000", 2023-01-02T18:18:08.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088907299999999999 2023-01-02T18:18:08.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:08.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535940+0000", 2023-01-02T18:18:08.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7307e-05 2023-01-02T18:18:08.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535988+0000", 2023-01-02T18:18:08.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5602e-05 2023-01-02T18:18:08.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536013+0000", 2023-01-02T18:18:08.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158 2023-01-02T18:18:08.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.704 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.704 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.705 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3460 13.1a 13:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e122)", 2023-01-02T18:18:08.705 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:08.705 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.7489846520000008, 2023-01-02T18:18:08.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004, 2023-01-02T18:18:08.705 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.706 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:08.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:08.706 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:08.706 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3460 2023-01-02T18:18:08.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.707 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:08.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:08.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:08.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731925+0000", 2023-01-02T18:18:08.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.447e-05 2023-01-02T18:18:08.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731940+0000", 2023-01-02T18:18:08.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4263e-05 2023-01-02T18:18:08.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731954+0000", 2023-01-02T18:18:08.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6684000000000002e-05 2023-01-02T18:18:08.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731971+0000", 2023-01-02T18:18:08.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1316999999999996e-05 2023-01-02T18:18:08.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732032+0000", 2023-01-02T18:18:08.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012202200000000001 2023-01-02T18:18:08.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732154+0000", 2023-01-02T18:18:08.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015345800000000001 2023-01-02T18:18:08.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:08.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732308+0000", 2023-01-02T18:18:08.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003479481 2023-01-02T18:18:08.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:08.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735787+0000", 2023-01-02T18:18:08.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087823000000000003 2023-01-02T18:18:08.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:08.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736665+0000", 2023-01-02T18:18:08.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7332000000000001e-05 2023-01-02T18:18:08.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736703+0000", 2023-01-02T18:18:08.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1186999999999998e-05 2023-01-02T18:18:08.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736734+0000", 2023-01-02T18:18:08.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004 2023-01-02T18:18:08.718 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.719 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.719 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.719 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3493 13.10 e128/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 128'2, mlcod=0'0)", 2023-01-02T18:18:08.719 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:08.720 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.63827551100000002, 2023-01-02T18:18:08.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999, 2023-01-02T18:18:08.720 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:08.720 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:08.720 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:08.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:08.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:08.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:08.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:08.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:08.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:08.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:08.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:08.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050436299999999997 2023-01-02T18:18:08.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:08.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843141+0000", 2023-01-02T18:18:08.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2051e-05 2023-01-02T18:18:08.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:08.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843153+0000", 2023-01-02T18:18:08.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.558e-06 2023-01-02T18:18:08.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843159+0000", 2023-01-02T18:18:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1963000000000003e-05 2023-01-02T18:18:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843221+0000", 2023-01-02T18:18:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6831000000000001e-05 2023-01-02T18:18:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:08.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843248+0000", 2023-01-02T18:18:08.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024489630000000002 2023-01-02T18:18:08.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:08.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845697+0000", 2023-01-02T18:18:08.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3207999999999998e-05 2023-01-02T18:18:08.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:08.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:08.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:08.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845730+0000", 2023-01-02T18:18:08.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999 2023-01-02T18:18:08.730 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.730 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.730 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:08.731 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:08.731 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:08.733 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:08.733 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:08.732+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:08.833 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:08.833+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:08.899 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:08.900 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:08.900 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:08.900 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:08.909 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:08.934 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:08.934+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:09.034 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:09.035+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:09.074 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:09.074 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:09.074 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:09.075 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:09.075 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:09.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:09.136 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:09.136+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:09.211 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:09.211 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:09.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:09.212 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:09.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.212 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:09.212 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:09.212 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 89.774332803999997, 2023-01-02T18:18:09.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:18:09.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.213 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.213 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.214 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.214 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:18:09.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.214 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:09.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:09.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:18:09.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:18:09.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:18:09.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:18:09.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:18:09.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:18:09.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:18:09.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:18:09.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:18:09.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:18:09.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:18:09.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:18:09.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:18:09.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:18:09.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:18:09.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:18:09.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:18:09.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:18:09.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:18:09.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:18:09.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:18:09.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:18:09.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:18:09.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:18:09.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:18:09.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:18:09.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.229 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.230 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:18:09.230 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:09.230 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.900792695000007, 2023-01-02T18:18:09.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:18:09.231 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.231 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.231 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.231 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:09.231 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:09.232 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:18:09.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.232 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:09.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:09.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:18:09.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:18:09.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:18:09.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:18:09.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:18:09.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:18:09.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:18:09.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:18:09.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:18:09.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:18:09.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:18:09.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:18:09.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:18:09.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:18:09.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:18:09.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:18:09.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:09.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:18:09.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:18:09.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:18:09.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:18:09.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:18:09.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:18:09.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:18:09.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:18:09.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:18:09.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:18:09.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.247 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.247 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.247 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:18:09.248 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:09.248 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.594832740000001, 2023-01-02T18:18:09.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:18:09.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.249 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.249 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:18:09.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.250 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:09.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:09.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:09.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:18:09.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:18:09.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:18:09.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:18:09.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:18:09.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:18:09.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:18:09.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:18:09.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:18:09.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:18:09.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:18:09.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:18:09.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:18:09.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:18:09.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:18:09.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:18:09.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:09.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:18:09.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:18:09.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:18:09.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:18:09.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:18:09.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:18:09.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:18:09.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:18:09.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:18:09.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:18:09.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.265 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.266 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:18:09.266 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:09.266 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.880360926000002, 2023-01-02T18:18:09.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:18:09.266 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.267 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.267 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.267 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.267 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.267 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:18:09.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.268 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:09.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:09.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:09.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:18:09.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:18:09.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:18:09.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:18:09.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:18:09.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:18:09.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:18:09.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:18:09.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:18:09.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:18:09.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:18:09.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:18:09.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:18:09.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:18:09.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:18:09.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:18:09.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:09.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:18:09.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:18:09.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:18:09.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:18:09.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:18:09.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:18:09.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:18:09.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:18:09.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:18:09.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:18:09.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.282 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.283 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.283 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:18:09.283 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:09.284 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.871259524999999, 2023-01-02T18:18:09.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:18:09.284 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.284 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:18:09.284 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.285 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:09.285 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:09.285 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:18:09.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.285 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:09.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:09.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:18:09.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:18:09.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:18:09.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:18:09.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:18:09.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:18:09.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:18:09.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:18:09.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:18:09.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:18:09.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:18:09.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:18:09.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:18:09.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:18:09.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:18:09.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:18:09.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:18:09.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.300 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.300 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.302 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:18:09.302 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:09.302 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.599903232999999, 2023-01-02T18:18:09.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:18:09.303 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.303 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:09.304 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.304 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.305 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.305 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:18:09.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.306 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:09.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:09.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:09.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:18:09.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:18:09.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:18:09.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:18:09.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:18:09.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:18:09.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:18:09.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:18:09.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:18:09.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:18:09.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:18:09.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:18:09.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:18:09.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:18:09.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:18:09.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:18:09.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:18:09.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:18:09.320 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.321 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.321 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.321 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:09.322 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:09.322 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.882533909000003, 2023-01-02T18:18:09.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:18:09.322 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.322 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.323 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.323 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.323 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.323 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:18:09.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.324 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:09.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:09.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:09.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:18:09.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:18:09.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:18:09.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:18:09.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:18:09.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:18:09.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:18:09.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:18:09.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:18:09.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:18:09.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:18:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:18:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:18:09.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:18:09.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:18:09.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:18:09.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:18:09.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:18:09.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:18:09.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:18:09.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:18:09.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:18:09.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:18:09.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:18:09.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:18:09.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:18:09.338 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.338 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.339 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.339 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:09.339 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:09.340 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.855797666999997, 2023-01-02T18:18:09.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:18:09.340 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.340 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.341 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:09.341 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:09.341 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:18:09.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.341 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:09.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:09.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:09.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:18:09.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:18:09.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:18:09.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:18:09.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:18:09.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:18:09.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:18:09.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:18:09.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:18:09.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:18:09.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:18:09.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:18:09.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:18:09.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:18:09.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:18:09.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:18:09.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:18:09.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:18:09.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:18:09.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:18:09.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:18:09.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:18:09.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:18:09.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:18:09.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:18:09.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:18:09.358 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.359 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.359 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.359 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:09.360 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:09.360 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.855750071000003, 2023-01-02T18:18:09.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:18:09.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.361 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.361 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:09.361 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:09.361 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:18:09.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.362 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:09.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:09.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:09.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:18:09.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:18:09.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:18:09.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:18:09.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:18:09.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:18:09.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:18:09.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:18:09.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:18:09.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:18:09.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:18:09.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:18:09.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:18:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:18:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:18:09.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:18:09.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:18:09.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:18:09.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:18:09.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:18:09.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:18:09.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:18:09.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:18:09.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:18:09.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:18:09.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:18:09.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.377 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.377 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.378 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:18:09.378 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:09.378 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.892680984999998, 2023-01-02T18:18:09.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:18:09.379 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.379 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.379 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:09.380 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:09.380 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:18:09.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.380 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:09.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:09.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:09.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:18:09.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:18:09.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:18:09.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:18:09.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:18:09.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:18:09.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:18:09.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:18:09.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:18:09.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:18:09.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:18:09.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:18:09.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:18:09.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:18:09.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:18:09.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:18:09.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:18:09.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:18:09.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:18:09.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:18:09.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:18:09.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:18:09.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:18:09.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:18:09.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:18:09.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:18:09.395 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.395 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.395 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.396 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:09.396 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:09.396 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.876574722000001, 2023-01-02T18:18:09.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:18:09.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.397 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.397 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.397 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.397 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.398 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:18:09.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.398 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:09.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:09.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:18:09.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:18:09.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:18:09.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:18:09.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:18:09.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:18:09.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:18:09.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:18:09.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:18:09.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:18:09.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:09.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:18:09.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:18:09.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:18:09.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:18:09.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:18:09.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:18:09.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:09.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:18:09.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:18:09.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:18:09.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:18:09.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:18:09.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:18:09.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:18:09.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:18:09.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:18:09.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:18:09.413 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.413 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.413 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.414 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:09.414 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:09.414 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.871252538, 2023-01-02T18:18:09.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:18:09.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:18:09.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.416 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:09.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:09.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:18:09.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:18:09.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:18:09.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:18:09.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:18:09.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:18:09.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:18:09.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:18:09.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:18:09.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:18:09.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:18:09.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:18:09.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:09.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:18:09.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:18:09.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:18:09.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:18:09.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:18:09.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:18:09.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:18:09.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:18:09.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:18:09.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:18:09.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.429 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.430 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:18:09.430 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:09.430 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.867699473000002, 2023-01-02T18:18:09.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:18:09.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:09.431 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:09.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:09.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:09.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:18:09.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:18:09.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:18:09.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:18:09.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:18:09.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:18:09.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:18:09.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:18:09.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:18:09.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:18:09.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:18:09.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:18:09.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:18:09.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:18:09.440 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.440 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.440 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.440 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:09.441 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:09.441 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.866067428999997, 2023-01-02T18:18:09.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:18:09.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.442 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.442 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.442 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.442 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.442 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:18:09.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.443 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:09.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:09.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:18:09.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:18:09.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:18:09.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:18:09.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:18:09.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:18:09.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:18:09.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:18:09.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:18:09.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:18:09.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:18:09.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:18:09.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:18:09.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:18:09.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:18:09.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:18:09.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:18:09.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:18:09.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:18:09.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:18:09.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:18:09.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:18:09.458 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.459 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.459 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:09.459 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:09.460 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.865873852, 2023-01-02T18:18:09.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:18:09.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.460 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.460 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.460 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.461 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:18:09.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.461 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:09.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:09.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:09.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:18:09.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:18:09.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:18:09.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:18:09.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:18:09.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:18:09.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:18:09.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:18:09.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:18:09.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:18:09.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:18:09.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:18:09.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:18:09.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:18:09.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:18:09.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:18:09.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:18:09.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:18:09.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:18:09.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:18:09.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:18:09.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:18:09.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.474 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.474 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.474 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:09.475 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:09.475 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.860457971999999, 2023-01-02T18:18:09.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:18:09.475 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.475 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.476 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.476 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:09.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.476 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:09.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:09.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:18:09.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:18:09.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:18:09.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:18:09.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:18:09.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:18:09.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:18:09.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:18:09.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:18:09.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:18:09.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:18:09.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:18:09.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:09.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:18:09.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:18:09.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:18:09.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:18:09.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:18:09.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:18:09.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:18:09.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:18:09.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:18:09.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.489 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.490 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:09.490 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:09.490 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.859918242999999, 2023-01-02T18:18:09.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:18:09.490 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:18:09.491 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.491 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.491 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.491 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:09.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.492 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:09.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:09.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:09.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:18:09.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:18:09.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:18:09.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:18:09.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:09.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:18:09.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:18:09.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:18:09.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:18:09.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:18:09.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:18:09.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:18:09.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:18:09.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:18:09.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:18:09.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.500 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.500 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.501 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:09.501 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:09.501 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.853902950999998, 2023-01-02T18:18:09.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:18:09.502 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.502 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:18:09.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.503 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:09.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:09.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:09.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:18:09.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:18:09.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:18:09.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:18:09.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:18:09.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:18:09.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:18:09.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:18:09.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:18:09.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:18:09.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:18:09.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:18:09.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:18:09.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:18:09.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:18:09.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:18:09.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:18:09.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:18:09.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:18:09.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:18:09.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:18:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:18:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3435 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.677256561, 2023-01-02T18:18:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001, 2023-01-02T18:18:09.517 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.518 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.518 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3435 2023-01-02T18:18:09.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.519 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:09.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:09.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532923+0000", 2023-01-02T18:18:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1790000000000008e-06 2023-01-02T18:18:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532931+0000", 2023-01-02T18:18:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.45e-05 2023-01-02T18:18:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532946+0000", 2023-01-02T18:18:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532952+0000", 2023-01-02T18:18:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6125999999999999e-05 2023-01-02T18:18:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532988+0000", 2023-01-02T18:18:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3418999999999998e-05 2023-01-02T18:18:09.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533041+0000", 2023-01-02T18:18:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6446999999999994e-05 2023-01-02T18:18:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533128+0000", 2023-01-02T18:18:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025771280000000001 2023-01-02T18:18:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535705+0000", 2023-01-02T18:18:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012653530000000001 2023-01-02T18:18:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536970+0000", 2023-01-02T18:18:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0913e-05 2023-01-02T18:18:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537001+0000", 2023-01-02T18:18:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.444e-05 2023-01-02T18:18:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537025+0000", 2023-01-02T18:18:09.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001 2023-01-02T18:18:09.531 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.531 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.531 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.532 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3454 12.1a 12:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e121)", 2023-01-02T18:18:09.532 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:09.532 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.480155368, 2023-01-02T18:18:09.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999, 2023-01-02T18:18:09.533 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:09.533 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:09.533 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:09.534 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:09.534 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:09.534 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3454 2023-01-02T18:18:09.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.534 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:09.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:09.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:09.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:09.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:09.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:09.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:09.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:09.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730024+0000", 2023-01-02T18:18:09.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0990000000000005e-06 2023-01-02T18:18:09.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:09.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730034+0000", 2023-01-02T18:18:09.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6657e-05 2023-01-02T18:18:09.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:09.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730050+0000", 2023-01-02T18:18:09.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4959999999999996e-06 2023-01-02T18:18:09.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:09.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730059+0000", 2023-01-02T18:18:09.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1004999999999997e-05 2023-01-02T18:18:09.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:09.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730110+0000", 2023-01-02T18:18:09.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2023-01-02T18:18:09.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:09.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730255+0000", 2023-01-02T18:18:09.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018625 2023-01-02T18:18:09.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:09.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730441+0000", 2023-01-02T18:18:09.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001313771 2023-01-02T18:18:09.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:09.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.731755+0000", 2023-01-02T18:18:09.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0084210629999999995 2023-01-02T18:18:09.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:09.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740176+0000", 2023-01-02T18:18:09.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4363000000000001e-05 2023-01-02T18:18:09.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:09.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740230+0000", 2023-01-02T18:18:09.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0450000000000001e-05 2023-01-02T18:18:09.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:09.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:09.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:09.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740271+0000", 2023-01-02T18:18:09.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999 2023-01-02T18:18:09.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.547 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:09.548 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:09.548 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:09.549 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:09.550 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:18:09.551 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:09.550+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:09.635 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:09.680 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:09.680+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:09.689 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:09.689 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:09.689 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:09.690 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:09.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:09.751 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:09.751+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:09.778 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:09.795 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:09.812 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:09.825 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:09.825 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:09.825 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:09.825 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:09.826 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:09.829 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:09.835 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:09.848 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:09.866 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:09.878 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:09.879+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:09.885 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:09.903 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:09.904 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:09.905 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:09.953 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:09.953+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:09.961 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:09.962 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:09.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:10.054 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:10.054+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:10.137 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:10.137 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:10.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:10.190 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:10.191+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:10.256 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:10.256+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:10.271 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:10.272 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:10.281 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:10.365 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:10.366+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:10.447 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:10.448 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:10.457 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:10.458 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:10.458+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:10.558 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:10.558+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:10.624 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:10.624 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:10.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:10.659 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:10.659+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:10.759 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:10.759 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:10.760 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:10.759+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:10.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:10.860 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:10.860+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:10.896 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:10.897 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:10.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:10.961 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:10.961+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:11.031 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:11.032 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:11.041 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:11.062 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:11.062+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:11.163 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:11.163+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:11.206 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:11.206 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:11.216 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:11.300 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:11.301+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:11.365 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:11.365+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:11.385 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:11.385 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:11.395 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:11.466 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:11.466+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:11.533 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:11.534 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:11.544 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:11.551 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:18:11.587 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:11.587+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:11.666 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:11.667+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:11.675 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:11.675 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:11.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:11.767 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:11.767+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:11.812 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:11.813 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:11.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:11.906 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:11.906+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:11.915 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:11.970 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:11.969+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:11.990 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:11.990 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:12.000 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:12.058 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:12.070 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:12.071+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:12.076 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:12.093 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:12.111 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:12.129 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:12.147 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:12.165 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:12.166 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:12.167 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:12.167 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:12.167 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:12.167 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:12.171 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:12.171+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:12.177 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:12.184 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:12.186 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:12.186 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:12.186 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:12.186 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:12.187 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:12.187 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:12.187 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:12.187 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:12.271 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:12.272+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:12.311 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:12.312 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:12.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:12.312 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:12.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.312 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:12.313 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:12.313 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 83.982356480999997, 2023-01-02T18:18:12.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:12.313 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.313 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.314 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:12.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:12.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:12.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:12.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:12.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:12.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:12.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:12.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:12.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:12.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:12.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:12.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:12.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:12.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:12.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:12.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:12.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:12.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:12.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.324 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.324 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:18:12.325 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:12.325 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.677402755999999, 2023-01-02T18:18:12.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:18:12.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:18:12.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.327 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:12.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:12.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:18:12.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:18:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:18:12.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:18:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:18:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:18:12.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:18:12.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:18:12.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:18:12.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:12.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:12.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:18:12.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:18:12.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:18:12.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:18:12.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:18:12.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:18:12.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:18:12.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:18:12.337 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.337 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.337 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.338 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:12.338 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:12.338 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.972861086000002, 2023-01-02T18:18:12.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:12.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.339 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:12.339 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:12.339 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:12.340 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:12.340 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:12.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.340 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:12.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:12.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:12.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:12.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:12.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:12.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:12.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:12.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:12.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:12.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:12.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:12.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:12.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:12.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:12.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:12.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:12.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:12.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:12.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:12.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:12.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:12.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.351 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.352 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:12.352 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:12.352 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.983129349999999, 2023-01-02T18:18:12.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:18:12.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.353 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.353 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:12.353 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:12.354 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:12.354 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:18:12.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.354 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:12.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:12.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:12.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:18:12.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:18:12.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:18:12.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:18:12.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:18:12.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:18:12.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:18:12.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:18:12.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:18:12.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:18:12.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:18:12.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:18:12.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:12.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:18:12.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:18:12.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:12.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:18:12.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:18:12.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:12.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:18:12.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:18:12.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:18:12.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:18:12.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:18:12.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:18:12.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.367 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.368 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:12.368 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:12.368 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.959803495000003, 2023-01-02T18:18:12.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:12.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:12.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:12.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:12.370 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:12.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:12.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.370 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:12.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:12.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:12.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:12.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:12.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:12.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:12.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:12.381 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.382 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 50.949728264999997, 2023-01-02T18:18:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.383 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.384 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:12.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:12.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:12.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:12.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:12.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:12.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:12.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:12.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:12.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:12.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:12.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:12.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:12.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:12.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:12.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:12.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:12.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:12.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:12.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:12.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:12.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:12.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:12.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:12.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:12.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:12.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:12.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:12.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:12.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:12.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:12.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:12.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.399 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.400 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:12.400 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:12.400 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.986578481000002, 2023-01-02T18:18:12.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:12.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:12.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:12.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:12.401 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:12.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:12.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.402 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:12.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:12.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:12.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:12.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:12.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:12.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:12.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:12.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:12.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:12.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:12.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:12.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:12.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:12.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:12.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:12.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:12.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:12.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:12.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:12.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:12.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:12.412 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.413 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.413 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.413 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:12.413 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:12.414 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.981815015999999, 2023-01-02T18:18:12.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:18:12.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.414 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.414 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:12.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:12.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:18:12.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:18:12.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:18:12.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:12.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:18:12.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:18:12.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:18:12.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:18:12.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:18:12.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:18:12.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:18:12.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:18:12.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:18:12.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:18:12.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:18:12.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:18:12.424 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.424 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.426 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:12.426 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:12.426 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.981281791000001, 2023-01-02T18:18:12.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:12.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.427 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.427 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:12.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:12.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:12.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:12.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:12.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:12.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:12.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:12.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:12.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:12.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:12.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:12.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:12.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:12.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:12.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:12.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:12.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:12.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:12.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.437 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.438 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2822 10.13 e101/98 10:ca309683:::rbd_id.image43:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:12.438 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:12.438 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.970263516999999, 2023-01-02T18:18:12.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999, 2023-01-02T18:18:12.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.439 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:12.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340621+0000", 2023-01-02T18:18:12.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:12.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340620+0000", 2023-01-02T18:18:12.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5080000000000002e-06 2023-01-02T18:18:12.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340627+0000", 2023-01-02T18:18:12.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7705000000000001e-05 2023-01-02T18:18:12.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340644+0000", 2023-01-02T18:18:12.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3319999999999992e-06 2023-01-02T18:18:12.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340653+0000", 2023-01-02T18:18:12.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.051e-05 2023-01-02T18:18:12.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340733+0000", 2023-01-02T18:18:12.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8810000000000001e-05 2023-01-02T18:18:12.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.340752+0000", 2023-01-02T18:18:12.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671329 2023-01-02T18:18:12.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342423+0000", 2023-01-02T18:18:12.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8523999999999999e-05 2023-01-02T18:18:12.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342462+0000", 2023-01-02T18:18:12.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018412439999999999 2023-01-02T18:18:12.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.448 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.449 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2818 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'5, mlcod=101'3)", 2023-01-02T18:18:12.449 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:12.449 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.965918963, 2023-01-02T18:18:12.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999, 2023-01-02T18:18:12.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.450 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:12.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344965+0000", 2023-01-02T18:18:12.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:12.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344964+0000", 2023-01-02T18:18:12.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7429999999999997e-06 2023-01-02T18:18:12.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344974+0000", 2023-01-02T18:18:12.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2181000000000001e-05 2023-01-02T18:18:12.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344986+0000", 2023-01-02T18:18:12.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6000000000000003e-06 2023-01-02T18:18:12.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344993+0000", 2023-01-02T18:18:12.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014440000000000001 2023-01-02T18:18:12.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345137+0000", 2023-01-02T18:18:12.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1721000000000001e-05 2023-01-02T18:18:12.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345159+0000", 2023-01-02T18:18:12.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001430125 2023-01-02T18:18:12.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346589+0000", 2023-01-02T18:18:12.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024790000000000001 2023-01-02T18:18:12.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346837+0000", 2023-01-02T18:18:12.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018716119999999999 2023-01-02T18:18:12.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.460 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.461 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:12.461 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:12.461 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.928832972999999, 2023-01-02T18:18:12.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:12.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.462 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:12.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:12.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:12.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:12.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:12.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:12.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:12.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:12.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:12.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:12.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:12.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:12.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:12.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:12.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:12.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:12.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:12.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:12.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:12.472 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.472 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.472 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.473 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:12.473 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:12.473 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.921352084999999, 2023-01-02T18:18:12.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:12.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.474 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:12.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:12.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:12.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:12.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:12.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:12.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:12.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:12.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:12.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:12.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:12.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:12.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:12.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:12.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:12.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:12.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:12.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:12.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.873699429999999, 2023-01-02T18:18:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:12.485 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:12.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:12.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:12.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.869326852, 2023-01-02T18:18:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:12.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:12.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:12.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:12.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:12.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.506 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3438 11.15 e117/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 117'5, mlcod=116'3)", 2023-01-02T18:18:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:12.507 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.777592353999999, 2023-01-02T18:18:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987, 2023-01-02T18:18:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533291+0000", 2023-01-02T18:18:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4139999999999997e-06 2023-01-02T18:18:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533299+0000", 2023-01-02T18:18:12.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1438e-05 2023-01-02T18:18:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533310+0000", 2023-01-02T18:18:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5089999999999996e-06 2023-01-02T18:18:12.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533318+0000", 2023-01-02T18:18:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6567999999999998e-05 2023-01-02T18:18:12.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533374+0000", 2023-01-02T18:18:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5011000000000002e-05 2023-01-02T18:18:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533399+0000", 2023-01-02T18:18:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024056519999999999 2023-01-02T18:18:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535805+0000", 2023-01-02T18:18:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5862000000000003e-05 2023-01-02T18:18:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535841+0000", 2023-01-02T18:18:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987 2023-01-02T18:18:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3436 11.14 e117/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 117'5, mlcod=108'3)", 2023-01-02T18:18:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.777501324999999, 2023-01-02T18:18:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999, 2023-01-02T18:18:12.518 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533382+0000", 2023-01-02T18:18:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.476e-06 2023-01-02T18:18:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533387+0000", 2023-01-02T18:18:12.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0322999999999999e-05 2023-01-02T18:18:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533397+0000", 2023-01-02T18:18:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2950000000000001e-06 2023-01-02T18:18:12.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533403+0000", 2023-01-02T18:18:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1789000000000002e-05 2023-01-02T18:18:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533454+0000", 2023-01-02T18:18:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9650999999999999e-05 2023-01-02T18:18:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533474+0000", 2023-01-02T18:18:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019917419999999999 2023-01-02T18:18:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535466+0000", 2023-01-02T18:18:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4618999999999999e-05 2023-01-02T18:18:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535490+0000", 2023-01-02T18:18:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999 2023-01-02T18:18:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.528 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:12.529 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.578017724, 2023-01-02T18:18:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:12.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:12.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3493 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e127)", 2023-01-02T18:18:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.469220398, 2023-01-02T18:18:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998, 2023-01-02T18:18:12.541 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:12.542 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3493 2023-01-02T18:18:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841661+0000", 2023-01-02T18:18:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8811999999999999e-05 2023-01-02T18:18:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841680+0000", 2023-01-02T18:18:12.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9380000000000001e-05 2023-01-02T18:18:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841699+0000", 2023-01-02T18:18:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:12.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841709+0000", 2023-01-02T18:18:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010059 2023-01-02T18:18:12.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841809+0000", 2023-01-02T18:18:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3533e-05 2023-01-02T18:18:12.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841903+0000", 2023-01-02T18:18:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036800899999999998 2023-01-02T18:18:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842271+0000", 2023-01-02T18:18:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033624560000000002 2023-01-02T18:18:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845633+0000", 2023-01-02T18:18:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020175099999999999 2023-01-02T18:18:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845835+0000", 2023-01-02T18:18:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1019999999999998e-05 2023-01-02T18:18:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845866+0000", 2023-01-02T18:18:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7328999999999999e-05 2023-01-02T18:18:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845893+0000", 2023-01-02T18:18:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998 2023-01-02T18:18:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3494 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e128)", 2023-01-02T18:18:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.4646910900000001, 2023-01-02T18:18:12.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999, 2023-01-02T18:18:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:12.557 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3494 2023-01-02T18:18:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:12.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:12.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846191+0000", 2023-01-02T18:18:12.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4089e-05 2023-01-02T18:18:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846205+0000", 2023-01-02T18:18:12.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8082000000000001e-05 2023-01-02T18:18:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846223+0000", 2023-01-02T18:18:12.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2023-01-02T18:18:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846231+0000", 2023-01-02T18:18:12.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100853 2023-01-02T18:18:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846332+0000", 2023-01-02T18:18:12.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4294000000000004e-05 2023-01-02T18:18:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846406+0000", 2023-01-02T18:18:12.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000381035 2023-01-02T18:18:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846787+0000", 2023-01-02T18:18:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029262089999999999 2023-01-02T18:18:12.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849713+0000", 2023-01-02T18:18:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022129699999999999 2023-01-02T18:18:12.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849934+0000", 2023-01-02T18:18:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6384000000000003e-05 2023-01-02T18:18:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849971+0000", 2023-01-02T18:18:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9811e-05 2023-01-02T18:18:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:12.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.850001+0000", 2023-01-02T18:18:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999 2023-01-02T18:18:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.570 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:12.571 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:12.571 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:12.571 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 6, 7, 5, 4] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:12.572 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:12.572 INFO:tasks.thrashosds.thrasher:Removing osd 3, in_osds are: [0, 1, 2, 3, 6, 7, 5, 4] 2023-01-02T18:18:12.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 3 2023-01-02T18:18:12.574 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:12.575 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:18:12.576 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:12.574+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:12.674 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:12.675+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:12.744 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:12.745 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:12.745 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:12.745 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:12.755 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:12.799 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:12.799+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:12.875 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:12.875+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:12.883 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:12.883 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:12.883 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:12.884 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:12.884 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:12.894 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:12.936 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-01-02T18:18:12.935+0000 7fe18f96e700 -1 mon.a@0(leader).osd e131 definitely_dead 0 2023-01-02T18:18:12.976 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:12.977+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:13.060 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:13.061 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:13.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:13.061 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:13.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.061 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:13.062 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:13.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 93.576271004000006, 2023-01-02T18:18:13.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:18:13.062 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.062 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.063 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:13.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:13.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:13.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:18:13.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:18:13.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:18:13.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:18:13.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:18:13.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:18:13.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:18:13.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:18:13.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:18:13.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:18:13.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:18:13.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:18:13.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:18:13.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:18:13.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:18:13.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:18:13.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.073 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.074 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:18:13.074 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:13.074 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 79.710524860999996, 2023-01-02T18:18:13.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:18:13.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.075 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.075 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:13.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:13.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:13.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:18:13.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:18:13.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:18:13.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:18:13.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:18:13.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:18:13.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:18:13.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:18:13.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:18:13.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:18:13.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:18:13.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:18:13.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:18:13.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:18:13.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:18:13.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:18:13.085 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.085 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.085 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.086 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:18:13.086 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:13.086 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.743696976999999, 2023-01-02T18:18:13.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:18:13.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.087 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.087 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:13.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:13.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:13.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:13.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:18:13.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:18:13.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:18:13.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:18:13.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:18:13.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:18:13.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:18:13.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:18:13.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:18:13.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:18:13.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:18:13.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:18:13.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:18:13.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:18:13.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:18:13.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.097 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.097 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.098 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:18:13.098 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:13.098 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.736206730000006, 2023-01-02T18:18:13.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:18:13.098 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.099 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.099 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:13.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:13.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:13.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:13.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:18:13.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:18:13.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:18:13.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:18:13.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:18:13.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:18:13.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:18:13.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:18:13.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:18:13.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:18:13.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:18:13.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:18:13.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:18:13.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:18:13.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:18:13.108 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.108 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.109 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:18:13.109 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:13.110 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.734413645000004, 2023-01-02T18:18:13.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:18:13.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.110 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:13.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:13.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:13.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:18:13.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:18:13.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:18:13.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:18:13.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:18:13.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:18:13.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:18:13.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:18:13.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:18:13.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:18:13.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:18:13.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:18:13.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:18:13.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:18:13.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:18:13.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:18:13.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.121 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.121 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.122 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:18:13.122 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:13.122 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.731522300999998, 2023-01-02T18:18:13.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:18:13.122 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.122 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.123 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:13.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:13.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:13.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:18:13.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:18:13.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:18:13.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:18:13.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:18:13.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:18:13.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:18:13.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:18:13.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:18:13.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:18:13.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:18:13.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:18:13.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:18:13.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:18:13.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:18:13.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:18:13.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.133 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.133 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.133 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:18:13.134 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:13.134 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.695241486999997, 2023-01-02T18:18:13.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:18:13.134 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.134 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.134 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:13.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:13.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:13.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:13.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:18:13.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:18:13.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:18:13.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:18:13.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:18:13.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:18:13.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:18:13.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:18:13.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:18:13.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:18:13.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:18:13.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:18:13.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:18:13.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:18:13.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:18:13.144 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.144 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.144 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.145 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:18:13.145 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:13.145 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.719606622000001, 2023-01-02T18:18:13.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:18:13.146 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.146 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.146 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:13.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:13.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:13.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:13.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:18:13.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:18:13.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:18:13.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:18:13.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:18:13.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:18:13.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:18:13.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:18:13.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:18:13.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:18:13.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:18:13.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:18:13.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:18:13.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:18:13.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:18:13.156 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.156 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.156 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.157 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:18:13.157 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:13.157 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.717867773000002, 2023-01-02T18:18:13.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:18:13.157 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.158 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:13.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:13.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:13.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:18:13.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:18:13.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:18:13.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:18:13.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:18:13.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:18:13.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:18:13.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:18:13.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:18:13.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:18:13.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:18:13.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:18:13.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:18:13.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:18:13.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:18:13.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:18:13.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.167 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.168 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.168 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:18:13.168 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:13.168 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.725542519000001, 2023-01-02T18:18:13.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:18:13.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.169 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:13.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:13.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:13.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:13.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:18:13.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:18:13.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:18:13.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:18:13.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:18:13.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:18:13.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:18:13.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:18:13.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:18:13.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:18:13.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:18:13.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:18:13.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:18:13.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:18:13.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:18:13.179 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.179 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.179 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.180 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:13.180 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:13.180 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.724399675999997, 2023-01-02T18:18:13.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:18:13.181 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.181 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.181 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:13.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:13.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:13.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:13.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:18:13.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:18:13.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:18:13.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:18:13.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:18:13.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:18:13.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:18:13.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:18:13.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:18:13.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:18:13.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:18:13.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:18:13.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:18:13.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:18:13.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:18:13.191 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.191 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.191 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.192 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:13.192 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:13.192 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.711845881999999, 2023-01-02T18:18:13.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:18:13.192 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.193 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.193 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:13.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:13.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:13.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:13.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:18:13.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:18:13.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:18:13.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:18:13.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:18:13.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:18:13.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:18:13.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:18:13.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:18:13.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:18:13.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:18:13.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:18:13.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:18:13.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:18:13.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:18:13.202 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.203 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.203 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.203 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:13.203 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:13.204 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.694443573000001, 2023-01-02T18:18:13.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:18:13.204 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.204 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.204 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:13.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:13.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:13.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:18:13.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:18:13.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:18:13.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:18:13.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:18:13.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:18:13.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:18:13.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:18:13.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:18:13.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:18:13.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:18:13.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:18:13.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:18:13.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:18:13.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:18:13.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:18:13.214 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.214 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.214 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.215 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:18:13.215 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:13.215 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.644390027, 2023-01-02T18:18:13.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:18:13.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.216 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:13.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:13.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:13.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:18:13.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:18:13.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:18:13.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:18:13.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:18:13.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:18:13.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:18:13.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:18:13.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:18:13.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:18:13.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:18:13.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:18:13.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:18:13.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:18:13.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:18:13.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:18:13.225 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.226 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.226 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.226 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:18:13.227 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:13.227 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.623732248, 2023-01-02T18:18:13.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:18:13.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.227 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.228 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.228 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.228 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.228 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:18:13.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.228 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:13.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:13.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:13.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:18:13.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:18:13.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:18:13.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:18:13.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:18:13.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:18:13.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:18:13.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:18:13.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:18:13.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:18:13.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:18:13.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:18:13.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:13.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:18:13.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:18:13.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:18:13.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:18:13.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:18:13.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:18:13.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:18:13.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:18:13.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:18:13.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:18:13.240 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.241 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.241 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3347 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e116)", 2023-01-02T18:18:13.242 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:13.242 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.619234296999998, 2023-01-02T18:18:13.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004, 2023-01-02T18:18:13.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3347 2023-01-02T18:18:13.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.243 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:13.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:13.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:13.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440699+0000", 2023-01-02T18:18:13.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5150000000000001e-05 2023-01-02T18:18:13.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440724+0000", 2023-01-02T18:18:13.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2691e-05 2023-01-02T18:18:13.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440747+0000", 2023-01-02T18:18:13.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9449999999999999e-06 2023-01-02T18:18:13.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440756+0000", 2023-01-02T18:18:13.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0661999999999997e-05 2023-01-02T18:18:13.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440807+0000", 2023-01-02T18:18:13.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4629999999999996e-05 2023-01-02T18:18:13.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440871+0000", 2023-01-02T18:18:13.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034606300000000002 2023-01-02T18:18:13.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:13.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441217+0000", 2023-01-02T18:18:13.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031920429999999999 2023-01-02T18:18:13.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444409+0000", 2023-01-02T18:18:13.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032486499999999997 2023-01-02T18:18:13.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444734+0000", 2023-01-02T18:18:13.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5741000000000002e-05 2023-01-02T18:18:13.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444770+0000", 2023-01-02T18:18:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7988e-05 2023-01-02T18:18:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444798+0000", 2023-01-02T18:18:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004 2023-01-02T18:18:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3438 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:13.257 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.526986709999999, 2023-01-02T18:18:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158, 2023-01-02T18:18:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.258 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3438 2023-01-02T18:18:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532948+0000", 2023-01-02T18:18:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:18:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532956+0000", 2023-01-02T18:18:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3448999999999999e-05 2023-01-02T18:18:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532969+0000", 2023-01-02T18:18:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4170000000000003e-06 2023-01-02T18:18:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532977+0000", 2023-01-02T18:18:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5679000000000001e-05 2023-01-02T18:18:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533023+0000", 2023-01-02T18:18:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2023-01-02T18:18:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533080+0000", 2023-01-02T18:18:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8567999999999997e-05 2023-01-02T18:18:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533159+0000", 2023-01-02T18:18:13.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018926119999999999 2023-01-02T18:18:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535051+0000", 2023-01-02T18:18:13.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088907299999999999 2023-01-02T18:18:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535940+0000", 2023-01-02T18:18:13.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7307e-05 2023-01-02T18:18:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535988+0000", 2023-01-02T18:18:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5602e-05 2023-01-02T18:18:13.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536013+0000", 2023-01-02T18:18:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158 2023-01-02T18:18:13.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.272 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.272 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.272 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3460 13.1a 13:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e122)", 2023-01-02T18:18:13.272 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:13.273 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.328007576999999, 2023-01-02T18:18:13.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004, 2023-01-02T18:18:13.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.273 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.274 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.274 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3460 2023-01-02T18:18:13.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.274 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:13.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:13.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:13.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731925+0000", 2023-01-02T18:18:13.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.447e-05 2023-01-02T18:18:13.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731940+0000", 2023-01-02T18:18:13.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4263e-05 2023-01-02T18:18:13.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731954+0000", 2023-01-02T18:18:13.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6684000000000002e-05 2023-01-02T18:18:13.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731971+0000", 2023-01-02T18:18:13.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1316999999999996e-05 2023-01-02T18:18:13.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732032+0000", 2023-01-02T18:18:13.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012202200000000001 2023-01-02T18:18:13.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732154+0000", 2023-01-02T18:18:13.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015345800000000001 2023-01-02T18:18:13.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:13.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732308+0000", 2023-01-02T18:18:13.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003479481 2023-01-02T18:18:13.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735787+0000", 2023-01-02T18:18:13.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087823000000000003 2023-01-02T18:18:13.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736665+0000", 2023-01-02T18:18:13.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7332000000000001e-05 2023-01-02T18:18:13.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736703+0000", 2023-01-02T18:18:13.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1186999999999998e-05 2023-01-02T18:18:13.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736734+0000", 2023-01-02T18:18:13.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004 2023-01-02T18:18:13.287 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.287 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.287 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.288 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3493 13.10 e128/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 128'2, mlcod=0'0)", 2023-01-02T18:18:13.288 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:13.288 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.2172984360000001, 2023-01-02T18:18:13.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999, 2023-01-02T18:18:13.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.289 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.289 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:13.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:13.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:13.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:13.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050436299999999997 2023-01-02T18:18:13.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843141+0000", 2023-01-02T18:18:13.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2051e-05 2023-01-02T18:18:13.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843153+0000", 2023-01-02T18:18:13.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.558e-06 2023-01-02T18:18:13.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843159+0000", 2023-01-02T18:18:13.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1963000000000003e-05 2023-01-02T18:18:13.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843221+0000", 2023-01-02T18:18:13.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6831000000000001e-05 2023-01-02T18:18:13.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843248+0000", 2023-01-02T18:18:13.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024489630000000002 2023-01-02T18:18:13.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845697+0000", 2023-01-02T18:18:13.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3207999999999998e-05 2023-01-02T18:18:13.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845730+0000", 2023-01-02T18:18:13.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999 2023-01-02T18:18:13.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.299 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.299 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3494 13.10 e129/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 129'3, mlcod=127'1)", 2023-01-02T18:18:13.300 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:13.300 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.2127688619999999, 2023-01-02T18:18:13.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998, 2023-01-02T18:18:13.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.301 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:13.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:13.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:13.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:13.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047132700000000001 2023-01-02T18:18:13.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847638+0000", 2023-01-02T18:18:13.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6300999999999999e-05 2023-01-02T18:18:13.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847654+0000", 2023-01-02T18:18:13.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1022999999999999e-05 2023-01-02T18:18:13.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847665+0000", 2023-01-02T18:18:13.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1383999999999994e-05 2023-01-02T18:18:13.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847727+0000", 2023-01-02T18:18:13.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7688999999999999e-05 2023-01-02T18:18:13.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847754+0000", 2023-01-02T18:18:13.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002026501 2023-01-02T18:18:13.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849781+0000", 2023-01-02T18:18:13.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2506999999999997e-05 2023-01-02T18:18:13.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849834+0000", 2023-01-02T18:18:13.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998 2023-01-02T18:18:13.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.311 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.311 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.311 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.311 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:13.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:13.314 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:13.313+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:13.397 INFO:teuthology.orchestra.run.smithi007.stderr:marked out osd.3. 2023-01-02T18:18:13.414 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:13.414+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:13.464 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:13.464 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:13.464 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:13.465 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:13.474 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:13.518 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:13.518+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:13.599 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:13.600 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:13.600 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:13.600 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:13.601 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:13.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:13.735 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:13.716+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:13.748 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:13.651+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:13.777 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:13.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 94.340824683999998, 2023-01-02T18:18:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:18:13.779 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.780 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:18:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:13.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:13.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:18:13.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:18:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:18:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:18:13.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:18:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:18:13.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:18:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:18:13.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:18:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:18:13.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:18:13.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:18:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:18:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:18:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:18:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:18:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:13.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:18:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:18:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:18:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:18:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:18:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:18:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:18:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:18:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:18:13.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:18:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:18:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.467284574999994, 2023-01-02T18:18:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:18:13.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:13.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:18:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:13.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:18:13.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:18:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:18:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:18:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:18:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:18:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:18:13.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:18:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:18:13.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:18:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:18:13.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:18:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:18:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:18:13.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:18:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:18:13.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:18:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:18:13.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:18:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:18:13.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:18:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:18:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:18:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:18:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:18:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:18:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.814 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:18:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:13.815 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.161324620000002, 2023-01-02T18:18:13.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:18:13.816 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.816 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:18:13.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:13.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:18:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:18:13.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:18:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:18:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:18:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:18:13.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:18:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:18:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:18:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:18:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:18:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:18:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:18:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:18:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:18:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:18:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:18:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:18:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:18:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:18:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:18:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:18:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:18:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:18:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:18:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:18:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:18:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.446852805999995, 2023-01-02T18:18:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:18:13.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:18:13.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:13.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:18:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:18:13.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:18:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:18:13.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:18:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:18:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:18:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:18:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:18:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:18:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:18:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:18:13.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:18:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:18:13.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:18:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:18:13.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:18:13.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:18:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:18:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:18:13.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:18:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:18:13.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:18:13.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:18:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:18:13.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:18:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:18:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.437751405, 2023-01-02T18:18:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:18:13.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:18:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:13.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:18:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:18:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:18:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:18:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:18:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:18:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:18:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:18:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:18:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:18:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:18:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:18:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:18:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:18:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:18:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:18:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:18:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:18:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.863 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:18:13.864 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.166395113, 2023-01-02T18:18:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:18:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:13.865 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:18:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.866 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:13.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:18:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:18:13.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:18:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:18:13.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:18:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:18:13.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:18:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:18:13.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:18:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:18:13.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:18:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:18:13.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:18:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:18:13.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:18:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:18:13.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:18:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:18:13.877 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.878 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.449025788999997, 2023-01-02T18:18:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:18:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:18:13.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:13.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:18:13.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:18:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:18:13.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:18:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:18:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:18:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:18:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:18:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:18:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:18:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:18:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:18:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:18:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:18:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:18:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:18:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:13.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:18:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:18:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:18:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:18:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:18:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:18:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:18:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:18:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:18:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:18:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.422289546999998, 2023-01-02T18:18:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:18:13.897 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:13.898 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:18:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:13.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:18:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:18:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:18:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:18:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:18:13.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:18:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:18:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:18:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:18:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:18:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:18:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:18:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:18:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:18:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:18:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:18:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:13.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:18:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:18:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:18:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:18:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:18:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:18:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:18:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:18:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:18:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:18:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.914 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:13.915 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.422241950999997, 2023-01-02T18:18:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:18:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.916 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:18:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:18:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:18:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:18:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:18:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:18:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:18:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:18:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:18:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:18:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:18:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:18:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:18:13.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:18:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:18:13.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:18:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:18:13.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:18:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:18:13.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:18:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:18:13.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:18:13.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:18:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:18:13.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:18:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:18:13.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:18:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:18:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.459172864999999, 2023-01-02T18:18:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:18:13.934 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:13.935 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:18:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:18:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:18:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:18:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:18:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:18:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:18:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:18:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:18:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:18:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:18:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:18:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:18:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:18:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:18:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:18:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:18:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:13.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:18:13.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:18:13.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:18:13.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:18:13.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:18:13.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:18:13.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:18:13.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:18:13.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:18:13.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:18:13.951 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.951 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.951 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.952 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:13.952 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:13.952 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.443066602000002, 2023-01-02T18:18:13.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:18:13.953 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.953 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.953 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.953 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.954 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.954 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:18:13.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.954 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:13.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:13.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:13.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:18:13.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:18:13.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:18:13.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:18:13.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:18:13.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:18:13.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:18:13.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:18:13.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:18:13.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:18:13.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:13.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:18:13.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:18:13.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:18:13.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:18:13.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:18:13.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:18:13.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:13.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:18:13.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:18:13.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:18:13.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:18:13.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:18:13.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:18:13.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:18:13.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:18:13.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:18:13.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:18:13.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.970 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.970 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.970 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:13.971 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:13.971 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.437744418000001, 2023-01-02T18:18:13.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:18:13.971 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:13.972 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:13.972 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:13.972 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:13.972 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:18:13.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.973 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:13.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:13.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:13.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:18:13.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:18:13.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:18:13.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:18:13.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:18:13.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:18:13.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:18:13.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:18:13.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:18:13.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:18:13.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:18:13.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:18:13.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:13.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:18:13.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:18:13.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:13.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:18:13.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:18:13.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:13.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:18:13.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:18:13.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:13.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:18:13.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:18:13.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:18:13.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:18:13.986 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.986 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.986 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.987 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:18:13.987 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:13.987 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.434191353000003, 2023-01-02T18:18:13.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:18:13.988 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:13.988 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:13.988 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:13.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:13.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:13.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:13.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:13.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:13.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:13.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:13.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:18:13.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:18:13.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:13.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:18:13.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:18:13.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:13.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:18:13.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:18:13.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:13.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:18:13.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:18:13.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:13.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:18:13.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:18:13.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:13.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:18:13.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:18:13.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:13.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:18:13.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:18:13.997 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.998 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:13.998 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:13.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:13.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:13.998 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:13.999 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:13.999 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.432559308999998, 2023-01-02T18:18:13.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:18:13.999 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:14.000 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:14.000 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:14.000 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:14.000 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:14.000 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:18:14.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.001 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:14.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:14.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:14.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:14.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:14.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:14.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:14.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:14.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:18:14.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:18:14.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:14.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:18:14.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:18:14.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:14.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:18:14.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:18:14.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:14.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:18:14.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:18:14.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:14.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:18:14.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:18:14.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:14.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:18:14.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:18:14.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:14.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:18:14.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:18:14.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:14.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:18:14.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:18:14.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:14.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:18:14.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:18:14.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:14.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:18:14.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:18:14.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:14.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:18:14.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:18:14.014 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.014 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:14.015 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.015 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:14.015 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:14.016 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.432365732000001, 2023-01-02T18:18:14.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:18:14.016 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:14.016 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:14.016 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:14.017 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:14.017 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:14.017 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:18:14.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.017 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:14.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:14.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:14.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:14.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:14.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:14.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:14.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:14.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:18:14.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:18:14.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:14.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:18:14.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:18:14.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:14.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:18:14.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:18:14.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:14.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:18:14.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:18:14.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:14.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:18:14.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:18:14.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:14.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:18:14.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:18:14.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:14.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:18:14.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:18:14.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:14.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:18:14.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:18:14.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:14.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:18:14.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:18:14.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:14.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:18:14.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:18:14.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:14.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:18:14.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:18:14.030 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.031 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:14.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.031 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:14.032 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:14.032 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.426949852, 2023-01-02T18:18:14.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:18:14.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:14.032 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:14.033 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:14.033 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:14.033 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:14.033 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:14.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.034 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:14.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:14.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:14.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:14.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:14.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:14.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:14.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:14.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:18:14.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:18:14.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:14.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:18:14.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:18:14.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:14.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:18:14.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:18:14.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:14.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:18:14.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:18:14.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:14.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:18:14.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:18:14.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:14.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:18:14.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:18:14.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:14.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:14.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:18:14.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:14.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:18:14.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:18:14.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:14.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:18:14.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:18:14.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:14.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:18:14.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:18:14.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:14.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:18:14.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:18:14.047 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.047 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:14.047 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.047 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:14.048 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:14.048 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.426410122999997, 2023-01-02T18:18:14.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:18:14.048 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:14.048 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:18:14.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:14.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:14.049 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:14.049 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:14.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.050 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:14.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:14.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:14.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:14.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:14.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:14.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:14.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:14.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:18:14.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:18:14.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:14.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:18:14.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:18:14.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:14.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:14.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:18:14.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:14.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:18:14.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:18:14.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:14.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:18:14.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:18:14.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:18:14.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:18:14.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:18:14.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:14.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:18:14.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:18:14.059 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.059 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:14.059 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.060 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:14.060 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:14.060 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.420394831000003, 2023-01-02T18:18:14.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:18:14.061 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:14.061 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:14.061 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:14.061 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:14.062 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:14.062 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:18:14.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.062 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:14.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:14.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:14.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:14.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:14.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:14.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:14.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:14.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:18:14.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:18:14.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:14.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:18:14.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:18:14.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:14.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:18:14.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:18:14.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:14.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:18:14.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:18:14.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:14.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:18:14.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:18:14.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:14.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:18:14.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:18:14.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:14.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:18:14.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:18:14.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:14.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:18:14.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:18:14.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:14.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:18:14.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:18:14.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:14.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:18:14.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:18:14.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:14.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:18:14.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:18:14.076 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.076 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:14.076 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.077 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3435 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:14.077 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:14.077 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.243748441000001, 2023-01-02T18:18:14.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001, 2023-01-02T18:18:14.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:14.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:14.078 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:14.078 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:14.078 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:14.079 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3435 2023-01-02T18:18:14.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.079 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:14.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:14.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:14.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:14.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:14.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:14.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:14.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:14.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532923+0000", 2023-01-02T18:18:14.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1790000000000008e-06 2023-01-02T18:18:14.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:14.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532931+0000", 2023-01-02T18:18:14.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.45e-05 2023-01-02T18:18:14.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:14.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532946+0000", 2023-01-02T18:18:14.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:14.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:14.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532952+0000", 2023-01-02T18:18:14.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6125999999999999e-05 2023-01-02T18:18:14.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:14.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532988+0000", 2023-01-02T18:18:14.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3418999999999998e-05 2023-01-02T18:18:14.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:14.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533041+0000", 2023-01-02T18:18:14.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6446999999999994e-05 2023-01-02T18:18:14.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:14.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533128+0000", 2023-01-02T18:18:14.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025771280000000001 2023-01-02T18:18:14.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:14.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535705+0000", 2023-01-02T18:18:14.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012653530000000001 2023-01-02T18:18:14.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:14.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536970+0000", 2023-01-02T18:18:14.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0913e-05 2023-01-02T18:18:14.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:14.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537001+0000", 2023-01-02T18:18:14.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.444e-05 2023-01-02T18:18:14.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:14.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537025+0000", 2023-01-02T18:18:14.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001 2023-01-02T18:18:14.093 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.093 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:14.093 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.094 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3454 12.1a 12:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e121)", 2023-01-02T18:18:14.094 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:14.094 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 15.046647247999999, 2023-01-02T18:18:14.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999, 2023-01-02T18:18:14.094 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:14.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:14.095 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:14.095 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:14.095 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:14.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3454 2023-01-02T18:18:14.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.096 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:14.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:14.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:14.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:14.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:14.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:14.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:14.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:14.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730024+0000", 2023-01-02T18:18:14.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0990000000000005e-06 2023-01-02T18:18:14.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:14.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730034+0000", 2023-01-02T18:18:14.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6657e-05 2023-01-02T18:18:14.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:14.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730050+0000", 2023-01-02T18:18:14.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4959999999999996e-06 2023-01-02T18:18:14.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:14.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730059+0000", 2023-01-02T18:18:14.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1004999999999997e-05 2023-01-02T18:18:14.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:14.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730110+0000", 2023-01-02T18:18:14.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2023-01-02T18:18:14.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:14.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730255+0000", 2023-01-02T18:18:14.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018625 2023-01-02T18:18:14.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:14.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730441+0000", 2023-01-02T18:18:14.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001313771 2023-01-02T18:18:14.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:14.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.731755+0000", 2023-01-02T18:18:14.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0084210629999999995 2023-01-02T18:18:14.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:14.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740176+0000", 2023-01-02T18:18:14.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4363000000000001e-05 2023-01-02T18:18:14.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:14.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740230+0000", 2023-01-02T18:18:14.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0450000000000001e-05 2023-01-02T18:18:14.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:14.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:14.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:14.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740271+0000", 2023-01-02T18:18:14.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999 2023-01-02T18:18:14.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.110 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:14.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:14.110 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:14.110 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:14.112 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:14.113 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:14.112+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:14.198 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:14.243 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:14.243+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:14.252 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:14.252 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:14.253 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:14.253 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:14.262 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:14.313 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:14.313+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:14.344 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:14.361 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:14.394 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:14.412 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:14.412 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:14.412 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:14.413 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:14.413 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:14.414 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:14.414+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:14.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:14.428 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:14.458 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:14.476 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:14.494 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:14.511 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:14.513 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:14.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:14.515 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:14.515+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:14.560 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:14.561 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:14.571 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:14.576 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:18:14.616 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:14.616+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:14.696 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:14.697 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:14.707 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:14.747 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:14.748+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:14.817 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:14.817+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:14.871 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:14.871 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:14.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:14.918 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:14.918+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:15.006 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:15.006 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:15.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:15.019 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:15.019+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:15.119 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:15.120+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:15.140 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:15.141 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:15.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:15.220 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:15.220+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:15.315 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:15.315 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:15.320 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:15.321+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:15.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:15.396 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:18:15.449 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:15.449+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:15.454 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:15.454 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:15.464 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:15.523 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:15.523+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:15.590 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:15.590 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:15.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:15.623 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:15.624+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:15.724 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:15.724+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:15.725 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:15.726 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:15.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:15.824 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:15.825+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:15.901 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:15.901 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:15.911 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:15.952 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:15.953+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:16.026 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:16.027+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:16.045 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:16.045 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:16.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:16.127 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:16.128+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:16.179 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:16.180 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:16.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:16.228 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:16.229+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:16.315 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:16.315 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:16.325 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:16.329 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:16.330+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:16.430 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:16.430+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:16.452 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:16.452 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:16.462 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:16.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:16.546 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:16.546+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:16.630 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:16.630 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:16.631 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:16.631+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:16.641 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:16.687 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:16.705 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:16.722 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:16.733 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:16.733+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:16.740 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:16.758 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:16.777 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:16.795 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:16.809 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:16.809 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.810 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 88.480526455000003, 2023-01-02T18:18:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.811 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:18:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 65.175572729999999, 2023-01-02T18:18:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:18:16.822 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:16.823 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:18:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:16.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:16.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:18:16.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:18:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:18:16.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:18:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:18:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:18:16.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:18:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:18:16.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:18:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:18:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:18:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:18:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:18:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:18:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:18:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:18:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:18:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.471031060000001, 2023-01-02T18:18:16.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:16.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:16.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:16.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:16.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:16.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:16.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:16.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:16.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:16.847 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.848 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2087 3.1a 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.481299323999998, 2023-01-02T18:18:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807, 2023-01-02T18:18:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.849 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2087 2023-01-02T18:18:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.850 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327755+0000", 2023-01-02T18:18:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327752+0000", 2023-01-02T18:18:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0536999999999999e-05 2023-01-02T18:18:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327763+0000", 2023-01-02T18:18:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6022e-05 2023-01-02T18:18:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327779+0000", 2023-01-02T18:18:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4269999999999996e-06 2023-01-02T18:18:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327785+0000", 2023-01-02T18:18:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3712999999999999e-05 2023-01-02T18:18:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327839+0000", 2023-01-02T18:18:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015787400000000001 2023-01-02T18:18:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327997+0000", 2023-01-02T18:18:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018395900000000001 2023-01-02T18:18:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:16.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328181+0000", 2023-01-02T18:18:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010549680000000001 2023-01-02T18:18:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:16.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329236+0000", 2023-01-02T18:18:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032945199999999999 2023-01-02T18:18:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329565+0000", 2023-01-02T18:18:16.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4543999999999998e-05 2023-01-02T18:18:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329620+0000", 2023-01-02T18:18:16.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6576999999999998e-05 2023-01-02T18:18:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329667+0000", 2023-01-02T18:18:16.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001911807 2023-01-02T18:18:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.863 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.457973469000002, 2023-01-02T18:18:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.864 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:16.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:16.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:16.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:16.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:16.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.876 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:16.877 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.447898238999997, 2023-01-02T18:18:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:16.878 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:16.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.484748455000002, 2023-01-02T18:18:16.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:16.896 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:16.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:16.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:16.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:16.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:16.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.907 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:16.908 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.479984989999998, 2023-01-02T18:18:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:18:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:16.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:16.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:18:16.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:18:16.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:18:16.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:16.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:18:16.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:18:16.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:18:16.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:18:16.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:18:16.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:18:16.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:18:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:18:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:18:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:18:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:18:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:18:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.479451765, 2023-01-02T18:18:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:16.920 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:16.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:16.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:16.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:16.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:16.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:16.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:16.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:16.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:16.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:16.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:16.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:16.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:16.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:16.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:16.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:16.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:16.930 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.930 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.931 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.931 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:16.931 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:16.932 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.427002946999998, 2023-01-02T18:18:16.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:16.932 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.932 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.932 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:16.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:16.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:16.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:16.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:16.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:16.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:16.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:16.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:16.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:16.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:16.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:16.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:16.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:16.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:16.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:16.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:16.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:16.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:16.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.942 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.943 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:16.943 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:16.943 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.419522058999998, 2023-01-02T18:18:16.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:16.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.944 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:16.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:16.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:16.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:16.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:16.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:16.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:16.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:16.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:16.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:16.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:16.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:16.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:16.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:16.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:16.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:16.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:16.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:16.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:16.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.954 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.955 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:16.955 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:16.955 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.371869404000002, 2023-01-02T18:18:16.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:16.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.955 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.956 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:16.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:16.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:16.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:16.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:16.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:16.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:16.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:16.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:16.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:16.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:16.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:16.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:16.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:16.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:16.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:16.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:16.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:16.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:16.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.965 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.965 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.966 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:16.966 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:16.966 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.367496826, 2023-01-02T18:18:16.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:16.967 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.967 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.967 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:16.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:16.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:16.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:16.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:16.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:16.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:16.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:16.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:16.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:16.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:16.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:16.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:16.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:16.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:16.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:16.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:16.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:16.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:16.977 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.977 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.977 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.977 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3438 11.15 e117/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 117'5, mlcod=116'3)", 2023-01-02T18:18:16.978 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:16.978 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.275762327999999, 2023-01-02T18:18:16.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987, 2023-01-02T18:18:16.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.979 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.979 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:16.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:16.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:16.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533291+0000", 2023-01-02T18:18:16.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4139999999999997e-06 2023-01-02T18:18:16.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533299+0000", 2023-01-02T18:18:16.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1438e-05 2023-01-02T18:18:16.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533310+0000", 2023-01-02T18:18:16.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5089999999999996e-06 2023-01-02T18:18:16.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533318+0000", 2023-01-02T18:18:16.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6567999999999998e-05 2023-01-02T18:18:16.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533374+0000", 2023-01-02T18:18:16.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5011000000000002e-05 2023-01-02T18:18:16.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533399+0000", 2023-01-02T18:18:16.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024056519999999999 2023-01-02T18:18:16.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535805+0000", 2023-01-02T18:18:16.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5862000000000003e-05 2023-01-02T18:18:16.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535841+0000", 2023-01-02T18:18:16.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987 2023-01-02T18:18:16.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.988 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:16.988 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:16.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.989 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3436 11.14 e117/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 117'5, mlcod=108'3)", 2023-01-02T18:18:16.989 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:16.989 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.275671298999999, 2023-01-02T18:18:16.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999, 2023-01-02T18:18:16.990 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:16.990 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:16.990 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:16.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:16.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:16.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:16.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:16.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:16.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:16.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:16.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533382+0000", 2023-01-02T18:18:16.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.476e-06 2023-01-02T18:18:16.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:16.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533387+0000", 2023-01-02T18:18:16.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0322999999999999e-05 2023-01-02T18:18:16.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:16.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533397+0000", 2023-01-02T18:18:16.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2950000000000001e-06 2023-01-02T18:18:16.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:16.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533403+0000", 2023-01-02T18:18:16.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1789000000000002e-05 2023-01-02T18:18:16.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:16.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533454+0000", 2023-01-02T18:18:16.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9650999999999999e-05 2023-01-02T18:18:16.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:16.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533474+0000", 2023-01-02T18:18:16.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019917419999999999 2023-01-02T18:18:16.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:16.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535466+0000", 2023-01-02T18:18:16.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4618999999999999e-05 2023-01-02T18:18:16.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:16.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:16.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:16.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535490+0000", 2023-01-02T18:18:17.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999 2023-01-02T18:18:17.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.000 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.000 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.001 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:17.001 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:17.001 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.076187697999998, 2023-01-02T18:18:17.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:17.001 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.002 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.002 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:17.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:17.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:17.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:17.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:17.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:17.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:17.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:17.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:17.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:17.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:17.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:17.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:17.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:17.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:17.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:17.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:17.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:17.011 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.012 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.012 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3493 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e127)", 2023-01-02T18:18:17.012 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:17.013 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.9673903720000006, 2023-01-02T18:18:17.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998, 2023-01-02T18:18:17.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.013 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.013 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:17.014 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:17.014 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:17.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3493 2023-01-02T18:18:17.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.014 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:17.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:17.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:17.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841661+0000", 2023-01-02T18:18:17.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8811999999999999e-05 2023-01-02T18:18:17.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841680+0000", 2023-01-02T18:18:17.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9380000000000001e-05 2023-01-02T18:18:17.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841699+0000", 2023-01-02T18:18:17.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:17.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841709+0000", 2023-01-02T18:18:17.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010059 2023-01-02T18:18:17.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841809+0000", 2023-01-02T18:18:17.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3533e-05 2023-01-02T18:18:17.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841903+0000", 2023-01-02T18:18:17.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036800899999999998 2023-01-02T18:18:17.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:17.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842271+0000", 2023-01-02T18:18:17.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033624560000000002 2023-01-02T18:18:17.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:17.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845633+0000", 2023-01-02T18:18:17.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020175099999999999 2023-01-02T18:18:17.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:17.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845835+0000", 2023-01-02T18:18:17.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1019999999999998e-05 2023-01-02T18:18:17.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845866+0000", 2023-01-02T18:18:17.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7328999999999999e-05 2023-01-02T18:18:17.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845893+0000", 2023-01-02T18:18:17.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998 2023-01-02T18:18:17.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.027 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.027 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.027 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3494 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e128)", 2023-01-02T18:18:17.027 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:17.028 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.9628610640000002, 2023-01-02T18:18:17.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999, 2023-01-02T18:18:17.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.028 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:17.029 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:17.029 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:17.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3494 2023-01-02T18:18:17.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.029 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:17.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:17.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:17.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846191+0000", 2023-01-02T18:18:17.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4089e-05 2023-01-02T18:18:17.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846205+0000", 2023-01-02T18:18:17.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8082000000000001e-05 2023-01-02T18:18:17.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846223+0000", 2023-01-02T18:18:17.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2023-01-02T18:18:17.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846231+0000", 2023-01-02T18:18:17.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100853 2023-01-02T18:18:17.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846332+0000", 2023-01-02T18:18:17.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4294000000000004e-05 2023-01-02T18:18:17.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846406+0000", 2023-01-02T18:18:17.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000381035 2023-01-02T18:18:17.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:17.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846787+0000", 2023-01-02T18:18:17.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029262089999999999 2023-01-02T18:18:17.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:17.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849713+0000", 2023-01-02T18:18:17.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022129699999999999 2023-01-02T18:18:17.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:17.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849934+0000", 2023-01-02T18:18:17.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6384000000000003e-05 2023-01-02T18:18:17.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849971+0000", 2023-01-02T18:18:17.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9811e-05 2023-01-02T18:18:17.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.850001+0000", 2023-01-02T18:18:17.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999 2023-01-02T18:18:17.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.042 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.042 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.043 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3500 13.1c e131/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 131'3, mlcod=130'1)", 2023-01-02T18:18:17.043 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:17.043 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.9368932729999999, 2023-01-02T18:18:17.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999, 2023-01-02T18:18:17.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.044 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:17.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:17.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872160+0000", 2023-01-02T18:18:17.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022329899999999998 2023-01-02T18:18:17.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874393+0000", 2023-01-02T18:18:17.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.252e-05 2023-01-02T18:18:17.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874406+0000", 2023-01-02T18:18:17.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0240000000000003e-06 2023-01-02T18:18:17.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874415+0000", 2023-01-02T18:18:17.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0895000000000005e-05 2023-01-02T18:18:17.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874486+0000", 2023-01-02T18:18:17.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4266e-05 2023-01-02T18:18:17.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874520+0000", 2023-01-02T18:18:17.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023338909999999998 2023-01-02T18:18:17.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876854+0000", 2023-01-02T18:18:17.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3161000000000001e-05 2023-01-02T18:18:17.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876907+0000", 2023-01-02T18:18:17.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999 2023-01-02T18:18:17.053 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.054 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.054 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.054 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3501 13.1c e132/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 132'4, mlcod=130'2)", 2023-01-02T18:18:17.055 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:17.055 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.9304629590000002, 2023-01-02T18:18:17.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001, 2023-01-02T18:18:17.055 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.055 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.055 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:17.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:17.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:17.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878589+0000", 2023-01-02T18:18:17.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011789120000000001 2023-01-02T18:18:17.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879768+0000", 2023-01-02T18:18:17.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6392000000000002e-05 2023-01-02T18:18:17.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879785+0000", 2023-01-02T18:18:17.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3309999999999998e-06 2023-01-02T18:18:17.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879792+0000", 2023-01-02T18:18:17.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4100000000000001e-05 2023-01-02T18:18:17.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879836+0000", 2023-01-02T18:18:17.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1690000000000001e-05 2023-01-02T18:18:17.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879858+0000", 2023-01-02T18:18:17.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001682692 2023-01-02T18:18:17.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881541+0000", 2023-01-02T18:18:17.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7658999999999999e-05 2023-01-02T18:18:17.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881588+0000", 2023-01-02T18:18:17.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001 2023-01-02T18:18:17.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.065 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.065 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.066 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:17.067 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:17.067 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:17.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:17.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:17.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:17.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:17.068 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:17.069 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:17.069 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:17.070 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:17.071 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:17.068+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:17.168 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:17.169+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:17.237 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:17.237 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:17.237 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:17.237 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:17.247 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:17.269 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:17.270+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:17.369 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:17.369+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:17.372 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:17.372 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:17.372 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:17.372 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:17.373 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:17.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:17.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:18:17.470 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:17.471+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:17.560 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:17.560 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:17.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:17.561 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:17.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.561 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:6 3.4 e46/43 3:267905b2:::rbd_id.image3:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:17.562 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:17.562 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 98.076137927999994, 2023-01-02T18:18:17.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997, 2023-01-02T18:18:17.562 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.562 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.563 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:17.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483665+0000", 2023-01-02T18:18:17.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483664+0000", 2023-01-02T18:18:17.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1380000000000007e-06 2023-01-02T18:18:17.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483673+0000", 2023-01-02T18:18:17.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1052000000000001e-05 2023-01-02T18:18:17.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483694+0000", 2023-01-02T18:18:17.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4894e-05 2023-01-02T18:18:17.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483709+0000", 2023-01-02T18:18:17.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4753999999999997e-05 2023-01-02T18:18:17.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483773+0000", 2023-01-02T18:18:17.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1537999999999999e-05 2023-01-02T18:18:17.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.483795+0000", 2023-01-02T18:18:17.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072883500000000005 2023-01-02T18:18:17.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484524+0000", 2023-01-02T18:18:17.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8927000000000002e-05 2023-01-02T18:18:17.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.484563+0000", 2023-01-02T18:18:17.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089773399999999997 2023-01-02T18:18:17.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.576 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.576 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.578 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:18:17.578 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:17.578 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 84.210391784999999, 2023-01-02T18:18:17.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:18:17.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.580 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:17.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:17.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:17.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:18:17.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:18:17.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:18:17.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:18:17.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:18:17.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:18:17.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:18:17.590 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:18:17.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.591 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.591 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.591 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:18:17.592 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:18:17.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:18:17.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:18:17.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:18:17.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:18:17.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:18:17.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:18:17.598 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.598 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.598 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.599 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:18:17.599 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:17.600 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.243563901000002, 2023-01-02T18:18:17.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:18:17.600 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.600 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.601 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:17.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:17.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:17.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:18:17.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:18:17.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:18:17.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:18:17.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:18:17.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:18:17.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:18:17.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:18:17.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:18:17.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:18:17.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:18:17.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:18:17.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:18:17.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:18:17.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:18:17.610 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.610 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.610 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.611 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:18:17.611 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:17.611 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.236073653999995, 2023-01-02T18:18:17.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:18:17.612 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.612 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.612 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:17.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:17.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:17.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:18:17.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:18:17.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:18:17.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:18:17.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:18:17.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:18:17.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:18:17.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:18:17.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:18:17.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:18:17.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:18:17.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:18:17.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:18:17.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:18:17.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:18:17.621 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.621 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.622 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.622 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:18:17.622 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:17.623 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.234280569000006, 2023-01-02T18:18:17.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:18:17.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.623 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:17.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:17.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:17.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:18:17.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:18:17.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:18:17.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:18:17.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:18:17.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:18:17.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:18:17.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:18:17.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:18:17.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:18:17.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:18:17.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:18:17.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:18:17.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:18:17.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:18:17.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:18:17.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.633 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.634 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:18:17.634 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:17.634 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.231389225000001, 2023-01-02T18:18:17.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:18:17.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.635 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.635 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:17.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:17.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:18:17.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:18:17.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:18:17.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:18:17.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:18:17.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:18:17.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:18:17.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:18:17.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:18:17.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:18:17.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:18:17.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:18:17.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:18:17.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:18:17.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:18:17.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:18:17.645 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.645 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.645 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.646 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:18:17.646 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:17.646 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.195108411, 2023-01-02T18:18:17.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:18:17.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.647 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:17.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:17.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:17.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:18:17.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:18:17.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:18:17.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:18:17.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:18:17.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:18:17.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:18:17.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:18:17.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:18:17.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:18:17.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:18:17.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:18:17.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:18:17.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:18:17.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:18:17.656 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.657 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.657 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.657 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:18:17.658 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:17.658 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.219473546000003, 2023-01-02T18:18:17.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:18:17.658 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.658 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.659 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:17.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:17.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:17.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:17.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:18:17.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:18:17.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:18:17.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:18:17.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:18:17.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:18:17.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:18:17.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:18:17.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:18:17.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:18:17.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:18:17.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:18:17.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:18:17.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:18:17.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:18:17.668 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.668 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.669 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.669 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:18:17.669 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:17.670 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.217734696999997, 2023-01-02T18:18:17.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:18:17.670 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.670 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.670 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:17.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:17.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:17.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:18:17.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:18:17.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:18:17.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:18:17.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:18:17.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:18:17.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:18:17.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:18:17.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:18:17.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:18:17.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:18:17.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:18:17.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:18:17.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:18:17.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:18:17.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:18:17.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.680 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.680 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.681 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:18:17.681 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:17.681 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.225409442999997, 2023-01-02T18:18:17.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:18:17.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.682 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.682 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:17.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:17.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:17.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:17.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:18:17.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:18:17.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:18:17.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:18:17.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:18:17.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:18:17.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:18:17.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:18:17.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:18:17.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:18:17.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:18:17.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:18:17.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:18:17.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:18:17.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:18:17.691 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.692 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.692 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.692 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:17.692 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:17.693 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.2242666, 2023-01-02T18:18:17.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:18:17.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.693 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.693 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:17.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:17.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:17.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:18:17.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:18:17.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:18:17.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:18:17.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:18:17.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:18:17.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:18:17.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:18:17.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:18:17.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:18:17.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:18:17.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:18:17.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:18:17.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:18:17.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:18:17.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.703 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.703 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.703 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:17.704 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:17.704 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.211712806000001, 2023-01-02T18:18:17.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:18:17.704 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.704 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.705 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:17.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:17.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:17.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:18:17.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:18:17.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:18:17.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:18:17.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:18:17.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:18:17.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:18:17.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:18:17.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:18:17.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:18:17.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:18:17.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:18:17.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:18:17.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:18:17.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:18:17.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.714 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.714 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.715 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:17.715 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:17.715 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.194310496999996, 2023-01-02T18:18:17.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:18:17.716 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.716 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.716 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:17.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:17.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:17.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:18:17.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:18:17.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:18:17.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:18:17.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:18:17.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:18:17.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:18:17.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:18:17.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:18:17.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:18:17.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:18:17.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:18:17.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:18:17.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:18:17.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:18:17.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:18:17.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.726 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.726 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:18:17.727 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:17.727 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.144256951000003, 2023-01-02T18:18:17.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:18:17.727 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.727 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.728 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:17.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:17.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:17.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:18:17.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:18:17.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:18:17.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:18:17.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:18:17.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:18:17.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:18:17.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:18:17.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:18:17.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:18:17.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:18:17.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:18:17.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:18:17.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:18:17.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:18:17.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:18:17.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.737 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.738 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:18:17.738 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:17.738 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.123599171999999, 2023-01-02T18:18:17.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:18:17.739 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.739 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:17.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:17.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:17.740 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:18:17.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.740 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:17.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:17.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:17.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:18:17.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:18:17.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:18:17.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:18:17.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:18:17.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:18:17.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:18:17.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:18:17.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:18:17.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:18:17.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:18:17.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:18:17.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:17.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:18:17.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:18:17.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:17.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:18:17.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:18:17.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:17.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:18:17.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:18:17.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:18:17.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:18:17.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:18:17.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:18:17.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.752 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.753 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3347 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e116)", 2023-01-02T18:18:17.753 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:17.753 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.119101221000001, 2023-01-02T18:18:17.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004, 2023-01-02T18:18:17.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:17.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:17.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:17.754 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3347 2023-01-02T18:18:17.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.755 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:17.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:17.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:17.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440699+0000", 2023-01-02T18:18:17.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5150000000000001e-05 2023-01-02T18:18:17.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440724+0000", 2023-01-02T18:18:17.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2691e-05 2023-01-02T18:18:17.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440747+0000", 2023-01-02T18:18:17.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9449999999999999e-06 2023-01-02T18:18:17.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440756+0000", 2023-01-02T18:18:17.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0661999999999997e-05 2023-01-02T18:18:17.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440807+0000", 2023-01-02T18:18:17.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4629999999999996e-05 2023-01-02T18:18:17.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440871+0000", 2023-01-02T18:18:17.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034606300000000002 2023-01-02T18:18:17.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:17.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441217+0000", 2023-01-02T18:18:17.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031920429999999999 2023-01-02T18:18:17.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:17.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444409+0000", 2023-01-02T18:18:17.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032486499999999997 2023-01-02T18:18:17.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:17.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444734+0000", 2023-01-02T18:18:17.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5741000000000002e-05 2023-01-02T18:18:17.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444770+0000", 2023-01-02T18:18:17.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7988e-05 2023-01-02T18:18:17.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444798+0000", 2023-01-02T18:18:17.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004 2023-01-02T18:18:17.767 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.767 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.767 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.768 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3438 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:17.768 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:17.768 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.026853633999998, 2023-01-02T18:18:17.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158, 2023-01-02T18:18:17.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:17.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:17.769 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:17.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3438 2023-01-02T18:18:17.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.770 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:17.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:17.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:17.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532948+0000", 2023-01-02T18:18:17.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:18:17.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532956+0000", 2023-01-02T18:18:17.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3448999999999999e-05 2023-01-02T18:18:17.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532969+0000", 2023-01-02T18:18:17.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4170000000000003e-06 2023-01-02T18:18:17.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532977+0000", 2023-01-02T18:18:17.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5679000000000001e-05 2023-01-02T18:18:17.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533023+0000", 2023-01-02T18:18:17.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2023-01-02T18:18:17.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533080+0000", 2023-01-02T18:18:17.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8567999999999997e-05 2023-01-02T18:18:17.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:17.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533159+0000", 2023-01-02T18:18:17.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018926119999999999 2023-01-02T18:18:17.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:17.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535051+0000", 2023-01-02T18:18:17.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088907299999999999 2023-01-02T18:18:17.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:17.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535940+0000", 2023-01-02T18:18:17.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7307e-05 2023-01-02T18:18:17.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535988+0000", 2023-01-02T18:18:17.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5602e-05 2023-01-02T18:18:17.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536013+0000", 2023-01-02T18:18:17.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158 2023-01-02T18:18:17.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.783 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.784 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3460 13.1a 13:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e122)", 2023-01-02T18:18:17.784 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:17.784 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 17.827874501, 2023-01-02T18:18:17.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004, 2023-01-02T18:18:17.784 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.785 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:17.785 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:17.785 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:17.785 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3460 2023-01-02T18:18:17.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.786 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:17.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:17.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731925+0000", 2023-01-02T18:18:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.447e-05 2023-01-02T18:18:17.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731940+0000", 2023-01-02T18:18:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4263e-05 2023-01-02T18:18:17.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731954+0000", 2023-01-02T18:18:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6684000000000002e-05 2023-01-02T18:18:17.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731971+0000", 2023-01-02T18:18:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1316999999999996e-05 2023-01-02T18:18:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732032+0000", 2023-01-02T18:18:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012202200000000001 2023-01-02T18:18:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732154+0000", 2023-01-02T18:18:17.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015345800000000001 2023-01-02T18:18:17.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:17.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732308+0000", 2023-01-02T18:18:17.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003479481 2023-01-02T18:18:17.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:17.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735787+0000", 2023-01-02T18:18:17.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087823000000000003 2023-01-02T18:18:17.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:17.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736665+0000", 2023-01-02T18:18:17.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7332000000000001e-05 2023-01-02T18:18:17.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736703+0000", 2023-01-02T18:18:17.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1186999999999998e-05 2023-01-02T18:18:17.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736734+0000", 2023-01-02T18:18:17.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004 2023-01-02T18:18:17.798 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.798 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.798 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.799 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3493 13.10 e128/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 128'2, mlcod=0'0)", 2023-01-02T18:18:17.799 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:17.799 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.7171653599999992, 2023-01-02T18:18:17.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999, 2023-01-02T18:18:17.799 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.800 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.800 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:17.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:17.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:17.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:17.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050436299999999997 2023-01-02T18:18:17.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843141+0000", 2023-01-02T18:18:17.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2051e-05 2023-01-02T18:18:17.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843153+0000", 2023-01-02T18:18:17.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.558e-06 2023-01-02T18:18:17.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843159+0000", 2023-01-02T18:18:17.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1963000000000003e-05 2023-01-02T18:18:17.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843221+0000", 2023-01-02T18:18:17.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6831000000000001e-05 2023-01-02T18:18:17.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843248+0000", 2023-01-02T18:18:17.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024489630000000002 2023-01-02T18:18:17.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845697+0000", 2023-01-02T18:18:17.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3207999999999998e-05 2023-01-02T18:18:17.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845730+0000", 2023-01-02T18:18:17.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999 2023-01-02T18:18:17.809 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.809 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.809 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.810 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3494 13.10 e129/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 129'3, mlcod=127'1)", 2023-01-02T18:18:17.810 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:17.810 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.7126357859999999, 2023-01-02T18:18:17.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998, 2023-01-02T18:18:17.810 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:17.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:17.811 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:17.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:17.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:17.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:17.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:17.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:17.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:17.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:17.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:17.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047132700000000001 2023-01-02T18:18:17.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:17.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847638+0000", 2023-01-02T18:18:17.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6300999999999999e-05 2023-01-02T18:18:17.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:17.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847654+0000", 2023-01-02T18:18:17.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1022999999999999e-05 2023-01-02T18:18:17.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:17.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847665+0000", 2023-01-02T18:18:17.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1383999999999994e-05 2023-01-02T18:18:17.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:17.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847727+0000", 2023-01-02T18:18:17.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7688999999999999e-05 2023-01-02T18:18:17.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:17.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847754+0000", 2023-01-02T18:18:17.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002026501 2023-01-02T18:18:17.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:17.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849781+0000", 2023-01-02T18:18:17.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2506999999999997e-05 2023-01-02T18:18:17.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:17.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:17.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:17.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849834+0000", 2023-01-02T18:18:17.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998 2023-01-02T18:18:17.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.820 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.820 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:17.820 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:17.821 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:17.822 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:17.823 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:17.822+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:17.923 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:17.924+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:17.988 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:17.988 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:17.989 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:17.989 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:17.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:18.023 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:18.024+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:18.122 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:18.142 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:18.143 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:18.144 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:18.145 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:18.145+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:18.245 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:18.246+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:18.271 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:18.271 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:18.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:18.272 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:18.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.272 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:18.272 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:18.273 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 98.834497967999994, 2023-01-02T18:18:18.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:18:18.273 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.273 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.274 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.274 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.274 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:18:18.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.274 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:18.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:18.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:18:18.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:18:18.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:18:18.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:18:18.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:18:18.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:18:18.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:18:18.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:18:18.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:18:18.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:18:18.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:18:18.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:18:18.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:18:18.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:18:18.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:18:18.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:18:18.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:18:18.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:18:18.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:18:18.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:18:18.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:18:18.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:18:18.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:18:18.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:18:18.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:18:18.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:18:18.289 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.289 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.289 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.290 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:18:18.290 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:18.290 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.960957859000004, 2023-01-02T18:18:18.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:18:18.290 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.291 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.291 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.291 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:18.291 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:18.291 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:18:18.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.292 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:18.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:18.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:18:18.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:18:18.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:18:18.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:18:18.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:18:18.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:18:18.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:18:18.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:18:18.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:18:18.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:18:18.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:18:18.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:18:18.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:18:18.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:18:18.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:18:18.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:18:18.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:18.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:18:18.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:18:18.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:18:18.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:18:18.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:18:18.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:18:18.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:18:18.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:18:18.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:18:18.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:18:18.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.306 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.306 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.307 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:18:18.307 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:18.307 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.654997903999998, 2023-01-02T18:18:18.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:18:18.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.308 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.308 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.308 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:18:18.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.309 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:18.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:18.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:18.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:18:18.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:18:18.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:18:18.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:18:18.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:18:18.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:18:18.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:18:18.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:18:18.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:18:18.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:18:18.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:18:18.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:18:18.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:18:18.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:18:18.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:18:18.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:18:18.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:18.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:18:18.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:18:18.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:18:18.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:18:18.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:18:18.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:18:18.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:18:18.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:18:18.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:18:18.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:18:18.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.324 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.324 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:18:18.325 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:18.325 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.940526090000006, 2023-01-02T18:18:18.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:18:18.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.326 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:18:18.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.327 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:18.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:18.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:18.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:18:18.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:18:18.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:18:18.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:18:18.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:18:18.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:18:18.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:18:18.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:18:18.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:18:18.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:18:18.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:18:18.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:18:18.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:18:18.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:18:18.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:18:18.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:18:18.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:18.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:18:18.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:18:18.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:18:18.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:18:18.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:18:18.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:18:18.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:18:18.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:18:18.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:18:18.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:18:18.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.341 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.342 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:18:18.342 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:18.342 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 70.931424688999996, 2023-01-02T18:18:18.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:18:18.343 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:18:18.343 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.343 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:18.343 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:18.344 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:18:18.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.344 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:18.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:18.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:18:18.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:18:18.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:18:18.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:18:18.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:18:18.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:18:18.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:18:18.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:18:18.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:18:18.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:18:18.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:18:18.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:18:18.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:18:18.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:18:18.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:18:18.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:18:18.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:18:18.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.354 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.354 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:18:18.355 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:18.355 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.660068397000003, 2023-01-02T18:18:18.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:18:18.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.355 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:18.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.356 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.356 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:18:18.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.357 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:18.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:18.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:18.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:18:18.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:18:18.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:18:18.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:18:18.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:18:18.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:18:18.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:18:18.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:18:18.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:18:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:18:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:18:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:18:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:18:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:18:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:18:18.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:18:18.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:18:18.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:18:18.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.367 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.368 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:18.368 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:18.368 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.942699073, 2023-01-02T18:18:18.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:18:18.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.369 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.370 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:18:18.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.370 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:18.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:18.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:18.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:18:18.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:18:18.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:18:18.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:18:18.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:18:18.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:18:18.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:18:18.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:18:18.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:18:18.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:18:18.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:18:18.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:18:18.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:18:18.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:18:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:18:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:18:18.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:18:18.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:18:18.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:18:18.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:18:18.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:18:18.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:18:18.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:18:18.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:18:18.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:18:18.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:18:18.384 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.384 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.385 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.385 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:18.385 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:18.386 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.915962831000002, 2023-01-02T18:18:18.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:18:18.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.386 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.386 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.386 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:18.387 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:18.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:18:18.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.387 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:18.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:18.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:18.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:18:18.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:18:18.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:18:18.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:18:18.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:18:18.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:18:18.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:18:18.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:18:18.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:18:18.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:18:18.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:18:18.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:18:18.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:18:18.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:18:18.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:18:18.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:18:18.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:18:18.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:18:18.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:18:18.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:18:18.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:18:18.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:18:18.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:18:18.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:18:18.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:18:18.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:18:18.401 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.401 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.402 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.402 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:18.402 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:18.403 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 55.915915235, 2023-01-02T18:18:18.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:18:18.403 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.403 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.403 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:18.404 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:18.404 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:18:18.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.404 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:18.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:18.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:18.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:18:18.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:18:18.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:18:18.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:18:18.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:18:18.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:18:18.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:18:18.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:18:18.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:18:18.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:18:18.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:18:18.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:18:18.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:18:18.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:18:18.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:18:18.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:18:18.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:18:18.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:18:18.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:18:18.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:18:18.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:18:18.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:18:18.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:18:18.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:18:18.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:18:18.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:18:18.419 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.419 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.419 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.420 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:18:18.420 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:18.420 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.952846149000003, 2023-01-02T18:18:18.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:18:18.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.421 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.421 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:18.421 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:18.421 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:18:18.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.422 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:18.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:18.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:18.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:18:18.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:18:18.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:18:18.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:18:18.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:18:18.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:18:18.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:18:18.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:18:18.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:18:18.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:18:18.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:18:18.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:18:18.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:18:18.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:18:18.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:18:18.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:18:18.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:18:18.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:18:18.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:18:18.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:18:18.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:18:18.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:18:18.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:18:18.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:18:18.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:18:18.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:18:18.436 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.436 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.436 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.437 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:18.437 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:18.437 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.936739885999998, 2023-01-02T18:18:18.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:18:18.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.438 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.438 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.438 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.439 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:18:18.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.439 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:18.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:18.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:18:18.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:18:18.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:18:18.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:18:18.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:18:18.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:18:18.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:18:18.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:18:18.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:18:18.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:18:18.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:18.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:18:18.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:18:18.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:18:18.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:18:18.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:18:18.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:18:18.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:18.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:18:18.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:18:18.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:18:18.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:18:18.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:18:18.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:18:18.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:18:18.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:18:18.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:18:18.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:18:18.453 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.453 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.454 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.454 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:18.454 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:18.455 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.931417701999997, 2023-01-02T18:18:18.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:18:18.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.455 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.455 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.455 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.456 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.456 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:18:18.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.456 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:18.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:18.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:18:18.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:18:18.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:18:18.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:18:18.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:18:18.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:18:18.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:18:18.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:18:18.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:18:18.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:18:18.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:18:18.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:18:18.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:18.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:18:18.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:18:18.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:18:18.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:18:18.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:18:18.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:18:18.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:18:18.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:18:18.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:18:18.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:18:18.468 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.468 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.469 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.469 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:18:18.469 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:18.470 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.927864636999999, 2023-01-02T18:18:18.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:18:18.470 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.470 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:18.470 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:18.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:18.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:18.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:18:18.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:18:18.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:18:18.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:18:18.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:18:18.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:18:18.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:18:18.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:18:18.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:18:18.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:18:18.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:18:18.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:18:18.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:18:18.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:18:18.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.479 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.480 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.480 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:18.480 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:18.480 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.926232593000002, 2023-01-02T18:18:18.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:18:18.481 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.481 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.482 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.482 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:18:18.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.482 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:18.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:18.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:18:18.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:18:18.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:18:18.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:18:18.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:18:18.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:18:18.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:18:18.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:18:18.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:18:18.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:18:18.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:18:18.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:18:18.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:18:18.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:18:18.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:18:18.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:18:18.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:18:18.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:18:18.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:18:18.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:18:18.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:18:18.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:18:18.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.495 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.496 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:18.496 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:18.496 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.926039015999997, 2023-01-02T18:18:18.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:18:18.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.497 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:18:18.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.498 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:18.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:18.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:18.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:18:18.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:18:18.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:18:18.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:18:18.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:18:18.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:18:18.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:18:18.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:18:18.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:18:18.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:18:18.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:18:18.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:18:18.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:18:18.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:18:18.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:18:18.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:18:18.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:18:18.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:18:18.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:18:18.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:18:18.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:18:18.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:18:18.510 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.510 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.510 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.511 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:18.511 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:18.511 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.920623136000003, 2023-01-02T18:18:18.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:18:18.512 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.512 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.512 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.512 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.512 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.513 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:18.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.513 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:18.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:18.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:18:18.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:18:18.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:18:18.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:18:18.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:18:18.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:18:18.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:18:18.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:18:18.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:18:18.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:18:18.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:18:18.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:18:18.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:18.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:18:18.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:18:18.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:18:18.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:18:18.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:18:18.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:18:18.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:18:18.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:18:18.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:18:18.525 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.525 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.526 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.526 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:18.526 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:18.527 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.920083407, 2023-01-02T18:18:18.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:18:18.527 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.527 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:18:18.527 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.528 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.528 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.528 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:18.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.528 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:18.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:18.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:18.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:18:18.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:18:18.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:18:18.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:18:18.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:18.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:18:18.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:18:18.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:18:18.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:18:18.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:18:18.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:18:18.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:18:18.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:18:18.536 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.537 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:18:18.537 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:18:18.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.537 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.538 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:18.538 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:18.538 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.914068114999999, 2023-01-02T18:18:18.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:18:18.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.539 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.539 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.539 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.540 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:18:18.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.540 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:18.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:18.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:18.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:18:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:18:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:18:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:18:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:18:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:18:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:18:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:18:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:18:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:18:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:18:18.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:18:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:18:18.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:18:18.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:18:18.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:18:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:18:18.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:18:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:18:18.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:18:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:18:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:18:18.552 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.553 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3435 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.737421725000001, 2023-01-02T18:18:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001, 2023-01-02T18:18:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3435 2023-01-02T18:18:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.555 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532923+0000", 2023-01-02T18:18:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1790000000000008e-06 2023-01-02T18:18:18.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532931+0000", 2023-01-02T18:18:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.45e-05 2023-01-02T18:18:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532946+0000", 2023-01-02T18:18:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532952+0000", 2023-01-02T18:18:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6125999999999999e-05 2023-01-02T18:18:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532988+0000", 2023-01-02T18:18:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3418999999999998e-05 2023-01-02T18:18:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533041+0000", 2023-01-02T18:18:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6446999999999994e-05 2023-01-02T18:18:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533128+0000", 2023-01-02T18:18:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025771280000000001 2023-01-02T18:18:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535705+0000", 2023-01-02T18:18:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012653530000000001 2023-01-02T18:18:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536970+0000", 2023-01-02T18:18:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0913e-05 2023-01-02T18:18:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537001+0000", 2023-01-02T18:18:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.444e-05 2023-01-02T18:18:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537025+0000", 2023-01-02T18:18:18.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001 2023-01-02T18:18:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3454 12.1a 12:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e121)", 2023-01-02T18:18:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.540320531999999, 2023-01-02T18:18:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999, 2023-01-02T18:18:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:18.569 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3454 2023-01-02T18:18:18.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:18.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730024+0000", 2023-01-02T18:18:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0990000000000005e-06 2023-01-02T18:18:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730034+0000", 2023-01-02T18:18:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6657e-05 2023-01-02T18:18:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730050+0000", 2023-01-02T18:18:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4959999999999996e-06 2023-01-02T18:18:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730059+0000", 2023-01-02T18:18:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1004999999999997e-05 2023-01-02T18:18:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730110+0000", 2023-01-02T18:18:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2023-01-02T18:18:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:18.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730255+0000", 2023-01-02T18:18:18.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018625 2023-01-02T18:18:18.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:18.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730441+0000", 2023-01-02T18:18:18.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001313771 2023-01-02T18:18:18.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:18.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.731755+0000", 2023-01-02T18:18:18.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0084210629999999995 2023-01-02T18:18:18.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:18.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740176+0000", 2023-01-02T18:18:18.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4363000000000001e-05 2023-01-02T18:18:18.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:18.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740230+0000", 2023-01-02T18:18:18.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0450000000000001e-05 2023-01-02T18:18:18.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:18.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:18.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:18.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740271+0000", 2023-01-02T18:18:18.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999 2023-01-02T18:18:18.583 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.583 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.583 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.584 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:18.584 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:18.584 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:18.584 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 5, 4] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:18.585 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:18.585 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2023-01-02T18:18:18.585 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:18:18.585 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:18:18.586 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2023-01-02T18:18:18.587 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:18.586+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:18.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:18.589 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:18:18.686 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:18.686+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:18.734 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:18.734 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "" 2023-01-02T18:18:18.735 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:18.735 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:18.735 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:18.736 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:18.736 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:18.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:18.787 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:18.787+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:18.888 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:18.889+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:18.913 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:18.914 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:18.914 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:18.914 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:18.914 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:18.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:19.008 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:19.009+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:19.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:19.092 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:19.092 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:19.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:19.092 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:19.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.093 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1 3.1a 3:5bdd5772:::image1.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:18:19.093 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:18:19.093 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.677311319, 2023-01-02T18:18:19.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839, 2023-01-02T18:18:19.093 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.094 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:18:19.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:19.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:19.094 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:19.094 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1 2023-01-02T18:18:19.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.095 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:18:19.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413950+0000", 2023-01-02T18:18:19.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:19.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413949+0000", 2023-01-02T18:18:19.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8359999999999999e-06 2023-01-02T18:18:19.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413954+0000", 2023-01-02T18:18:19.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9600000000000003e-06 2023-01-02T18:18:19.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413961+0000", 2023-01-02T18:18:19.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7519999999999999e-06 2023-01-02T18:18:19.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.413968+0000", 2023-01-02T18:18:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0071999999999999e-05 2023-01-02T18:18:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414008+0000", 2023-01-02T18:18:19.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1890000000000001e-06 2023-01-02T18:18:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.414015+0000", 2023-01-02T18:18:19.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013744829999999999 2023-01-02T18:18:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415389+0000", 2023-01-02T18:18:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1655000000000003e-05 2023-01-02T18:18:19.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.415471+0000", 2023-01-02T18:18:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001520839 2023-01-02T18:18:19.104 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.105 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:18:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:18:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.676361532, 2023-01-02T18:18:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:18:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.106 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:18:19.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:18:19.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:18:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:19.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:18:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:18:19.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:18:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:18:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:18:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:18:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:18:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:18:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:18:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:18:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:18:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:18:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:18:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:18:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:18:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:18:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:18:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:18:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:18:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:18:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:18:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:18:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:18:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:18:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:18:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:18:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.122 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:18:19.123 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.670693270000001, 2023-01-02T18:18:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:18:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:19.124 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:18:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:18:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:18:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:18:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:18:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:18:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:18:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:18:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:18:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:18:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:18:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:18:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:18:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:18:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:18:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:18:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:18:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:18:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:18:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:18:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:18:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:18:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:18:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:18:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:18:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:18:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:18:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:18:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:18:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.140 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:19.141 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:18:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.665159607999996, 2023-01-02T18:18:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:18:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:18:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:18:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:18:19.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:18:19.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:18:19.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:18:19.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:18:19.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:18:19.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:18:19.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:18:19.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:18:19.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:18:19.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:18:19.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:18:19.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:18:19.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:18:19.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:18:19.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:18:19.152 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.152 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.152 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.153 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:11 3.1 e46/43 3:826f36d4:::rbd_header.12a2b7720443:head v 46'1, mlcod=0'0)", 2023-01-02T18:18:19.153 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:18:19.153 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.657456608000004, 2023-01-02T18:18:19.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152, 2023-01-02T18:18:19.154 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.154 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.154 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:18:19.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:18:19.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:19.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433805+0000", 2023-01-02T18:18:19.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:18:19.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433810+0000", 2023-01-02T18:18:19.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1821000000000001e-05 2023-01-02T18:18:19.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433822+0000", 2023-01-02T18:18:19.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4549999999999998e-06 2023-01-02T18:18:19.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433829+0000", 2023-01-02T18:18:19.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6005000000000003e-05 2023-01-02T18:18:19.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433885+0000", 2023-01-02T18:18:19.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.16e-05 2023-01-02T18:18:19.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.433907+0000", 2023-01-02T18:18:19.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011094480000000001 2023-01-02T18:18:19.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435016+0000", 2023-01-02T18:18:19.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8626999999999999e-05 2023-01-02T18:18:19.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.435045+0000", 2023-01-02T18:18:19.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001240152 2023-01-02T18:18:19.165 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.166 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.166 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.166 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:31 3.1c e46/43 3:3d3f3250:::rbd_id.image2:head v 46'3, mlcod=46'1)", 2023-01-02T18:18:19.167 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:18:19.167 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.632797115000002, 2023-01-02T18:18:19.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999, 2023-01-02T18:18:19.167 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.167 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.168 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:18:19.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458464+0000", 2023-01-02T18:18:19.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:19.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458463+0000", 2023-01-02T18:18:19.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3389999999999998e-06 2023-01-02T18:18:19.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458470+0000", 2023-01-02T18:18:19.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.205e-05 2023-01-02T18:18:19.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458482+0000", 2023-01-02T18:18:19.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5809999999999996e-06 2023-01-02T18:18:19.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458487+0000", 2023-01-02T18:18:19.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8702000000000001e-05 2023-01-02T18:18:19.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458546+0000", 2023-01-02T18:18:19.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2495e-05 2023-01-02T18:18:19.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458559+0000", 2023-01-02T18:18:19.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001846735 2023-01-02T18:18:19.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460405+0000", 2023-01-02T18:18:19.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9183000000000002e-05 2023-01-02T18:18:19.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460435+0000", 2023-01-02T18:18:19.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019701969999999999 2023-01-02T18:18:19.178 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.178 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.178 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.178 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:33 3.3 3:c76fae31:::rbd_object_map.12a21ad382ee:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:19.179 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:18:19.179 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.628404552999996, 2023-01-02T18:18:19.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001, 2023-01-02T18:18:19.179 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.179 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:19.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:19.180 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:19.180 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 33 2023-01-02T18:18:19.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.180 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:18:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462857+0000", 2023-01-02T18:18:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462856+0000", 2023-01-02T18:18:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4710000000000004e-06 2023-01-02T18:18:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462862+0000", 2023-01-02T18:18:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:18:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462875+0000", 2023-01-02T18:18:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.491e-05 2023-01-02T18:18:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462890+0000", 2023-01-02T18:18:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9657999999999999e-05 2023-01-02T18:18:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.462930+0000", 2023-01-02T18:18:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1362999999999999e-05 2023-01-02T18:18:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463021+0000", 2023-01-02T18:18:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015166800000000001 2023-01-02T18:18:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463173+0000", 2023-01-02T18:18:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074740899999999999 2023-01-02T18:18:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.463920+0000", 2023-01-02T18:18:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045107699999999998 2023-01-02T18:18:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464372+0000", 2023-01-02T18:18:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6213e-05 2023-01-02T18:18:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464408+0000", 2023-01-02T18:18:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.535e-05 2023-01-02T18:18:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.464433+0000", 2023-01-02T18:18:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015762560000000001 2023-01-02T18:18:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:18:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:18:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.579460455000003, 2023-01-02T18:18:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:18:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:18:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:18:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:18:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:18:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:18:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:18:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:18:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:18:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:18:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:18:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:18:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:18:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:18:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:18:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:18:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:18:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:18:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:18:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:18:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:18:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.657504791999997, 2023-01-02T18:18:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:18:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:18:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:18:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:18:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:18:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:18:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:18:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:18:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:18:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:18:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:18:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:18:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:18:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:18:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:18:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:18:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:18:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:18:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:18:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:18:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:18:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:18:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:18:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:18:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:18:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:18:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:18:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:18:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:18:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:18:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:18:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.792723734000006, 2023-01-02T18:18:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:18:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:18:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:18:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:18:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:18:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:18:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:18:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:18:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:18:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:18:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:18:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:18:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:18:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:18:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:18:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:18:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:18:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:18:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:18:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:18:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:18:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:18:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:18:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:18:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:18:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:18:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:18:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:18:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:18:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:18:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:272 4.9 4:911e4614:::rbd_id.image18:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:18:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:18:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.781095214000004, 2023-01-02T18:18:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999, 2023-01-02T18:18:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 272 2023-01-02T18:18:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:18:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310166+0000", 2023-01-02T18:18:19.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:19.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310165+0000", 2023-01-02T18:18:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.628e-06 2023-01-02T18:18:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310174+0000", 2023-01-02T18:18:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.571e-05 2023-01-02T18:18:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310190+0000", 2023-01-02T18:18:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:18:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310198+0000", 2023-01-02T18:18:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6770000000000001e-05 2023-01-02T18:18:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310245+0000", 2023-01-02T18:18:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000159517 2023-01-02T18:18:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310404+0000", 2023-01-02T18:18:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00023075600000000001 2023-01-02T18:18:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.310635+0000", 2023-01-02T18:18:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00088889700000000004 2023-01-02T18:18:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311524+0000", 2023-01-02T18:18:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011021 2023-01-02T18:18:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311634+0000", 2023-01-02T18:18:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2626000000000002e-05 2023-01-02T18:18:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311667+0000", 2023-01-02T18:18:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9774000000000002e-05 2023-01-02T18:18:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.311706+0000", 2023-01-02T18:18:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0015402549999999999 2023-01-02T18:18:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(8.1b 125/124 [PushOp(8:d8cae014:::rbd_id.image28:head, version: 68'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(8:d8cae014:::rbd_id.image28:head@68'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.780675+0000", 2023-01-02T18:18:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.310586339, 2023-01-02T18:18:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0021783459999999998, 2023-01-02T18:18:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780675+0000", 2023-01-02T18:18:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780675+0000", 2023-01-02T18:18:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780674+0000", 2023-01-02T18:18:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2589e-05 2023-01-02T18:18:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780697+0000", 2023-01-02T18:18:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8652999999999999e-05 2023-01-02T18:18:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780715+0000", 2023-01-02T18:18:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2925000000000001e-05 2023-01-02T18:18:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780728+0000", 2023-01-02T18:18:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2286000000000005e-05 2023-01-02T18:18:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780810+0000", 2023-01-02T18:18:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:18:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780822+0000", 2023-01-02T18:18:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020315580000000001 2023-01-02T18:18:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.782853+0000", 2023-01-02T18:18:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0021783459999999998 2023-01-02T18:18:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(3.1b 125/124 [PushOp(3:def61116:::rbd_id.image17:head, version: 46'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:def61116:::rbd_id.image17:head@46'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.780801+0000", 2023-01-02T18:18:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.310460451000001, 2023-01-02T18:18:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028938050000000002, 2023-01-02T18:18:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780801+0000", 2023-01-02T18:18:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780801+0000", 2023-01-02T18:18:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780800+0000", 2023-01-02T18:18:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3433e-05 2023-01-02T18:18:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780814+0000", 2023-01-02T18:18:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5350999999999999e-05 2023-01-02T18:18:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780829+0000", 2023-01-02T18:18:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.06e-05 2023-01-02T18:18:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780840+0000", 2023-01-02T18:18:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010008700000000001 2023-01-02T18:18:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780940+0000", 2023-01-02T18:18:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2119999999999997e-06 2023-01-02T18:18:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.780947+0000", 2023-01-02T18:18:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00274786 2023-01-02T18:18:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.783695+0000", 2023-01-02T18:18:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028938050000000002 2023-01-02T18:18:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(12.1a 125/124 [PushOp(12:5cea7035:::rbd_info:head, version: 121'1, data_included: [], data_size: 0, omap_header_size: 0, omap_entries_size: 1, attrset_size: 2, recovery_info: ObjectRecoveryInfo(12:5cea7035:::rbd_info:head@121'1, size: 0, copy_subset: [], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:0, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.791302+0000", 2023-01-02T18:18:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.299959527999999, 2023-01-02T18:18:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001210722, 2023-01-02T18:18:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791302+0000", 2023-01-02T18:18:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791302+0000", 2023-01-02T18:18:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791302+0000", 2023-01-02T18:18:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6103000000000002e-05 2023-01-02T18:18:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791318+0000", 2023-01-02T18:18:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7237000000000001e-05 2023-01-02T18:18:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791335+0000", 2023-01-02T18:18:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1532000000000001e-05 2023-01-02T18:18:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.791346+0000", 2023-01-02T18:18:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00066366999999999999 2023-01-02T18:18:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.792010+0000", 2023-01-02T18:18:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0825999999999999e-05 2023-01-02T18:18:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.792021+0000", 2023-01-02T18:18:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049166300000000004 2023-01-02T18:18:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.792513+0000", 2023-01-02T18:18:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001210722 2023-01-02T18:18:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.289 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(8.b 125/124 [PushOp(8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head, version: 72'1, data_included: [0~35], data_size: 35, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head@72'1, size: 35, copy_subset: [0~35], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:35, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:19.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.796350+0000", 2023-01-02T18:18:19.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.294911052, 2023-01-02T18:18:19.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017453410000000001, 2023-01-02T18:18:19.290 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.290 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:19.290 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796350+0000", 2023-01-02T18:18:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796350+0000", 2023-01-02T18:18:19.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:19.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796350+0000", 2023-01-02T18:18:19.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3314e-05 2023-01-02T18:18:19.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796363+0000", 2023-01-02T18:18:19.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7924999999999999e-05 2023-01-02T18:18:19.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796381+0000", 2023-01-02T18:18:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0920999999999999e-05 2023-01-02T18:18:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796392+0000", 2023-01-02T18:18:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6407000000000003e-05 2023-01-02T18:18:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796458+0000", 2023-01-02T18:18:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9859999999999994e-06 2023-01-02T18:18:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.796466+0000", 2023-01-02T18:18:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001629588 2023-01-02T18:18:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.798096+0000", 2023-01-02T18:18:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017453410000000001 2023-01-02T18:18:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3484 12.16 e125/124 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head v 125'3, mlcod=123'1)", 2023-01-02T18:18:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.809621+0000", 2023-01-02T18:18:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 16.281640682999999, 2023-01-02T18:18:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002427944, 2023-01-02T18:18:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809621+0000", 2023-01-02T18:18:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809621+0000", 2023-01-02T18:18:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809620+0000", 2023-01-02T18:18:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8889999999999996e-06 2023-01-02T18:18:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809627+0000", 2023-01-02T18:18:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0693000000000001e-05 2023-01-02T18:18:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809638+0000", 2023-01-02T18:18:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6469999999999997e-06 2023-01-02T18:18:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809642+0000", 2023-01-02T18:18:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5593000000000002e-05 2023-01-02T18:18:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809688+0000", 2023-01-02T18:18:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1826000000000001e-05 2023-01-02T18:18:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.809710+0000", 2023-01-02T18:18:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023060810000000002 2023-01-02T18:18:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812016+0000", 2023-01-02T18:18:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2937e-05 2023-01-02T18:18:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812049+0000", 2023-01-02T18:18:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002427944 2023-01-02T18:18:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(3.19 133/132 [PushOp(3:9f0648ad:::rbd_object_map.12a2f5961a41:head, version: 46'1, data_included: [0~30], data_size: 30, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(3:9f0648ad:::rbd_object_map.12a2f5961a41:head@46'1, size: 30, copy_subset: [0~30], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:30, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:14.402005+0000", 2023-01-02T18:18:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.6892563420000002, 2023-01-02T18:18:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025456620000000002, 2023-01-02T18:18:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.402005+0000", 2023-01-02T18:18:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.402005+0000", 2023-01-02T18:18:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.402005+0000", 2023-01-02T18:18:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3593e-05 2023-01-02T18:18:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.402018+0000", 2023-01-02T18:18:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4412e-05 2023-01-02T18:18:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.402033+0000", 2023-01-02T18:18:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1388e-05 2023-01-02T18:18:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.402044+0000", 2023-01-02T18:18:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0021955939999999999 2023-01-02T18:18:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.404240+0000", 2023-01-02T18:18:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6989999999999992e-06 2023-01-02T18:18:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.404248+0000", 2023-01-02T18:18:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030225199999999998 2023-01-02T18:18:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.404551+0000", 2023-01-02T18:18:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025456620000000002 2023-01-02T18:18:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3507 13.3 e134/124 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head v 134'3, mlcod=133'1)", 2023-01-02T18:18:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:18:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.1965292519999999, 2023-01-02T18:18:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003658751, 2023-01-02T18:18:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:18:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:18:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894729+0000", 2023-01-02T18:18:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001143016 2023-01-02T18:18:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895872+0000", 2023-01-02T18:18:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6974999999999999e-05 2023-01-02T18:18:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895889+0000", 2023-01-02T18:18:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4590000000000004e-06 2023-01-02T18:18:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895899+0000", 2023-01-02T18:18:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2062000000000001e-05 2023-01-02T18:18:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895981+0000", 2023-01-02T18:18:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2603e-05 2023-01-02T18:18:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.896004+0000", 2023-01-02T18:18:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023445829999999999 2023-01-02T18:18:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.898348+0000", 2023-01-02T18:18:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2809999999999998e-05 2023-01-02T18:18:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.898391+0000", 2023-01-02T18:18:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003658751 2023-01-02T18:18:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3508 13.3 e134/124 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head v 134'4, mlcod=134'2)", 2023-01-02T18:18:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:18:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.1913862980000001, 2023-01-02T18:18:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035122700000000001, 2023-01-02T18:18:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:18:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:18:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899872+0000", 2023-01-02T18:18:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001146268 2023-01-02T18:18:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901019+0000", 2023-01-02T18:18:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8525999999999998e-05 2023-01-02T18:18:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901037+0000", 2023-01-02T18:18:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.893e-06 2023-01-02T18:18:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901047+0000", 2023-01-02T18:18:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3754000000000001e-05 2023-01-02T18:18:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901101+0000", 2023-01-02T18:18:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5004999999999999e-05 2023-01-02T18:18:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901126+0000", 2023-01-02T18:18:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022245860000000002 2023-01-02T18:18:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.903350+0000", 2023-01-02T18:18:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6918000000000001e-05 2023-01-02T18:18:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.903387+0000", 2023-01-02T18:18:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035122700000000001 2023-01-02T18:18:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3509 12.16 e135/124 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head v 135'7, mlcod=130'5)", 2023-01-02T18:18:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.908063+0000", 2023-01-02T18:18:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.18319864699999999, 2023-01-02T18:18:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026148370000000001, 2023-01-02T18:18:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.908063+0000", 2023-01-02T18:18:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.908063+0000", 2023-01-02T18:18:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.908063+0000", 2023-01-02T18:18:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2400000000000004e-06 2023-01-02T18:18:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.908069+0000", 2023-01-02T18:18:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7753000000000001e-05 2023-01-02T18:18:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.908087+0000", 2023-01-02T18:18:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2020000000000004e-06 2023-01-02T18:18:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.908095+0000", 2023-01-02T18:18:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6641000000000002e-05 2023-01-02T18:18:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.908151+0000", 2023-01-02T18:18:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6259999999999999e-05 2023-01-02T18:18:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.908178+0000", 2023-01-02T18:18:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002467749 2023-01-02T18:18:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910645+0000", 2023-01-02T18:18:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2249000000000002e-05 2023-01-02T18:18:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910678+0000", 2023-01-02T18:18:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0026148370000000001 2023-01-02T18:18:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.355 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.355 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:19.355 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:19.355 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:19.356 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:19.117+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:19.358 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:19.358 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:19.359 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:19.359 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:19.359 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:19.359 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:19.359 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:19.360 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:19.360 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:19.360 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:19.360 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:19.361 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:19.362 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:19.362 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:19.356+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:19.458 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:19.458+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:19.524 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:19.524 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:19.534 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:19.578 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:19.579+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:19.659 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:19.659+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:19.660 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:19.660 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:19.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:19.760 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:19.760+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:19.837 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:19.837 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:19.846 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:19.861 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:19.861+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:19.962 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:19.962+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:19.972 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:19.972 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:19.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:20.063 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:20.063+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:20.151 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:20.151 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:20.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:20.163 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:20.163+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:20.264 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:20.265+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:20.286 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:20.287 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:20.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:20.365 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:20.365+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:20.462 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:20.462 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:20.465 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:20.466+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:20.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:20.566 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:20.567+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:20.591 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:18:20.637 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:20.637 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:20.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:20.667 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:20.667+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:20.769 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:20.769+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:20.813 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:20.813 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:20.823 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:20.870 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:20.870+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:20.951 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:20.952 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:20.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:20.971 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:20.971+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:21.009 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.RemoveFullTryDataPool (25460 ms) 2023-01-02T18:18:21.009 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestIO 2023-01-02T18:18:21.009 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:21.072 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:21.072+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:21.135 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:21.136 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:21.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:21.172 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:21.173+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:21.274 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:21.274+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:21.314 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:21.315 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:21.325 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:21.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:21.411 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:21.411+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:21.456 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:21.456 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:21.467 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:21.475 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:21.476+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:21.518 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:21.537 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:21.557 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:21.575 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:21.576 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:21.577+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:21.594 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:21.613 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:21.632 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:21.646 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:21.647 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:21.647 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:21.647 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:21.647 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:21.652 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:21.653 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:21.654 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:21.654 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:21.654 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:21.654 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:21.654 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:21.655 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:21.655 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:21.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:21.677 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:18:21.677 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:21.678+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:21.778 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:21.778+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:21.809 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:21.810 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:21.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:21.810 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:21.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.810 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:21.811 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:21.811 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 93.480441064999994, 2023-01-02T18:18:21.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:21.811 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.811 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.812 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:21.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:21.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:21.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:21.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:21.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:21.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:21.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:21.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:21.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:21.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:21.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:21.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:21.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:21.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:21.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:21.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:21.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:21.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:21.821 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.822 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.822 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.822 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:18:21.823 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:21.823 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 70.175487340000004, 2023-01-02T18:18:21.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:18:21.823 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.823 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:21.824 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:21.824 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:21.824 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:21.824 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:18:21.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.825 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:21.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:21.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:21.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:18:21.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:18:21.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:18:21.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:18:21.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:18:21.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:18:21.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:18:21.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:18:21.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:18:21.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:21.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:21.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:18:21.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:18:21.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:18:21.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:18:21.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:18:21.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:18:21.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:18:21.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:18:21.835 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.835 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.836 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.836 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:21.836 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:21.837 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.470945670000006, 2023-01-02T18:18:21.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:21.837 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.837 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:21.837 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:21.838 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:21.838 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:21.838 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:21.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.838 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:21.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:21.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:21.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:21.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:21.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:21.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:21.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:21.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:21.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:21.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:21.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:21.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:21.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:21.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:21.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:21.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:21.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:21.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:21.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:21.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.849 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.849 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.850 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:21.850 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:21.850 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.457888079, 2023-01-02T18:18:21.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:21.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:21.851 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:21.851 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:21.852 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:21.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:21.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.852 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:21.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:21.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:21.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:21.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:21.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:21.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:21.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:21.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:21.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:21.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:21.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:21.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:21.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:21.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:21.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:21.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:21.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:21.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.863 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.863 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.864 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:21.864 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:21.864 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.447812849000002, 2023-01-02T18:18:21.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:21.864 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.865 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.865 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:21.865 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:21.865 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:21.865 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:21.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.866 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:21.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:21.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:21.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:21.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:21.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:21.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:21.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:21.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:21.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:21.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:21.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:21.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:21.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:21.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:21.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:21.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:21.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:21.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:21.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:21.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:21.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:21.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:21.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:21.877 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:21.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:21.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:21.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:21.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:21.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:21.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:21.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:21.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:21.880 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.880 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.880 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.881 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:21.881 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:21.881 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 56.484663064999999, 2023-01-02T18:18:21.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:21.882 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.882 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:21.882 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:21.882 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:21.883 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:21.883 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:21.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.883 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:21.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:21.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:21.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:21.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:21.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:21.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:21.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:21.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:21.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:21.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:21.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:21.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:21.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:21.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:21.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:21.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:21.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:21.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:21.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:21.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.894 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.894 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.895 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:21.895 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:21.895 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.479899600000003, 2023-01-02T18:18:21.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:18:21.895 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.896 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.896 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:21.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:21.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:21.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:18:21.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:18:21.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:18:21.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:21.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:18:21.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:18:21.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:18:21.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:18:21.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:18:21.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:18:21.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:18:21.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:18:21.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:18:21.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:18:21.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:18:21.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:18:21.905 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.905 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.905 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.906 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:21.906 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:21.906 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.479366374999998, 2023-01-02T18:18:21.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:21.906 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.907 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.907 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:21.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:21.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:21.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:21.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:21.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:21.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:21.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:21.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:21.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:21.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:21.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:21.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:21.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:21.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:21.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:21.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:21.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:21.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:21.916 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.916 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.916 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.917 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:21.917 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:21.917 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.426917557000003, 2023-01-02T18:18:21.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:21.918 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.918 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.918 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:21.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:21.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:21.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:21.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:21.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:21.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:21.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:21.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:21.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:21.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:21.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:21.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:21.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:21.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:21.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:21.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:21.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:21.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:21.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.928 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.928 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.928 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:21.928 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:21.929 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.419436669, 2023-01-02T18:18:21.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:21.929 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.929 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.929 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:21.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:21.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:21.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:21.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:21.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:21.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:21.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:21.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:21.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:21.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:21.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:21.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:21.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:21.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:21.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:21.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:21.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:21.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:21.938 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.938 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.939 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:21.939 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:21.940 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.371784013999999, 2023-01-02T18:18:21.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:21.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.940 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:21.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:21.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:21.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:21.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:21.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:21.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:21.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:21.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:21.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:21.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:21.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:21.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:21.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:21.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:21.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:21.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:21.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:21.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:21.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.950 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.950 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:21.951 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:21.951 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.367411436000001, 2023-01-02T18:18:21.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:21.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.952 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:21.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:21.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:21.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:21.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:21.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:21.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:21.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:21.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:21.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:21.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:21.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:21.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:21.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:21.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:21.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:21.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:21.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:21.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:21.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.961 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.962 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3438 11.15 e117/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 117'5, mlcod=116'3)", 2023-01-02T18:18:21.962 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:21.962 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.275676938, 2023-01-02T18:18:21.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987, 2023-01-02T18:18:21.963 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.963 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:21.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:21.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:21.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533291+0000", 2023-01-02T18:18:21.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4139999999999997e-06 2023-01-02T18:18:21.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533299+0000", 2023-01-02T18:18:21.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1438e-05 2023-01-02T18:18:21.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533310+0000", 2023-01-02T18:18:21.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5089999999999996e-06 2023-01-02T18:18:21.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533318+0000", 2023-01-02T18:18:21.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6567999999999998e-05 2023-01-02T18:18:21.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533374+0000", 2023-01-02T18:18:21.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5011000000000002e-05 2023-01-02T18:18:21.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533399+0000", 2023-01-02T18:18:21.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024056519999999999 2023-01-02T18:18:21.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535805+0000", 2023-01-02T18:18:21.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5862000000000003e-05 2023-01-02T18:18:21.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535841+0000", 2023-01-02T18:18:21.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987 2023-01-02T18:18:21.972 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.972 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.972 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.973 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3436 11.14 e117/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 117'5, mlcod=108'3)", 2023-01-02T18:18:21.973 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:21.973 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.275585909, 2023-01-02T18:18:21.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999, 2023-01-02T18:18:21.974 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.974 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.974 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:21.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:21.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:21.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533382+0000", 2023-01-02T18:18:21.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.476e-06 2023-01-02T18:18:21.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533387+0000", 2023-01-02T18:18:21.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0322999999999999e-05 2023-01-02T18:18:21.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533397+0000", 2023-01-02T18:18:21.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2950000000000001e-06 2023-01-02T18:18:21.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533403+0000", 2023-01-02T18:18:21.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1789000000000002e-05 2023-01-02T18:18:21.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533454+0000", 2023-01-02T18:18:21.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9650999999999999e-05 2023-01-02T18:18:21.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533474+0000", 2023-01-02T18:18:21.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019917419999999999 2023-01-02T18:18:21.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535466+0000", 2023-01-02T18:18:21.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4618999999999999e-05 2023-01-02T18:18:21.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535490+0000", 2023-01-02T18:18:21.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999 2023-01-02T18:18:21.983 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.983 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.984 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:21.984 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:21.985 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.076102307999999, 2023-01-02T18:18:21.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:21.985 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.985 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.985 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:21.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:21.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:21.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:21.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:21.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:21.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:21.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:21.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:21.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:21.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:21.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:21.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:21.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:21.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:21.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:21.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:21.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:21.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:21.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:21.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:21.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:21.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:21.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:21.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:21.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:21.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:21.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:21.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.995 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:21.995 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:21.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.996 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3493 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e127)", 2023-01-02T18:18:21.996 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:21.996 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.967304982, 2023-01-02T18:18:21.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998, 2023-01-02T18:18:21.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:21.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:21.997 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:21.997 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:21.998 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:21.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3493 2023-01-02T18:18:21.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.998 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:21.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:21.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:21.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:21.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:21.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:21.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:22.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:22.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841661+0000", 2023-01-02T18:18:22.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8811999999999999e-05 2023-01-02T18:18:22.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841680+0000", 2023-01-02T18:18:22.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9380000000000001e-05 2023-01-02T18:18:22.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841699+0000", 2023-01-02T18:18:22.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:22.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841709+0000", 2023-01-02T18:18:22.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010059 2023-01-02T18:18:22.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841809+0000", 2023-01-02T18:18:22.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3533e-05 2023-01-02T18:18:22.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841903+0000", 2023-01-02T18:18:22.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036800899999999998 2023-01-02T18:18:22.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:22.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842271+0000", 2023-01-02T18:18:22.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033624560000000002 2023-01-02T18:18:22.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:22.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845633+0000", 2023-01-02T18:18:22.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020175099999999999 2023-01-02T18:18:22.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:22.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845835+0000", 2023-01-02T18:18:22.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1019999999999998e-05 2023-01-02T18:18:22.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845866+0000", 2023-01-02T18:18:22.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7328999999999999e-05 2023-01-02T18:18:22.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845893+0000", 2023-01-02T18:18:22.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998 2023-01-02T18:18:22.010 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.011 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.011 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.011 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3494 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e128)", 2023-01-02T18:18:22.012 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:22.012 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 12.962775674, 2023-01-02T18:18:22.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999, 2023-01-02T18:18:22.012 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.012 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.012 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:22.013 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:22.013 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:22.013 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3494 2023-01-02T18:18:22.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.013 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:22.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:22.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:22.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846191+0000", 2023-01-02T18:18:22.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4089e-05 2023-01-02T18:18:22.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846205+0000", 2023-01-02T18:18:22.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8082000000000001e-05 2023-01-02T18:18:22.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846223+0000", 2023-01-02T18:18:22.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2023-01-02T18:18:22.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846231+0000", 2023-01-02T18:18:22.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100853 2023-01-02T18:18:22.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846332+0000", 2023-01-02T18:18:22.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4294000000000004e-05 2023-01-02T18:18:22.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846406+0000", 2023-01-02T18:18:22.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000381035 2023-01-02T18:18:22.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:22.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846787+0000", 2023-01-02T18:18:22.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029262089999999999 2023-01-02T18:18:22.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:22.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849713+0000", 2023-01-02T18:18:22.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022129699999999999 2023-01-02T18:18:22.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:22.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849934+0000", 2023-01-02T18:18:22.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6384000000000003e-05 2023-01-02T18:18:22.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849971+0000", 2023-01-02T18:18:22.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9811e-05 2023-01-02T18:18:22.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.850001+0000", 2023-01-02T18:18:22.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999 2023-01-02T18:18:22.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.026 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.027 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3500 13.1c e131/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 131'3, mlcod=130'1)", 2023-01-02T18:18:22.027 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:22.027 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.9368078830000002, 2023-01-02T18:18:22.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999, 2023-01-02T18:18:22.027 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.028 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:22.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:22.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872160+0000", 2023-01-02T18:18:22.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022329899999999998 2023-01-02T18:18:22.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874393+0000", 2023-01-02T18:18:22.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.252e-05 2023-01-02T18:18:22.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874406+0000", 2023-01-02T18:18:22.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0240000000000003e-06 2023-01-02T18:18:22.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874415+0000", 2023-01-02T18:18:22.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0895000000000005e-05 2023-01-02T18:18:22.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874486+0000", 2023-01-02T18:18:22.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4266e-05 2023-01-02T18:18:22.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874520+0000", 2023-01-02T18:18:22.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023338909999999998 2023-01-02T18:18:22.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876854+0000", 2023-01-02T18:18:22.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3161000000000001e-05 2023-01-02T18:18:22.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876907+0000", 2023-01-02T18:18:22.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999 2023-01-02T18:18:22.037 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.037 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.038 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.038 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3501 13.1c e132/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 132'4, mlcod=130'2)", 2023-01-02T18:18:22.038 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:22.038 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 7.930377569, 2023-01-02T18:18:22.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001, 2023-01-02T18:18:22.039 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.039 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.039 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:22.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:22.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:22.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878589+0000", 2023-01-02T18:18:22.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011789120000000001 2023-01-02T18:18:22.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879768+0000", 2023-01-02T18:18:22.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6392000000000002e-05 2023-01-02T18:18:22.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879785+0000", 2023-01-02T18:18:22.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3309999999999998e-06 2023-01-02T18:18:22.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879792+0000", 2023-01-02T18:18:22.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4100000000000001e-05 2023-01-02T18:18:22.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879836+0000", 2023-01-02T18:18:22.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1690000000000001e-05 2023-01-02T18:18:22.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879858+0000", 2023-01-02T18:18:22.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001682692 2023-01-02T18:18:22.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881541+0000", 2023-01-02T18:18:22.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7658999999999999e-05 2023-01-02T18:18:22.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881588+0000", 2023-01-02T18:18:22.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001 2023-01-02T18:18:22.049 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.049 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.049 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.050 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3510 13.10 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:18:22.050 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:22.050 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 2.8978260169999999, 2023-01-02T18:18:22.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999, 2023-01-02T18:18:22.050 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.051 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.051 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:22.051 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:22.051 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:22.051 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3510 2023-01-02T18:18:22.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.052 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:22.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:22.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:22.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911139+0000", 2023-01-02T18:18:22.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9587000000000001e-05 2023-01-02T18:18:22.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911159+0000", 2023-01-02T18:18:22.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2842000000000002e-05 2023-01-02T18:18:22.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911192+0000", 2023-01-02T18:18:22.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5116999999999999e-05 2023-01-02T18:18:22.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911207+0000", 2023-01-02T18:18:22.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000120098 2023-01-02T18:18:22.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911327+0000", 2023-01-02T18:18:22.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.536e-06 2023-01-02T18:18:22.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:22.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911332+0000", 2023-01-02T18:18:22.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025961489999999999 2023-01-02T18:18:22.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.913928+0000", 2023-01-02T18:18:22.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016713700000000001 2023-01-02T18:18:22.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914096+0000", 2023-01-02T18:18:22.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044610400000000001 2023-01-02T18:18:22.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:22.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914542+0000", 2023-01-02T18:18:22.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027693449999999999 2023-01-02T18:18:22.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:22.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917311+0000", 2023-01-02T18:18:22.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079338599999999998 2023-01-02T18:18:22.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918104+0000", 2023-01-02T18:18:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8297000000000003e-05 2023-01-02T18:18:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918143+0000", 2023-01-02T18:18:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7084e-05 2023-01-02T18:18:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918170+0000", 2023-01-02T18:18:22.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999 2023-01-02T18:18:22.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.067 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.067 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.067 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:22.068 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:22.069+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:22.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:22.169 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:22.169+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:22.238 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:22.238 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:22.239 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:22.239 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:22.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:22.270 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:22.270+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:22.370 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:22.371+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:22.424 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:22.424 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:22.424 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:22.425 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:22.425 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:22.434 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:22.471 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:22.471+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:22.565 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:22.566 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:22.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:22.566 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:22.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.566 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:18:22.567 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:22.567 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 89.215646731999996, 2023-01-02T18:18:22.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:18:22.567 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.567 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.568 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:22.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:22.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:22.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:18:22.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:18:22.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:18:22.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:18:22.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:18:22.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:18:22.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:18:22.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:18:22.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:18:22.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:18:22.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:18:22.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:18:22.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:18:22.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:18:22.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:18:22.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:18:22.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.578 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.579 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:18:22.579 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:22.579 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.248818847999999, 2023-01-02T18:18:22.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:18:22.580 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.580 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.580 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.580 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:22.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:22.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:22.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:18:22.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:18:22.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:18:22.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:18:22.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:18:22.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:18:22.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:18:22.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:18:22.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:18:22.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:18:22.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:18:22.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:18:22.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:18:22.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:18:22.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:18:22.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.590 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.591 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:18:22.591 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:22.591 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.241328601000006, 2023-01-02T18:18:22.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:18:22.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.592 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:22.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:22.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:22.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:18:22.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:18:22.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:18:22.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:18:22.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:18:22.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:18:22.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:18:22.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:18:22.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:18:22.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:18:22.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:18:22.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:18:22.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:18:22.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:18:22.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:18:22.602 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.602 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.602 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.603 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:18:22.603 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:22.603 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.239535516000004, 2023-01-02T18:18:22.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:18:22.603 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.603 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.604 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:22.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:22.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:22.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:18:22.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:18:22.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:18:22.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:18:22.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:18:22.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:18:22.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.609 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:18:22.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:18:22.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:18:22.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:18:22.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:18:22.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:18:22.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:18:22.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:18:22.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:18:22.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:18:22.613 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.613 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.614 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.614 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:18:22.614 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:22.615 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.236644171999998, 2023-01-02T18:18:22.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:18:22.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.615 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.615 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:22.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:22.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:18:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:18:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:18:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:18:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:18:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:18:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:18:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:18:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:18:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:18:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:18:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:18:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:18:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:18:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:18:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:18:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:18:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.200363357999997, 2023-01-02T18:18:22.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:18:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:22.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:18:22.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:18:22.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:18:22.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:18:22.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:18:22.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:18:22.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:18:22.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:18:22.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:18:22.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:18:22.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:18:22.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:18:22.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:18:22.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:18:22.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:18:22.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.637 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.637 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:18:22.638 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:22.638 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.224728493000001, 2023-01-02T18:18:22.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:18:22.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.639 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:22.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:22.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:22.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:22.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:18:22.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:18:22.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:18:22.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:18:22.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:18:22.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:18:22.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:18:22.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:18:22.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:18:22.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:18:22.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:18:22.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:18:22.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:18:22.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:18:22.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:18:22.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.648 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.649 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:18:22.649 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:22.649 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.222989644000002, 2023-01-02T18:18:22.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:18:22.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.650 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.650 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:22.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:22.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:22.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:18:22.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:18:22.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:18:22.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:18:22.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:18:22.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:18:22.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:18:22.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:18:22.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:18:22.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:18:22.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:18:22.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:18:22.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:18:22.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:18:22.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:18:22.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:18:22.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.660 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.660 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.661 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:18:22.661 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:22.661 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.230664390000001, 2023-01-02T18:18:22.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:18:22.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.662 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.662 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:22.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:22.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:22.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:22.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:18:22.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:18:22.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:18:22.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:18:22.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:18:22.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:18:22.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:18:22.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:18:22.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:18:22.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:18:22.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:18:22.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:18:22.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:18:22.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:18:22.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:18:22.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.672 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.672 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.673 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:22.673 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:22.673 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.229521546999997, 2023-01-02T18:18:22.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:18:22.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.674 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.674 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:22.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:22.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:22.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:18:22.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:18:22.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:18:22.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:18:22.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:18:22.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:18:22.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:18:22.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:18:22.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:18:22.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:18:22.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:18:22.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:18:22.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:18:22.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:18:22.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:18:22.684 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.684 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.684 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.685 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:22.685 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:22.685 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.216967752999999, 2023-01-02T18:18:22.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:18:22.686 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.686 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.686 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:22.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:22.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:22.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:18:22.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:18:22.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:18:22.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:18:22.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:18:22.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:18:22.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:18:22.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:18:22.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:18:22.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:18:22.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:18:22.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:18:22.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:18:22.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:18:22.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:18:22.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.696 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.697 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:22.697 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:22.697 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.199565444000001, 2023-01-02T18:18:22.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:18:22.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.698 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.698 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:22.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:22.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:22.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:18:22.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:18:22.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:18:22.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:18:22.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:18:22.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:18:22.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:18:22.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:18:22.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:18:22.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:18:22.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:18:22.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:18:22.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:18:22.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:18:22.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:18:22.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:18:22.707 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.708 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.708 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.708 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:18:22.709 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:22.709 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.149511898, 2023-01-02T18:18:22.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:18:22.709 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.709 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.710 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:22.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:22.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:22.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:18:22.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:18:22.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:18:22.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:18:22.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:18:22.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:18:22.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:18:22.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:18:22.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:18:22.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:18:22.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:18:22.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:18:22.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:18:22.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:18:22.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:18:22.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:18:22.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.720 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.721 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:18:22.721 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:22.721 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.128854119, 2023-01-02T18:18:22.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:18:22.722 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.722 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.722 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:22.722 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:22.722 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:22.723 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:18:22.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.723 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:22.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:22.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:22.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:18:22.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:18:22.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:18:22.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:18:22.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:18:22.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:18:22.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:18:22.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:18:22.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:18:22.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:18:22.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:18:22.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:18:22.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:22.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:18:22.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:18:22.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:22.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:18:22.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:18:22.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:22.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:18:22.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:18:22.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:18:22.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:18:22.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:18:22.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:18:22.736 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.736 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.736 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.737 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3347 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e116)", 2023-01-02T18:18:22.737 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:22.737 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.124356167999998, 2023-01-02T18:18:22.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004, 2023-01-02T18:18:22.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.738 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:22.738 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:22.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:22.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3347 2023-01-02T18:18:22.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.739 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:22.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:22.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:22.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440699+0000", 2023-01-02T18:18:22.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5150000000000001e-05 2023-01-02T18:18:22.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440724+0000", 2023-01-02T18:18:22.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2691e-05 2023-01-02T18:18:22.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440747+0000", 2023-01-02T18:18:22.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9449999999999999e-06 2023-01-02T18:18:22.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440756+0000", 2023-01-02T18:18:22.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0661999999999997e-05 2023-01-02T18:18:22.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440807+0000", 2023-01-02T18:18:22.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4629999999999996e-05 2023-01-02T18:18:22.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440871+0000", 2023-01-02T18:18:22.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034606300000000002 2023-01-02T18:18:22.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:22.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441217+0000", 2023-01-02T18:18:22.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031920429999999999 2023-01-02T18:18:22.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:22.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444409+0000", 2023-01-02T18:18:22.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032486499999999997 2023-01-02T18:18:22.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:22.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444734+0000", 2023-01-02T18:18:22.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5741000000000002e-05 2023-01-02T18:18:22.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444770+0000", 2023-01-02T18:18:22.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7988e-05 2023-01-02T18:18:22.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444798+0000", 2023-01-02T18:18:22.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004 2023-01-02T18:18:22.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.752 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3438 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.032108580999999, 2023-01-02T18:18:22.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158, 2023-01-02T18:18:22.754 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:22.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:22.754 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:22.755 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3438 2023-01-02T18:18:22.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.755 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:22.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:22.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:22.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532948+0000", 2023-01-02T18:18:22.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:18:22.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532956+0000", 2023-01-02T18:18:22.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3448999999999999e-05 2023-01-02T18:18:22.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532969+0000", 2023-01-02T18:18:22.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4170000000000003e-06 2023-01-02T18:18:22.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532977+0000", 2023-01-02T18:18:22.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5679000000000001e-05 2023-01-02T18:18:22.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533023+0000", 2023-01-02T18:18:22.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2023-01-02T18:18:22.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533080+0000", 2023-01-02T18:18:22.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8567999999999997e-05 2023-01-02T18:18:22.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:22.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533159+0000", 2023-01-02T18:18:22.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018926119999999999 2023-01-02T18:18:22.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:22.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535051+0000", 2023-01-02T18:18:22.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088907299999999999 2023-01-02T18:18:22.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:22.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535940+0000", 2023-01-02T18:18:22.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7307e-05 2023-01-02T18:18:22.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535988+0000", 2023-01-02T18:18:22.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5602e-05 2023-01-02T18:18:22.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536013+0000", 2023-01-02T18:18:22.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158 2023-01-02T18:18:22.767 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.768 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.768 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3460 13.1a 13:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e122)", 2023-01-02T18:18:22.769 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:22.769 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.833129448000001, 2023-01-02T18:18:22.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004, 2023-01-02T18:18:22.769 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.769 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.770 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:22.770 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:22.770 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:22.770 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3460 2023-01-02T18:18:22.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.771 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:22.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:22.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:22.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731925+0000", 2023-01-02T18:18:22.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.447e-05 2023-01-02T18:18:22.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731940+0000", 2023-01-02T18:18:22.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4263e-05 2023-01-02T18:18:22.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731954+0000", 2023-01-02T18:18:22.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6684000000000002e-05 2023-01-02T18:18:22.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731971+0000", 2023-01-02T18:18:22.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1316999999999996e-05 2023-01-02T18:18:22.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732032+0000", 2023-01-02T18:18:22.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012202200000000001 2023-01-02T18:18:22.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732154+0000", 2023-01-02T18:18:22.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015345800000000001 2023-01-02T18:18:22.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:22.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732308+0000", 2023-01-02T18:18:22.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003479481 2023-01-02T18:18:22.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:22.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735787+0000", 2023-01-02T18:18:22.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087823000000000003 2023-01-02T18:18:22.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:22.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736665+0000", 2023-01-02T18:18:22.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7332000000000001e-05 2023-01-02T18:18:22.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736703+0000", 2023-01-02T18:18:22.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1186999999999998e-05 2023-01-02T18:18:22.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736734+0000", 2023-01-02T18:18:22.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004 2023-01-02T18:18:22.783 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.783 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.784 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.784 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3493 13.10 e128/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 128'2, mlcod=0'0)", 2023-01-02T18:18:22.784 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:22.784 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.722420307, 2023-01-02T18:18:22.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999, 2023-01-02T18:18:22.785 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.785 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.785 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:22.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:22.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:22.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050436299999999997 2023-01-02T18:18:22.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843141+0000", 2023-01-02T18:18:22.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2051e-05 2023-01-02T18:18:22.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843153+0000", 2023-01-02T18:18:22.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.558e-06 2023-01-02T18:18:22.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843159+0000", 2023-01-02T18:18:22.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1963000000000003e-05 2023-01-02T18:18:22.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843221+0000", 2023-01-02T18:18:22.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6831000000000001e-05 2023-01-02T18:18:22.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843248+0000", 2023-01-02T18:18:22.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024489630000000002 2023-01-02T18:18:22.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845697+0000", 2023-01-02T18:18:22.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3207999999999998e-05 2023-01-02T18:18:22.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845730+0000", 2023-01-02T18:18:22.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999 2023-01-02T18:18:22.795 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.795 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.795 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.796 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3494 13.10 e129/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 129'3, mlcod=127'1)", 2023-01-02T18:18:22.796 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:22.796 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.717890733000001, 2023-01-02T18:18:22.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998, 2023-01-02T18:18:22.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.797 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.797 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:22.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:22.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:22.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:22.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047132700000000001 2023-01-02T18:18:22.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847638+0000", 2023-01-02T18:18:22.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6300999999999999e-05 2023-01-02T18:18:22.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847654+0000", 2023-01-02T18:18:22.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1022999999999999e-05 2023-01-02T18:18:22.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847665+0000", 2023-01-02T18:18:22.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1383999999999994e-05 2023-01-02T18:18:22.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847727+0000", 2023-01-02T18:18:22.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7688999999999999e-05 2023-01-02T18:18:22.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847754+0000", 2023-01-02T18:18:22.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002026501 2023-01-02T18:18:22.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849781+0000", 2023-01-02T18:18:22.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2506999999999997e-05 2023-01-02T18:18:22.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849834+0000", 2023-01-02T18:18:22.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998 2023-01-02T18:18:22.806 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.806 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.807 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.807 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3510 13.10 e135/120 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head v 135'5, mlcod=129'3)", 2023-01-02T18:18:22.807 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:22.808 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.6499657550000002, 2023-01-02T18:18:22.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028970319999999999, 2023-01-02T18:18:22.808 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:22.808 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:22.808 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:22.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:22.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:22.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:22.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:22.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:22.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:22.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:22.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:22.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059833399999999995 2023-01-02T18:18:22.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:22.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915690+0000", 2023-01-02T18:18:22.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2251e-05 2023-01-02T18:18:22.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:22.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915702+0000", 2023-01-02T18:18:22.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0260000000000004e-06 2023-01-02T18:18:22.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:22.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915708+0000", 2023-01-02T18:18:22.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9144000000000002e-05 2023-01-02T18:18:22.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:22.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915767+0000", 2023-01-02T18:18:22.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8093999999999999e-05 2023-01-02T18:18:22.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:22.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915795+0000", 2023-01-02T18:18:22.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021551000000000001 2023-01-02T18:18:22.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:22.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917951+0000", 2023-01-02T18:18:22.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8435e-05 2023-01-02T18:18:22.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:22.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:22.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:22.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917989+0000", 2023-01-02T18:18:22.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028970319999999999 2023-01-02T18:18:22.818 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.818 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.818 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.819 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:22.819 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:22.819 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:22.821 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:22.821 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:22.822 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:22.822 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:22.822 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:22.822 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:22.822 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.823 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:22.823 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.823 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.823 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:22.823 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.824 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:22.824 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.824 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.824 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:22.824 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.825 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:22.825 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.825 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.825 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:22.825 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.831 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:22.832 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.832 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.832 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:22.832 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.832 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:22.833 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.833 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.833 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:22.833 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:22.833 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:22.834 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:22.834 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:22.834 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:22.834 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:22.834 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:22.835 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:22.835 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:22.835 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:22.835 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.835 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:22.835 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.836 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.836 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:22.836 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.836 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:22.836 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.837 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.837 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:22.837 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.837 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:22.838 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.838 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.838 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:22.838 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.838 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:22.838 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.839 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.839 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:22.839 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.839 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:22.839 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.840 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.840 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:22.840 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.840 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.840 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.841 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.841 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.841 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.841 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:22.841 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:22.842 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:22.842 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.842 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:22.842 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:22.842 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:22.842 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.843 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:22.843 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:22.843 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:22.843 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.843 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:22.844 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:22.844 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:22.844 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.844 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:22.844 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:22.845 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:22.845 INFO:tasks.workunit.client.0.smithi007.stdout:discard: 512~512 = 512 2023-01-02T18:18:22.845 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.845 INFO:tasks.workunit.client.0.smithi007.stdout:aio discard: 1536~512 = 0 2023-01-02T18:18:22.845 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.846 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.846 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.846 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.846 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:22.846 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:22.846 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.847 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.847 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:22.847 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.847 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.847 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:22.847 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.848 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.848 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:22.848 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.848 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.848 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.849 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.849 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:22.849 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.849 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.849 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:22.850 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.850 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.850 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:22.850 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.850 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.851 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:22.851 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.851 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.851 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.851 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.851 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:22.852 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.852 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.852 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:22.852 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.852 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.853 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:22.853 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.853 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.853 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:22.853 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.854 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.854 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.854 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.854 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:22.854 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.854 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.855 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:22.855 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.855 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.855 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:22.855 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.856 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.856 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:22.856 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.856 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.856 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.857 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.857 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:22.857 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.857 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.857 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:22.858 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.858 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.858 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:22.858 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.858 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.859 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:22.859 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.859 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.859 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.859 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.859 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.860 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:22.860 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.860 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.860 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:22.860 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.861 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.861 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.861 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:22.861 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.861 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.862 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:22.862 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.862 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.862 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.862 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:22.862 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.863 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.863 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:22.863 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.863 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.863 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.864 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:22.864 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.864 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.864 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:22.864 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.865 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.865 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.865 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:22.865 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.865 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.866 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:22.866 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:22.866 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.866 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:22.866 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.866 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.867 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:22.867 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.867 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.867 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.867 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:22.868 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:22.868 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:22.868 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:22.868 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:22.868 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:22.869 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:22.869 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:22.821+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:22.921 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:22.921+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:23.000 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:23.000 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:23.000 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:23.001 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:23.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:23.051 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:23.051+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:23.123 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:23.123+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:23.179 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:23.180 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:23.180 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:23.180 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:23.180 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:23.192 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:23.238 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:23.238+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:23.323 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:23.323 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:23.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:23.324 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:23.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.324 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:12 3.1e 3:7d975153:::rbd_object_map.12a2b7720443:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:23.324 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:23.325 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 103.88643475799999, 2023-01-02T18:18:23.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378, 2023-01-02T18:18:23.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.326 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.326 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 12 2023-01-02T18:18:23.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.327 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:23.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435849+0000", 2023-01-02T18:18:23.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435847+0000", 2023-01-02T18:18:23.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9129999999999997e-06 2023-01-02T18:18:23.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435854+0000", 2023-01-02T18:18:23.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5639999999999999e-05 2023-01-02T18:18:23.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435870+0000", 2023-01-02T18:18:23.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5750000000000003e-06 2023-01-02T18:18:23.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435877+0000", 2023-01-02T18:18:23.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0114999999999997e-05 2023-01-02T18:18:23.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435927+0000", 2023-01-02T18:18:23.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6370000000000004e-06 2023-01-02T18:18:23.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435933+0000", 2023-01-02T18:18:23.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017851270000000001 2023-01-02T18:18:23.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437718+0000", 2023-01-02T18:18:23.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000140927 2023-01-02T18:18:23.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.437859+0000", 2023-01-02T18:18:23.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023343800000000001 2023-01-02T18:18:23.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.438092+0000", 2023-01-02T18:18:23.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011181609999999999 2023-01-02T18:18:23.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439211+0000", 2023-01-02T18:18:23.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00046552399999999998 2023-01-02T18:18:23.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439676+0000", 2023-01-02T18:18:23.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9768e-05 2023-01-02T18:18:23.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439706+0000", 2023-01-02T18:18:23.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0463000000000002e-05 2023-01-02T18:18:23.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.439746+0000", 2023-01-02T18:18:23.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003897378 2023-01-02T18:18:23.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.341 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.341 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.342 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:369 7.1c 7:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:18:23.342 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:23.342 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.012894649000003, 2023-01-02T18:18:23.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998, 2023-01-02T18:18:23.343 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.343 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.343 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.343 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:23.344 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:23.344 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 369 2023-01-02T18:18:23.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.344 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:23.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309389+0000", 2023-01-02T18:18:23.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309387+0000", 2023-01-02T18:18:23.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2335e-05 2023-01-02T18:18:23.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309400+0000", 2023-01-02T18:18:23.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3827e-05 2023-01-02T18:18:23.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309413+0000", 2023-01-02T18:18:23.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9320000000000002e-06 2023-01-02T18:18:23.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309422+0000", 2023-01-02T18:18:23.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3378999999999999e-05 2023-01-02T18:18:23.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309466+0000", 2023-01-02T18:18:23.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8289999999999998e-06 2023-01-02T18:18:23.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.309471+0000", 2023-01-02T18:18:23.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037946780000000001 2023-01-02T18:18:23.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313265+0000", 2023-01-02T18:18:23.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1385999999999996e-05 2023-01-02T18:18:23.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313347+0000", 2023-01-02T18:18:23.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013567399999999999 2023-01-02T18:18:23.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:23.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.313482+0000", 2023-01-02T18:18:23.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001181283 2023-01-02T18:18:23.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314664+0000", 2023-01-02T18:18:23.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029934200000000002 2023-01-02T18:18:23.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.314963+0000", 2023-01-02T18:18:23.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7651000000000002e-05 2023-01-02T18:18:23.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315011+0000", 2023-01-02T18:18:23.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1569999999999997e-05 2023-01-02T18:18:23.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315052+0000", 2023-01-02T18:18:23.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056631809999999998 2023-01-02T18:18:23.359 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.359 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.359 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.359 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2134 8.18 8:1ebc1321:::rbd_id.image31:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:18:23.360 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:23.360 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.706934693999997, 2023-01-02T18:18:23.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171, 2023-01-02T18:18:23.360 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.360 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.361 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.361 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.361 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.361 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2134 2023-01-02T18:18:23.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.362 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:23.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615349+0000", 2023-01-02T18:18:23.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:23.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615347+0000", 2023-01-02T18:18:23.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8219999999999996e-06 2023-01-02T18:18:23.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615356+0000", 2023-01-02T18:18:23.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4824000000000001e-05 2023-01-02T18:18:23.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615371+0000", 2023-01-02T18:18:23.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7860000000000002e-06 2023-01-02T18:18:23.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615377+0000", 2023-01-02T18:18:23.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6175999999999999e-05 2023-01-02T18:18:23.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615433+0000", 2023-01-02T18:18:23.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5227e-05 2023-01-02T18:18:23.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.615448+0000", 2023-01-02T18:18:23.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002459494 2023-01-02T18:18:23.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.617908+0000", 2023-01-02T18:18:23.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119478 2023-01-02T18:18:23.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618027+0000", 2023-01-02T18:18:23.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000212623 2023-01-02T18:18:23.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:23.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618240+0000", 2023-01-02T18:18:23.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061660600000000001 2023-01-02T18:18:23.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.618856+0000", 2023-01-02T18:18:23.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042596799999999998 2023-01-02T18:18:23.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619282+0000", 2023-01-02T18:18:23.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0744000000000001e-05 2023-01-02T18:18:23.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619333+0000", 2023-01-02T18:18:23.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0045e-05 2023-01-02T18:18:23.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.619373+0000", 2023-01-02T18:18:23.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004024171 2023-01-02T18:18:23.376 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.376 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.376 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.377 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2487 8.b 8:d4469778:::rbd_object_map.12a2b157d0cc.0000000000000007:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e72)", 2023-01-02T18:18:23.377 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:23.377 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 77.992462880000005, 2023-01-02T18:18:23.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002, 2023-01-02T18:18:23.378 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.378 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.378 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.378 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.378 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.379 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2487 2023-01-02T18:18:23.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.379 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:23.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329821+0000", 2023-01-02T18:18:23.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:23.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329818+0000", 2023-01-02T18:18:23.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3439e-05 2023-01-02T18:18:23.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329832+0000", 2023-01-02T18:18:23.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3363999999999999e-05 2023-01-02T18:18:23.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329855+0000", 2023-01-02T18:18:23.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8750000000000006e-06 2023-01-02T18:18:23.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329864+0000", 2023-01-02T18:18:23.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1450999999999999e-05 2023-01-02T18:18:23.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329915+0000", 2023-01-02T18:18:23.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7079999999999997e-06 2023-01-02T18:18:23.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.329923+0000", 2023-01-02T18:18:23.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030976179999999999 2023-01-02T18:18:23.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333021+0000", 2023-01-02T18:18:23.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014489 2023-01-02T18:18:23.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333166+0000", 2023-01-02T18:18:23.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020885700000000001 2023-01-02T18:18:23.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:23.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.333374+0000", 2023-01-02T18:18:23.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00071352600000000003 2023-01-02T18:18:23.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334088+0000", 2023-01-02T18:18:23.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042932700000000002 2023-01-02T18:18:23.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334517+0000", 2023-01-02T18:18:23.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0092000000000001e-05 2023-01-02T18:18:23.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334567+0000", 2023-01-02T18:18:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0200000000000001e-05 2023-01-02T18:18:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:05.334608+0000", 2023-01-02T18:18:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047867550000000002 2023-01-02T18:18:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.393 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1190 9.1 9:84874ab6:::image34.rbd:head [stat] snapc 0=[] ondisk+read+known_if_redirected e74)", 2023-01-02T18:18:23.394 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.983361478999996, 2023-01-02T18:18:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998, 2023-01-02T18:18:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:18:23.395 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1190 2023-01-02T18:18:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338922+0000", 2023-01-02T18:18:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338920+0000", 2023-01-02T18:18:23.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7040000000000006e-06 2023-01-02T18:18:23.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338930+0000", 2023-01-02T18:18:23.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4126e-05 2023-01-02T18:18:23.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338944+0000", 2023-01-02T18:18:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5024e-05 2023-01-02T18:18:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.338959+0000", 2023-01-02T18:18:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1804999999999994e-05 2023-01-02T18:18:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339031+0000", 2023-01-02T18:18:23.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9300000000000003e-06 2023-01-02T18:18:23.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:18:23.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.339039+0000", 2023-01-02T18:18:23.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0074253519999999996 2023-01-02T18:18:23.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346464+0000", 2023-01-02T18:18:23.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101228 2023-01-02T18:18:23.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:07.346565+0000", 2023-01-02T18:18:23.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076433209999999998 2023-01-02T18:18:23.406 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.406 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.406 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.407 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2642 3.b 3:d587efcd:::rbd_object_map.12a23fc13ef0:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e77)", 2023-01-02T18:18:23.407 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:23.407 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.712005187000003, 2023-01-02T18:18:23.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003, 2023-01-02T18:18:23.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.408 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:23.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.408 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.408 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2642 2023-01-02T18:18:23.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.409 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:23.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610278+0000", 2023-01-02T18:18:23.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:23.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610276+0000", 2023-01-02T18:18:23.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0939e-05 2023-01-02T18:18:23.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610287+0000", 2023-01-02T18:18:23.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9046999999999999e-05 2023-01-02T18:18:23.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610306+0000", 2023-01-02T18:18:23.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3990000000000001e-06 2023-01-02T18:18:23.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610312+0000", 2023-01-02T18:18:23.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2379999999999996e-05 2023-01-02T18:18:23.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610375+0000", 2023-01-02T18:18:23.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9369999999999993e-06 2023-01-02T18:18:23.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.610384+0000", 2023-01-02T18:18:23.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039628490000000001 2023-01-02T18:18:23.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614347+0000", 2023-01-02T18:18:23.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6799000000000006e-05 2023-01-02T18:18:23.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614443+0000", 2023-01-02T18:18:23.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000128498 2023-01-02T18:18:23.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:10.614572+0000", 2023-01-02T18:18:23.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042934590000000003 2023-01-02T18:18:23.419 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.420 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.420 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.420 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2766 3.2 3:4585a139:::rbd_object_map.12a27d57f136.0000000000000009:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:23.421 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:23.421 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.994635862999999, 2023-01-02T18:18:23.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999, 2023-01-02T18:18:23.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.421 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.422 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.422 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.422 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.422 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2766 2023-01-02T18:18:23.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.423 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:23.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327648+0000", 2023-01-02T18:18:23.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:23.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327645+0000", 2023-01-02T18:18:23.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3966e-05 2023-01-02T18:18:23.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327659+0000", 2023-01-02T18:18:23.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3504000000000001e-05 2023-01-02T18:18:23.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327682+0000", 2023-01-02T18:18:23.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1352000000000001e-05 2023-01-02T18:18:23.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327694+0000", 2023-01-02T18:18:23.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6397999999999999e-05 2023-01-02T18:18:23.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327740+0000", 2023-01-02T18:18:23.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7799999999999997e-06 2023-01-02T18:18:23.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.327746+0000", 2023-01-02T18:18:23.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039313610000000004 2023-01-02T18:18:23.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331677+0000", 2023-01-02T18:18:23.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015033399999999999 2023-01-02T18:18:23.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331828+0000", 2023-01-02T18:18:23.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000106103 2023-01-02T18:18:23.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.331934+0000", 2023-01-02T18:18:23.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00161152 2023-01-02T18:18:23.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333545+0000", 2023-01-02T18:18:23.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9345999999999999e-05 2023-01-02T18:18:23.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333585+0000", 2023-01-02T18:18:23.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4221999999999997e-05 2023-01-02T18:18:23.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333639+0000", 2023-01-02T18:18:23.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1669999999999999e-05 2023-01-02T18:18:23.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.333680+0000", 2023-01-02T18:18:23.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0060326989999999999 2023-01-02T18:18:23.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.437 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.438 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.438 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2207 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:23.438 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.967899621000001, 2023-01-02T18:18:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004, 2023-01-02T18:18:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.439 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:23.440 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:23.440 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2207 2023-01-02T18:18:23.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.440 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354384+0000", 2023-01-02T18:18:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354381+0000", 2023-01-02T18:18:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8153999999999999e-05 2023-01-02T18:18:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354399+0000", 2023-01-02T18:18:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5462000000000001e-05 2023-01-02T18:18:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354424+0000", 2023-01-02T18:18:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.471e-05 2023-01-02T18:18:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354439+0000", 2023-01-02T18:18:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000135229 2023-01-02T18:18:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354574+0000", 2023-01-02T18:18:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.043e-05 2023-01-02T18:18:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.354585+0000", 2023-01-02T18:18:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041787639999999997 2023-01-02T18:18:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358763+0000", 2023-01-02T18:18:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105993 2023-01-02T18:18:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.358869+0000", 2023-01-02T18:18:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042074499999999998 2023-01-02T18:18:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359290+0000", 2023-01-02T18:18:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00065798500000000004 2023-01-02T18:18:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.359948+0000", 2023-01-02T18:18:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052364299999999996 2023-01-02T18:18:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360472+0000", 2023-01-02T18:18:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9982999999999998e-05 2023-01-02T18:18:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360532+0000", 2023-01-02T18:18:23.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2775000000000002e-05 2023-01-02T18:18:23.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.360585+0000", 2023-01-02T18:18:23.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0062005970000000004 2023-01-02T18:18:23.455 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.455 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.455 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.456 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2224 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:23.456 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:23.456 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.967852024999999, 2023-01-02T18:18:23.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996, 2023-01-02T18:18:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:23.457 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:23.458 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2224 2023-01-02T18:18:23.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.458 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354432+0000", 2023-01-02T18:18:23.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:23.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354428+0000", 2023-01-02T18:18:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9915000000000002e-05 2023-01-02T18:18:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354448+0000", 2023-01-02T18:18:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4433000000000001e-05 2023-01-02T18:18:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354473+0000", 2023-01-02T18:18:23.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9920000000000002e-06 2023-01-02T18:18:23.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354483+0000", 2023-01-02T18:18:23.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00039695900000000001 2023-01-02T18:18:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354880+0000", 2023-01-02T18:18:23.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6689999999999995e-06 2023-01-02T18:18:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.354888+0000", 2023-01-02T18:18:23.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0044200339999999998 2023-01-02T18:18:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359308+0000", 2023-01-02T18:18:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000101535 2023-01-02T18:18:23.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359410+0000", 2023-01-02T18:18:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042670799999999998 2023-01-02T18:18:23.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.359837+0000", 2023-01-02T18:18:23.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013693869999999999 2023-01-02T18:18:23.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361206+0000", 2023-01-02T18:18:23.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077495400000000001 2023-01-02T18:18:23.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.361981+0000", 2023-01-02T18:18:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5219000000000001e-05 2023-01-02T18:18:23.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362036+0000", 2023-01-02T18:18:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5148000000000002e-05 2023-01-02T18:18:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:22.362081+0000", 2023-01-02T18:18:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076496029999999996 2023-01-02T18:18:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.472 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2274 3.1e 3:7c248dbe:::rbd_header.11d5ac377738:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e92)", 2023-01-02T18:18:23.473 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.004782939000002, 2023-01-02T18:18:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004, 2023-01-02T18:18:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.474 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2274 2023-01-02T18:18:23.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:23.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317501+0000", 2023-01-02T18:18:23.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317499+0000", 2023-01-02T18:18:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2490000000000007e-06 2023-01-02T18:18:23.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317508+0000", 2023-01-02T18:18:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8910000000000007e-06 2023-01-02T18:18:23.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317518+0000", 2023-01-02T18:18:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7060000000000001e-06 2023-01-02T18:18:23.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317523+0000", 2023-01-02T18:18:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5518000000000001e-05 2023-01-02T18:18:23.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317559+0000", 2023-01-02T18:18:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5199999999999999e-06 2023-01-02T18:18:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.317563+0000", 2023-01-02T18:18:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017502279999999999 2023-01-02T18:18:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319314+0000", 2023-01-02T18:18:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4537999999999998e-05 2023-01-02T18:18:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319378+0000", 2023-01-02T18:18:23.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028489500000000002 2023-01-02T18:18:23.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.319663+0000", 2023-01-02T18:18:23.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00072102899999999998 2023-01-02T18:18:23.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.320384+0000", 2023-01-02T18:18:23.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0009840300000000001 2023-01-02T18:18:23.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321368+0000", 2023-01-02T18:18:23.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2605e-05 2023-01-02T18:18:23.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321441+0000", 2023-01-02T18:18:23.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2042999999999997e-05 2023-01-02T18:18:23.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.321483+0000", 2023-01-02T18:18:23.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039820740000000004 2023-01-02T18:18:23.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.490 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.491 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2820 10.1b 10:db3f43d9:::rbd_id.image45:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:23.491 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:23.491 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.988676675999997, 2023-01-02T18:18:23.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999, 2023-01-02T18:18:23.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.492 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.492 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.492 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2820 2023-01-02T18:18:23.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.493 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:23.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333607+0000", 2023-01-02T18:18:23.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333605+0000", 2023-01-02T18:18:23.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0101999999999999e-05 2023-01-02T18:18:23.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333615+0000", 2023-01-02T18:18:23.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7289999999999999e-05 2023-01-02T18:18:23.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333632+0000", 2023-01-02T18:18:23.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5730000000000008e-06 2023-01-02T18:18:23.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333641+0000", 2023-01-02T18:18:23.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2868999999999998e-05 2023-01-02T18:18:23.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333694+0000", 2023-01-02T18:18:23.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.17e-06 2023-01-02T18:18:23.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:23.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.333701+0000", 2023-01-02T18:18:23.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036938079999999998 2023-01-02T18:18:23.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337395+0000", 2023-01-02T18:18:23.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013915999999999999 2023-01-02T18:18:23.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337534+0000", 2023-01-02T18:18:23.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022073199999999999 2023-01-02T18:18:23.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:23.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337755+0000", 2023-01-02T18:18:23.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0088278690000000003 2023-01-02T18:18:23.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346583+0000", 2023-01-02T18:18:23.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5449000000000001e-05 2023-01-02T18:18:23.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346598+0000", 2023-01-02T18:18:23.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2741999999999998e-05 2023-01-02T18:18:23.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346641+0000", 2023-01-02T18:18:23.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9359e-05 2023-01-02T18:18:23.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346680+0000", 2023-01-02T18:18:23.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.013073197999999999 2023-01-02T18:18:23.507 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.507 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.508 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2823 10.15 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:23.508 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:23.508 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.983354491999997, 2023-01-02T18:18:23.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004, 2023-01-02T18:18:23.509 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.509 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.509 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.509 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.510 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.510 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2823 2023-01-02T18:18:23.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.510 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:23.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338929+0000", 2023-01-02T18:18:23.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338927+0000", 2023-01-02T18:18:23.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6740000000000003e-06 2023-01-02T18:18:23.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338936+0000", 2023-01-02T18:18:23.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0991e-05 2023-01-02T18:18:23.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338947+0000", 2023-01-02T18:18:23.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6209999999999998e-06 2023-01-02T18:18:23.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.338954+0000", 2023-01-02T18:18:23.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000119147 2023-01-02T18:18:23.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339073+0000", 2023-01-02T18:18:23.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000111038 2023-01-02T18:18:23.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339184+0000", 2023-01-02T18:18:23.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022849 2023-01-02T18:18:23.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:23.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.339412+0000", 2023-01-02T18:18:23.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0067156669999999998 2023-01-02T18:18:23.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346128+0000", 2023-01-02T18:18:23.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000362846 2023-01-02T18:18:23.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346491+0000", 2023-01-02T18:18:23.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4206999999999998e-05 2023-01-02T18:18:23.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346545+0000", 2023-01-02T18:18:23.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4110999999999997e-05 2023-01-02T18:18:23.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346599+0000", 2023-01-02T18:18:23.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076700350000000004 2023-01-02T18:18:23.532 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.533 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.533 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.534 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop_reply(client.4770.0:2823 10.15 e101/98 ondisk, result = 0)", 2023-01-02T18:18:23.535 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:23.535 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.979801426999998, 2023-01-02T18:18:23.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999, 2023-01-02T18:18:23.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:23.537 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.537 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:23.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342482+0000", 2023-01-02T18:18:23.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:23.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342481+0000", 2023-01-02T18:18:23.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7340000000000002e-06 2023-01-02T18:18:23.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342488+0000", 2023-01-02T18:18:23.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5e-05 2023-01-02T18:18:23.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342503+0000", 2023-01-02T18:18:23.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0879999999999997e-06 2023-01-02T18:18:23.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.342510+0000", 2023-01-02T18:18:23.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029176789999999998 2023-01-02T18:18:23.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.345428+0000", 2023-01-02T18:18:23.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00069087300000000005 2023-01-02T18:18:23.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346119+0000", 2023-01-02T18:18:23.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2848e-05 2023-01-02T18:18:23.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346131+0000", 2023-01-02T18:18:23.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036492759999999999 2023-01-02T18:18:23.547 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.547 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.548 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.548 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2824 10.17 10:ef0a2752:::rbd_header.12a2779686d1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:23.548 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:23.549 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.978169383000001, 2023-01-02T18:18:23.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999, 2023-01-02T18:18:23.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.549 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.549 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.550 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.550 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.550 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2824 2023-01-02T18:18:23.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.551 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.551 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:23.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344114+0000", 2023-01-02T18:18:23.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344112+0000", 2023-01-02T18:18:23.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4269999999999997e-06 2023-01-02T18:18:23.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344122+0000", 2023-01-02T18:18:23.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2082999999999999e-05 2023-01-02T18:18:23.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344134+0000", 2023-01-02T18:18:23.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.832e-06 2023-01-02T18:18:23.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344141+0000", 2023-01-02T18:18:23.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2114999999999998e-05 2023-01-02T18:18:23.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344193+0000", 2023-01-02T18:18:23.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000127162 2023-01-02T18:18:23.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344320+0000", 2023-01-02T18:18:23.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024456199999999998 2023-01-02T18:18:23.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.344565+0000", 2023-01-02T18:18:23.565 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023649029999999998 2023-01-02T18:18:23.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.346929+0000", 2023-01-02T18:18:23.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016233339999999999 2023-01-02T18:18:23.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348553+0000", 2023-01-02T18:18:23.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9367000000000003e-05 2023-01-02T18:18:23.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348612+0000", 2023-01-02T18:18:23.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0141000000000001e-05 2023-01-02T18:18:23.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348652+0000", 2023-01-02T18:18:23.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045379959999999999 2023-01-02T18:18:23.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.569 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.570 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3326 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:23.570 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:23.570 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.977975806000003, 2023-01-02T18:18:23.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004, 2023-01-02T18:18:23.571 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.571 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.571 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.571 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.572 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.572 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3326 2023-01-02T18:18:23.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.572 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:23.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344308+0000", 2023-01-02T18:18:23.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:23.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344306+0000", 2023-01-02T18:18:23.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1659999999999997e-06 2023-01-02T18:18:23.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.578 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344313+0000", 2023-01-02T18:18:23.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1593000000000001e-05 2023-01-02T18:18:23.579 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344325+0000", 2023-01-02T18:18:23.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5989999999999996e-06 2023-01-02T18:18:23.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344333+0000", 2023-01-02T18:18:23.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0806000000000001e-05 2023-01-02T18:18:23.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344383+0000", 2023-01-02T18:18:23.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016516 2023-01-02T18:18:23.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.344549+0000", 2023-01-02T18:18:23.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00057431500000000005 2023-01-02T18:18:23.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.345123+0000", 2023-01-02T18:18:23.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031925769999999998 2023-01-02T18:18:23.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.348315+0000", 2023-01-02T18:18:23.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00094989399999999996 2023-01-02T18:18:23.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349265+0000", 2023-01-02T18:18:23.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.512e-05 2023-01-02T18:18:23.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349330+0000", 2023-01-02T18:18:23.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7114999999999999e-05 2023-01-02T18:18:23.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.589 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:39.349378+0000", 2023-01-02T18:18:23.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0050697650000000004 2023-01-02T18:18:23.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.590 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.590 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.591 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:23.591 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:23.591 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.972559926000002, 2023-01-02T18:18:23.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998, 2023-01-02T18:18:23.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.592 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:23.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.593 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:23.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349724+0000", 2023-01-02T18:18:23.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349722+0000", 2023-01-02T18:18:23.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2350000000000002e-06 2023-01-02T18:18:23.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349729+0000", 2023-01-02T18:18:23.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2243e-05 2023-01-02T18:18:23.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349741+0000", 2023-01-02T18:18:23.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7089999999999999e-06 2023-01-02T18:18:23.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349747+0000", 2023-01-02T18:18:23.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6380000000000001e-05 2023-01-02T18:18:23.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349783+0000", 2023-01-02T18:18:23.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9949000000000002e-05 2023-01-02T18:18:23.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.349873+0000", 2023-01-02T18:18:23.601 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040596099999999998 2023-01-02T18:18:23.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:23.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026994279999999998 2023-01-02T18:18:23.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352979+0000", 2023-01-02T18:18:23.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029797489999999999 2023-01-02T18:18:23.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355958+0000", 2023-01-02T18:18:23.604 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1276999999999999e-05 2023-01-02T18:18:23.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.605 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.605 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355990+0000", 2023-01-02T18:18:23.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.698e-05 2023-01-02T18:18:23.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.356047+0000", 2023-01-02T18:18:23.606 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063230309999999998 2023-01-02T18:18:23.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.607 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.607 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.608 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3327 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:23.608 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:23.608 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.972020196999999, 2023-01-02T18:18:23.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997, 2023-01-02T18:18:23.609 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.609 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "delayed", 2023-01-02T18:18:23.609 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.609 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.609 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.610 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3327 2023-01-02T18:18:23.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.610 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:23.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350263+0000", 2023-01-02T18:18:23.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:23.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350262+0000", 2023-01-02T18:18:23.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2700000000000001e-06 2023-01-02T18:18:23.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350269+0000", 2023-01-02T18:18:23.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0692e-05 2023-01-02T18:18:23.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350279+0000", 2023-01-02T18:18:23.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3300000000000001e-06 2023-01-02T18:18:23.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.350287+0000", 2023-01-02T18:18:23.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002022589 2023-01-02T18:18:23.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352309+0000", 2023-01-02T18:18:23.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4941000000000002e-05 2023-01-02T18:18:23.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.620 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for ondisk", 2023-01-02T18:18:23.620 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.352354+0000", 2023-01-02T18:18:23.620 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036448940000000001 2023-01-02T18:18:23.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.621 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.621 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:40.355999+0000", 2023-01-02T18:18:23.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0057356079999999997 2023-01-02T18:18:23.622 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.622 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.622 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.623 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3329 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:23.623 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:23.623 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.966004904999998, 2023-01-02T18:18:23.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997, 2023-01-02T18:18:23.624 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.624 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.625 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.625 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.625 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3329 2023-01-02T18:18:23.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.626 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:23.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356279+0000", 2023-01-02T18:18:23.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:23.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356276+0000", 2023-01-02T18:18:23.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7804000000000001e-05 2023-01-02T18:18:23.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356294+0000", 2023-01-02T18:18:23.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8663999999999999e-05 2023-01-02T18:18:23.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356323+0000", 2023-01-02T18:18:23.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2112e-05 2023-01-02T18:18:23.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356335+0000", 2023-01-02T18:18:23.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4226000000000005e-05 2023-01-02T18:18:23.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356399+0000", 2023-01-02T18:18:23.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0001529 2023-01-02T18:18:23.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.356552+0000", 2023-01-02T18:18:23.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00052206300000000002 2023-01-02T18:18:23.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.357074+0000", 2023-01-02T18:18:23.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030254829999999998 2023-01-02T18:18:23.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.360100+0000", 2023-01-02T18:18:23.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017414259999999999 2023-01-02T18:18:23.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361841+0000", 2023-01-02T18:18:23.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6987000000000001e-05 2023-01-02T18:18:23.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361908+0000", 2023-01-02T18:18:23.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.397e-05 2023-01-02T18:18:23.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:41.361962+0000", 2023-01-02T18:18:23.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0056831959999999997 2023-01-02T18:18:23.640 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.640 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.640 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.641 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3435 11.9 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:23.641 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:23.641 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.789358515, 2023-01-02T18:18:23.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001, 2023-01-02T18:18:23.642 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.642 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.643 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.643 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.643 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.644 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3435 2023-01-02T18:18:23.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.644 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:23.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532925+0000", 2023-01-02T18:18:23.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532923+0000", 2023-01-02T18:18:23.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1790000000000008e-06 2023-01-02T18:18:23.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532931+0000", 2023-01-02T18:18:23.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.45e-05 2023-01-02T18:18:23.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532946+0000", 2023-01-02T18:18:23.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532952+0000", 2023-01-02T18:18:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6125999999999999e-05 2023-01-02T18:18:23.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532988+0000", 2023-01-02T18:18:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3418999999999998e-05 2023-01-02T18:18:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533041+0000", 2023-01-02T18:18:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6446999999999994e-05 2023-01-02T18:18:23.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:23.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533128+0000", 2023-01-02T18:18:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025771280000000001 2023-01-02T18:18:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535705+0000", 2023-01-02T18:18:23.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012653530000000001 2023-01-02T18:18:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536970+0000", 2023-01-02T18:18:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0913e-05 2023-01-02T18:18:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537001+0000", 2023-01-02T18:18:23.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.444e-05 2023-01-02T18:18:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.537025+0000", 2023-01-02T18:18:23.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041003580000000001 2023-01-02T18:18:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3454 12.1a 12:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e121)", 2023-01-02T18:18:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.592257321999998, 2023-01-02T18:18:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999, 2023-01-02T18:18:23.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:23.667 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:23.667 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:23.667 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:23.668 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:23.668 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3454 2023-01-02T18:18:23.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.668 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:23.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:23.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:23.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:23.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:23.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730026+0000", 2023-01-02T18:18:23.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:23.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:23.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730024+0000", 2023-01-02T18:18:23.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0990000000000005e-06 2023-01-02T18:18:23.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:23.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730034+0000", 2023-01-02T18:18:23.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6657e-05 2023-01-02T18:18:23.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:23.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730050+0000", 2023-01-02T18:18:23.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4959999999999996e-06 2023-01-02T18:18:23.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:23.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730059+0000", 2023-01-02T18:18:23.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1004999999999997e-05 2023-01-02T18:18:23.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:23.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730110+0000", 2023-01-02T18:18:23.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000144909 2023-01-02T18:18:23.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:23.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730255+0000", 2023-01-02T18:18:23.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018625 2023-01-02T18:18:23.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:23.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.730441+0000", 2023-01-02T18:18:23.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001313771 2023-01-02T18:18:23.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:23.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.731755+0000", 2023-01-02T18:18:23.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0084210629999999995 2023-01-02T18:18:23.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:23.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740176+0000", 2023-01-02T18:18:23.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4363000000000001e-05 2023-01-02T18:18:23.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:23.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740230+0000", 2023-01-02T18:18:23.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0450000000000001e-05 2023-01-02T18:18:23.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:23.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:23.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:23.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:58.740271+0000", 2023-01-02T18:18:23.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010244224999999999 2023-01-02T18:18:23.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.682 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.683 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:23.683 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:23.683 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:23.684 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:23.685 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:23.685+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:23.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:23.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:18:23.746 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 5, 4] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:23.746 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:23.747 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-01-02T18:18:23.747 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-01-02T18:18:23.813 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:23.813+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:23.825 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:23.825 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:23.825 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:23.825 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:23.836 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:23.879 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:23.887 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:23.887+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:23.899 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:23.934 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:23.955 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:23.973 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:23.977 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:23.977 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:23.988 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:23.989 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:23.988+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:23.990 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:24.009 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:24.028 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:24.029 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:24.030 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:24.031 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:24.089 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:24.089+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:24.104 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:18:24.104 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:24.105 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 137, 2023-01-02T18:18:24.105 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "4e320929-c4bb-4ea9-9e1c-d8479b7e40b1", 2023-01-02T18:18:24.105 INFO:teuthology.orchestra.run.smithi007.stdout: "created": "2023-01-02T18:15:29.542145+0000", 2023-01-02T18:18:24.105 INFO:teuthology.orchestra.run.smithi007.stdout: "modified": "2023-01-02T18:18:21.664740+0000", 2023-01-02T18:18:24.106 INFO:teuthology.orchestra.run.smithi007.stdout: "last_up_change": "2023-01-02T18:15:38.537792+0000", 2023-01-02T18:18:24.106 INFO:teuthology.orchestra.run.smithi007.stdout: "last_in_change": "2023-01-02T18:18:13.365363+0000", 2023-01-02T18:18:24.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-01-02T18:18:24.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_num": 5804032, 2023-01-02T18:18:24.106 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_set": [ 2023-01-02T18:18:24.107 INFO:teuthology.orchestra.run.smithi007.stdout: "nodeep-scrub", 2023-01-02T18:18:24.107 INFO:teuthology.orchestra.run.smithi007.stdout: "pglog_hardlimit", 2023-01-02T18:18:24.107 INFO:teuthology.orchestra.run.smithi007.stdout: "purged_snapdirs", 2023-01-02T18:18:24.108 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_deletes", 2023-01-02T18:18:24.108 INFO:teuthology.orchestra.run.smithi007.stdout: "sortbitwise" 2023-01-02T18:18:24.108 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:24.108 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_version": 4, 2023-01-02T18:18:24.108 INFO:teuthology.orchestra.run.smithi007.stdout: "full_ratio": 0.94999998807907104, 2023-01-02T18:18:24.109 INFO:teuthology.orchestra.run.smithi007.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-01-02T18:18:24.109 INFO:teuthology.orchestra.run.smithi007.stdout: "nearfull_ratio": 0.85000002384185791, 2023-01-02T18:18:24.109 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_snapshot": "", 2023-01-02T18:18:24.109 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_max": 13, 2023-01-02T18:18:24.110 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd": 8, 2023-01-02T18:18:24.110 INFO:teuthology.orchestra.run.smithi007.stdout: "require_min_compat_client": "luminous", 2023-01-02T18:18:24.110 INFO:teuthology.orchestra.run.smithi007.stdout: "min_compat_client": "luminous", 2023-01-02T18:18:24.110 INFO:teuthology.orchestra.run.smithi007.stdout: "require_osd_release": "pacific", 2023-01-02T18:18:24.111 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": [ 2023-01-02T18:18:24.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.111 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 1, 2023-01-02T18:18:24.111 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "device_health_metrics", 2023-01-02T18:18:24.111 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:38.598445+0000", 2023-01-02T18:18:24.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:18:24.112 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:18:24.112 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.112 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.113 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.113 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.113 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.113 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.114 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.114 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.114 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.114 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.114 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 1, 2023-01-02T18:18:24.115 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 1, 2023-01-02T18:18:24.115 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 1, 2023-01-02T18:18:24.115 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 1, 2023-01-02T18:18:24.115 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 1, 2023-01-02T18:18:24.115 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.116 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.116 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.116 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.116 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.117 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.117 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.117 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "16", 2023-01-02T18:18:24.118 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.118 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.118 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.118 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.118 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.119 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:18:24.119 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:18:24.119 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.119 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.120 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.120 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.120 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.120 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.120 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.121 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.121 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.121 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.121 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.122 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.122 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.122 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.122 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.122 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.123 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.123 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.123 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.124 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.124 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.124 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.124 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.124 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.125 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.125 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.125 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.125 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.125 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.126 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-01-02T18:18:24.126 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_max": 32, 2023-01-02T18:18:24.126 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 1 2023-01-02T18:18:24.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.127 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.127 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_devicehealth": {} 2023-01-02T18:18:24.127 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.128 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 2, 2023-01-02T18:18:24.128 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "rbd", 2023-01-02T18:18:24.128 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:40.853543+0000", 2023-01-02T18:18:24.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:18:24.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:18:24.129 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.129 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.129 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.129 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.130 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.130 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.130 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.130 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.130 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.131 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.131 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 8, 2023-01-02T18:18:24.131 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 8, 2023-01-02T18:18:24.131 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 8, 2023-01-02T18:18:24.131 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 8, 2023-01-02T18:18:24.132 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 8, 2023-01-02T18:18:24.132 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.132 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.132 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.132 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.132 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.133 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.133 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.133 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "18", 2023-01-02T18:18:24.134 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.134 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.134 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.134 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.134 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.135 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:18:24.135 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:18:24.135 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.135 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.136 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.136 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.136 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.136 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.136 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.137 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.137 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.137 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.137 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.137 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.138 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.138 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.138 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.138 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.139 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.139 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.139 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.139 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.140 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.140 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.140 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.140 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.140 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.141 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.141 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.141 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.141 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.142 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.142 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.142 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd": {} 2023-01-02T18:18:24.142 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.143 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-01-02T18:18:24.143 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-1", 2023-01-02T18:18:24.143 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:36.229953+0000", 2023-01-02T18:18:24.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.143 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.144 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.144 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.144 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.144 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.144 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.145 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.145 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.145 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.145 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.146 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.146 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.146 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.146 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.146 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.147 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.147 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.147 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.147 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.147 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.148 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.148 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.148 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.148 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "97", 2023-01-02T18:18:24.149 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.149 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.149 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.149 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.149 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.150 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 23, 2023-01-02T18:18:24.150 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 97, 2023-01-02T18:18:24.150 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.150 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.150 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.151 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.151 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.151 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.151 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.152 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.152 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.152 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.152 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.152 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.153 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.153 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.153 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.153 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.154 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.154 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.154 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.154 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.155 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.155 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.155 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.155 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.155 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.156 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.156 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.156 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.156 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.157 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.157 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.157 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.158 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 4, 2023-01-02T18:18:24.158 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-2", 2023-01-02T18:18:24.158 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:39.906131+0000", 2023-01-02T18:18:24.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.158 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.159 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.159 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.159 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.159 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.160 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.160 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.160 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.160 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.160 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.161 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.162 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.162 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.162 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.162 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.163 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.163 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.163 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.163 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "51", 2023-01-02T18:18:24.164 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.164 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.164 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.164 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.164 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.165 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:24.165 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 51, 2023-01-02T18:18:24.165 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.165 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.165 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.166 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.166 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.166 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.166 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.167 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.167 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.167 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.167 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.167 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.168 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.168 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.168 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.168 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.169 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.169 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.169 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.170 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.170 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.170 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.170 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.171 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.171 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.171 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.171 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.171 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.172 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.172 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.172 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.173 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 5, 2023-01-02T18:18:24.173 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-3", 2023-01-02T18:18:24.173 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:44.455124+0000", 2023-01-02T18:18:24.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.173 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.174 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.174 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.174 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.174 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.174 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.175 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.175 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.175 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.175 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.175 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.176 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.176 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.176 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.176 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.176 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.177 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.177 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.177 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.177 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.178 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.178 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.178 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.178 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "56", 2023-01-02T18:18:24.179 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.179 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.179 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.179 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.179 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.180 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:24.180 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 56, 2023-01-02T18:18:24.180 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.180 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.180 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.181 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.181 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.181 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.181 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.182 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.182 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.182 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.183 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.183 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.183 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.183 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.183 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.184 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.184 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.184 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.184 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.185 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.185 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.185 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.185 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.186 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.186 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.186 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.186 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.186 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.187 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.187 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.187 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 6, 2023-01-02T18:18:24.188 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-4", 2023-01-02T18:18:24.188 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:49.454047+0000", 2023-01-02T18:18:24.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.188 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.188 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.189 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.189 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.189 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.189 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.190 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.190 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.190 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.190 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.190 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.191 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.191 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.191 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.191 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.191 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.191 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.192 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.192 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.192 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.192 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.192 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.193 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.193 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "60", 2023-01-02T18:18:24.193 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.193 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.194 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.194 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.194 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.194 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:24.194 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 60, 2023-01-02T18:18:24.195 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.195 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.195 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.195 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.195 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.196 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.196 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.196 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.196 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.196 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.197 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.197 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.197 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.197 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.197 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.198 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.198 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.198 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.198 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.198 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.199 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.199 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.199 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.199 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.200 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.200 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.200 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.200 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.201 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.201 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.201 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.201 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.202 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 7, 2023-01-02T18:18:24.202 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-5", 2023-01-02T18:18:24.202 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:53.843144+0000", 2023-01-02T18:18:24.202 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.203 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.203 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.203 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.203 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.204 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.204 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.204 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.204 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.204 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.205 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.205 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.205 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.205 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.205 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.206 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.206 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.206 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.206 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.206 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.207 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.207 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.207 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.208 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "64", 2023-01-02T18:18:24.208 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.208 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.208 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.208 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.209 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.209 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:24.209 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 64, 2023-01-02T18:18:24.209 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.209 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.210 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.210 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.210 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.210 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.210 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.211 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.211 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.211 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.211 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.211 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.212 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.212 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.212 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.212 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.212 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.213 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.213 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.213 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.213 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.214 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.214 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.214 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.214 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.214 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.215 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.215 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.215 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.215 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.215 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.216 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.216 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.217 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 8, 2023-01-02T18:18:24.217 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-6", 2023-01-02T18:18:24.217 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:57.794651+0000", 2023-01-02T18:18:24.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.218 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.218 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.218 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.218 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.219 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.219 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.219 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.219 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.219 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.219 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.220 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.220 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.220 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.220 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.220 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.221 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.221 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.221 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.221 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.222 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.222 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.222 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.222 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "72", 2023-01-02T18:18:24.223 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.223 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.223 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.223 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.223 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.224 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 7, 2023-01-02T18:18:24.224 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 72, 2023-01-02T18:18:24.224 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.224 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.224 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.225 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.225 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.226 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.226 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.226 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.226 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.226 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.227 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.227 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.227 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.227 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.227 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.228 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.228 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.228 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.229 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.229 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.229 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.229 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.230 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.230 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.230 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.230 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.230 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.231 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.231 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.231 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 9, 2023-01-02T18:18:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-7", 2023-01-02T18:18:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:05.454247+0000", 2023-01-02T18:18:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.232 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.233 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.233 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.233 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.233 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.233 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.234 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.234 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.234 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.234 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.235 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.235 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.235 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.235 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.236 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.236 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.236 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.236 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.236 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.237 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.237 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.237 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.237 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.238 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "76", 2023-01-02T18:18:24.238 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.238 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.238 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.239 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.239 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.239 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:24.239 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 76, 2023-01-02T18:18:24.239 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.239 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.240 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.240 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.240 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.240 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.240 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.241 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.241 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.241 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.242 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.242 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.242 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.242 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.242 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.243 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.243 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.243 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.243 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.244 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.244 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.244 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.244 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.244 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.245 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.245 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.245 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.245 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.246 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.246 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.246 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.246 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.247 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 10, 2023-01-02T18:18:24.247 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-8", 2023-01-02T18:18:24.248 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:30.404991+0000", 2023-01-02T18:18:24.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.248 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.249 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.249 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.249 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.249 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.249 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.250 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.250 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.250 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.250 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.250 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.251 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.251 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.251 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.251 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.252 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.252 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.252 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.253 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.253 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.253 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.254 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "101", 2023-01-02T18:18:24.254 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.254 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.254 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.255 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.255 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.255 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 9, 2023-01-02T18:18:24.255 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 101, 2023-01-02T18:18:24.255 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.256 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.256 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.256 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.256 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.257 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.257 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.257 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.258 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.258 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.258 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.258 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.258 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.259 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.259 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.259 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.259 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.259 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.260 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.260 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.260 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.261 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.261 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.261 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.262 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.262 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.262 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.262 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.262 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.262 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.263 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.264 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 11, 2023-01-02T18:18:24.264 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-9", 2023-01-02T18:18:24.264 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:34.668757+0000", 2023-01-02T18:18:24.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:24.264 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:24.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.265 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.265 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.265 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.265 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.266 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.266 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.266 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.266 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.266 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.267 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.267 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.267 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.267 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.268 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.268 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.268 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.268 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.268 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.269 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.269 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.269 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.270 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "126", 2023-01-02T18:18:24.270 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.270 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.270 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.270 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.271 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.271 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:24.271 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 105, 2023-01-02T18:18:24.271 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.271 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.271 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 10485760, 2023-01-02T18:18:24.272 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.272 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.272 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.272 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.273 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.273 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.273 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.273 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.274 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.274 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.274 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.274 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.274 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.275 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.275 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.275 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.275 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.276 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.276 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.276 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.276 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.277 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.277 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.277 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.278 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.278 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.278 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.279 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.279 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.281 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 12, 2023-01-02T18:18:24.281 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-10", 2023-01-02T18:18:24.282 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:55.603366+0000", 2023-01-02T18:18:24.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:18:24.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:18:24.283 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.283 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.283 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.284 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.284 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.284 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.285 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.285 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.286 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.286 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.286 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.287 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.287 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.287 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.288 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.288 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.288 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.289 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.289 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.290 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.290 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.290 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.291 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "120", 2023-01-02T18:18:24.291 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.292 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.292 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.293 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.293 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.293 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:18:24.294 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:18:24.294 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.295 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.295 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:24.295 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.296 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.296 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.297 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.297 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.297 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.298 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.298 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.299 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.299 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.299 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.299 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.300 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.300 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.300 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.301 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.301 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.302 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.302 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.302 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.303 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.303 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.303 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.303 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.304 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.304 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.304 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.304 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.304 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.305 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.305 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.305 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 13, 2023-01-02T18:18:24.306 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-11", 2023-01-02T18:18:24.306 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:56.778124+0000", 2023-01-02T18:18:24.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 9219, 2023-01-02T18:18:24.306 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,full,full_quota,selfmanaged_snaps", 2023-01-02T18:18:24.306 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:24.307 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:24.307 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:24.307 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:24.307 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:24.307 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:24.308 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:24.308 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:24.308 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:24.309 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:24.309 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:24.309 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:24.309 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:24.310 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:24.310 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:24.310 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:24.310 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:24.311 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:24.311 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:24.311 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:24.311 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:24.311 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:24.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.312 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "136", 2023-01-02T18:18:24.312 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:24.312 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:24.312 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:24.313 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:24.313 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:24.313 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:24.313 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 123, 2023-01-02T18:18:24.313 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:24.314 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:24.314 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 10485760, 2023-01-02T18:18:24.314 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:24.314 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:24.314 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:24.315 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:24.315 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:24.315 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:24.315 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:24.315 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:24.316 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:24.316 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:24.316 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:24.316 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:24.316 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:24.317 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:24.317 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:24.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:24.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.317 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:24.318 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:24.318 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:24.318 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:24.318 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:24.319 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:24.319 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:24.319 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:24.320 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:24.320 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:24.320 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:24.320 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:24.321 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:24.321 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:24.321 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.321 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.321 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:24.322 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:18:24.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.322 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:18:24.322 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "69e18813-bd8e-4b22-9c40-d702ff3a5efd", 2023-01-02T18:18:24.322 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:24.322 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:24.323 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:24.323 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.6576995849609375, 2023-01-02T18:18:24.323 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:24.323 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:24.324 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:24.324 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 132, 2023-01-02T18:18:24.324 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:24.325 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:24.325 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:24.325 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.326 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.326 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6808", 2023-01-02T18:18:24.326 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:24.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.327 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.328 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6809", 2023-01-02T18:18:24.328 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:24.329 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.329 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.330 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:24.330 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.331 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6810", 2023-01-02T18:18:24.332 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:24.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.333 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.333 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6811", 2023-01-02T18:18:24.333 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:24.334 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.334 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.335 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:24.335 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.335 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.336 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6814", 2023-01-02T18:18:24.336 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:24.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.336 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.337 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6815", 2023-01-02T18:18:24.337 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:24.337 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.337 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.338 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:24.338 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.338 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.339 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6812", 2023-01-02T18:18:24.339 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:24.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.339 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.340 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6813", 2023-01-02T18:18:24.340 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:24.340 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.340 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.341 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6809/107063", 2023-01-02T18:18:24.341 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6811/107063", 2023-01-02T18:18:24.341 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6815/107063", 2023-01-02T18:18:24.341 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6813/107063", 2023-01-02T18:18:24.342 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:24.342 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:24.342 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:24.342 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.343 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:18:24.343 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "aa04dec6-4607-4f2a-85a3-a6278832fef3", 2023-01-02T18:18:24.343 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:24.343 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:24.343 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:24.344 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.3902130126953125, 2023-01-02T18:18:24.344 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:24.344 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:24.344 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:24.344 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 132, 2023-01-02T18:18:24.345 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:24.345 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:24.345 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:24.345 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.346 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.346 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6824", 2023-01-02T18:18:24.346 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:24.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.347 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.347 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6825", 2023-01-02T18:18:24.347 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:24.347 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.348 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.348 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:24.348 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.349 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6826", 2023-01-02T18:18:24.349 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:24.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.350 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.350 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6827", 2023-01-02T18:18:24.350 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:24.350 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.351 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.351 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:24.351 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.352 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.352 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6830", 2023-01-02T18:18:24.352 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:24.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.353 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6831", 2023-01-02T18:18:24.353 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:24.354 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.354 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.354 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:24.355 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.355 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.355 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6828", 2023-01-02T18:18:24.356 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:24.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.356 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.356 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6829", 2023-01-02T18:18:24.357 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:24.357 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.357 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.358 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6825/107066", 2023-01-02T18:18:24.358 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6827/107066", 2023-01-02T18:18:24.359 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6831/107066", 2023-01-02T18:18:24.359 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6829/107066", 2023-01-02T18:18:24.359 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:24.360 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:24.360 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:24.360 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.361 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:18:24.362 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "c98a28fb-d910-4601-a229-d4318259ab9b", 2023-01-02T18:18:24.362 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:24.362 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:24.362 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.14453125, 2023-01-02T18:18:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:24.363 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 132, 2023-01-02T18:18:24.364 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:24.364 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:24.364 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:24.364 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.365 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.365 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6816", 2023-01-02T18:18:24.365 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:24.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.366 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.366 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6817", 2023-01-02T18:18:24.367 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:24.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.367 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.368 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:24.368 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.368 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6818", 2023-01-02T18:18:24.369 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:24.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.369 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.370 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6819", 2023-01-02T18:18:24.370 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:24.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.370 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.371 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:24.371 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.371 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6822", 2023-01-02T18:18:24.372 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:24.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.372 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6823", 2023-01-02T18:18:24.373 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:24.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.373 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.374 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:24.374 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.374 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6820", 2023-01-02T18:18:24.375 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:24.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.375 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.376 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6821", 2023-01-02T18:18:24.376 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:24.376 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.376 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.377 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6817/107065", 2023-01-02T18:18:24.377 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6819/107065", 2023-01-02T18:18:24.377 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6823/107065", 2023-01-02T18:18:24.377 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6821/107065", 2023-01-02T18:18:24.377 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:24.378 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:24.378 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:24.378 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.379 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:18:24.379 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "3c5d48f4-5384-4563-8acb-11d866b85ef4", 2023-01-02T18:18:24.379 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:24.379 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 0, 2023-01-02T18:18:24.379 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 0, 2023-01-02T18:18:24.380 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:18:24.380 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:24.380 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:24.380 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:24.380 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 128, 2023-01-02T18:18:24.381 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:24.381 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:24.381 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:24.381 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.382 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.382 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2023-01-02T18:18:24.382 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:24.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.383 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2023-01-02T18:18:24.383 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:24.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.384 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.384 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:24.384 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.385 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.385 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6802", 2023-01-02T18:18:24.385 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:24.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.386 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.386 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6803", 2023-01-02T18:18:24.387 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:24.387 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.387 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.388 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:24.388 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.389 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6806", 2023-01-02T18:18:24.390 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:24.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.391 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.391 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6807", 2023-01-02T18:18:24.391 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:24.392 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.392 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.393 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:24.393 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.394 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.394 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6804", 2023-01-02T18:18:24.394 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:24.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.396 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6805", 2023-01-02T18:18:24.396 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:24.396 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.397 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.397 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6801/107064", 2023-01-02T18:18:24.398 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6803/107064", 2023-01-02T18:18:24.398 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6807/107064", 2023-01-02T18:18:24.398 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6805/107064", 2023-01-02T18:18:24.399 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:24.399 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:24.400 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:24.400 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.401 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:18:24.401 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "2476d495-4979-4679-a7e9-12652c270092", 2023-01-02T18:18:24.401 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:24.402 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:24.402 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:24.402 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.35540771484375, 2023-01-02T18:18:24.402 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:24.402 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:24.403 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:24.403 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 132, 2023-01-02T18:18:24.403 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:24.403 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:24.403 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:24.404 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.404 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6800", 2023-01-02T18:18:24.404 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:24.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.405 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.405 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6801", 2023-01-02T18:18:24.406 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:24.406 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.406 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.406 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:24.407 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.407 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6802", 2023-01-02T18:18:24.407 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:24.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.408 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.408 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6803", 2023-01-02T18:18:24.408 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:24.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.409 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.409 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:24.410 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.410 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.410 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6806", 2023-01-02T18:18:24.410 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:24.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.412 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6807", 2023-01-02T18:18:24.412 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:24.412 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.412 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.413 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:24.413 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.413 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.414 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6804", 2023-01-02T18:18:24.414 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:24.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.415 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6805", 2023-01-02T18:18:24.415 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:24.415 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.415 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.416 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6801/106900", 2023-01-02T18:18:24.416 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6803/106900", 2023-01-02T18:18:24.416 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6807/106900", 2023-01-02T18:18:24.416 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6805/106900", 2023-01-02T18:18:24.416 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:24.417 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:24.417 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:24.417 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.418 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:18:24.418 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "38d57e5e-b6c1-445f-b181-23fb518698f9", 2023-01-02T18:18:24.418 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:24.418 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:24.418 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:24.419 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:18:24.419 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:24.419 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:24.419 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:24.420 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 132, 2023-01-02T18:18:24.420 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:24.420 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:24.420 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:24.420 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.421 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.421 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6816", 2023-01-02T18:18:24.421 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:24.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.422 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.422 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6817", 2023-01-02T18:18:24.422 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:24.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.423 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.423 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:24.423 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.424 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6818", 2023-01-02T18:18:24.424 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:24.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.425 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.425 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6819", 2023-01-02T18:18:24.425 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:24.426 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.426 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.426 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:24.426 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.427 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.427 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6822", 2023-01-02T18:18:24.427 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:24.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.428 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.428 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6823", 2023-01-02T18:18:24.428 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:24.428 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.429 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.429 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:24.429 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.430 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.430 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6820", 2023-01-02T18:18:24.430 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:24.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.431 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6821", 2023-01-02T18:18:24.432 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:24.432 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.432 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.432 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6817/106930", 2023-01-02T18:18:24.432 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6819/106930", 2023-01-02T18:18:24.433 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6823/106930", 2023-01-02T18:18:24.433 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6821/106930", 2023-01-02T18:18:24.433 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:24.433 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:24.434 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:24.434 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.434 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:18:24.435 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "6c78f25a-2a65-47fe-b101-e47c00a5b2f6", 2023-01-02T18:18:24.435 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:24.435 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:24.435 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:24.435 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:18:24.436 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:24.436 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:24.436 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:24.436 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 132, 2023-01-02T18:18:24.436 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:24.437 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:24.437 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:24.437 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.438 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6808", 2023-01-02T18:18:24.438 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:24.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.439 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.439 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6809", 2023-01-02T18:18:24.439 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:24.439 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.439 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.440 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:24.440 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.441 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.441 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6810", 2023-01-02T18:18:24.441 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:24.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.442 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.442 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6811", 2023-01-02T18:18:24.442 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:24.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.443 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.443 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:24.443 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.444 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6814", 2023-01-02T18:18:24.444 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:24.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.445 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.445 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6815", 2023-01-02T18:18:24.445 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:24.446 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.446 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.446 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:24.446 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.447 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.447 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6812", 2023-01-02T18:18:24.447 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:24.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.448 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.448 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6813", 2023-01-02T18:18:24.448 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:24.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.449 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.449 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6809/106901", 2023-01-02T18:18:24.449 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6811/106901", 2023-01-02T18:18:24.450 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6815/106901", 2023-01-02T18:18:24.450 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6813/106901", 2023-01-02T18:18:24.450 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:24.450 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:24.450 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:24.451 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.451 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:18:24.451 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "b094706d-7145-4865-ae95-e5cd7e40d23b", 2023-01-02T18:18:24.451 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:24.452 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:24.452 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:24.452 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:18:24.452 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:24.453 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:24.453 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:24.453 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 132, 2023-01-02T18:18:24.453 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:24.454 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:24.454 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:24.454 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.455 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6824", 2023-01-02T18:18:24.455 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:24.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.455 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.456 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6825", 2023-01-02T18:18:24.456 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:24.456 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.456 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.457 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:24.457 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.457 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.457 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6826", 2023-01-02T18:18:24.458 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:24.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.458 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.458 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6827", 2023-01-02T18:18:24.459 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:24.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.459 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.459 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:24.460 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.460 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6830", 2023-01-02T18:18:24.460 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:24.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.461 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6831", 2023-01-02T18:18:24.462 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:24.462 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.462 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.463 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:24.463 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:24.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:24.463 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6828", 2023-01-02T18:18:24.464 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:24.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.464 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:24.465 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6829", 2023-01-02T18:18:24.465 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:24.465 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.465 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.466 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6825/106931", 2023-01-02T18:18:24.466 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6827/106931", 2023-01-02T18:18:24.466 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6831/106931", 2023-01-02T18:18:24.466 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6829/106931", 2023-01-02T18:18:24.467 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:24.467 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:24.467 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:24.467 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.467 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.468 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:24.468 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_xinfo": [ 2023-01-02T18:18:24.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.468 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:18:24.469 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:24.469 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:24.469 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:24.469 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:24.469 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:24.470 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.290083+0000", 2023-01-02T18:18:24.470 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:24.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.471 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:18:24.471 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:24.471 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:24.471 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:24.472 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:24.472 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:24.472 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.303022+0000", 2023-01-02T18:18:24.472 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:24.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.473 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:18:24.473 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:24.473 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:24.474 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:24.474 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:24.474 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:24.474 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.292245+0000", 2023-01-02T18:18:24.474 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:24.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.475 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:18:24.475 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:24.475 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:24.476 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:24.476 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:24.476 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 65536, 2023-01-02T18:18:24.476 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.210530+0000", 2023-01-02T18:18:24.476 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:24.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.477 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:18:24.477 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:24.477 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:24.478 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:24.478 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:24.478 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:24.478 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.282212+0000", 2023-01-02T18:18:24.479 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:24.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.479 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:18:24.479 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:24.479 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:24.480 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:24.480 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:24.480 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:24.480 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.237376+0000", 2023-01-02T18:18:24.480 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:24.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.481 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:18:24.481 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:24.481 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:24.482 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:24.482 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:24.482 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:24.482 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.239974+0000", 2023-01-02T18:18:24.483 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:24.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.483 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:18:24.484 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:24.484 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:24.484 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:24.484 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:24.485 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:24.485 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.276340+0000", 2023-01-02T18:18:24.485 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:24.485 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.485 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:24.486 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap": [ 2023-01-02T18:18:24.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:24.486 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "2.0", 2023-01-02T18:18:24.486 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:18:24.486 INFO:teuthology.orchestra.run.smithi007.stdout: 2, 2023-01-02T18:18:24.487 INFO:teuthology.orchestra.run.smithi007.stdout: 3 2023-01-02T18:18:24.487 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:24.487 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.487 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:24.487 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_items": [], 2023-01-02T18:18:24.488 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_temp": [], 2023-01-02T18:18:24.488 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_temp": [], 2023-01-02T18:18:24.488 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklist": {}, 2023-01-02T18:18:24.488 INFO:teuthology.orchestra.run.smithi007.stdout: "range_blocklist": {}, 2023-01-02T18:18:24.488 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profiles": { 2023-01-02T18:18:24.489 INFO:teuthology.orchestra.run.smithi007.stdout: "default": { 2023-01-02T18:18:24.489 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-failure-domain": "osd", 2023-01-02T18:18:24.489 INFO:teuthology.orchestra.run.smithi007.stdout: "k": "2", 2023-01-02T18:18:24.489 INFO:teuthology.orchestra.run.smithi007.stdout: "m": "1", 2023-01-02T18:18:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin": "jerasure", 2023-01-02T18:18:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "ruleset-failure-domain": "osd", 2023-01-02T18:18:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: "technique": "reed_sol_van" 2023-01-02T18:18:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps_queue": [], 2023-01-02T18:18:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "new_removed_snaps": [], 2023-01-02T18:18:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "new_purged_snaps": [], 2023-01-02T18:18:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_node_flags": {}, 2023-01-02T18:18:24.491 INFO:teuthology.orchestra.run.smithi007.stdout: "device_class_flags": {}, 2023-01-02T18:18:24.492 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode": { 2023-01-02T18:18:24.492 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_enabled": false, 2023-01-02T18:18:24.492 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_bucket_count": 0, 2023-01-02T18:18:24.492 INFO:teuthology.orchestra.run.smithi007.stdout: "degraded_stretch_mode": 0, 2023-01-02T18:18:24.492 INFO:teuthology.orchestra.run.smithi007.stdout: "recovering_stretch_mode": 0, 2023-01-02T18:18:24.493 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_bucket": 0 2023-01-02T18:18:24.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:24.493 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:24.495 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:24.497 INFO:tasks.thrashosds.thrasher:j is {'epoch': 137, 'fsid': '4e320929-c4bb-4ea9-9e1c-d8479b7e40b1', 'created': '2023-01-02T18:15:29.542145+0000', 'modified': '2023-01-02T18:18:21.664740+0000', 'last_up_change': '2023-01-02T18:15:38.537792+0000', 'last_in_change': '2023-01-02T18:18:13.365363+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 13, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-02T18:15:38.598445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-01-02T18:15:40.853543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'test-librbd-smithi007-118686-1', 'create_time': '2023-01-02T18:16:36.229953+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'test-librbd-smithi007-118686-2', 'create_time': '2023-01-02T18:16:39.906131+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 5, 'pool_name': 'test-librbd-smithi007-118686-3', 'create_time': '2023-01-02T18:16:44.455124+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 56, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 6, 'pool_name': 'test-librbd-smithi007-118686-4', 'create_time': '2023-01-02T18:16:49.454047+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 60, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 7, 'pool_name': 'test-librbd-smithi007-118686-5', 'create_time': '2023-01-02T18:16:53.843144+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 64, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 8, 'pool_name': 'test-librbd-smithi007-118686-6', 'create_time': '2023-01-02T18:16:57.794651+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 9, 'pool_name': 'test-librbd-smithi007-118686-7', 'create_time': '2023-01-02T18:17:05.454247+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 10, 'pool_name': 'test-librbd-smithi007-118686-8', 'create_time': '2023-01-02T18:17:30.404991+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 11, 'pool_name': 'test-librbd-smithi007-118686-9', 'create_time': '2023-01-02T18:17:34.668757+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 10485760, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 12, 'pool_name': 'test-librbd-smithi007-118686-10', 'create_time': '2023-01-02T18:17:55.603366+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 13, 'pool_name': 'test-librbd-smithi007-118686-11', 'create_time': '2023-01-02T18:17:56.778124+0000', 'flags': 9219, 'flags_names': 'hashpspool,full,full_quota,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 123, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 10485760, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '69e18813-bd8e-4b22-9c40-d702ff3a5efd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6576995849609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6808', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6809', 'nonce': 107063}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6810', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6811', 'nonce': 107063}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6814', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6815', 'nonce': 107063}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6812', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6813', 'nonce': 107063}]}, 'public_addr': '172.21.15.7:6809/107063', 'cluster_addr': '172.21.15.7:6811/107063', 'heartbeat_back_addr': '172.21.15.7:6815/107063', 'heartbeat_front_addr': '172.21.15.7:6813/107063', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa04dec6-4607-4f2a-85a3-a6278832fef3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3902130126953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6824', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6825', 'nonce': 107066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6826', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6827', 'nonce': 107066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6830', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6831', 'nonce': 107066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6828', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6829', 'nonce': 107066}]}, 'public_addr': '172.21.15.7:6825/107066', 'cluster_addr': '172.21.15.7:6827/107066', 'heartbeat_back_addr': '172.21.15.7:6831/107066', 'heartbeat_front_addr': '172.21.15.7:6829/107066', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'c98a28fb-d910-4601-a229-d4318259ab9b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.14453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6816', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6817', 'nonce': 107065}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6818', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6819', 'nonce': 107065}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6822', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6823', 'nonce': 107065}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6820', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6821', 'nonce': 107065}]}, 'public_addr': '172.21.15.7:6817/107065', 'cluster_addr': '172.21.15.7:6819/107065', 'heartbeat_back_addr': '172.21.15.7:6823/107065', 'heartbeat_front_addr': '172.21.15.7:6821/107065', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3c5d48f4-5384-4563-8acb-11d866b85ef4', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 128, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6800', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6801', 'nonce': 107064}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6802', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6803', 'nonce': 107064}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6806', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6807', 'nonce': 107064}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6804', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6805', 'nonce': 107064}]}, 'public_addr': '172.21.15.7:6801/107064', 'cluster_addr': '172.21.15.7:6803/107064', 'heartbeat_back_addr': '172.21.15.7:6807/107064', 'heartbeat_front_addr': '172.21.15.7:6805/107064', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '2476d495-4979-4679-a7e9-12652c270092', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.35540771484375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 106900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 106900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 106900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 106900}]}, 'public_addr': '172.21.15.57:6801/106900', 'cluster_addr': '172.21.15.57:6803/106900', 'heartbeat_back_addr': '172.21.15.57:6807/106900', 'heartbeat_front_addr': '172.21.15.57:6805/106900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '38d57e5e-b6c1-445f-b181-23fb518698f9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6816', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6817', 'nonce': 106930}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6818', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 106930}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6822', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6823', 'nonce': 106930}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6820', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6821', 'nonce': 106930}]}, 'public_addr': '172.21.15.57:6817/106930', 'cluster_addr': '172.21.15.57:6819/106930', 'heartbeat_back_addr': '172.21.15.57:6823/106930', 'heartbeat_front_addr': '172.21.15.57:6821/106930', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6c78f25a-2a65-47fe-b101-e47c00a5b2f6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6808', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6809', 'nonce': 106901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6810', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6811', 'nonce': 106901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6814', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6815', 'nonce': 106901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6812', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6813', 'nonce': 106901}]}, 'public_addr': '172.21.15.57:6809/106901', 'cluster_addr': '172.21.15.57:6811/106901', 'heartbeat_back_addr': '172.21.15.57:6815/106901', 'heartbeat_front_addr': '172.21.15.57:6813/106901', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'b094706d-7145-4865-ae95-e5cd7e40d23b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6824', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6825', 'nonce': 106931}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6826', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6827', 'nonce': 106931}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6830', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6831', 'nonce': 106931}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6828', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6829', 'nonce': 106931}]}, 'public_addr': '172.21.15.57:6825/106931', 'cluster_addr': '172.21.15.57:6827/106931', 'heartbeat_back_addr': '172.21.15.57:6831/106931', 'heartbeat_front_addr': '172.21.15.57:6829/106931', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.290083+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.303022+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.292245+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.210530+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.282212+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.237376+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.239974+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.276340+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [2, 3]}], 'pg_upmap_items': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-01-02T18:18:24.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-01-02T18:18:24.498 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.498 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.498 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.499 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.499 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.499 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.500 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.500 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.500 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.500 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.501 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.501 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.502 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.502 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.502 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.503 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:24.503 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.503 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.504 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:24.504 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.504 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.504 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.505 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.505 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.505 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.506 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.506 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.506 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.507 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.507 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.507 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.508 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.508 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.508 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.509 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.509 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.509 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.510 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.510 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.510 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.511 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.511 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.511 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.512 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.512 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.512 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.513 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.513 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.513 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.514 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:24.514 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.515 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.515 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:24.515 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.515 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.516 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.516 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.516 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.516 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.516 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.517 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.517 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.517 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.517 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.518 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.518 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.518 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.518 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.518 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.519 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.519 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.519 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.519 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.520 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.520 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.520 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.520 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.520 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.521 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.521 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.521 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.521 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.522 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.522 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:24.522 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.522 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.522 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:24.523 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.523 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.523 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.523 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.523 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.524 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.524 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.524 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.524 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.524 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.525 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.525 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.525 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.525 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.526 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.526 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.526 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.526 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.527 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.527 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.527 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.527 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.527 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.528 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:24.528 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:24.528 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:24.528 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:24.528 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:24.529 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.529 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.529 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:24.529 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:24.530 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:24.530 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:24.530 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:24.530 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:24.530 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:24.531 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:24.531 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestIO (3485 ms) 2023-01-02T18:18:24.531 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS1 2023-01-02T18:18:24.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:24.532 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:24.494+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:24.533 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:24.595 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:24.595+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:24.659 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:24.660 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:24.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:24.713 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:24.714+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:24.796 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:24.796 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:24.797 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:24.797+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:24.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:24.868 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:18:24.878 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-01-02T18:18:24.879 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2023-01-02T18:18:24.554682+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2099510,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":18335,"num_read_kb":12935,"num_write":1062,"num_write_kb":37611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":184,"num_bytes_recovered":2859,"num_keys_recovered":1331,"num_objects_omap":57,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1232,"ondisk_log_size":1232,"up":722,"acting":722,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":722,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":89388,"kb_used_data":13508,"kb_used_omap":0,"kb_used_meta":74176,"kb_avail":660513492,"statfs":{"total":676457349120,"available":676365815808,"internally_reserved":0,"allocated":13832192,"data_stored":7526787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":75956224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10485711,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8578,"num_read_kb":4378,"num_write":114,"num_write_kb":8267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.150694"},"pg_stats":[{"pgid":"13.14","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320265+0000","last_change":"2023-01-02T18:18:00.741719+0000","last_active":"2023-01-02T18:18:19.320265+0000","last_peered":"2023-01-02T18:18:19.320265+0000","last_clean":"2023-01-02T18:18:19.320265+0000","last_became_active":"2023-01-02T18:17:58.735081+0000","last_became_peered":"2023-01-02T18:17:58.735081+0000","last_unstale":"2023-01-02T18:18:19.320265+0000","last_undegraded":"2023-01-02T18:18:19.320265+0000","last_fullsized":"2023-01-02T18:18:19.320265+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094804+0000","last_change":"2023-01-02T18:18:14.409720+0000","last_active":"2023-01-02T18:18:20.094804+0000","last_peered":"2023-01-02T18:18:20.094804+0000","last_clean":"2023-01-02T18:18:20.094804+0000","last_became_active":"2023-01-02T18:18:14.409464+0000","last_became_peered":"2023-01-02T18:18:14.409464+0000","last_unstale":"2023-01-02T18:18:20.094804+0000","last_undegraded":"2023-01-02T18:18:20.094804+0000","last_fullsized":"2023-01-02T18:18:20.094804+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1c","version":"56'3","reported_seq":33,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325566+0000","last_change":"2023-01-02T18:18:14.420564+0000","last_active":"2023-01-02T18:18:19.325566+0000","last_peered":"2023-01-02T18:18:19.325566+0000","last_clean":"2023-01-02T18:18:19.325566+0000","last_became_active":"2023-01-02T18:18:14.399852+0000","last_became_peered":"2023-01-02T18:18:14.399852+0000","last_unstale":"2023-01-02T18:18:19.325566+0000","last_undegraded":"2023-01-02T18:18:19.325566+0000","last_fullsized":"2023-01-02T18:18:19.325566+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"84'5","reported_seq":34,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-01-02T18:18:24.499694+0000","last_change":"2023-01-02T18:18:02.833544+0000","last_active":"2023-01-02T18:18:24.499694+0000","last_peered":"2023-01-02T18:18:24.499694+0000","last_clean":"2023-01-02T18:18:24.499694+0000","last_became_active":"2023-01-02T18:18:02.780824+0000","last_became_peered":"2023-01-02T18:18:02.780824+0000","last_unstale":"2023-01-02T18:18:24.499694+0000","last_undegraded":"2023-01-02T18:18:24.499694+0000","last_fullsized":"2023-01-02T18:18:24.499694+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":47,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"51'8","reported_seq":43,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924059+0000","last_change":"2023-01-02T18:18:14.433773+0000","last_active":"2023-01-02T18:18:19.924059+0000","last_peered":"2023-01-02T18:18:19.924059+0000","last_clean":"2023-01-02T18:18:19.924059+0000","last_became_active":"2023-01-02T18:18:14.397357+0000","last_became_peered":"2023-01-02T18:18:14.397357+0000","last_unstale":"2023-01-02T18:18:19.924059+0000","last_undegraded":"2023-01-02T18:18:19.924059+0000","last_fullsized":"2023-01-02T18:18:19.924059+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"64'1","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924855+0000","last_change":"2023-01-02T18:18:14.454683+0000","last_active":"2023-01-02T18:18:19.924855+0000","last_peered":"2023-01-02T18:18:19.924855+0000","last_clean":"2023-01-02T18:18:19.924855+0000","last_became_active":"2023-01-02T18:18:14.412052+0000","last_became_peered":"2023-01-02T18:18:14.412052+0000","last_unstale":"2023-01-02T18:18:19.924855+0000","last_undegraded":"2023-01-02T18:18:19.924855+0000","last_fullsized":"2023-01-02T18:18:19.924855+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"72'4","reported_seq":54,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326600+0000","last_change":"2023-01-02T18:17:29.382390+0000","last_active":"2023-01-02T18:18:19.326600+0000","last_peered":"2023-01-02T18:18:19.326600+0000","last_clean":"2023-01-02T18:18:19.326600+0000","last_became_active":"2023-01-02T18:17:29.335369+0000","last_became_peered":"2023-01-02T18:17:29.335369+0000","last_unstale":"2023-01-02T18:18:19.326600+0000","last_undegraded":"2023-01-02T18:18:19.326600+0000","last_fullsized":"2023-01-02T18:18:19.326600+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":78,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756610+0000","last_change":"2023-01-02T18:18:08.362508+0000","last_active":"2023-01-02T18:18:19.756610+0000","last_peered":"2023-01-02T18:18:19.756610+0000","last_clean":"2023-01-02T18:18:19.756610+0000","last_became_active":"2023-01-02T18:18:08.362025+0000","last_became_peered":"2023-01-02T18:18:08.362025+0000","last_unstale":"2023-01-02T18:18:19.756610+0000","last_undegraded":"2023-01-02T18:18:19.756610+0000","last_fullsized":"2023-01-02T18:18:19.756610+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"101'2","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756326+0000","last_change":"2023-01-02T18:17:34.343730+0000","last_active":"2023-01-02T18:18:19.756326+0000","last_peered":"2023-01-02T18:18:19.756326+0000","last_clean":"2023-01-02T18:18:19.756326+0000","last_became_active":"2023-01-02T18:17:32.346354+0000","last_became_peered":"2023-01-02T18:17:32.346354+0000","last_unstale":"2023-01-02T18:18:19.756326+0000","last_undegraded":"2023-01-02T18:18:19.756326+0000","last_fullsized":"2023-01-02T18:18:19.756326+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":45,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755996+0000","last_change":"2023-01-02T18:17:38.462825+0000","last_active":"2023-01-02T18:18:19.755996+0000","last_peered":"2023-01-02T18:18:19.755996+0000","last_clean":"2023-01-02T18:18:19.755996+0000","last_became_active":"2023-01-02T18:17:36.449207+0000","last_became_peered":"2023-01-02T18:17:36.449207+0000","last_unstale":"2023-01-02T18:18:19.755996+0000","last_undegraded":"2023-01-02T18:18:19.755996+0000","last_fullsized":"2023-01-02T18:18:19.755996+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094362+0000","last_change":"2023-01-02T18:17:56.731083+0000","last_active":"2023-01-02T18:18:20.094362+0000","last_peered":"2023-01-02T18:18:20.094362+0000","last_clean":"2023-01-02T18:18:20.094362+0000","last_became_active":"2023-01-02T18:17:56.730871+0000","last_became_peered":"2023-01-02T18:17:56.730871+0000","last_unstale":"2023-01-02T18:18:20.094362+0000","last_undegraded":"2023-01-02T18:18:20.094362+0000","last_fullsized":"2023-01-02T18:18:20.094362+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327245+0000","last_change":"2023-01-02T18:18:00.735366+0000","last_active":"2023-01-02T18:18:19.327245+0000","last_peered":"2023-01-02T18:18:19.327245+0000","last_clean":"2023-01-02T18:18:19.327245+0000","last_became_active":"2023-01-02T18:17:58.739836+0000","last_became_peered":"2023-01-02T18:17:58.739836+0000","last_unstale":"2023-01-02T18:18:19.327245+0000","last_undegraded":"2023-01-02T18:18:19.327245+0000","last_fullsized":"2023-01-02T18:18:19.327245+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"60'9","reported_seq":208,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756893+0000","last_change":"2023-01-02T18:17:29.354782+0000","last_active":"2023-01-02T18:18:19.756893+0000","last_peered":"2023-01-02T18:18:19.756893+0000","last_clean":"2023-01-02T18:18:19.756893+0000","last_became_active":"2023-01-02T18:17:29.340734+0000","last_became_peered":"2023-01-02T18:17:29.340734+0000","last_unstale":"2023-01-02T18:18:19.756893+0000","last_undegraded":"2023-01-02T18:18:19.756893+0000","last_fullsized":"2023-01-02T18:18:19.756893+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":127,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":84,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"56'15","reported_seq":175,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095682+0000","last_change":"2023-01-02T18:18:02.804213+0000","last_active":"2023-01-02T18:18:20.095682+0000","last_peered":"2023-01-02T18:18:20.095682+0000","last_clean":"2023-01-02T18:18:20.095682+0000","last_became_active":"2023-01-02T18:18:02.778105+0000","last_became_peered":"2023-01-02T18:18:02.778105+0000","last_unstale":"2023-01-02T18:18:20.095682+0000","last_undegraded":"2023-01-02T18:18:20.095682+0000","last_fullsized":"2023-01-02T18:18:20.095682+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"46'7","reported_seq":186,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923011+0000","last_change":"2023-01-02T18:18:14.420553+0000","last_active":"2023-01-02T18:18:19.923011+0000","last_peered":"2023-01-02T18:18:19.923011+0000","last_clean":"2023-01-02T18:18:19.923011+0000","last_became_active":"2023-01-02T18:18:14.392040+0000","last_became_peered":"2023-01-02T18:18:14.392040+0000","last_unstale":"2023-01-02T18:18:19.923011+0000","last_undegraded":"2023-01-02T18:18:19.923011+0000","last_fullsized":"2023-01-02T18:18:19.923011+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":30,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":44,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":30,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":102,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320897+0000","last_change":"2023-01-02T18:16:44.314797+0000","last_active":"2023-01-02T18:18:19.320897+0000","last_peered":"2023-01-02T18:18:19.320897+0000","last_clean":"2023-01-02T18:18:19.320897+0000","last_became_active":"2023-01-02T18:16:41.442107+0000","last_became_peered":"2023-01-02T18:16:41.442107+0000","last_unstale":"2023-01-02T18:18:19.320897+0000","last_undegraded":"2023-01-02T18:18:19.320897+0000","last_fullsized":"2023-01-02T18:18:19.320897+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924075+0000","last_change":"2023-01-02T18:17:48.664224+0000","last_active":"2023-01-02T18:18:19.924075+0000","last_peered":"2023-01-02T18:18:19.924075+0000","last_clean":"2023-01-02T18:18:19.924075+0000","last_became_active":"2023-01-02T18:17:48.663942+0000","last_became_peered":"2023-01-02T18:17:48.663942+0000","last_unstale":"2023-01-02T18:18:19.924075+0000","last_undegraded":"2023-01-02T18:18:19.924075+0000","last_fullsized":"2023-01-02T18:18:19.924075+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":84,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094676+0000","last_change":"2023-01-02T18:17:01.316808+0000","last_active":"2023-01-02T18:18:20.094676+0000","last_peered":"2023-01-02T18:18:20.094676+0000","last_clean":"2023-01-02T18:18:20.094676+0000","last_became_active":"2023-01-02T18:16:59.310294+0000","last_became_peered":"2023-01-02T18:16:59.310294+0000","last_unstale":"2023-01-02T18:18:20.094676+0000","last_undegraded":"2023-01-02T18:18:20.094676+0000","last_fullsized":"2023-01-02T18:18:20.094676+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":74,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756424+0000","last_change":"2023-01-02T18:17:09.323079+0000","last_active":"2023-01-02T18:18:19.756424+0000","last_peered":"2023-01-02T18:18:19.756424+0000","last_clean":"2023-01-02T18:18:19.756424+0000","last_became_active":"2023-01-02T18:17:07.344746+0000","last_became_peered":"2023-01-02T18:17:07.344746+0000","last_unstale":"2023-01-02T18:18:19.756424+0000","last_undegraded":"2023-01-02T18:18:19.756424+0000","last_fullsized":"2023-01-02T18:18:19.756424+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":65,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756705+0000","last_change":"2023-01-02T18:18:08.362337+0000","last_active":"2023-01-02T18:18:19.756705+0000","last_peered":"2023-01-02T18:18:19.756705+0000","last_clean":"2023-01-02T18:18:19.756705+0000","last_became_active":"2023-01-02T18:18:08.361623+0000","last_became_peered":"2023-01-02T18:18:08.361623+0000","last_unstale":"2023-01-02T18:18:19.756705+0000","last_undegraded":"2023-01-02T18:18:19.756705+0000","last_fullsized":"2023-01-02T18:18:19.756705+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755862+0000","last_change":"2023-01-02T18:18:14.406738+0000","last_active":"2023-01-02T18:18:19.755862+0000","last_peered":"2023-01-02T18:18:19.755862+0000","last_clean":"2023-01-02T18:18:19.755862+0000","last_became_active":"2023-01-02T18:18:14.399728+0000","last_became_peered":"2023-01-02T18:18:14.399728+0000","last_unstale":"2023-01-02T18:18:19.755862+0000","last_undegraded":"2023-01-02T18:18:19.755862+0000","last_fullsized":"2023-01-02T18:18:19.755862+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"136'17","reported_seq":59,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:21.007704+0000","last_change":"2023-01-02T18:18:02.839920+0000","last_active":"2023-01-02T18:18:21.007704+0000","last_peered":"2023-01-02T18:18:21.007704+0000","last_clean":"2023-01-02T18:18:21.007704+0000","last_became_active":"2023-01-02T18:18:02.789519+0000","last_became_peered":"2023-01-02T18:18:02.789519+0000","last_unstale":"2023-01-02T18:18:21.007704+0000","last_undegraded":"2023-01-02T18:18:21.007704+0000","last_fullsized":"2023-01-02T18:18:21.007704+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":46,"num_write":24,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326880+0000","last_change":"2023-01-02T18:18:14.401533+0000","last_active":"2023-01-02T18:18:19.326880+0000","last_peered":"2023-01-02T18:18:19.326880+0000","last_clean":"2023-01-02T18:18:19.326880+0000","last_became_active":"2023-01-02T18:18:14.399255+0000","last_became_peered":"2023-01-02T18:18:14.399255+0000","last_unstale":"2023-01-02T18:18:19.326880+0000","last_undegraded":"2023-01-02T18:18:19.326880+0000","last_fullsized":"2023-01-02T18:18:19.326880+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1c","version":"64'3","reported_seq":66,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327875+0000","last_change":"2023-01-02T18:18:14.444132+0000","last_active":"2023-01-02T18:18:19.327875+0000","last_peered":"2023-01-02T18:18:19.327875+0000","last_clean":"2023-01-02T18:18:19.327875+0000","last_became_active":"2023-01-02T18:18:14.399129+0000","last_became_peered":"2023-01-02T18:18:14.399129+0000","last_unstale":"2023-01-02T18:18:19.327875+0000","last_undegraded":"2023-01-02T18:18:19.327875+0000","last_fullsized":"2023-01-02T18:18:19.327875+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":7,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328605+0000","last_change":"2023-01-02T18:17:29.329770+0000","last_active":"2023-01-02T18:18:19.328605+0000","last_peered":"2023-01-02T18:18:19.328605+0000","last_clean":"2023-01-02T18:18:19.328605+0000","last_became_active":"2023-01-02T18:17:29.328232+0000","last_became_peered":"2023-01-02T18:17:29.328232+0000","last_unstale":"2023-01-02T18:18:19.328605+0000","last_undegraded":"2023-01-02T18:18:19.328605+0000","last_fullsized":"2023-01-02T18:18:19.328605+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":97,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320116+0000","last_change":"2023-01-02T18:16:49.324511+0000","last_active":"2023-01-02T18:18:19.320116+0000","last_peered":"2023-01-02T18:18:19.320116+0000","last_clean":"2023-01-02T18:18:19.320116+0000","last_became_active":"2023-01-02T18:16:46.315388+0000","last_became_peered":"2023-01-02T18:16:46.315388+0000","last_unstale":"2023-01-02T18:18:19.320116+0000","last_undegraded":"2023-01-02T18:18:19.320116+0000","last_fullsized":"2023-01-02T18:18:19.320116+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"46'9","reported_seq":76,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319294+0000","last_change":"2023-01-02T18:18:14.418161+0000","last_active":"2023-01-02T18:18:19.319294+0000","last_peered":"2023-01-02T18:18:19.319294+0000","last_clean":"2023-01-02T18:18:19.319294+0000","last_became_active":"2023-01-02T18:18:14.399884+0000","last_became_peered":"2023-01-02T18:18:14.399884+0000","last_unstale":"2023-01-02T18:18:19.319294+0000","last_undegraded":"2023-01-02T18:18:19.319294+0000","last_fullsized":"2023-01-02T18:18:19.319294+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":97,"num_read_kb":82,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":65,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":111,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095540+0000","last_change":"2023-01-02T18:17:29.338927+0000","last_active":"2023-01-02T18:18:20.095540+0000","last_peered":"2023-01-02T18:18:20.095540+0000","last_clean":"2023-01-02T18:18:20.095540+0000","last_became_active":"2023-01-02T18:17:29.338639+0000","last_became_peered":"2023-01-02T18:17:29.338639+0000","last_unstale":"2023-01-02T18:18:20.095540+0000","last_undegraded":"2023-01-02T18:18:20.095540+0000","last_fullsized":"2023-01-02T18:18:20.095540+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452286+0000","last_change":"2023-01-02T18:18:14.391865+0000","last_active":"2023-01-02T18:18:19.452286+0000","last_peered":"2023-01-02T18:18:19.452286+0000","last_clean":"2023-01-02T18:18:19.452286+0000","last_became_active":"2023-01-02T18:18:14.391519+0000","last_became_peered":"2023-01-02T18:18:14.391519+0000","last_unstale":"2023-01-02T18:18:19.452286+0000","last_undegraded":"2023-01-02T18:18:19.452286+0000","last_fullsized":"2023-01-02T18:18:19.452286+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328828+0000","last_change":"2023-01-02T18:17:29.332434+0000","last_active":"2023-01-02T18:18:19.328828+0000","last_peered":"2023-01-02T18:18:19.328828+0000","last_clean":"2023-01-02T18:18:19.328828+0000","last_became_active":"2023-01-02T18:17:29.329956+0000","last_became_peered":"2023-01-02T18:17:29.329956+0000","last_unstale":"2023-01-02T18:18:19.328828+0000","last_undegraded":"2023-01-02T18:18:19.328828+0000","last_fullsized":"2023-01-02T18:18:19.328828+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326339+0000","last_change":"2023-01-02T18:17:34.316239+0000","last_active":"2023-01-02T18:18:19.326339+0000","last_peered":"2023-01-02T18:18:19.326339+0000","last_clean":"2023-01-02T18:18:19.326339+0000","last_became_active":"2023-01-02T18:17:32.337541+0000","last_became_peered":"2023-01-02T18:17:32.337541+0000","last_unstale":"2023-01-02T18:18:19.326339+0000","last_undegraded":"2023-01-02T18:18:19.326339+0000","last_fullsized":"2023-01-02T18:18:19.326339+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":47,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319283+0000","last_change":"2023-01-02T18:17:38.444061+0000","last_active":"2023-01-02T18:18:19.319283+0000","last_peered":"2023-01-02T18:18:19.319283+0000","last_clean":"2023-01-02T18:18:19.319283+0000","last_became_active":"2023-01-02T18:17:36.437329+0000","last_became_peered":"2023-01-02T18:17:36.437329+0000","last_unstale":"2023-01-02T18:18:19.319283+0000","last_undegraded":"2023-01-02T18:18:19.319283+0000","last_fullsized":"2023-01-02T18:18:19.319283+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095619+0000","last_change":"2023-01-02T18:18:14.405663+0000","last_active":"2023-01-02T18:18:20.095619+0000","last_peered":"2023-01-02T18:18:20.095619+0000","last_clean":"2023-01-02T18:18:20.095619+0000","last_became_active":"2023-01-02T18:18:14.405343+0000","last_became_peered":"2023-01-02T18:18:14.405343+0000","last_unstale":"2023-01-02T18:18:20.095619+0000","last_undegraded":"2023-01-02T18:18:20.095619+0000","last_fullsized":"2023-01-02T18:18:20.095619+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756548+0000","last_change":"2023-01-02T18:18:14.410648+0000","last_active":"2023-01-02T18:18:19.756548+0000","last_peered":"2023-01-02T18:18:19.756548+0000","last_clean":"2023-01-02T18:18:19.756548+0000","last_became_active":"2023-01-02T18:18:14.409919+0000","last_became_peered":"2023-01-02T18:18:14.409919+0000","last_unstale":"2023-01-02T18:18:19.756548+0000","last_undegraded":"2023-01-02T18:18:19.756548+0000","last_fullsized":"2023-01-02T18:18:19.756548+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":88,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320591+0000","last_change":"2023-01-02T18:16:57.305881+0000","last_active":"2023-01-02T18:18:19.320591+0000","last_peered":"2023-01-02T18:18:19.320591+0000","last_clean":"2023-01-02T18:18:19.320591+0000","last_became_active":"2023-01-02T18:16:55.315654+0000","last_became_peered":"2023-01-02T18:16:55.315654+0000","last_unstale":"2023-01-02T18:18:19.320591+0000","last_undegraded":"2023-01-02T18:18:19.320591+0000","last_fullsized":"2023-01-02T18:18:19.320591+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"60'7","reported_seq":188,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756396+0000","last_change":"2023-01-02T18:16:53.346677+0000","last_active":"2023-01-02T18:18:19.756396+0000","last_peered":"2023-01-02T18:18:19.756396+0000","last_clean":"2023-01-02T18:18:19.756396+0000","last_became_active":"2023-01-02T18:16:51.338384+0000","last_became_peered":"2023-01-02T18:16:51.338384+0000","last_unstale":"2023-01-02T18:18:19.756396+0000","last_undegraded":"2023-01-02T18:18:19.756396+0000","last_fullsized":"2023-01-02T18:18:19.756396+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":113,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094455+0000","last_change":"2023-01-02T18:18:02.790204+0000","last_active":"2023-01-02T18:18:20.094455+0000","last_peered":"2023-01-02T18:18:20.094455+0000","last_clean":"2023-01-02T18:18:20.094455+0000","last_became_active":"2023-01-02T18:18:02.789818+0000","last_became_peered":"2023-01-02T18:18:02.789818+0000","last_unstale":"2023-01-02T18:18:20.094455+0000","last_undegraded":"2023-01-02T18:18:20.094455+0000","last_fullsized":"2023-01-02T18:18:20.094455+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"46'1","reported_seq":64,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328733+0000","last_change":"2023-01-02T18:17:30.331763+0000","last_active":"2023-01-02T18:18:19.328733+0000","last_peered":"2023-01-02T18:18:19.328733+0000","last_clean":"2023-01-02T18:18:19.328733+0000","last_became_active":"2023-01-02T18:17:29.327892+0000","last_became_peered":"2023-01-02T18:17:29.327892+0000","last_unstale":"2023-01-02T18:18:19.328733+0000","last_undegraded":"2023-01-02T18:18:19.328733+0000","last_fullsized":"2023-01-02T18:18:19.328733+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093481+0000","last_change":"2023-01-02T18:18:14.405724+0000","last_active":"2023-01-02T18:18:20.093481+0000","last_peered":"2023-01-02T18:18:20.093481+0000","last_clean":"2023-01-02T18:18:20.093481+0000","last_became_active":"2023-01-02T18:18:14.405125+0000","last_became_peered":"2023-01-02T18:18:14.405125+0000","last_unstale":"2023-01-02T18:18:20.093481+0000","last_undegraded":"2023-01-02T18:18:20.093481+0000","last_fullsized":"2023-01-02T18:18:20.093481+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"71'6","reported_seq":54,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327754+0000","last_change":"2023-01-02T18:17:29.380260+0000","last_active":"2023-01-02T18:18:19.327754+0000","last_peered":"2023-01-02T18:18:19.327754+0000","last_clean":"2023-01-02T18:18:19.327754+0000","last_became_active":"2023-01-02T18:17:29.334697+0000","last_became_peered":"2023-01-02T18:17:29.334697+0000","last_unstale":"2023-01-02T18:18:19.327754+0000","last_undegraded":"2023-01-02T18:18:19.327754+0000","last_fullsized":"2023-01-02T18:18:19.327754+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":21,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":84,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320064+0000","last_change":"2023-01-02T18:17:29.320212+0000","last_active":"2023-01-02T18:18:19.320064+0000","last_peered":"2023-01-02T18:18:19.320064+0000","last_clean":"2023-01-02T18:18:19.320064+0000","last_became_active":"2023-01-02T18:17:29.319459+0000","last_became_peered":"2023-01-02T18:17:29.319459+0000","last_unstale":"2023-01-02T18:18:19.320064+0000","last_undegraded":"2023-01-02T18:18:19.320064+0000","last_fullsized":"2023-01-02T18:18:19.320064+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"101'8","reported_seq":74,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321364+0000","last_change":"2023-01-02T18:17:34.316857+0000","last_active":"2023-01-02T18:18:19.321364+0000","last_peered":"2023-01-02T18:18:19.321364+0000","last_clean":"2023-01-02T18:18:19.321364+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:18:19.321364+0000","last_undegraded":"2023-01-02T18:18:19.321364+0000","last_fullsized":"2023-01-02T18:18:19.321364+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758339+0000","last_change":"2023-01-02T18:18:14.412872+0000","last_active":"2023-01-02T18:18:19.758339+0000","last_peered":"2023-01-02T18:18:19.758339+0000","last_clean":"2023-01-02T18:18:19.758339+0000","last_became_active":"2023-01-02T18:18:14.412662+0000","last_became_peered":"2023-01-02T18:18:14.412662+0000","last_unstale":"2023-01-02T18:18:19.758339+0000","last_undegraded":"2023-01-02T18:18:19.758339+0000","last_fullsized":"2023-01-02T18:18:19.758339+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923212+0000","last_change":"2023-01-02T18:18:02.777511+0000","last_active":"2023-01-02T18:18:19.923212+0000","last_peered":"2023-01-02T18:18:19.923212+0000","last_clean":"2023-01-02T18:18:19.923212+0000","last_became_active":"2023-01-02T18:18:02.777188+0000","last_became_peered":"2023-01-02T18:18:02.777188+0000","last_unstale":"2023-01-02T18:18:19.923212+0000","last_undegraded":"2023-01-02T18:18:19.923212+0000","last_fullsized":"2023-01-02T18:18:19.923212+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"136'5","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.990939+0000","last_change":"2023-01-02T18:18:00.740937+0000","last_active":"2023-01-02T18:18:20.990939+0000","last_peered":"2023-01-02T18:18:20.990939+0000","last_clean":"2023-01-02T18:18:20.990939+0000","last_became_active":"2023-01-02T18:17:58.733322+0000","last_became_peered":"2023-01-02T18:17:58.733322+0000","last_unstale":"2023-01-02T18:18:20.990939+0000","last_undegraded":"2023-01-02T18:18:20.990939+0000","last_fullsized":"2023-01-02T18:18:20.990939+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":88,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093920+0000","last_change":"2023-01-02T18:16:57.307188+0000","last_active":"2023-01-02T18:18:20.093920+0000","last_peered":"2023-01-02T18:18:20.093920+0000","last_clean":"2023-01-02T18:18:20.093920+0000","last_became_active":"2023-01-02T18:16:55.312649+0000","last_became_peered":"2023-01-02T18:16:55.312649+0000","last_unstale":"2023-01-02T18:18:20.093920+0000","last_undegraded":"2023-01-02T18:18:20.093920+0000","last_fullsized":"2023-01-02T18:18:20.093920+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"60'1","reported_seq":32,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320506+0000","last_change":"2023-01-02T18:18:14.433954+0000","last_active":"2023-01-02T18:18:19.320506+0000","last_peered":"2023-01-02T18:18:19.320506+0000","last_clean":"2023-01-02T18:18:19.320506+0000","last_became_active":"2023-01-02T18:18:14.404467+0000","last_became_peered":"2023-01-02T18:18:14.404467+0000","last_unstale":"2023-01-02T18:18:19.320506+0000","last_undegraded":"2023-01-02T18:18:19.320506+0000","last_fullsized":"2023-01-02T18:18:19.320506+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":111,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755784+0000","last_change":"2023-01-02T18:18:02.793602+0000","last_active":"2023-01-02T18:18:19.755784+0000","last_peered":"2023-01-02T18:18:19.755784+0000","last_clean":"2023-01-02T18:18:19.755784+0000","last_became_active":"2023-01-02T18:18:02.793264+0000","last_became_peered":"2023-01-02T18:18:02.793264+0000","last_unstale":"2023-01-02T18:18:19.755784+0000","last_undegraded":"2023-01-02T18:18:19.755784+0000","last_fullsized":"2023-01-02T18:18:19.755784+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"137'3","reported_seq":74,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-01-02T18:18:24.512812+0000","last_change":"2023-01-02T18:17:30.331472+0000","last_active":"2023-01-02T18:18:24.512812+0000","last_peered":"2023-01-02T18:18:24.512812+0000","last_clean":"2023-01-02T18:18:24.512812+0000","last_became_active":"2023-01-02T18:17:29.333176+0000","last_became_peered":"2023-01-02T18:17:29.333176+0000","last_unstale":"2023-01-02T18:18:24.512812+0000","last_undegraded":"2023-01-02T18:18:24.512812+0000","last_fullsized":"2023-01-02T18:18:24.512812+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":15,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756874+0000","last_change":"2023-01-02T18:18:14.410837+0000","last_active":"2023-01-02T18:18:19.756874+0000","last_peered":"2023-01-02T18:18:19.756874+0000","last_clean":"2023-01-02T18:18:19.756874+0000","last_became_active":"2023-01-02T18:18:14.410319+0000","last_became_peered":"2023-01-02T18:18:14.410319+0000","last_unstale":"2023-01-02T18:18:19.756874+0000","last_undegraded":"2023-01-02T18:18:19.756874+0000","last_fullsized":"2023-01-02T18:18:19.756874+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"71'4","reported_seq":90,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320328+0000","last_change":"2023-01-02T18:17:01.320111+0000","last_active":"2023-01-02T18:18:19.320328+0000","last_peered":"2023-01-02T18:18:19.320328+0000","last_clean":"2023-01-02T18:18:19.320328+0000","last_became_active":"2023-01-02T18:16:59.320501+0000","last_became_peered":"2023-01-02T18:16:59.320501+0000","last_unstale":"2023-01-02T18:18:19.320328+0000","last_undegraded":"2023-01-02T18:18:19.320328+0000","last_fullsized":"2023-01-02T18:18:19.320328+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1c","version":"76'3","reported_seq":85,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.922593+0000","last_change":"2023-01-02T18:17:09.308316+0000","last_active":"2023-01-02T18:18:19.922593+0000","last_peered":"2023-01-02T18:18:19.922593+0000","last_clean":"2023-01-02T18:18:19.922593+0000","last_became_active":"2023-01-02T18:17:07.339700+0000","last_became_peered":"2023-01-02T18:17:07.339700+0000","last_unstale":"2023-01-02T18:18:19.922593+0000","last_undegraded":"2023-01-02T18:18:19.922593+0000","last_fullsized":"2023-01-02T18:18:19.922593+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":9,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":61,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758090+0000","last_change":"2023-01-02T18:17:34.343843+0000","last_active":"2023-01-02T18:18:19.758090+0000","last_peered":"2023-01-02T18:18:19.758090+0000","last_clean":"2023-01-02T18:18:19.758090+0000","last_became_active":"2023-01-02T18:17:32.344716+0000","last_became_peered":"2023-01-02T18:17:32.344716+0000","last_unstale":"2023-01-02T18:18:19.758090+0000","last_undegraded":"2023-01-02T18:18:19.758090+0000","last_fullsized":"2023-01-02T18:18:19.758090+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":45,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757820+0000","last_change":"2023-01-02T18:17:38.464884+0000","last_active":"2023-01-02T18:18:19.757820+0000","last_peered":"2023-01-02T18:18:19.757820+0000","last_clean":"2023-01-02T18:18:19.757820+0000","last_became_active":"2023-01-02T18:17:36.445153+0000","last_became_peered":"2023-01-02T18:17:36.445153+0000","last_unstale":"2023-01-02T18:18:19.757820+0000","last_undegraded":"2023-01-02T18:18:19.757820+0000","last_fullsized":"2023-01-02T18:18:19.757820+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326178+0000","last_change":"2023-01-02T18:17:56.726411+0000","last_active":"2023-01-02T18:18:19.326178+0000","last_peered":"2023-01-02T18:18:19.326178+0000","last_clean":"2023-01-02T18:18:19.326178+0000","last_became_active":"2023-01-02T18:17:56.726121+0000","last_became_peered":"2023-01-02T18:17:56.726121+0000","last_unstale":"2023-01-02T18:18:19.326178+0000","last_undegraded":"2023-01-02T18:18:19.326178+0000","last_fullsized":"2023-01-02T18:18:19.326178+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":25,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325328+0000","last_change":"2023-01-02T18:18:02.763873+0000","last_active":"2023-01-02T18:18:19.325328+0000","last_peered":"2023-01-02T18:18:19.325328+0000","last_clean":"2023-01-02T18:18:19.325328+0000","last_became_active":"2023-01-02T18:18:02.763060+0000","last_became_peered":"2023-01-02T18:18:02.763060+0000","last_unstale":"2023-01-02T18:18:19.325328+0000","last_undegraded":"2023-01-02T18:18:19.325328+0000","last_fullsized":"2023-01-02T18:18:19.325328+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":86,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756372+0000","last_change":"2023-01-02T18:16:57.311013+0000","last_active":"2023-01-02T18:18:19.756372+0000","last_peered":"2023-01-02T18:18:19.756372+0000","last_clean":"2023-01-02T18:18:19.756372+0000","last_became_active":"2023-01-02T18:16:55.309232+0000","last_became_peered":"2023-01-02T18:16:55.309232+0000","last_unstale":"2023-01-02T18:18:19.756372+0000","last_undegraded":"2023-01-02T18:18:19.756372+0000","last_fullsized":"2023-01-02T18:18:19.756372+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":100,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320772+0000","last_change":"2023-01-02T18:17:29.320574+0000","last_active":"2023-01-02T18:18:19.320772+0000","last_peered":"2023-01-02T18:18:19.320772+0000","last_clean":"2023-01-02T18:18:19.320772+0000","last_became_active":"2023-01-02T18:17:29.320274+0000","last_became_peered":"2023-01-02T18:17:29.320274+0000","last_unstale":"2023-01-02T18:18:19.320772+0000","last_undegraded":"2023-01-02T18:18:19.320772+0000","last_fullsized":"2023-01-02T18:18:19.320772+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320253+0000","last_change":"2023-01-02T18:18:14.398877+0000","last_active":"2023-01-02T18:18:19.320253+0000","last_peered":"2023-01-02T18:18:19.320253+0000","last_clean":"2023-01-02T18:18:19.320253+0000","last_became_active":"2023-01-02T18:18:14.390961+0000","last_became_peered":"2023-01-02T18:18:14.390961+0000","last_unstale":"2023-01-02T18:18:19.320253+0000","last_undegraded":"2023-01-02T18:18:19.320253+0000","last_fullsized":"2023-01-02T18:18:19.320253+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"86'18","reported_seq":255,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756614+0000","last_change":"2023-01-02T18:18:14.440892+0000","last_active":"2023-01-02T18:18:19.756614+0000","last_peered":"2023-01-02T18:18:19.756614+0000","last_clean":"2023-01-02T18:18:19.756614+0000","last_became_active":"2023-01-02T18:18:14.411218+0000","last_became_peered":"2023-01-02T18:18:14.411218+0000","last_unstale":"2023-01-02T18:18:19.756614+0000","last_undegraded":"2023-01-02T18:18:19.756614+0000","last_fullsized":"2023-01-02T18:18:19.756614+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":18,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":223,"num_read_kb":192,"num_write":21,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":118,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094769+0000","last_change":"2023-01-02T18:17:48.662639+0000","last_active":"2023-01-02T18:18:20.094769+0000","last_peered":"2023-01-02T18:18:20.094769+0000","last_clean":"2023-01-02T18:18:20.094769+0000","last_became_active":"2023-01-02T18:17:48.662288+0000","last_became_peered":"2023-01-02T18:17:48.662288+0000","last_unstale":"2023-01-02T18:18:20.094769+0000","last_undegraded":"2023-01-02T18:18:20.094769+0000","last_fullsized":"2023-01-02T18:18:20.094769+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757672+0000","last_change":"2023-01-02T18:18:14.413697+0000","last_active":"2023-01-02T18:18:19.757672+0000","last_peered":"2023-01-02T18:18:19.757672+0000","last_clean":"2023-01-02T18:18:19.757672+0000","last_became_active":"2023-01-02T18:18:14.413389+0000","last_became_peered":"2023-01-02T18:18:14.413389+0000","last_unstale":"2023-01-02T18:18:19.757672+0000","last_undegraded":"2023-01-02T18:18:19.757672+0000","last_fullsized":"2023-01-02T18:18:19.757672+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":76,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.925067+0000","last_change":"2023-01-02T18:17:09.308664+0000","last_active":"2023-01-02T18:18:19.925067+0000","last_peered":"2023-01-02T18:18:19.925067+0000","last_clean":"2023-01-02T18:18:19.925067+0000","last_became_active":"2023-01-02T18:17:07.344272+0000","last_became_peered":"2023-01-02T18:17:07.344272+0000","last_unstale":"2023-01-02T18:18:19.925067+0000","last_undegraded":"2023-01-02T18:18:19.925067+0000","last_fullsized":"2023-01-02T18:18:19.925067+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"101'10","reported_seq":85,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094532+0000","last_change":"2023-01-02T18:17:34.326274+0000","last_active":"2023-01-02T18:18:20.094532+0000","last_peered":"2023-01-02T18:18:20.094532+0000","last_clean":"2023-01-02T18:18:20.094532+0000","last_became_active":"2023-01-02T18:17:32.339630+0000","last_became_peered":"2023-01-02T18:17:32.339630+0000","last_unstale":"2023-01-02T18:18:20.094532+0000","last_undegraded":"2023-01-02T18:18:20.094532+0000","last_fullsized":"2023-01-02T18:18:20.094532+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":28,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":45,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756561+0000","last_change":"2023-01-02T18:17:38.464600+0000","last_active":"2023-01-02T18:18:19.756561+0000","last_peered":"2023-01-02T18:18:19.756561+0000","last_clean":"2023-01-02T18:18:19.756561+0000","last_became_active":"2023-01-02T18:17:36.445763+0000","last_became_peered":"2023-01-02T18:17:36.445763+0000","last_unstale":"2023-01-02T18:18:19.756561+0000","last_undegraded":"2023-01-02T18:18:19.756561+0000","last_fullsized":"2023-01-02T18:18:19.756561+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"121'1","reported_seq":41,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.976746+0000","last_change":"2023-01-02T18:18:14.417840+0000","last_active":"2023-01-02T18:18:20.976746+0000","last_peered":"2023-01-02T18:18:20.976746+0000","last_clean":"2023-01-02T18:18:20.976746+0000","last_became_active":"2023-01-02T18:18:14.397300+0000","last_became_peered":"2023-01-02T18:18:14.397300+0000","last_unstale":"2023-01-02T18:18:20.976746+0000","last_undegraded":"2023-01-02T18:18:20.976746+0000","last_fullsized":"2023-01-02T18:18:20.976746+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1a","version":"123'2","reported_seq":30,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452007+0000","last_change":"2023-01-02T18:18:00.736009+0000","last_active":"2023-01-02T18:18:19.452007+0000","last_peered":"2023-01-02T18:18:19.452007+0000","last_clean":"2023-01-02T18:18:19.452007+0000","last_became_active":"2023-01-02T18:17:58.739782+0000","last_became_peered":"2023-01-02T18:17:58.739782+0000","last_unstale":"2023-01-02T18:18:19.452007+0000","last_undegraded":"2023-01-02T18:18:19.452007+0000","last_fullsized":"2023-01-02T18:18:19.452007+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.451956+0000","last_change":"2023-01-02T18:18:14.395441+0000","last_active":"2023-01-02T18:18:19.451956+0000","last_peered":"2023-01-02T18:18:19.451956+0000","last_clean":"2023-01-02T18:18:19.451956+0000","last_became_active":"2023-01-02T18:18:14.395099+0000","last_became_peered":"2023-01-02T18:18:14.395099+0000","last_unstale":"2023-01-02T18:18:19.451956+0000","last_undegraded":"2023-01-02T18:18:19.451956+0000","last_fullsized":"2023-01-02T18:18:19.451956+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319984+0000","last_change":"2023-01-02T18:18:14.400220+0000","last_active":"2023-01-02T18:18:19.319984+0000","last_peered":"2023-01-02T18:18:19.319984+0000","last_clean":"2023-01-02T18:18:19.319984+0000","last_became_active":"2023-01-02T18:18:14.399837+0000","last_became_peered":"2023-01-02T18:18:14.399837+0000","last_unstale":"2023-01-02T18:18:19.319984+0000","last_undegraded":"2023-01-02T18:18:19.319984+0000","last_fullsized":"2023-01-02T18:18:19.319984+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328862+0000","last_change":"2023-01-02T18:17:29.333748+0000","last_active":"2023-01-02T18:18:19.328862+0000","last_peered":"2023-01-02T18:18:19.328862+0000","last_clean":"2023-01-02T18:18:19.328862+0000","last_became_active":"2023-01-02T18:17:29.330002+0000","last_became_peered":"2023-01-02T18:17:29.330002+0000","last_unstale":"2023-01-02T18:18:19.328862+0000","last_undegraded":"2023-01-02T18:18:19.328862+0000","last_fullsized":"2023-01-02T18:18:19.328862+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"46'1","reported_seq":153,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756780+0000","last_change":"2023-01-02T18:18:08.362986+0000","last_active":"2023-01-02T18:18:19.756780+0000","last_peered":"2023-01-02T18:18:19.756780+0000","last_clean":"2023-01-02T18:18:19.756780+0000","last_became_active":"2023-01-02T18:18:08.362660+0000","last_became_peered":"2023-01-02T18:18:08.362660+0000","last_unstale":"2023-01-02T18:18:19.756780+0000","last_undegraded":"2023-01-02T18:18:19.756780+0000","last_fullsized":"2023-01-02T18:18:19.756780+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325954+0000","last_change":"2023-01-02T18:18:02.775898+0000","last_active":"2023-01-02T18:18:19.325954+0000","last_peered":"2023-01-02T18:18:19.325954+0000","last_clean":"2023-01-02T18:18:19.325954+0000","last_became_active":"2023-01-02T18:18:02.775488+0000","last_became_peered":"2023-01-02T18:18:02.775488+0000","last_unstale":"2023-01-02T18:18:19.325954+0000","last_undegraded":"2023-01-02T18:18:19.325954+0000","last_fullsized":"2023-01-02T18:18:19.325954+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":104,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321145+0000","last_change":"2023-01-02T18:17:29.343403+0000","last_active":"2023-01-02T18:18:19.321145+0000","last_peered":"2023-01-02T18:18:19.321145+0000","last_clean":"2023-01-02T18:18:19.321145+0000","last_became_active":"2023-01-02T18:17:29.320060+0000","last_became_peered":"2023-01-02T18:17:29.320060+0000","last_unstale":"2023-01-02T18:18:19.321145+0000","last_undegraded":"2023-01-02T18:18:19.321145+0000","last_fullsized":"2023-01-02T18:18:19.321145+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":76,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321280+0000","last_change":"2023-01-02T18:17:09.325339+0000","last_active":"2023-01-02T18:18:19.321280+0000","last_peered":"2023-01-02T18:18:19.321280+0000","last_clean":"2023-01-02T18:18:19.321280+0000","last_became_active":"2023-01-02T18:17:07.341155+0000","last_became_peered":"2023-01-02T18:17:07.341155+0000","last_unstale":"2023-01-02T18:18:19.321280+0000","last_undegraded":"2023-01-02T18:18:19.321280+0000","last_fullsized":"2023-01-02T18:18:19.321280+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1d","version":"101'8","reported_seq":78,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094453+0000","last_change":"2023-01-02T18:18:08.363193+0000","last_active":"2023-01-02T18:18:20.094453+0000","last_peered":"2023-01-02T18:18:20.094453+0000","last_clean":"2023-01-02T18:18:20.094453+0000","last_became_active":"2023-01-02T18:18:08.362887+0000","last_became_peered":"2023-01-02T18:18:08.362887+0000","last_unstale":"2023-01-02T18:18:20.094453+0000","last_undegraded":"2023-01-02T18:18:20.094453+0000","last_fullsized":"2023-01-02T18:18:20.094453+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1c","version":"117'12","reported_seq":68,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095479+0000","last_change":"2023-01-02T18:17:38.460374+0000","last_active":"2023-01-02T18:18:20.095479+0000","last_peered":"2023-01-02T18:18:20.095479+0000","last_clean":"2023-01-02T18:18:20.095479+0000","last_became_active":"2023-01-02T18:17:36.443934+0000","last_became_peered":"2023-01-02T18:17:36.443934+0000","last_unstale":"2023-01-02T18:18:20.095479+0000","last_undegraded":"2023-01-02T18:18:20.095479+0000","last_fullsized":"2023-01-02T18:18:20.095479+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":27,"num_read_kb":22,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325882+0000","last_change":"2023-01-02T18:18:02.777577+0000","last_active":"2023-01-02T18:18:19.325882+0000","last_peered":"2023-01-02T18:18:19.325882+0000","last_clean":"2023-01-02T18:18:19.325882+0000","last_became_active":"2023-01-02T18:18:02.777266+0000","last_became_peered":"2023-01-02T18:18:02.777266+0000","last_unstale":"2023-01-02T18:18:19.325882+0000","last_undegraded":"2023-01-02T18:18:19.325882+0000","last_fullsized":"2023-01-02T18:18:19.325882+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756346+0000","last_change":"2023-01-02T18:18:00.740375+0000","last_active":"2023-01-02T18:18:19.756346+0000","last_peered":"2023-01-02T18:18:19.756346+0000","last_clean":"2023-01-02T18:18:19.756346+0000","last_became_active":"2023-01-02T18:17:58.737895+0000","last_became_peered":"2023-01-02T18:17:58.737895+0000","last_unstale":"2023-01-02T18:18:19.756346+0000","last_undegraded":"2023-01-02T18:18:19.756346+0000","last_fullsized":"2023-01-02T18:18:19.756346+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":94,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757927+0000","last_change":"2023-01-02T18:17:29.340931+0000","last_active":"2023-01-02T18:18:19.757927+0000","last_peered":"2023-01-02T18:18:19.757927+0000","last_clean":"2023-01-02T18:18:19.757927+0000","last_became_active":"2023-01-02T18:17:29.340602+0000","last_became_peered":"2023-01-02T18:17:29.340602+0000","last_unstale":"2023-01-02T18:18:19.757927+0000","last_undegraded":"2023-01-02T18:18:19.757927+0000","last_fullsized":"2023-01-02T18:18:19.757927+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":90,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755630+0000","last_change":"2023-01-02T18:16:53.347232+0000","last_active":"2023-01-02T18:18:19.755630+0000","last_peered":"2023-01-02T18:18:19.755630+0000","last_clean":"2023-01-02T18:18:19.755630+0000","last_became_active":"2023-01-02T18:16:51.337359+0000","last_became_peered":"2023-01-02T18:16:51.337359+0000","last_unstale":"2023-01-02T18:18:19.755630+0000","last_undegraded":"2023-01-02T18:18:19.755630+0000","last_fullsized":"2023-01-02T18:18:19.755630+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327144+0000","last_change":"2023-01-02T18:17:29.329761+0000","last_active":"2023-01-02T18:18:19.327144+0000","last_peered":"2023-01-02T18:18:19.327144+0000","last_clean":"2023-01-02T18:18:19.327144+0000","last_became_active":"2023-01-02T18:17:29.327470+0000","last_became_peered":"2023-01-02T18:17:29.327470+0000","last_unstale":"2023-01-02T18:18:19.327144+0000","last_undegraded":"2023-01-02T18:18:19.327144+0000","last_fullsized":"2023-01-02T18:18:19.327144+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"137'25","reported_seq":286,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-01-02T18:18:24.495279+0000","last_change":"2023-01-02T18:18:02.862343+0000","last_active":"2023-01-02T18:18:24.495279+0000","last_peered":"2023-01-02T18:18:24.495279+0000","last_clean":"2023-01-02T18:18:24.495279+0000","last_became_active":"2023-01-02T18:18:02.800563+0000","last_became_peered":"2023-01-02T18:18:02.800563+0000","last_unstale":"2023-01-02T18:18:24.495279+0000","last_undegraded":"2023-01-02T18:18:24.495279+0000","last_fullsized":"2023-01-02T18:18:24.495279+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":270,"num_read_kb":223,"num_write":30,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16,"num_keys_recovered":8,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756403+0000","last_change":"2023-01-02T18:18:14.392638+0000","last_active":"2023-01-02T18:18:19.756403+0000","last_peered":"2023-01-02T18:18:19.756403+0000","last_clean":"2023-01-02T18:18:19.756403+0000","last_became_active":"2023-01-02T18:18:14.392332+0000","last_became_peered":"2023-01-02T18:18:14.392332+0000","last_unstale":"2023-01-02T18:18:19.756403+0000","last_undegraded":"2023-01-02T18:18:19.756403+0000","last_fullsized":"2023-01-02T18:18:19.756403+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.18","version":"69'1","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326025+0000","last_change":"2023-01-02T18:18:14.436810+0000","last_active":"2023-01-02T18:18:19.326025+0000","last_peered":"2023-01-02T18:18:19.326025+0000","last_clean":"2023-01-02T18:18:19.326025+0000","last_became_active":"2023-01-02T18:18:14.394284+0000","last_became_peered":"2023-01-02T18:18:14.394284+0000","last_unstale":"2023-01-02T18:18:19.326025+0000","last_undegraded":"2023-01-02T18:18:19.326025+0000","last_fullsized":"2023-01-02T18:18:19.326025+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":32,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094546+0000","last_change":"2023-01-02T18:18:14.403937+0000","last_active":"2023-01-02T18:18:20.094546+0000","last_peered":"2023-01-02T18:18:20.094546+0000","last_clean":"2023-01-02T18:18:20.094546+0000","last_became_active":"2023-01-02T18:18:14.403552+0000","last_became_peered":"2023-01-02T18:18:14.403552+0000","last_unstale":"2023-01-02T18:18:20.094546+0000","last_undegraded":"2023-01-02T18:18:20.094546+0000","last_fullsized":"2023-01-02T18:18:20.094546+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1a","version":"101'8","reported_seq":87,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093740+0000","last_change":"2023-01-02T18:17:34.325778+0000","last_active":"2023-01-02T18:18:20.093740+0000","last_peered":"2023-01-02T18:18:20.093740+0000","last_clean":"2023-01-02T18:18:20.093740+0000","last_became_active":"2023-01-02T18:17:32.340683+0000","last_became_peered":"2023-01-02T18:17:32.340683+0000","last_unstale":"2023-01-02T18:18:20.093740+0000","last_undegraded":"2023-01-02T18:18:20.093740+0000","last_fullsized":"2023-01-02T18:18:20.093740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":49,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757104+0000","last_change":"2023-01-02T18:18:08.362072+0000","last_active":"2023-01-02T18:18:19.757104+0000","last_peered":"2023-01-02T18:18:19.757104+0000","last_clean":"2023-01-02T18:18:19.757104+0000","last_became_active":"2023-01-02T18:18:08.361756+0000","last_became_peered":"2023-01-02T18:18:08.361756+0000","last_unstale":"2023-01-02T18:18:19.757104+0000","last_undegraded":"2023-01-02T18:18:19.757104+0000","last_fullsized":"2023-01-02T18:18:19.757104+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"136'2","reported_seq":31,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.967153+0000","last_change":"2023-01-02T18:17:56.731384+0000","last_active":"2023-01-02T18:18:20.967153+0000","last_peered":"2023-01-02T18:18:20.967153+0000","last_clean":"2023-01-02T18:18:20.967153+0000","last_became_active":"2023-01-02T18:17:56.731100+0000","last_became_peered":"2023-01-02T18:17:56.731100+0000","last_unstale":"2023-01-02T18:18:20.967153+0000","last_undegraded":"2023-01-02T18:18:20.967153+0000","last_fullsized":"2023-01-02T18:18:20.967153+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"136'5","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.990919+0000","last_change":"2023-01-02T18:18:00.738182+0000","last_active":"2023-01-02T18:18:20.990919+0000","last_peered":"2023-01-02T18:18:20.990919+0000","last_clean":"2023-01-02T18:18:20.990919+0000","last_became_active":"2023-01-02T18:17:58.740482+0000","last_became_peered":"2023-01-02T18:17:58.740482+0000","last_unstale":"2023-01-02T18:18:20.990919+0000","last_undegraded":"2023-01-02T18:18:20.990919+0000","last_fullsized":"2023-01-02T18:18:20.990919+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":92,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321178+0000","last_change":"2023-01-02T18:18:08.361133+0000","last_active":"2023-01-02T18:18:19.321178+0000","last_peered":"2023-01-02T18:18:19.321178+0000","last_clean":"2023-01-02T18:18:19.321178+0000","last_became_active":"2023-01-02T18:18:08.360812+0000","last_became_peered":"2023-01-02T18:18:08.360812+0000","last_unstale":"2023-01-02T18:18:19.321178+0000","last_undegraded":"2023-01-02T18:18:19.321178+0000","last_fullsized":"2023-01-02T18:18:19.321178+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326086+0000","last_change":"2023-01-02T18:18:02.766517+0000","last_active":"2023-01-02T18:18:19.326086+0000","last_peered":"2023-01-02T18:18:19.326086+0000","last_clean":"2023-01-02T18:18:19.326086+0000","last_became_active":"2023-01-02T18:18:02.766176+0000","last_became_peered":"2023-01-02T18:18:02.766176+0000","last_unstale":"2023-01-02T18:18:19.326086+0000","last_undegraded":"2023-01-02T18:18:19.326086+0000","last_fullsized":"2023-01-02T18:18:19.326086+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756862+0000","last_change":"2023-01-02T18:18:14.411297+0000","last_active":"2023-01-02T18:18:19.756862+0000","last_peered":"2023-01-02T18:18:19.756862+0000","last_clean":"2023-01-02T18:18:19.756862+0000","last_became_active":"2023-01-02T18:18:14.410986+0000","last_became_peered":"2023-01-02T18:18:14.410986+0000","last_unstale":"2023-01-02T18:18:19.756862+0000","last_undegraded":"2023-01-02T18:18:19.756862+0000","last_fullsized":"2023-01-02T18:18:19.756862+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"46'1","reported_seq":148,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756237+0000","last_change":"2023-01-02T18:17:30.333125+0000","last_active":"2023-01-02T18:18:19.756237+0000","last_peered":"2023-01-02T18:18:19.756237+0000","last_clean":"2023-01-02T18:18:19.756237+0000","last_became_active":"2023-01-02T18:16:37.431650+0000","last_became_peered":"2023-01-02T18:16:37.431650+0000","last_unstale":"2023-01-02T18:18:19.756237+0000","last_undegraded":"2023-01-02T18:18:19.756237+0000","last_fullsized":"2023-01-02T18:18:19.756237+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327415+0000","last_change":"2023-01-02T18:17:29.335193+0000","last_active":"2023-01-02T18:18:19.327415+0000","last_peered":"2023-01-02T18:18:19.327415+0000","last_clean":"2023-01-02T18:18:19.327415+0000","last_became_active":"2023-01-02T18:17:29.334681+0000","last_became_peered":"2023-01-02T18:17:29.334681+0000","last_unstale":"2023-01-02T18:18:19.327415+0000","last_undegraded":"2023-01-02T18:18:19.327415+0000","last_fullsized":"2023-01-02T18:18:19.327415+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"68'4","reported_seq":66,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328540+0000","last_change":"2023-01-02T18:18:02.842595+0000","last_active":"2023-01-02T18:18:19.328540+0000","last_peered":"2023-01-02T18:18:19.328540+0000","last_clean":"2023-01-02T18:18:19.328540+0000","last_became_active":"2023-01-02T18:18:02.799957+0000","last_became_peered":"2023-01-02T18:18:02.799957+0000","last_unstale":"2023-01-02T18:18:19.328540+0000","last_undegraded":"2023-01-02T18:18:19.328540+0000","last_fullsized":"2023-01-02T18:18:19.328540+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":76,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093634+0000","last_change":"2023-01-02T18:17:09.330482+0000","last_active":"2023-01-02T18:18:20.093634+0000","last_peered":"2023-01-02T18:18:20.093634+0000","last_clean":"2023-01-02T18:18:20.093634+0000","last_became_active":"2023-01-02T18:17:07.344261+0000","last_became_peered":"2023-01-02T18:17:07.344261+0000","last_unstale":"2023-01-02T18:18:20.093634+0000","last_undegraded":"2023-01-02T18:18:20.093634+0000","last_fullsized":"2023-01-02T18:18:20.093634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1b","version":"101'2","reported_seq":72,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326034+0000","last_change":"2023-01-02T18:18:14.432070+0000","last_active":"2023-01-02T18:18:19.326034+0000","last_peered":"2023-01-02T18:18:19.326034+0000","last_clean":"2023-01-02T18:18:19.326034+0000","last_became_active":"2023-01-02T18:18:14.415347+0000","last_became_peered":"2023-01-02T18:18:14.415347+0000","last_unstale":"2023-01-02T18:18:19.326034+0000","last_undegraded":"2023-01-02T18:18:19.326034+0000","last_fullsized":"2023-01-02T18:18:19.326034+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1a","version":"105'3","reported_seq":75,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328737+0000","last_change":"2023-01-02T18:18:14.455408+0000","last_active":"2023-01-02T18:18:19.328737+0000","last_peered":"2023-01-02T18:18:19.328737+0000","last_clean":"2023-01-02T18:18:19.328737+0000","last_became_active":"2023-01-02T18:18:14.402322+0000","last_became_peered":"2023-01-02T18:18:14.402322+0000","last_unstale":"2023-01-02T18:18:19.328737+0000","last_undegraded":"2023-01-02T18:18:19.328737+0000","last_fullsized":"2023-01-02T18:18:19.328737+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":12,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320153+0000","last_change":"2023-01-02T18:17:56.723414+0000","last_active":"2023-01-02T18:18:19.320153+0000","last_peered":"2023-01-02T18:18:19.320153+0000","last_clean":"2023-01-02T18:18:19.320153+0000","last_became_active":"2023-01-02T18:17:56.723144+0000","last_became_peered":"2023-01-02T18:17:56.723144+0000","last_unstale":"2023-01-02T18:18:19.320153+0000","last_undegraded":"2023-01-02T18:18:19.320153+0000","last_fullsized":"2023-01-02T18:18:19.320153+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.096044+0000","last_change":"2023-01-02T18:18:00.737826+0000","last_active":"2023-01-02T18:18:20.096044+0000","last_peered":"2023-01-02T18:18:20.096044+0000","last_clean":"2023-01-02T18:18:20.096044+0000","last_became_active":"2023-01-02T18:17:58.738697+0000","last_became_peered":"2023-01-02T18:17:58.738697+0000","last_unstale":"2023-01-02T18:18:20.096044+0000","last_undegraded":"2023-01-02T18:18:20.096044+0000","last_fullsized":"2023-01-02T18:18:20.096044+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.15","version":"64'1","reported_seq":91,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756468+0000","last_change":"2023-01-02T18:16:57.312416+0000","last_active":"2023-01-02T18:18:19.756468+0000","last_peered":"2023-01-02T18:18:19.756468+0000","last_clean":"2023-01-02T18:18:19.756468+0000","last_became_active":"2023-01-02T18:16:55.312994+0000","last_became_peered":"2023-01-02T18:16:55.312994+0000","last_unstale":"2023-01-02T18:18:19.756468+0000","last_undegraded":"2023-01-02T18:18:19.756468+0000","last_fullsized":"2023-01-02T18:18:19.756468+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":99,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452752+0000","last_change":"2023-01-02T18:18:02.774638+0000","last_active":"2023-01-02T18:18:19.452752+0000","last_peered":"2023-01-02T18:18:19.452752+0000","last_clean":"2023-01-02T18:18:19.452752+0000","last_became_active":"2023-01-02T18:18:02.774320+0000","last_became_peered":"2023-01-02T18:18:02.774320+0000","last_unstale":"2023-01-02T18:18:19.452752+0000","last_undegraded":"2023-01-02T18:18:19.452752+0000","last_fullsized":"2023-01-02T18:18:19.452752+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757871+0000","last_change":"2023-01-02T18:18:14.396090+0000","last_active":"2023-01-02T18:18:19.757871+0000","last_peered":"2023-01-02T18:18:19.757871+0000","last_clean":"2023-01-02T18:18:19.757871+0000","last_became_active":"2023-01-02T18:18:14.395793+0000","last_became_peered":"2023-01-02T18:18:14.395793+0000","last_unstale":"2023-01-02T18:18:19.757871+0000","last_undegraded":"2023-01-02T18:18:19.757871+0000","last_fullsized":"2023-01-02T18:18:19.757871+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.11","version":"46'3","reported_seq":180,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756713+0000","last_change":"2023-01-02T18:18:02.852818+0000","last_active":"2023-01-02T18:18:19.756713+0000","last_peered":"2023-01-02T18:18:19.756713+0000","last_clean":"2023-01-02T18:18:19.756713+0000","last_became_active":"2023-01-02T18:18:02.796511+0000","last_became_peered":"2023-01-02T18:18:02.796511+0000","last_unstale":"2023-01-02T18:18:19.756713+0000","last_undegraded":"2023-01-02T18:18:19.756713+0000","last_fullsized":"2023-01-02T18:18:19.756713+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":22,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757735+0000","last_change":"2023-01-02T18:18:14.406602+0000","last_active":"2023-01-02T18:18:19.757735+0000","last_peered":"2023-01-02T18:18:19.757735+0000","last_clean":"2023-01-02T18:18:19.757735+0000","last_became_active":"2023-01-02T18:18:14.406285+0000","last_became_peered":"2023-01-02T18:18:14.406285+0000","last_unstale":"2023-01-02T18:18:19.757735+0000","last_undegraded":"2023-01-02T18:18:19.757735+0000","last_fullsized":"2023-01-02T18:18:19.757735+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1a","version":"68'2","reported_seq":191,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093360+0000","last_change":"2023-01-02T18:17:01.317114+0000","last_active":"2023-01-02T18:18:20.093360+0000","last_peered":"2023-01-02T18:18:20.093360+0000","last_clean":"2023-01-02T18:18:20.093360+0000","last_became_active":"2023-01-02T18:16:59.324986+0000","last_became_peered":"2023-01-02T18:16:59.324986+0000","last_unstale":"2023-01-02T18:18:20.093360+0000","last_undegraded":"2023-01-02T18:18:20.093360+0000","last_fullsized":"2023-01-02T18:18:20.093360+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320740+0000","last_change":"2023-01-02T18:18:14.400818+0000","last_active":"2023-01-02T18:18:19.320740+0000","last_peered":"2023-01-02T18:18:19.320740+0000","last_clean":"2023-01-02T18:18:19.320740+0000","last_became_active":"2023-01-02T18:18:14.400487+0000","last_became_peered":"2023-01-02T18:18:14.400487+0000","last_unstale":"2023-01-02T18:18:19.320740+0000","last_undegraded":"2023-01-02T18:18:19.320740+0000","last_fullsized":"2023-01-02T18:18:19.320740+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":62,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.451791+0000","last_change":"2023-01-02T18:17:34.343511+0000","last_active":"2023-01-02T18:18:19.451791+0000","last_peered":"2023-01-02T18:18:19.451791+0000","last_clean":"2023-01-02T18:18:19.451791+0000","last_became_active":"2023-01-02T18:17:32.340038+0000","last_became_peered":"2023-01-02T18:17:32.340038+0000","last_unstale":"2023-01-02T18:18:19.451791+0000","last_undegraded":"2023-01-02T18:18:19.451791+0000","last_fullsized":"2023-01-02T18:18:19.451791+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":47,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319504+0000","last_change":"2023-01-02T18:17:38.444327+0000","last_active":"2023-01-02T18:18:19.319504+0000","last_peered":"2023-01-02T18:18:19.319504+0000","last_clean":"2023-01-02T18:18:19.319504+0000","last_became_active":"2023-01-02T18:17:36.443020+0000","last_became_peered":"2023-01-02T18:17:36.443020+0000","last_unstale":"2023-01-02T18:18:19.319504+0000","last_undegraded":"2023-01-02T18:18:19.319504+0000","last_fullsized":"2023-01-02T18:18:19.319504+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":28,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326040+0000","last_change":"2023-01-02T18:18:14.409061+0000","last_active":"2023-01-02T18:18:19.326040+0000","last_peered":"2023-01-02T18:18:19.326040+0000","last_clean":"2023-01-02T18:18:19.326040+0000","last_became_active":"2023-01-02T18:18:14.408749+0000","last_became_peered":"2023-01-02T18:18:14.408749+0000","last_unstale":"2023-01-02T18:18:19.326040+0000","last_undegraded":"2023-01-02T18:18:19.326040+0000","last_fullsized":"2023-01-02T18:18:19.326040+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":33,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094887+0000","last_change":"2023-01-02T18:18:08.363383+0000","last_active":"2023-01-02T18:18:20.094887+0000","last_peered":"2023-01-02T18:18:20.094887+0000","last_clean":"2023-01-02T18:18:20.094887+0000","last_became_active":"2023-01-02T18:18:08.362837+0000","last_became_peered":"2023-01-02T18:18:08.362837+0000","last_unstale":"2023-01-02T18:18:20.094887+0000","last_undegraded":"2023-01-02T18:18:20.094887+0000","last_fullsized":"2023-01-02T18:18:20.094887+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"64'1","reported_seq":32,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452476+0000","last_change":"2023-01-02T18:18:14.414175+0000","last_active":"2023-01-02T18:18:19.452476+0000","last_peered":"2023-01-02T18:18:19.452476+0000","last_clean":"2023-01-02T18:18:19.452476+0000","last_became_active":"2023-01-02T18:18:14.398430+0000","last_became_peered":"2023-01-02T18:18:14.398430+0000","last_unstale":"2023-01-02T18:18:19.452476+0000","last_undegraded":"2023-01-02T18:18:19.452476+0000","last_fullsized":"2023-01-02T18:18:19.452476+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":90,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757500+0000","last_change":"2023-01-02T18:16:53.346848+0000","last_active":"2023-01-02T18:18:19.757500+0000","last_peered":"2023-01-02T18:18:19.757500+0000","last_clean":"2023-01-02T18:18:19.757500+0000","last_became_active":"2023-01-02T18:16:51.333586+0000","last_became_peered":"2023-01-02T18:16:51.333586+0000","last_unstale":"2023-01-02T18:18:19.757500+0000","last_undegraded":"2023-01-02T18:18:19.757500+0000","last_fullsized":"2023-01-02T18:18:19.757500+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":58,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328537+0000","last_change":"2023-01-02T18:18:14.399459+0000","last_active":"2023-01-02T18:18:19.328537+0000","last_peered":"2023-01-02T18:18:19.328537+0000","last_clean":"2023-01-02T18:18:19.328537+0000","last_became_active":"2023-01-02T18:18:14.399132+0000","last_became_peered":"2023-01-02T18:18:14.399132+0000","last_unstale":"2023-01-02T18:18:19.328537+0000","last_undegraded":"2023-01-02T18:18:19.328537+0000","last_fullsized":"2023-01-02T18:18:19.328537+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"80'15","reported_seq":224,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093793+0000","last_change":"2023-01-02T18:17:30.502618+0000","last_active":"2023-01-02T18:18:20.093793+0000","last_peered":"2023-01-02T18:18:20.093793+0000","last_clean":"2023-01-02T18:18:20.093793+0000","last_became_active":"2023-01-02T18:16:37.422311+0000","last_became_peered":"2023-01-02T18:16:37.422311+0000","last_unstale":"2023-01-02T18:18:20.093793+0000","last_undegraded":"2023-01-02T18:18:20.093793+0000","last_fullsized":"2023-01-02T18:18:20.093793+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":151,"num_write":22,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757925+0000","last_change":"2023-01-02T18:18:14.396889+0000","last_active":"2023-01-02T18:18:19.757925+0000","last_peered":"2023-01-02T18:18:19.757925+0000","last_clean":"2023-01-02T18:18:19.757925+0000","last_became_active":"2023-01-02T18:18:14.396585+0000","last_became_peered":"2023-01-02T18:18:14.396585+0000","last_unstale":"2023-01-02T18:18:19.757925+0000","last_undegraded":"2023-01-02T18:18:19.757925+0000","last_fullsized":"2023-01-02T18:18:19.757925+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"72'85","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325604+0000","last_change":"2023-01-02T18:18:02.800035+0000","last_active":"2023-01-02T18:18:19.325604+0000","last_peered":"2023-01-02T18:18:19.325604+0000","last_clean":"2023-01-02T18:18:19.325604+0000","last_became_active":"2023-01-02T18:18:02.761736+0000","last_became_peered":"2023-01-02T18:18:02.761736+0000","last_unstale":"2023-01-02T18:18:19.325604+0000","last_undegraded":"2023-01-02T18:18:19.325604+0000","last_fullsized":"2023-01-02T18:18:19.325604+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":85,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1512,"num_read_kb":1369,"num_write":77,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":79,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1a","version":"76'3","reported_seq":19,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755989+0000","last_change":"2023-01-02T18:18:14.427730+0000","last_active":"2023-01-02T18:18:19.755989+0000","last_peered":"2023-01-02T18:18:19.755989+0000","last_clean":"2023-01-02T18:18:19.755989+0000","last_became_active":"2023-01-02T18:18:14.399527+0000","last_became_peered":"2023-01-02T18:18:14.399527+0000","last_unstale":"2023-01-02T18:18:19.755989+0000","last_undegraded":"2023-01-02T18:18:19.755989+0000","last_fullsized":"2023-01-02T18:18:19.755989+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":34,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":71,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.922912+0000","last_change":"2023-01-02T18:18:02.777846+0000","last_active":"2023-01-02T18:18:19.922912+0000","last_peered":"2023-01-02T18:18:19.922912+0000","last_clean":"2023-01-02T18:18:19.922912+0000","last_became_active":"2023-01-02T18:18:02.777630+0000","last_became_peered":"2023-01-02T18:18:02.777630+0000","last_unstale":"2023-01-02T18:18:19.922912+0000","last_undegraded":"2023-01-02T18:18:19.922912+0000","last_fullsized":"2023-01-02T18:18:19.922912+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":19,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.451847+0000","last_change":"2023-01-02T18:18:08.359292+0000","last_active":"2023-01-02T18:18:19.451847+0000","last_peered":"2023-01-02T18:18:19.451847+0000","last_clean":"2023-01-02T18:18:19.451847+0000","last_became_active":"2023-01-02T18:18:08.358660+0000","last_became_peered":"2023-01-02T18:18:08.358660+0000","last_unstale":"2023-01-02T18:18:19.451847+0000","last_undegraded":"2023-01-02T18:18:19.451847+0000","last_fullsized":"2023-01-02T18:18:19.451847+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095942+0000","last_change":"2023-01-02T18:17:56.727524+0000","last_active":"2023-01-02T18:18:20.095942+0000","last_peered":"2023-01-02T18:18:20.095942+0000","last_clean":"2023-01-02T18:18:20.095942+0000","last_became_active":"2023-01-02T18:17:56.727274+0000","last_became_peered":"2023-01-02T18:17:56.727274+0000","last_unstale":"2023-01-02T18:18:20.095942+0000","last_undegraded":"2023-01-02T18:18:20.095942+0000","last_fullsized":"2023-01-02T18:18:20.095942+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":96,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923905+0000","last_change":"2023-01-02T18:17:29.319062+0000","last_active":"2023-01-02T18:18:19.923905+0000","last_peered":"2023-01-02T18:18:19.923905+0000","last_clean":"2023-01-02T18:18:19.923905+0000","last_became_active":"2023-01-02T18:17:29.318747+0000","last_became_peered":"2023-01-02T18:17:29.318747+0000","last_unstale":"2023-01-02T18:18:19.923905+0000","last_undegraded":"2023-01-02T18:18:19.923905+0000","last_fullsized":"2023-01-02T18:18:19.923905+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328463+0000","last_change":"2023-01-02T18:17:29.335316+0000","last_active":"2023-01-02T18:18:19.328463+0000","last_peered":"2023-01-02T18:18:19.328463+0000","last_clean":"2023-01-02T18:18:19.328463+0000","last_became_active":"2023-01-02T18:17:29.333739+0000","last_became_peered":"2023-01-02T18:17:29.333739+0000","last_unstale":"2023-01-02T18:18:19.328463+0000","last_undegraded":"2023-01-02T18:18:19.328463+0000","last_fullsized":"2023-01-02T18:18:19.328463+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":95,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756885+0000","last_change":"2023-01-02T18:16:49.305243+0000","last_active":"2023-01-02T18:18:19.756885+0000","last_peered":"2023-01-02T18:18:19.756885+0000","last_clean":"2023-01-02T18:18:19.756885+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:18:19.756885+0000","last_undegraded":"2023-01-02T18:18:19.756885+0000","last_fullsized":"2023-01-02T18:18:19.756885+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"82'14","reported_seq":246,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758016+0000","last_change":"2023-01-02T18:18:02.822898+0000","last_active":"2023-01-02T18:18:19.758016+0000","last_peered":"2023-01-02T18:18:19.758016+0000","last_clean":"2023-01-02T18:18:19.758016+0000","last_became_active":"2023-01-02T18:18:02.793322+0000","last_became_peered":"2023-01-02T18:18:02.793322+0000","last_unstale":"2023-01-02T18:18:19.758016+0000","last_undegraded":"2023-01-02T18:18:19.758016+0000","last_fullsized":"2023-01-02T18:18:19.758016+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":14,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":148,"num_read_kb":122,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":92,"num_keys_recovered":26,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"51'1","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326445+0000","last_change":"2023-01-02T18:17:29.334624+0000","last_active":"2023-01-02T18:18:19.326445+0000","last_peered":"2023-01-02T18:18:19.326445+0000","last_clean":"2023-01-02T18:18:19.326445+0000","last_became_active":"2023-01-02T18:17:29.332434+0000","last_became_peered":"2023-01-02T18:17:29.332434+0000","last_unstale":"2023-01-02T18:18:19.326445+0000","last_undegraded":"2023-01-02T18:18:19.326445+0000","last_fullsized":"2023-01-02T18:18:19.326445+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"72'10","reported_seq":66,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328736+0000","last_change":"2023-01-02T18:18:02.816207+0000","last_active":"2023-01-02T18:18:19.328736+0000","last_peered":"2023-01-02T18:18:19.328736+0000","last_clean":"2023-01-02T18:18:19.328736+0000","last_became_active":"2023-01-02T18:18:02.798478+0000","last_became_peered":"2023-01-02T18:18:02.798478+0000","last_unstale":"2023-01-02T18:18:19.328736+0000","last_undegraded":"2023-01-02T18:18:19.328736+0000","last_fullsized":"2023-01-02T18:18:19.328736+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":125,"num_read_kb":120,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":156,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328599+0000","last_change":"2023-01-02T18:17:29.329576+0000","last_active":"2023-01-02T18:18:19.328599+0000","last_peered":"2023-01-02T18:18:19.328599+0000","last_clean":"2023-01-02T18:18:19.328599+0000","last_became_active":"2023-01-02T18:17:29.328074+0000","last_became_peered":"2023-01-02T18:17:29.328074+0000","last_unstale":"2023-01-02T18:18:19.328599+0000","last_undegraded":"2023-01-02T18:18:19.328599+0000","last_fullsized":"2023-01-02T18:18:19.328599+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"101'19","reported_seq":125,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327125+0000","last_change":"2023-01-02T18:17:34.318618+0000","last_active":"2023-01-02T18:18:19.327125+0000","last_peered":"2023-01-02T18:18:19.327125+0000","last_clean":"2023-01-02T18:18:19.327125+0000","last_became_active":"2023-01-02T18:17:32.337685+0000","last_became_peered":"2023-01-02T18:17:32.337685+0000","last_unstale":"2023-01-02T18:18:19.327125+0000","last_undegraded":"2023-01-02T18:18:19.327125+0000","last_fullsized":"2023-01-02T18:18:19.327125+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.7","version":"105'15","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327402+0000","last_change":"2023-01-02T18:17:38.447587+0000","last_active":"2023-01-02T18:18:19.327402+0000","last_peered":"2023-01-02T18:18:19.327402+0000","last_clean":"2023-01-02T18:18:19.327402+0000","last_became_active":"2023-01-02T18:17:36.439633+0000","last_became_peered":"2023-01-02T18:17:36.439633+0000","last_unstale":"2023-01-02T18:18:19.327402+0000","last_undegraded":"2023-01-02T18:18:19.327402+0000","last_fullsized":"2023-01-02T18:18:19.327402+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":30,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093801+0000","last_change":"2023-01-02T18:18:08.364941+0000","last_active":"2023-01-02T18:18:20.093801+0000","last_peered":"2023-01-02T18:18:20.093801+0000","last_clean":"2023-01-02T18:18:20.093801+0000","last_became_active":"2023-01-02T18:18:08.364419+0000","last_became_peered":"2023-01-02T18:18:08.364419+0000","last_unstale":"2023-01-02T18:18:20.093801+0000","last_undegraded":"2023-01-02T18:18:20.093801+0000","last_fullsized":"2023-01-02T18:18:20.093801+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094002+0000","last_change":"2023-01-02T18:18:00.737738+0000","last_active":"2023-01-02T18:18:20.094002+0000","last_peered":"2023-01-02T18:18:20.094002+0000","last_clean":"2023-01-02T18:18:20.094002+0000","last_became_active":"2023-01-02T18:17:58.739275+0000","last_became_peered":"2023-01-02T18:17:58.739275+0000","last_unstale":"2023-01-02T18:18:20.094002+0000","last_undegraded":"2023-01-02T18:18:20.094002+0000","last_fullsized":"2023-01-02T18:18:20.094002+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326409+0000","last_change":"2023-01-02T18:18:14.402647+0000","last_active":"2023-01-02T18:18:19.326409+0000","last_peered":"2023-01-02T18:18:19.326409+0000","last_clean":"2023-01-02T18:18:19.326409+0000","last_became_active":"2023-01-02T18:18:14.401886+0000","last_became_peered":"2023-01-02T18:18:14.401886+0000","last_unstale":"2023-01-02T18:18:19.326409+0000","last_undegraded":"2023-01-02T18:18:19.326409+0000","last_fullsized":"2023-01-02T18:18:19.326409+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757640+0000","last_change":"2023-01-02T18:18:14.407311+0000","last_active":"2023-01-02T18:18:19.757640+0000","last_peered":"2023-01-02T18:18:19.757640+0000","last_clean":"2023-01-02T18:18:19.757640+0000","last_became_active":"2023-01-02T18:18:14.407005+0000","last_became_peered":"2023-01-02T18:18:14.407005+0000","last_unstale":"2023-01-02T18:18:19.757640+0000","last_undegraded":"2023-01-02T18:18:19.757640+0000","last_fullsized":"2023-01-02T18:18:19.757640+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":97,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319586+0000","last_change":"2023-01-02T18:16:49.323166+0000","last_active":"2023-01-02T18:18:19.319586+0000","last_peered":"2023-01-02T18:18:19.319586+0000","last_clean":"2023-01-02T18:18:19.319586+0000","last_became_active":"2023-01-02T18:16:46.309577+0000","last_became_peered":"2023-01-02T18:16:46.309577+0000","last_unstale":"2023-01-02T18:18:19.319586+0000","last_undegraded":"2023-01-02T18:18:19.319586+0000","last_fullsized":"2023-01-02T18:18:19.319586+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"46'7","reported_seq":201,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757914+0000","last_change":"2023-01-02T18:18:02.844570+0000","last_active":"2023-01-02T18:18:19.757914+0000","last_peered":"2023-01-02T18:18:19.757914+0000","last_clean":"2023-01-02T18:18:19.757914+0000","last_became_active":"2023-01-02T18:18:02.794881+0000","last_became_peered":"2023-01-02T18:18:02.794881+0000","last_unstale":"2023-01-02T18:18:19.757914+0000","last_undegraded":"2023-01-02T18:18:19.757914+0000","last_fullsized":"2023-01-02T18:18:19.757914+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":63,"num_read_kb":54,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"51'3","reported_seq":24,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325172+0000","last_change":"2023-01-02T18:18:02.823024+0000","last_active":"2023-01-02T18:18:19.325172+0000","last_peered":"2023-01-02T18:18:19.325172+0000","last_clean":"2023-01-02T18:18:19.325172+0000","last_became_active":"2023-01-02T18:18:02.777177+0000","last_became_peered":"2023-01-02T18:18:02.777177+0000","last_unstale":"2023-01-02T18:18:19.325172+0000","last_undegraded":"2023-01-02T18:18:19.325172+0000","last_fullsized":"2023-01-02T18:18:19.325172+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"71'2","reported_seq":110,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094879+0000","last_change":"2023-01-02T18:18:02.856087+0000","last_active":"2023-01-02T18:18:20.094879+0000","last_peered":"2023-01-02T18:18:20.094879+0000","last_clean":"2023-01-02T18:18:20.094879+0000","last_became_active":"2023-01-02T18:18:02.795009+0000","last_became_peered":"2023-01-02T18:18:02.795009+0000","last_unstale":"2023-01-02T18:18:20.094879+0000","last_undegraded":"2023-01-02T18:18:20.094879+0000","last_fullsized":"2023-01-02T18:18:20.094879+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":19,"num_read_kb":5,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":32,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":84,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924198+0000","last_change":"2023-01-02T18:18:02.777410+0000","last_active":"2023-01-02T18:18:19.924198+0000","last_peered":"2023-01-02T18:18:19.924198+0000","last_clean":"2023-01-02T18:18:19.924198+0000","last_became_active":"2023-01-02T18:18:02.777027+0000","last_became_peered":"2023-01-02T18:18:02.777027+0000","last_unstale":"2023-01-02T18:18:19.924198+0000","last_undegraded":"2023-01-02T18:18:19.924198+0000","last_fullsized":"2023-01-02T18:18:19.924198+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.7","version":"101'8","reported_seq":86,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095864+0000","last_change":"2023-01-02T18:18:14.456986+0000","last_active":"2023-01-02T18:18:20.095864+0000","last_peered":"2023-01-02T18:18:20.095864+0000","last_clean":"2023-01-02T18:18:20.095864+0000","last_became_active":"2023-01-02T18:18:14.414360+0000","last_became_peered":"2023-01-02T18:18:14.414360+0000","last_unstale":"2023-01-02T18:18:20.095864+0000","last_undegraded":"2023-01-02T18:18:20.095864+0000","last_fullsized":"2023-01-02T18:18:20.095864+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"117'2","reported_seq":49,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321425+0000","last_change":"2023-01-02T18:17:38.446055+0000","last_active":"2023-01-02T18:18:19.321425+0000","last_peered":"2023-01-02T18:18:19.321425+0000","last_clean":"2023-01-02T18:18:19.321425+0000","last_became_active":"2023-01-02T18:17:36.428938+0000","last_became_peered":"2023-01-02T18:17:36.428938+0000","last_unstale":"2023-01-02T18:18:19.321425+0000","last_undegraded":"2023-01-02T18:18:19.321425+0000","last_fullsized":"2023-01-02T18:18:19.321425+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1","version":"136'2","reported_seq":42,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.965554+0000","last_change":"2023-01-02T18:18:14.459411+0000","last_active":"2023-01-02T18:18:20.965554+0000","last_peered":"2023-01-02T18:18:20.965554+0000","last_clean":"2023-01-02T18:18:20.965554+0000","last_became_active":"2023-01-02T18:18:14.418846+0000","last_became_peered":"2023-01-02T18:18:14.418846+0000","last_unstale":"2023-01-02T18:18:20.965554+0000","last_undegraded":"2023-01-02T18:18:20.965554+0000","last_fullsized":"2023-01-02T18:18:20.965554+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756943+0000","last_change":"2023-01-02T18:18:00.732747+0000","last_active":"2023-01-02T18:18:19.756943+0000","last_peered":"2023-01-02T18:18:19.756943+0000","last_clean":"2023-01-02T18:18:19.756943+0000","last_became_active":"2023-01-02T18:17:58.739653+0000","last_became_peered":"2023-01-02T18:17:58.739653+0000","last_unstale":"2023-01-02T18:18:19.756943+0000","last_undegraded":"2023-01-02T18:18:19.756943+0000","last_fullsized":"2023-01-02T18:18:19.756943+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"64'1","reported_seq":89,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320096+0000","last_change":"2023-01-02T18:16:57.306246+0000","last_active":"2023-01-02T18:18:19.320096+0000","last_peered":"2023-01-02T18:18:19.320096+0000","last_clean":"2023-01-02T18:18:19.320096+0000","last_became_active":"2023-01-02T18:16:55.314440+0000","last_became_peered":"2023-01-02T18:16:55.314440+0000","last_unstale":"2023-01-02T18:18:19.320096+0000","last_undegraded":"2023-01-02T18:18:19.320096+0000","last_fullsized":"2023-01-02T18:18:19.320096+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":90,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755699+0000","last_change":"2023-01-02T18:16:53.345366+0000","last_active":"2023-01-02T18:18:19.755699+0000","last_peered":"2023-01-02T18:18:19.755699+0000","last_clean":"2023-01-02T18:18:19.755699+0000","last_became_active":"2023-01-02T18:16:51.338582+0000","last_became_peered":"2023-01-02T18:16:51.338582+0000","last_unstale":"2023-01-02T18:18:19.755699+0000","last_undegraded":"2023-01-02T18:18:19.755699+0000","last_fullsized":"2023-01-02T18:18:19.755699+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"56'8","reported_seq":107,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452405+0000","last_change":"2023-01-02T18:16:49.297975+0000","last_active":"2023-01-02T18:18:19.452405+0000","last_peered":"2023-01-02T18:18:19.452405+0000","last_clean":"2023-01-02T18:18:19.452405+0000","last_became_active":"2023-01-02T18:16:46.311159+0000","last_became_peered":"2023-01-02T18:16:46.311159+0000","last_unstale":"2023-01-02T18:18:19.452405+0000","last_undegraded":"2023-01-02T18:18:19.452405+0000","last_fullsized":"2023-01-02T18:18:19.452405+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"137'8","reported_seq":189,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-01-02T18:18:21.685837+0000","last_change":"2023-01-02T18:17:30.335368+0000","last_active":"2023-01-02T18:18:21.685837+0000","last_peered":"2023-01-02T18:18:21.685837+0000","last_clean":"2023-01-02T18:18:21.685837+0000","last_became_active":"2023-01-02T18:17:29.341233+0000","last_became_peered":"2023-01-02T18:17:29.341233+0000","last_unstale":"2023-01-02T18:18:21.685837+0000","last_undegraded":"2023-01-02T18:18:21.685837+0000","last_fullsized":"2023-01-02T18:18:21.685837+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":65,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":7,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":60,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":102,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094156+0000","last_change":"2023-01-02T18:16:44.320821+0000","last_active":"2023-01-02T18:18:20.094156+0000","last_peered":"2023-01-02T18:18:20.094156+0000","last_clean":"2023-01-02T18:18:20.094156+0000","last_became_active":"2023-01-02T18:16:41.445017+0000","last_became_peered":"2023-01-02T18:16:41.445017+0000","last_unstale":"2023-01-02T18:18:20.094156+0000","last_undegraded":"2023-01-02T18:18:20.094156+0000","last_fullsized":"2023-01-02T18:18:20.094156+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":84,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321199+0000","last_change":"2023-01-02T18:17:01.320562+0000","last_active":"2023-01-02T18:18:19.321199+0000","last_peered":"2023-01-02T18:18:19.321199+0000","last_clean":"2023-01-02T18:18:19.321199+0000","last_became_active":"2023-01-02T18:16:59.321730+0000","last_became_peered":"2023-01-02T18:16:59.321730+0000","last_unstale":"2023-01-02T18:18:19.321199+0000","last_undegraded":"2023-01-02T18:18:19.321199+0000","last_fullsized":"2023-01-02T18:18:19.321199+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328845+0000","last_change":"2023-01-02T18:17:29.333481+0000","last_active":"2023-01-02T18:18:19.328845+0000","last_peered":"2023-01-02T18:18:19.328845+0000","last_clean":"2023-01-02T18:18:19.328845+0000","last_became_active":"2023-01-02T18:17:29.333173+0000","last_became_peered":"2023-01-02T18:17:29.333173+0000","last_unstale":"2023-01-02T18:18:19.328845+0000","last_undegraded":"2023-01-02T18:18:19.328845+0000","last_fullsized":"2023-01-02T18:18:19.328845+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":71,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320416+0000","last_change":"2023-01-02T18:18:02.781355+0000","last_active":"2023-01-02T18:18:19.320416+0000","last_peered":"2023-01-02T18:18:19.320416+0000","last_clean":"2023-01-02T18:18:19.320416+0000","last_became_active":"2023-01-02T18:18:02.781071+0000","last_became_peered":"2023-01-02T18:18:02.781071+0000","last_unstale":"2023-01-02T18:18:19.320416+0000","last_undegraded":"2023-01-02T18:18:19.320416+0000","last_fullsized":"2023-01-02T18:18:19.320416+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.5","version":"117'21","reported_seq":125,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757067+0000","last_change":"2023-01-02T18:17:38.464795+0000","last_active":"2023-01-02T18:18:19.757067+0000","last_peered":"2023-01-02T18:18:19.757067+0000","last_clean":"2023-01-02T18:18:19.757067+0000","last_became_active":"2023-01-02T18:17:36.442539+0000","last_became_peered":"2023-01-02T18:17:36.442539+0000","last_unstale":"2023-01-02T18:18:19.757067+0000","last_undegraded":"2023-01-02T18:18:19.757067+0000","last_fullsized":"2023-01-02T18:18:19.757067+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":100,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756295+0000","last_change":"2023-01-02T18:18:14.414036+0000","last_active":"2023-01-02T18:18:19.756295+0000","last_peered":"2023-01-02T18:18:19.756295+0000","last_clean":"2023-01-02T18:18:19.756295+0000","last_became_active":"2023-01-02T18:18:14.412859+0000","last_became_peered":"2023-01-02T18:18:14.412859+0000","last_unstale":"2023-01-02T18:18:19.756295+0000","last_undegraded":"2023-01-02T18:18:19.756295+0000","last_fullsized":"2023-01-02T18:18:19.756295+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3","version":"136'5","reported_seq":42,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.991061+0000","last_change":"2023-01-02T18:18:02.793317+0000","last_active":"2023-01-02T18:18:20.991061+0000","last_peered":"2023-01-02T18:18:20.991061+0000","last_clean":"2023-01-02T18:18:20.991061+0000","last_became_active":"2023-01-02T18:18:02.793044+0000","last_became_peered":"2023-01-02T18:18:02.793044+0000","last_unstale":"2023-01-02T18:18:20.991061+0000","last_undegraded":"2023-01-02T18:18:20.991061+0000","last_fullsized":"2023-01-02T18:18:20.991061+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":86,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755884+0000","last_change":"2023-01-02T18:16:57.310887+0000","last_active":"2023-01-02T18:18:19.755884+0000","last_peered":"2023-01-02T18:18:19.755884+0000","last_clean":"2023-01-02T18:18:19.755884+0000","last_became_active":"2023-01-02T18:16:55.311670+0000","last_became_peered":"2023-01-02T18:16:55.311670+0000","last_unstale":"2023-01-02T18:18:19.755884+0000","last_undegraded":"2023-01-02T18:18:19.755884+0000","last_fullsized":"2023-01-02T18:18:19.755884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":90,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755566+0000","last_change":"2023-01-02T18:16:53.346245+0000","last_active":"2023-01-02T18:18:19.755566+0000","last_peered":"2023-01-02T18:18:19.755566+0000","last_clean":"2023-01-02T18:18:19.755566+0000","last_became_active":"2023-01-02T18:16:51.337042+0000","last_became_peered":"2023-01-02T18:16:51.337042+0000","last_unstale":"2023-01-02T18:18:19.755566+0000","last_undegraded":"2023-01-02T18:18:19.755566+0000","last_fullsized":"2023-01-02T18:18:19.755566+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325021+0000","last_change":"2023-01-02T18:18:02.775688+0000","last_active":"2023-01-02T18:18:19.325021+0000","last_peered":"2023-01-02T18:18:19.325021+0000","last_clean":"2023-01-02T18:18:19.325021+0000","last_became_active":"2023-01-02T18:18:02.773661+0000","last_became_peered":"2023-01-02T18:18:02.773661+0000","last_unstale":"2023-01-02T18:18:19.325021+0000","last_undegraded":"2023-01-02T18:18:19.325021+0000","last_fullsized":"2023-01-02T18:18:19.325021+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.c","version":"137'6","reported_seq":79,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-01-02T18:18:24.509013+0000","last_change":"2023-01-02T18:18:14.458076+0000","last_active":"2023-01-02T18:18:24.509013+0000","last_peered":"2023-01-02T18:18:24.509013+0000","last_clean":"2023-01-02T18:18:24.509013+0000","last_became_active":"2023-01-02T18:18:14.406372+0000","last_became_peered":"2023-01-02T18:18:14.406372+0000","last_unstale":"2023-01-02T18:18:24.509013+0000","last_undegraded":"2023-01-02T18:18:24.509013+0000","last_fullsized":"2023-01-02T18:18:24.509013+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":7,"num_write":6,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":102,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320126+0000","last_change":"2023-01-02T18:16:44.314431+0000","last_active":"2023-01-02T18:18:19.320126+0000","last_peered":"2023-01-02T18:18:19.320126+0000","last_clean":"2023-01-02T18:18:19.320126+0000","last_became_active":"2023-01-02T18:16:41.442779+0000","last_became_peered":"2023-01-02T18:16:41.442779+0000","last_unstale":"2023-01-02T18:18:19.320126+0000","last_undegraded":"2023-01-02T18:18:19.320126+0000","last_fullsized":"2023-01-02T18:18:19.320126+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094614+0000","last_change":"2023-01-02T18:18:14.405405+0000","last_active":"2023-01-02T18:18:20.094614+0000","last_peered":"2023-01-02T18:18:20.094614+0000","last_clean":"2023-01-02T18:18:20.094614+0000","last_became_active":"2023-01-02T18:18:14.404978+0000","last_became_peered":"2023-01-02T18:18:14.404978+0000","last_unstale":"2023-01-02T18:18:20.094614+0000","last_undegraded":"2023-01-02T18:18:20.094614+0000","last_fullsized":"2023-01-02T18:18:20.094614+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327649+0000","last_change":"2023-01-02T18:17:29.323882+0000","last_active":"2023-01-02T18:18:19.327649+0000","last_peered":"2023-01-02T18:18:19.327649+0000","last_clean":"2023-01-02T18:18:19.327649+0000","last_became_active":"2023-01-02T18:17:29.323226+0000","last_became_peered":"2023-01-02T18:17:29.323226+0000","last_unstale":"2023-01-02T18:18:19.327649+0000","last_undegraded":"2023-01-02T18:18:19.327649+0000","last_fullsized":"2023-01-02T18:18:19.327649+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"101'2","reported_seq":65,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319971+0000","last_change":"2023-01-02T18:17:34.316134+0000","last_active":"2023-01-02T18:18:19.319971+0000","last_peered":"2023-01-02T18:18:19.319971+0000","last_clean":"2023-01-02T18:18:19.319971+0000","last_became_active":"2023-01-02T18:17:32.340596+0000","last_became_peered":"2023-01-02T18:17:32.340596+0000","last_unstale":"2023-01-02T18:18:19.319971+0000","last_undegraded":"2023-01-02T18:18:19.319971+0000","last_fullsized":"2023-01-02T18:18:19.319971+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":45,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756498+0000","last_change":"2023-01-02T18:17:38.463731+0000","last_active":"2023-01-02T18:18:19.756498+0000","last_peered":"2023-01-02T18:18:19.756498+0000","last_clean":"2023-01-02T18:18:19.756498+0000","last_became_active":"2023-01-02T18:17:36.444543+0000","last_became_peered":"2023-01-02T18:17:36.444543+0000","last_unstale":"2023-01-02T18:18:19.756498+0000","last_undegraded":"2023-01-02T18:18:19.756498+0000","last_fullsized":"2023-01-02T18:18:19.756498+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"136'4","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:21.010381+0000","last_change":"2023-01-02T18:17:56.722102+0000","last_active":"2023-01-02T18:18:21.010381+0000","last_peered":"2023-01-02T18:18:21.010381+0000","last_clean":"2023-01-02T18:18:21.010381+0000","last_became_active":"2023-01-02T18:17:56.721423+0000","last_became_peered":"2023-01-02T18:17:56.721423+0000","last_unstale":"2023-01-02T18:18:21.010381+0000","last_undegraded":"2023-01-02T18:18:21.010381+0000","last_fullsized":"2023-01-02T18:18:21.010381+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":37,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326562+0000","last_change":"2023-01-02T18:18:14.397839+0000","last_active":"2023-01-02T18:18:19.326562+0000","last_peered":"2023-01-02T18:18:19.326562+0000","last_clean":"2023-01-02T18:18:19.326562+0000","last_became_active":"2023-01-02T18:18:14.397525+0000","last_became_peered":"2023-01-02T18:18:14.397525+0000","last_unstale":"2023-01-02T18:18:19.326562+0000","last_undegraded":"2023-01-02T18:18:19.326562+0000","last_fullsized":"2023-01-02T18:18:19.326562+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"64'6","reported_seq":195,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321162+0000","last_change":"2023-01-02T18:18:14.437188+0000","last_active":"2023-01-02T18:18:19.321162+0000","last_peered":"2023-01-02T18:18:19.321162+0000","last_clean":"2023-01-02T18:18:19.321162+0000","last_became_active":"2023-01-02T18:18:14.417942+0000","last_became_peered":"2023-01-02T18:18:14.417942+0000","last_unstale":"2023-01-02T18:18:19.321162+0000","last_undegraded":"2023-01-02T18:18:19.321162+0000","last_fullsized":"2023-01-02T18:18:19.321162+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":122,"num_read_kb":118,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":96,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924773+0000","last_change":"2023-01-02T18:18:08.359809+0000","last_active":"2023-01-02T18:18:19.924773+0000","last_peered":"2023-01-02T18:18:19.924773+0000","last_clean":"2023-01-02T18:18:19.924773+0000","last_became_active":"2023-01-02T18:18:08.359499+0000","last_became_peered":"2023-01-02T18:18:08.359499+0000","last_unstale":"2023-01-02T18:18:19.924773+0000","last_undegraded":"2023-01-02T18:18:19.924773+0000","last_fullsized":"2023-01-02T18:18:19.924773+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.d","version":"56'3","reported_seq":98,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756508+0000","last_change":"2023-01-02T18:16:49.305492+0000","last_active":"2023-01-02T18:18:19.756508+0000","last_peered":"2023-01-02T18:18:19.756508+0000","last_clean":"2023-01-02T18:18:19.756508+0000","last_became_active":"2023-01-02T18:16:46.315174+0000","last_became_peered":"2023-01-02T18:16:46.315174+0000","last_unstale":"2023-01-02T18:18:19.756508+0000","last_undegraded":"2023-01-02T18:18:19.756508+0000","last_fullsized":"2023-01-02T18:18:19.756508+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"80'8","reported_seq":87,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320227+0000","last_change":"2023-01-02T18:18:14.429077+0000","last_active":"2023-01-02T18:18:19.320227+0000","last_peered":"2023-01-02T18:18:19.320227+0000","last_clean":"2023-01-02T18:18:19.320227+0000","last_became_active":"2023-01-02T18:18:14.400222+0000","last_became_peered":"2023-01-02T18:18:14.400222+0000","last_unstale":"2023-01-02T18:18:19.320227+0000","last_undegraded":"2023-01-02T18:18:19.320227+0000","last_fullsized":"2023-01-02T18:18:19.320227+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":12,"num_write":5,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":51,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094711+0000","last_change":"2023-01-02T18:18:14.409987+0000","last_active":"2023-01-02T18:18:20.094711+0000","last_peered":"2023-01-02T18:18:20.094711+0000","last_clean":"2023-01-02T18:18:20.094711+0000","last_became_active":"2023-01-02T18:18:14.409693+0000","last_became_peered":"2023-01-02T18:18:14.409693+0000","last_unstale":"2023-01-02T18:18:20.094711+0000","last_undegraded":"2023-01-02T18:18:20.094711+0000","last_fullsized":"2023-01-02T18:18:20.094711+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.0","version":"72'11","reported_seq":113,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326126+0000","last_change":"2023-01-02T18:18:14.448452+0000","last_active":"2023-01-02T18:18:19.326126+0000","last_peered":"2023-01-02T18:18:19.326126+0000","last_clean":"2023-01-02T18:18:19.326126+0000","last_became_active":"2023-01-02T18:18:14.401091+0000","last_became_peered":"2023-01-02T18:18:14.401091+0000","last_unstale":"2023-01-02T18:18:19.326126+0000","last_undegraded":"2023-01-02T18:18:19.326126+0000","last_fullsized":"2023-01-02T18:18:19.326126+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":11,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":64,"num_write":8,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":16,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094496+0000","last_change":"2023-01-02T18:18:14.419192+0000","last_active":"2023-01-02T18:18:20.094496+0000","last_peered":"2023-01-02T18:18:20.094496+0000","last_clean":"2023-01-02T18:18:20.094496+0000","last_became_active":"2023-01-02T18:18:14.418818+0000","last_became_peered":"2023-01-02T18:18:14.418818+0000","last_unstale":"2023-01-02T18:18:20.094496+0000","last_undegraded":"2023-01-02T18:18:20.094496+0000","last_fullsized":"2023-01-02T18:18:20.094496+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":71,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923581+0000","last_change":"2023-01-02T18:18:02.778118+0000","last_active":"2023-01-02T18:18:19.923581+0000","last_peered":"2023-01-02T18:18:19.923581+0000","last_clean":"2023-01-02T18:18:19.923581+0000","last_became_active":"2023-01-02T18:18:02.777806+0000","last_became_peered":"2023-01-02T18:18:02.777806+0000","last_unstale":"2023-01-02T18:18:19.923581+0000","last_undegraded":"2023-01-02T18:18:19.923581+0000","last_fullsized":"2023-01-02T18:18:19.923581+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"117'12","reported_seq":69,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094213+0000","last_change":"2023-01-02T18:17:38.459018+0000","last_active":"2023-01-02T18:18:20.094213+0000","last_peered":"2023-01-02T18:18:20.094213+0000","last_clean":"2023-01-02T18:18:20.094213+0000","last_became_active":"2023-01-02T18:17:36.442139+0000","last_became_peered":"2023-01-02T18:17:36.442139+0000","last_unstale":"2023-01-02T18:18:20.094213+0000","last_undegraded":"2023-01-02T18:18:20.094213+0000","last_fullsized":"2023-01-02T18:18:20.094213+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.4","version":"136'20","reported_seq":117,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:21.006240+0000","last_change":"2023-01-02T18:18:14.448960+0000","last_active":"2023-01-02T18:18:21.006240+0000","last_peered":"2023-01-02T18:18:21.006240+0000","last_clean":"2023-01-02T18:18:21.006240+0000","last_became_active":"2023-01-02T18:18:14.408261+0000","last_became_peered":"2023-01-02T18:18:14.408261+0000","last_unstale":"2023-01-02T18:18:21.006240+0000","last_undegraded":"2023-01-02T18:18:21.006240+0000","last_fullsized":"2023-01-02T18:18:21.006240+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":100,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":25,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326758+0000","last_change":"2023-01-02T18:18:02.785884+0000","last_active":"2023-01-02T18:18:19.326758+0000","last_peered":"2023-01-02T18:18:19.326758+0000","last_clean":"2023-01-02T18:18:19.326758+0000","last_became_active":"2023-01-02T18:18:02.772511+0000","last_became_peered":"2023-01-02T18:18:02.772511+0000","last_unstale":"2023-01-02T18:18:19.326758+0000","last_undegraded":"2023-01-02T18:18:19.326758+0000","last_fullsized":"2023-01-02T18:18:19.326758+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":95,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452851+0000","last_change":"2023-01-02T18:17:29.325884+0000","last_active":"2023-01-02T18:18:19.452851+0000","last_peered":"2023-01-02T18:18:19.452851+0000","last_clean":"2023-01-02T18:18:19.452851+0000","last_became_active":"2023-01-02T18:17:29.325539+0000","last_became_peered":"2023-01-02T18:17:29.325539+0000","last_unstale":"2023-01-02T18:18:19.452851+0000","last_undegraded":"2023-01-02T18:18:19.452851+0000","last_fullsized":"2023-01-02T18:18:19.452851+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.453186+0000","last_change":"2023-01-02T18:18:14.389322+0000","last_active":"2023-01-02T18:18:19.453186+0000","last_peered":"2023-01-02T18:18:19.453186+0000","last_clean":"2023-01-02T18:18:19.453186+0000","last_became_active":"2023-01-02T18:18:14.388479+0000","last_became_peered":"2023-01-02T18:18:14.388479+0000","last_unstale":"2023-01-02T18:18:19.453186+0000","last_undegraded":"2023-01-02T18:18:19.453186+0000","last_fullsized":"2023-01-02T18:18:19.453186+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924098+0000","last_change":"2023-01-02T18:18:08.358403+0000","last_active":"2023-01-02T18:18:19.924098+0000","last_peered":"2023-01-02T18:18:19.924098+0000","last_clean":"2023-01-02T18:18:19.924098+0000","last_became_active":"2023-01-02T18:18:08.357988+0000","last_became_peered":"2023-01-02T18:18:08.357988+0000","last_unstale":"2023-01-02T18:18:19.924098+0000","last_undegraded":"2023-01-02T18:18:19.924098+0000","last_fullsized":"2023-01-02T18:18:19.924098+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"137'64","reported_seq":8594,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-01-02T18:18:24.488911+0000","last_change":"2023-01-02T18:18:02.829154+0000","last_active":"2023-01-02T18:18:24.488911+0000","last_peered":"2023-01-02T18:18:24.488911+0000","last_clean":"2023-01-02T18:18:24.488911+0000","last_became_active":"2023-01-02T18:18:02.778190+0000","last_became_peered":"2023-01-02T18:18:02.778190+0000","last_unstale":"2023-01-02T18:18:24.488911+0000","last_undegraded":"2023-01-02T18:18:24.488911+0000","last_fullsized":"2023-01-02T18:18:24.488911+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":64,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2097168,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8385,"num_read_kb":4214,"num_write":60,"num_write_kb":2104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":32,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327251+0000","last_change":"2023-01-02T18:18:02.774070+0000","last_active":"2023-01-02T18:18:19.327251+0000","last_peered":"2023-01-02T18:18:19.327251+0000","last_clean":"2023-01-02T18:18:19.327251+0000","last_became_active":"2023-01-02T18:18:02.766713+0000","last_became_peered":"2023-01-02T18:18:02.766713+0000","last_unstale":"2023-01-02T18:18:19.327251+0000","last_undegraded":"2023-01-02T18:18:19.327251+0000","last_fullsized":"2023-01-02T18:18:19.327251+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":84,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.922541+0000","last_change":"2023-01-02T18:17:01.307632+0000","last_active":"2023-01-02T18:18:19.922541+0000","last_peered":"2023-01-02T18:18:19.922541+0000","last_clean":"2023-01-02T18:18:19.922541+0000","last_became_active":"2023-01-02T18:16:59.325319+0000","last_became_peered":"2023-01-02T18:16:59.325319+0000","last_unstale":"2023-01-02T18:18:19.922541+0000","last_undegraded":"2023-01-02T18:18:19.922541+0000","last_fullsized":"2023-01-02T18:18:19.922541+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":76,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093679+0000","last_change":"2023-01-02T18:17:09.330500+0000","last_active":"2023-01-02T18:18:20.093679+0000","last_peered":"2023-01-02T18:18:20.093679+0000","last_clean":"2023-01-02T18:18:20.093679+0000","last_became_active":"2023-01-02T18:17:07.345902+0000","last_became_peered":"2023-01-02T18:17:07.345902+0000","last_unstale":"2023-01-02T18:18:20.093679+0000","last_undegraded":"2023-01-02T18:18:20.093679+0000","last_fullsized":"2023-01-02T18:18:20.093679+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3","version":"101'31","reported_seq":153,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327880+0000","last_change":"2023-01-02T18:17:34.318218+0000","last_active":"2023-01-02T18:18:19.327880+0000","last_peered":"2023-01-02T18:18:19.327880+0000","last_clean":"2023-01-02T18:18:19.327880+0000","last_became_active":"2023-01-02T18:17:32.342244+0000","last_became_peered":"2023-01-02T18:17:32.342244+0000","last_unstale":"2023-01-02T18:18:19.327880+0000","last_undegraded":"2023-01-02T18:18:19.327880+0000","last_fullsized":"2023-01-02T18:18:19.327880+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":110,"num_read_kb":99,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319231+0000","last_change":"2023-01-02T18:18:14.398669+0000","last_active":"2023-01-02T18:18:19.319231+0000","last_peered":"2023-01-02T18:18:19.319231+0000","last_clean":"2023-01-02T18:18:19.319231+0000","last_became_active":"2023-01-02T18:18:14.398226+0000","last_became_peered":"2023-01-02T18:18:14.398226+0000","last_unstale":"2023-01-02T18:18:19.319231+0000","last_undegraded":"2023-01-02T18:18:19.319231+0000","last_fullsized":"2023-01-02T18:18:19.319231+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094625+0000","last_change":"2023-01-02T18:17:56.726827+0000","last_active":"2023-01-02T18:18:20.094625+0000","last_peered":"2023-01-02T18:18:20.094625+0000","last_clean":"2023-01-02T18:18:20.094625+0000","last_became_active":"2023-01-02T18:17:56.726367+0000","last_became_peered":"2023-01-02T18:17:56.726367+0000","last_unstale":"2023-01-02T18:18:20.094625+0000","last_undegraded":"2023-01-02T18:18:20.094625+0000","last_fullsized":"2023-01-02T18:18:20.094625+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094148+0000","last_change":"2023-01-02T18:18:00.738377+0000","last_active":"2023-01-02T18:18:20.094148+0000","last_peered":"2023-01-02T18:18:20.094148+0000","last_clean":"2023-01-02T18:18:20.094148+0000","last_became_active":"2023-01-02T18:17:58.738490+0000","last_became_peered":"2023-01-02T18:17:58.738490+0000","last_unstale":"2023-01-02T18:18:20.094148+0000","last_undegraded":"2023-01-02T18:18:20.094148+0000","last_fullsized":"2023-01-02T18:18:20.094148+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758305+0000","last_change":"2023-01-02T18:18:00.740227+0000","last_active":"2023-01-02T18:18:19.758305+0000","last_peered":"2023-01-02T18:18:19.758305+0000","last_clean":"2023-01-02T18:18:19.758305+0000","last_became_active":"2023-01-02T18:17:58.738760+0000","last_became_peered":"2023-01-02T18:17:58.738760+0000","last_unstale":"2023-01-02T18:18:19.758305+0000","last_undegraded":"2023-01-02T18:18:19.758305+0000","last_fullsized":"2023-01-02T18:18:19.758305+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":88,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094958+0000","last_change":"2023-01-02T18:16:57.307947+0000","last_active":"2023-01-02T18:18:20.094958+0000","last_peered":"2023-01-02T18:18:20.094958+0000","last_clean":"2023-01-02T18:18:20.094958+0000","last_became_active":"2023-01-02T18:16:55.313480+0000","last_became_peered":"2023-01-02T18:16:55.313480+0000","last_unstale":"2023-01-02T18:18:20.094958+0000","last_undegraded":"2023-01-02T18:18:20.094958+0000","last_fullsized":"2023-01-02T18:18:20.094958+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094624+0000","last_change":"2023-01-02T18:18:14.410952+0000","last_active":"2023-01-02T18:18:20.094624+0000","last_peered":"2023-01-02T18:18:20.094624+0000","last_clean":"2023-01-02T18:18:20.094624+0000","last_became_active":"2023-01-02T18:18:14.410615+0000","last_became_peered":"2023-01-02T18:18:14.410615+0000","last_unstale":"2023-01-02T18:18:20.094624+0000","last_undegraded":"2023-01-02T18:18:20.094624+0000","last_fullsized":"2023-01-02T18:18:20.094624+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":58,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327722+0000","last_change":"2023-01-02T18:18:02.794806+0000","last_active":"2023-01-02T18:18:19.327722+0000","last_peered":"2023-01-02T18:18:19.327722+0000","last_clean":"2023-01-02T18:18:19.327722+0000","last_became_active":"2023-01-02T18:18:02.794473+0000","last_became_peered":"2023-01-02T18:18:02.794473+0000","last_unstale":"2023-01-02T18:18:19.327722+0000","last_undegraded":"2023-01-02T18:18:19.327722+0000","last_fullsized":"2023-01-02T18:18:19.327722+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325019+0000","last_change":"2023-01-02T18:18:02.770562+0000","last_active":"2023-01-02T18:18:19.325019+0000","last_peered":"2023-01-02T18:18:19.325019+0000","last_clean":"2023-01-02T18:18:19.325019+0000","last_became_active":"2023-01-02T18:18:02.769650+0000","last_became_peered":"2023-01-02T18:18:02.769650+0000","last_unstale":"2023-01-02T18:18:19.325019+0000","last_undegraded":"2023-01-02T18:18:19.325019+0000","last_fullsized":"2023-01-02T18:18:19.325019+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"51'1","reported_seq":140,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095601+0000","last_change":"2023-01-02T18:18:08.363172+0000","last_active":"2023-01-02T18:18:20.095601+0000","last_peered":"2023-01-02T18:18:20.095601+0000","last_clean":"2023-01-02T18:18:20.095601+0000","last_became_active":"2023-01-02T18:18:08.362249+0000","last_became_peered":"2023-01-02T18:18:08.362249+0000","last_unstale":"2023-01-02T18:18:20.095601+0000","last_undegraded":"2023-01-02T18:18:20.095601+0000","last_fullsized":"2023-01-02T18:18:20.095601+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325282+0000","last_change":"2023-01-02T18:18:02.776433+0000","last_active":"2023-01-02T18:18:19.325282+0000","last_peered":"2023-01-02T18:18:19.325282+0000","last_clean":"2023-01-02T18:18:19.325282+0000","last_became_active":"2023-01-02T18:18:02.774308+0000","last_became_peered":"2023-01-02T18:18:02.774308+0000","last_unstale":"2023-01-02T18:18:19.325282+0000","last_undegraded":"2023-01-02T18:18:19.325282+0000","last_fullsized":"2023-01-02T18:18:19.325282+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.3","version":"76'4","reported_seq":92,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756522+0000","last_change":"2023-01-02T18:18:14.421515+0000","last_active":"2023-01-02T18:18:19.756522+0000","last_peered":"2023-01-02T18:18:19.756522+0000","last_clean":"2023-01-02T18:18:19.756522+0000","last_became_active":"2023-01-02T18:18:14.393842+0000","last_became_peered":"2023-01-02T18:18:14.393842+0000","last_unstale":"2023-01-02T18:18:19.756522+0000","last_undegraded":"2023-01-02T18:18:19.756522+0000","last_fullsized":"2023-01-02T18:18:19.756522+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093594+0000","last_change":"2023-01-02T18:17:34.324670+0000","last_active":"2023-01-02T18:18:20.093594+0000","last_peered":"2023-01-02T18:18:20.093594+0000","last_clean":"2023-01-02T18:18:20.093594+0000","last_became_active":"2023-01-02T18:17:32.339850+0000","last_became_peered":"2023-01-02T18:17:32.339850+0000","last_unstale":"2023-01-02T18:18:20.093594+0000","last_undegraded":"2023-01-02T18:18:20.093594+0000","last_fullsized":"2023-01-02T18:18:20.093594+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1","version":"117'22","reported_seq":87,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095329+0000","last_change":"2023-01-02T18:18:14.453060+0000","last_active":"2023-01-02T18:18:20.095329+0000","last_peered":"2023-01-02T18:18:20.095329+0000","last_clean":"2023-01-02T18:18:20.095329+0000","last_became_active":"2023-01-02T18:18:14.408424+0000","last_became_peered":"2023-01-02T18:18:14.408424+0000","last_unstale":"2023-01-02T18:18:20.095329+0000","last_undegraded":"2023-01-02T18:18:20.095329+0000","last_fullsized":"2023-01-02T18:18:20.095329+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":46,"num_write":29,"num_write_kb":4111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.6","version":"136'1","reported_seq":27,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:21.008909+0000","last_change":"2023-01-02T18:17:56.727825+0000","last_active":"2023-01-02T18:18:21.008909+0000","last_peered":"2023-01-02T18:18:21.008909+0000","last_clean":"2023-01-02T18:18:21.008909+0000","last_became_active":"2023-01-02T18:17:56.727533+0000","last_became_peered":"2023-01-02T18:17:56.727533+0000","last_unstale":"2023-01-02T18:18:21.008909+0000","last_undegraded":"2023-01-02T18:18:21.008909+0000","last_fullsized":"2023-01-02T18:18:21.008909+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":96,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095407+0000","last_change":"2023-01-02T18:18:14.418801+0000","last_active":"2023-01-02T18:18:20.095407+0000","last_peered":"2023-01-02T18:18:20.095407+0000","last_clean":"2023-01-02T18:18:20.095407+0000","last_became_active":"2023-01-02T18:18:14.417994+0000","last_became_peered":"2023-01-02T18:18:14.417994+0000","last_unstale":"2023-01-02T18:18:20.095407+0000","last_undegraded":"2023-01-02T18:18:20.095407+0000","last_fullsized":"2023-01-02T18:18:20.095407+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327331+0000","last_change":"2023-01-02T18:17:29.329378+0000","last_active":"2023-01-02T18:18:19.327331+0000","last_peered":"2023-01-02T18:18:19.327331+0000","last_clean":"2023-01-02T18:18:19.327331+0000","last_became_active":"2023-01-02T18:17:29.327709+0000","last_became_peered":"2023-01-02T18:17:29.327709+0000","last_unstale":"2023-01-02T18:18:19.327331+0000","last_undegraded":"2023-01-02T18:18:19.327331+0000","last_fullsized":"2023-01-02T18:18:19.327331+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":54,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328454+0000","last_change":"2023-01-02T18:18:08.361458+0000","last_active":"2023-01-02T18:18:19.328454+0000","last_peered":"2023-01-02T18:18:19.328454+0000","last_clean":"2023-01-02T18:18:19.328454+0000","last_became_active":"2023-01-02T18:18:08.361114+0000","last_became_peered":"2023-01-02T18:18:08.361114+0000","last_unstale":"2023-01-02T18:18:19.328454+0000","last_undegraded":"2023-01-02T18:18:19.328454+0000","last_fullsized":"2023-01-02T18:18:19.328454+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.8","version":"76'8","reported_seq":77,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.922871+0000","last_change":"2023-01-02T18:18:14.451994+0000","last_active":"2023-01-02T18:18:19.922871+0000","last_peered":"2023-01-02T18:18:19.922871+0000","last_clean":"2023-01-02T18:18:19.922871+0000","last_became_active":"2023-01-02T18:18:14.411425+0000","last_became_peered":"2023-01-02T18:18:14.411425+0000","last_unstale":"2023-01-02T18:18:19.922871+0000","last_undegraded":"2023-01-02T18:18:19.922871+0000","last_fullsized":"2023-01-02T18:18:19.922871+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":67,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":9,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":67,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":110,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.925155+0000","last_change":"2023-01-02T18:18:14.394936+0000","last_active":"2023-01-02T18:18:19.925155+0000","last_peered":"2023-01-02T18:18:19.925155+0000","last_clean":"2023-01-02T18:18:19.925155+0000","last_became_active":"2023-01-02T18:18:14.394581+0000","last_became_peered":"2023-01-02T18:18:14.394581+0000","last_unstale":"2023-01-02T18:18:19.925155+0000","last_undegraded":"2023-01-02T18:18:19.925155+0000","last_fullsized":"2023-01-02T18:18:19.925155+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3","version":"69'1","reported_seq":78,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327593+0000","last_change":"2023-01-02T18:17:48.664153+0000","last_active":"2023-01-02T18:18:19.327593+0000","last_peered":"2023-01-02T18:18:19.327593+0000","last_clean":"2023-01-02T18:18:19.327593+0000","last_became_active":"2023-01-02T18:17:48.656642+0000","last_became_peered":"2023-01-02T18:17:48.656642+0000","last_unstale":"2023-01-02T18:18:19.327593+0000","last_undegraded":"2023-01-02T18:18:19.327593+0000","last_fullsized":"2023-01-02T18:18:19.327593+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"76'12","reported_seq":143,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923597+0000","last_change":"2023-01-02T18:18:14.446207+0000","last_active":"2023-01-02T18:18:19.923597+0000","last_peered":"2023-01-02T18:18:19.923597+0000","last_clean":"2023-01-02T18:18:19.923597+0000","last_became_active":"2023-01-02T18:18:14.406965+0000","last_became_peered":"2023-01-02T18:18:14.406965+0000","last_unstale":"2023-01-02T18:18:19.923597+0000","last_undegraded":"2023-01-02T18:18:19.923597+0000","last_fullsized":"2023-01-02T18:18:19.923597+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":134,"num_read_kb":124,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":65,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755870+0000","last_change":"2023-01-02T18:18:08.359399+0000","last_active":"2023-01-02T18:18:19.755870+0000","last_peered":"2023-01-02T18:18:19.755870+0000","last_clean":"2023-01-02T18:18:19.755870+0000","last_became_active":"2023-01-02T18:18:08.359069+0000","last_became_peered":"2023-01-02T18:18:08.359069+0000","last_unstale":"2023-01-02T18:18:19.755870+0000","last_undegraded":"2023-01-02T18:18:19.755870+0000","last_fullsized":"2023-01-02T18:18:19.755870+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757453+0000","last_change":"2023-01-02T18:18:14.398421+0000","last_active":"2023-01-02T18:18:19.757453+0000","last_peered":"2023-01-02T18:18:19.757453+0000","last_clean":"2023-01-02T18:18:19.757453+0000","last_became_active":"2023-01-02T18:18:14.398120+0000","last_became_peered":"2023-01-02T18:18:14.398120+0000","last_unstale":"2023-01-02T18:18:19.757453+0000","last_undegraded":"2023-01-02T18:18:19.757453+0000","last_fullsized":"2023-01-02T18:18:19.757453+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758257+0000","last_change":"2023-01-02T18:17:56.721235+0000","last_active":"2023-01-02T18:18:19.758257+0000","last_peered":"2023-01-02T18:18:19.758257+0000","last_clean":"2023-01-02T18:18:19.758257+0000","last_became_active":"2023-01-02T18:17:56.720962+0000","last_became_peered":"2023-01-02T18:17:56.720962+0000","last_unstale":"2023-01-02T18:18:19.758257+0000","last_undegraded":"2023-01-02T18:18:19.758257+0000","last_fullsized":"2023-01-02T18:18:19.758257+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":33,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327752+0000","last_change":"2023-01-02T18:18:08.361357+0000","last_active":"2023-01-02T18:18:19.327752+0000","last_peered":"2023-01-02T18:18:19.327752+0000","last_clean":"2023-01-02T18:18:19.327752+0000","last_became_active":"2023-01-02T18:18:08.361013+0000","last_became_peered":"2023-01-02T18:18:08.361013+0000","last_unstale":"2023-01-02T18:18:19.327752+0000","last_undegraded":"2023-01-02T18:18:19.327752+0000","last_fullsized":"2023-01-02T18:18:19.327752+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":37,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326577+0000","last_change":"2023-01-02T18:18:14.384047+0000","last_active":"2023-01-02T18:18:19.326577+0000","last_peered":"2023-01-02T18:18:19.326577+0000","last_clean":"2023-01-02T18:18:19.326577+0000","last_became_active":"2023-01-02T18:18:14.383706+0000","last_became_peered":"2023-01-02T18:18:14.383706+0000","last_unstale":"2023-01-02T18:18:19.326577+0000","last_undegraded":"2023-01-02T18:18:19.326577+0000","last_fullsized":"2023-01-02T18:18:19.326577+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1","version":"64'3","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093632+0000","last_change":"2023-01-02T18:18:14.422856+0000","last_active":"2023-01-02T18:18:20.093632+0000","last_peered":"2023-01-02T18:18:20.093632+0000","last_clean":"2023-01-02T18:18:20.093632+0000","last_became_active":"2023-01-02T18:18:14.403157+0000","last_became_peered":"2023-01-02T18:18:14.403157+0000","last_unstale":"2023-01-02T18:18:20.093632+0000","last_undegraded":"2023-01-02T18:18:20.093632+0000","last_fullsized":"2023-01-02T18:18:20.093632+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"60'1","reported_seq":109,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319683+0000","last_change":"2023-01-02T18:18:14.431400+0000","last_active":"2023-01-02T18:18:19.319683+0000","last_peered":"2023-01-02T18:18:19.319683+0000","last_clean":"2023-01-02T18:18:19.319683+0000","last_became_active":"2023-01-02T18:18:14.403845+0000","last_became_peered":"2023-01-02T18:18:14.403845+0000","last_unstale":"2023-01-02T18:18:19.319683+0000","last_undegraded":"2023-01-02T18:18:19.319683+0000","last_fullsized":"2023-01-02T18:18:19.319683+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":127,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923998+0000","last_change":"2023-01-02T18:15:42.575197+0000","last_active":"2023-01-02T18:18:19.923998+0000","last_peered":"2023-01-02T18:18:19.923998+0000","last_clean":"2023-01-02T18:18:19.923998+0000","last_became_active":"2023-01-02T18:15:42.574597+0000","last_became_peered":"2023-01-02T18:15:42.574597+0000","last_unstale":"2023-01-02T18:18:19.923998+0000","last_undegraded":"2023-01-02T18:18:19.923998+0000","last_fullsized":"2023-01-02T18:18:19.923998+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"82'2","reported_seq":80,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328689+0000","last_change":"2023-01-02T18:18:14.453070+0000","last_active":"2023-01-02T18:18:19.328689+0000","last_peered":"2023-01-02T18:18:19.328689+0000","last_clean":"2023-01-02T18:18:19.328689+0000","last_became_active":"2023-01-02T18:18:14.401374+0000","last_became_peered":"2023-01-02T18:18:14.401374+0000","last_unstale":"2023-01-02T18:18:19.328689+0000","last_undegraded":"2023-01-02T18:18:19.328689+0000","last_fullsized":"2023-01-02T18:18:19.328689+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":80,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":119,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923316+0000","last_change":"2023-01-02T18:17:29.319612+0000","last_active":"2023-01-02T18:18:19.923316+0000","last_peered":"2023-01-02T18:18:19.923316+0000","last_clean":"2023-01-02T18:18:19.923316+0000","last_became_active":"2023-01-02T18:17:29.319276+0000","last_became_peered":"2023-01-02T18:17:29.319276+0000","last_unstale":"2023-01-02T18:18:19.923316+0000","last_undegraded":"2023-01-02T18:18:19.923316+0000","last_fullsized":"2023-01-02T18:18:19.923316+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"56'4","reported_seq":106,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094398+0000","last_change":"2023-01-02T18:16:49.318310+0000","last_active":"2023-01-02T18:18:20.094398+0000","last_peered":"2023-01-02T18:18:20.094398+0000","last_clean":"2023-01-02T18:18:20.094398+0000","last_became_active":"2023-01-02T18:16:46.314536+0000","last_became_peered":"2023-01-02T18:16:46.314536+0000","last_unstale":"2023-01-02T18:18:20.094398+0000","last_undegraded":"2023-01-02T18:18:20.094398+0000","last_fullsized":"2023-01-02T18:18:20.094398+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":84,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321289+0000","last_change":"2023-01-02T18:17:01.319888+0000","last_active":"2023-01-02T18:18:19.321289+0000","last_peered":"2023-01-02T18:18:19.321289+0000","last_clean":"2023-01-02T18:18:19.321289+0000","last_became_active":"2023-01-02T18:16:59.322021+0000","last_became_peered":"2023-01-02T18:16:59.322021+0000","last_unstale":"2023-01-02T18:18:19.321289+0000","last_undegraded":"2023-01-02T18:18:19.321289+0000","last_fullsized":"2023-01-02T18:18:19.321289+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328832+0000","last_change":"2023-01-02T18:17:29.326591+0000","last_active":"2023-01-02T18:18:19.328832+0000","last_peered":"2023-01-02T18:18:19.328832+0000","last_clean":"2023-01-02T18:18:19.328832+0000","last_became_active":"2023-01-02T18:17:29.326222+0000","last_became_peered":"2023-01-02T18:17:29.326222+0000","last_unstale":"2023-01-02T18:18:19.328832+0000","last_undegraded":"2023-01-02T18:18:19.328832+0000","last_fullsized":"2023-01-02T18:18:19.328832+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":69,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756675+0000","last_change":"2023-01-02T18:18:02.793700+0000","last_active":"2023-01-02T18:18:19.756675+0000","last_peered":"2023-01-02T18:18:19.756675+0000","last_clean":"2023-01-02T18:18:19.756675+0000","last_became_active":"2023-01-02T18:18:02.793353+0000","last_became_peered":"2023-01-02T18:18:02.793353+0000","last_unstale":"2023-01-02T18:18:19.756675+0000","last_undegraded":"2023-01-02T18:18:19.756675+0000","last_fullsized":"2023-01-02T18:18:19.756675+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":19,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.453031+0000","last_change":"2023-01-02T18:18:08.360087+0000","last_active":"2023-01-02T18:18:19.453031+0000","last_peered":"2023-01-02T18:18:19.453031+0000","last_clean":"2023-01-02T18:18:19.453031+0000","last_became_active":"2023-01-02T18:18:08.359706+0000","last_became_peered":"2023-01-02T18:18:08.359706+0000","last_unstale":"2023-01-02T18:18:19.453031+0000","last_undegraded":"2023-01-02T18:18:19.453031+0000","last_fullsized":"2023-01-02T18:18:19.453031+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":25,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452110+0000","last_change":"2023-01-02T18:17:56.722686+0000","last_active":"2023-01-02T18:18:19.452110+0000","last_peered":"2023-01-02T18:18:19.452110+0000","last_clean":"2023-01-02T18:18:19.452110+0000","last_became_active":"2023-01-02T18:17:56.722402+0000","last_became_peered":"2023-01-02T18:17:56.722402+0000","last_unstale":"2023-01-02T18:18:19.452110+0000","last_undegraded":"2023-01-02T18:18:19.452110+0000","last_fullsized":"2023-01-02T18:18:19.452110+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":25,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327135+0000","last_change":"2023-01-02T18:18:02.788285+0000","last_active":"2023-01-02T18:18:19.327135+0000","last_peered":"2023-01-02T18:18:19.327135+0000","last_clean":"2023-01-02T18:18:19.327135+0000","last_became_active":"2023-01-02T18:18:02.784207+0000","last_became_peered":"2023-01-02T18:18:02.784207+0000","last_unstale":"2023-01-02T18:18:19.327135+0000","last_undegraded":"2023-01-02T18:18:19.327135+0000","last_fullsized":"2023-01-02T18:18:19.327135+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":88,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094704+0000","last_change":"2023-01-02T18:16:57.307859+0000","last_active":"2023-01-02T18:18:20.094704+0000","last_peered":"2023-01-02T18:18:20.094704+0000","last_clean":"2023-01-02T18:18:20.094704+0000","last_became_active":"2023-01-02T18:16:55.312501+0000","last_became_peered":"2023-01-02T18:16:55.312501+0000","last_unstale":"2023-01-02T18:18:20.094704+0000","last_undegraded":"2023-01-02T18:18:20.094704+0000","last_fullsized":"2023-01-02T18:18:20.094704+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":95,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325525+0000","last_change":"2023-01-02T18:18:14.413264+0000","last_active":"2023-01-02T18:18:19.325525+0000","last_peered":"2023-01-02T18:18:19.325525+0000","last_clean":"2023-01-02T18:18:19.325525+0000","last_became_active":"2023-01-02T18:18:14.412961+0000","last_became_peered":"2023-01-02T18:18:14.412961+0000","last_unstale":"2023-01-02T18:18:19.325525+0000","last_undegraded":"2023-01-02T18:18:19.325525+0000","last_fullsized":"2023-01-02T18:18:19.325525+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":97,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320230+0000","last_change":"2023-01-02T18:16:49.324984+0000","last_active":"2023-01-02T18:18:19.320230+0000","last_peered":"2023-01-02T18:18:19.320230+0000","last_clean":"2023-01-02T18:18:19.320230+0000","last_became_active":"2023-01-02T18:16:46.312176+0000","last_became_peered":"2023-01-02T18:16:46.312176+0000","last_unstale":"2023-01-02T18:18:19.320230+0000","last_undegraded":"2023-01-02T18:18:19.320230+0000","last_fullsized":"2023-01-02T18:18:19.320230+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328721+0000","last_change":"2023-01-02T18:17:29.331000+0000","last_active":"2023-01-02T18:18:19.328721+0000","last_peered":"2023-01-02T18:18:19.328721+0000","last_clean":"2023-01-02T18:18:19.328721+0000","last_became_active":"2023-01-02T18:17:29.329297+0000","last_became_peered":"2023-01-02T18:17:29.329297+0000","last_unstale":"2023-01-02T18:18:19.328721+0000","last_undegraded":"2023-01-02T18:18:19.328721+0000","last_fullsized":"2023-01-02T18:18:19.328721+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"137'13","reported_seq":31,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-01-02T18:18:21.678580+0000","last_change":"2023-01-02T18:18:02.818468+0000","last_active":"2023-01-02T18:18:21.678580+0000","last_peered":"2023-01-02T18:18:21.678580+0000","last_clean":"2023-01-02T18:18:21.678580+0000","last_became_active":"2023-01-02T18:18:02.774455+0000","last_became_peered":"2023-01-02T18:18:02.774455+0000","last_unstale":"2023-01-02T18:18:21.678580+0000","last_undegraded":"2023-01-02T18:18:21.678580+0000","last_fullsized":"2023-01-02T18:18:21.678580+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":21,"num_read_kb":11,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":102,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924047+0000","last_change":"2023-01-02T18:16:44.298018+0000","last_active":"2023-01-02T18:18:19.924047+0000","last_peered":"2023-01-02T18:18:19.924047+0000","last_clean":"2023-01-02T18:18:19.924047+0000","last_became_active":"2023-01-02T18:16:41.441487+0000","last_became_peered":"2023-01-02T18:16:41.441487+0000","last_unstale":"2023-01-02T18:18:19.924047+0000","last_undegraded":"2023-01-02T18:18:19.924047+0000","last_fullsized":"2023-01-02T18:18:19.924047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.8","version":"68'1","reported_seq":66,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326886+0000","last_change":"2023-01-02T18:18:14.439577+0000","last_active":"2023-01-02T18:18:19.326886+0000","last_peered":"2023-01-02T18:18:19.326886+0000","last_clean":"2023-01-02T18:18:19.326886+0000","last_became_active":"2023-01-02T18:18:14.394944+0000","last_became_peered":"2023-01-02T18:18:14.394944+0000","last_unstale":"2023-01-02T18:18:19.326886+0000","last_undegraded":"2023-01-02T18:18:19.326886+0000","last_fullsized":"2023-01-02T18:18:19.326886+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":32,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"76'4","reported_seq":80,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755664+0000","last_change":"2023-01-02T18:17:09.322082+0000","last_active":"2023-01-02T18:18:19.755664+0000","last_peered":"2023-01-02T18:18:19.755664+0000","last_clean":"2023-01-02T18:18:19.755664+0000","last_became_active":"2023-01-02T18:17:07.340751+0000","last_became_peered":"2023-01-02T18:17:07.340751+0000","last_unstale":"2023-01-02T18:18:19.755664+0000","last_undegraded":"2023-01-02T18:18:19.755664+0000","last_fullsized":"2023-01-02T18:18:19.755664+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":3,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093835+0000","last_change":"2023-01-02T18:17:34.326569+0000","last_active":"2023-01-02T18:18:20.093835+0000","last_peered":"2023-01-02T18:18:20.093835+0000","last_clean":"2023-01-02T18:18:20.093835+0000","last_became_active":"2023-01-02T18:17:32.341143+0000","last_became_peered":"2023-01-02T18:17:32.341143+0000","last_unstale":"2023-01-02T18:18:20.093835+0000","last_undegraded":"2023-01-02T18:18:20.093835+0000","last_fullsized":"2023-01-02T18:18:20.093835+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320038+0000","last_change":"2023-01-02T18:18:14.398679+0000","last_active":"2023-01-02T18:18:19.320038+0000","last_peered":"2023-01-02T18:18:19.320038+0000","last_clean":"2023-01-02T18:18:19.320038+0000","last_became_active":"2023-01-02T18:18:14.390568+0000","last_became_peered":"2023-01-02T18:18:14.390568+0000","last_unstale":"2023-01-02T18:18:19.320038+0000","last_undegraded":"2023-01-02T18:18:19.320038+0000","last_fullsized":"2023-01-02T18:18:19.320038+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320353+0000","last_change":"2023-01-02T18:17:56.725529+0000","last_active":"2023-01-02T18:18:19.320353+0000","last_peered":"2023-01-02T18:18:19.320353+0000","last_clean":"2023-01-02T18:18:19.320353+0000","last_became_active":"2023-01-02T18:17:56.725243+0000","last_became_peered":"2023-01-02T18:17:56.725243+0000","last_unstale":"2023-01-02T18:18:19.320353+0000","last_undegraded":"2023-01-02T18:18:19.320353+0000","last_fullsized":"2023-01-02T18:18:19.320353+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757502+0000","last_change":"2023-01-02T18:18:00.740436+0000","last_active":"2023-01-02T18:18:19.757502+0000","last_peered":"2023-01-02T18:18:19.757502+0000","last_clean":"2023-01-02T18:18:19.757502+0000","last_became_active":"2023-01-02T18:17:58.741629+0000","last_became_peered":"2023-01-02T18:17:58.741629+0000","last_unstale":"2023-01-02T18:18:19.757502+0000","last_undegraded":"2023-01-02T18:18:19.757502+0000","last_fullsized":"2023-01-02T18:18:19.757502+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":96,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320503+0000","last_change":"2023-01-02T18:18:02.775248+0000","last_active":"2023-01-02T18:18:19.320503+0000","last_peered":"2023-01-02T18:18:19.320503+0000","last_clean":"2023-01-02T18:18:19.320503+0000","last_became_active":"2023-01-02T18:18:02.774567+0000","last_became_peered":"2023-01-02T18:18:02.774567+0000","last_unstale":"2023-01-02T18:18:19.320503+0000","last_undegraded":"2023-01-02T18:18:19.320503+0000","last_fullsized":"2023-01-02T18:18:19.320503+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":90,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757555+0000","last_change":"2023-01-02T18:16:53.346940+0000","last_active":"2023-01-02T18:18:19.757555+0000","last_peered":"2023-01-02T18:18:19.757555+0000","last_clean":"2023-01-02T18:18:19.757555+0000","last_became_active":"2023-01-02T18:16:51.334796+0000","last_became_peered":"2023-01-02T18:16:51.334796+0000","last_unstale":"2023-01-02T18:18:19.757555+0000","last_undegraded":"2023-01-02T18:18:19.757555+0000","last_fullsized":"2023-01-02T18:18:19.757555+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"56'1","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452830+0000","last_change":"2023-01-02T18:17:29.328315+0000","last_active":"2023-01-02T18:18:19.452830+0000","last_peered":"2023-01-02T18:18:19.452830+0000","last_clean":"2023-01-02T18:18:19.452830+0000","last_became_active":"2023-01-02T18:17:29.328011+0000","last_became_peered":"2023-01-02T18:17:29.328011+0000","last_unstale":"2023-01-02T18:18:19.452830+0000","last_undegraded":"2023-01-02T18:18:19.452830+0000","last_fullsized":"2023-01-02T18:18:19.452830+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319278+0000","last_change":"2023-01-02T18:18:14.399454+0000","last_active":"2023-01-02T18:18:19.319278+0000","last_peered":"2023-01-02T18:18:19.319278+0000","last_clean":"2023-01-02T18:18:19.319278+0000","last_became_active":"2023-01-02T18:18:14.398266+0000","last_became_peered":"2023-01-02T18:18:14.398266+0000","last_unstale":"2023-01-02T18:18:19.319278+0000","last_undegraded":"2023-01-02T18:18:19.319278+0000","last_fullsized":"2023-01-02T18:18:19.319278+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"90'10","reported_seq":191,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923095+0000","last_change":"2023-01-02T18:17:30.324702+0000","last_active":"2023-01-02T18:18:19.923095+0000","last_peered":"2023-01-02T18:18:19.923095+0000","last_clean":"2023-01-02T18:18:19.923095+0000","last_became_active":"2023-01-02T18:16:38.035564+0000","last_became_peered":"2023-01-02T18:16:38.035564+0000","last_unstale":"2023-01-02T18:18:19.923095+0000","last_undegraded":"2023-01-02T18:18:19.923095+0000","last_fullsized":"2023-01-02T18:18:19.923095+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":84,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924839+0000","last_change":"2023-01-02T18:17:48.654077+0000","last_active":"2023-01-02T18:18:19.924839+0000","last_peered":"2023-01-02T18:18:19.924839+0000","last_clean":"2023-01-02T18:18:19.924839+0000","last_became_active":"2023-01-02T18:17:48.653707+0000","last_became_peered":"2023-01-02T18:17:48.653707+0000","last_unstale":"2023-01-02T18:18:19.924839+0000","last_undegraded":"2023-01-02T18:18:19.924839+0000","last_fullsized":"2023-01-02T18:18:19.924839+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"72'1","reported_seq":116,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325086+0000","last_change":"2023-01-02T18:18:14.429784+0000","last_active":"2023-01-02T18:18:19.325086+0000","last_peered":"2023-01-02T18:18:19.325086+0000","last_clean":"2023-01-02T18:18:19.325086+0000","last_became_active":"2023-01-02T18:18:14.402774+0000","last_became_peered":"2023-01-02T18:18:14.402774+0000","last_unstale":"2023-01-02T18:18:19.325086+0000","last_undegraded":"2023-01-02T18:18:19.325086+0000","last_fullsized":"2023-01-02T18:18:19.325086+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":105,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.a","version":"76'9","reported_seq":54,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328561+0000","last_change":"2023-01-02T18:17:29.361212+0000","last_active":"2023-01-02T18:18:19.328561+0000","last_peered":"2023-01-02T18:18:19.328561+0000","last_clean":"2023-01-02T18:18:19.328561+0000","last_became_active":"2023-01-02T18:17:29.328070+0000","last_became_peered":"2023-01-02T18:17:29.328070+0000","last_unstale":"2023-01-02T18:18:19.328561+0000","last_undegraded":"2023-01-02T18:18:19.328561+0000","last_fullsized":"2023-01-02T18:18:19.328561+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":53,"num_read_kb":47,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326420+0000","last_change":"2023-01-02T18:17:34.316527+0000","last_active":"2023-01-02T18:18:19.326420+0000","last_peered":"2023-01-02T18:18:19.326420+0000","last_clean":"2023-01-02T18:18:19.326420+0000","last_became_active":"2023-01-02T18:17:32.342303+0000","last_became_peered":"2023-01-02T18:17:32.342303+0000","last_unstale":"2023-01-02T18:18:19.326420+0000","last_undegraded":"2023-01-02T18:18:19.326420+0000","last_fullsized":"2023-01-02T18:18:19.326420+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093498+0000","last_change":"2023-01-02T18:18:14.405766+0000","last_active":"2023-01-02T18:18:20.093498+0000","last_peered":"2023-01-02T18:18:20.093498+0000","last_clean":"2023-01-02T18:18:20.093498+0000","last_became_active":"2023-01-02T18:18:14.405463+0000","last_became_peered":"2023-01-02T18:18:14.405463+0000","last_unstale":"2023-01-02T18:18:20.093498+0000","last_undegraded":"2023-01-02T18:18:20.093498+0000","last_fullsized":"2023-01-02T18:18:20.093498+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095939+0000","last_change":"2023-01-02T18:17:56.725236+0000","last_active":"2023-01-02T18:18:20.095939+0000","last_peered":"2023-01-02T18:18:20.095939+0000","last_clean":"2023-01-02T18:18:20.095939+0000","last_became_active":"2023-01-02T18:17:56.725008+0000","last_became_peered":"2023-01-02T18:17:56.725008+0000","last_unstale":"2023-01-02T18:18:20.095939+0000","last_undegraded":"2023-01-02T18:18:20.095939+0000","last_fullsized":"2023-01-02T18:18:20.095939+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923762+0000","last_change":"2023-01-02T18:18:00.735164+0000","last_active":"2023-01-02T18:18:19.923762+0000","last_peered":"2023-01-02T18:18:19.923762+0000","last_clean":"2023-01-02T18:18:19.923762+0000","last_became_active":"2023-01-02T18:17:58.732192+0000","last_became_peered":"2023-01-02T18:17:58.732192+0000","last_unstale":"2023-01-02T18:18:19.923762+0000","last_undegraded":"2023-01-02T18:18:19.923762+0000","last_fullsized":"2023-01-02T18:18:19.923762+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":88,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320973+0000","last_change":"2023-01-02T18:16:57.306958+0000","last_active":"2023-01-02T18:18:19.320973+0000","last_peered":"2023-01-02T18:18:19.320973+0000","last_clean":"2023-01-02T18:18:19.320973+0000","last_became_active":"2023-01-02T18:16:55.315237+0000","last_became_peered":"2023-01-02T18:16:55.315237+0000","last_unstale":"2023-01-02T18:18:19.320973+0000","last_undegraded":"2023-01-02T18:18:19.320973+0000","last_fullsized":"2023-01-02T18:18:19.320973+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"60'77","reported_seq":66,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328726+0000","last_change":"2023-01-02T18:18:14.425304+0000","last_active":"2023-01-02T18:18:19.328726+0000","last_peered":"2023-01-02T18:18:19.328726+0000","last_clean":"2023-01-02T18:18:19.328726+0000","last_became_active":"2023-01-02T18:18:14.394345+0000","last_became_peered":"2023-01-02T18:18:14.394345+0000","last_unstale":"2023-01-02T18:18:19.328726+0000","last_undegraded":"2023-01-02T18:18:19.328726+0000","last_fullsized":"2023-01-02T18:18:19.328726+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":156,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327686+0000","last_change":"2023-01-02T18:17:29.323754+0000","last_active":"2023-01-02T18:18:19.327686+0000","last_peered":"2023-01-02T18:18:19.327686+0000","last_clean":"2023-01-02T18:18:19.327686+0000","last_became_active":"2023-01-02T18:17:29.320497+0000","last_became_peered":"2023-01-02T18:17:29.320497+0000","last_unstale":"2023-01-02T18:18:19.327686+0000","last_undegraded":"2023-01-02T18:18:19.327686+0000","last_fullsized":"2023-01-02T18:18:19.327686+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":127,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755967+0000","last_change":"2023-01-02T18:15:40.576981+0000","last_active":"2023-01-02T18:18:19.755967+0000","last_peered":"2023-01-02T18:18:19.755967+0000","last_clean":"2023-01-02T18:18:19.755967+0000","last_became_active":"2023-01-02T18:15:40.576717+0000","last_became_peered":"2023-01-02T18:15:40.576717+0000","last_unstale":"2023-01-02T18:18:19.755967+0000","last_undegraded":"2023-01-02T18:18:19.755967+0000","last_fullsized":"2023-01-02T18:18:19.755967+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:39.553250+0000","last_clean_scrub_stamp":"2023-01-02T18:15:39.553250+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"96'9","reported_seq":162,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328461+0000","last_change":"2023-01-02T18:18:14.463980+0000","last_active":"2023-01-02T18:18:19.328461+0000","last_peered":"2023-01-02T18:18:19.328461+0000","last_clean":"2023-01-02T18:18:19.328461+0000","last_became_active":"2023-01-02T18:18:14.407345+0000","last_became_peered":"2023-01-02T18:18:14.407345+0000","last_unstale":"2023-01-02T18:18:19.328461+0000","last_undegraded":"2023-01-02T18:18:19.328461+0000","last_fullsized":"2023-01-02T18:18:19.328461+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":45,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":70,"num_keys_recovered":16,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"51'1","reported_seq":127,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094777+0000","last_change":"2023-01-02T18:18:02.864678+0000","last_active":"2023-01-02T18:18:20.094777+0000","last_peered":"2023-01-02T18:18:20.094777+0000","last_clean":"2023-01-02T18:18:20.094777+0000","last_became_active":"2023-01-02T18:18:02.795471+0000","last_became_peered":"2023-01-02T18:18:02.795471+0000","last_unstale":"2023-01-02T18:18:20.094777+0000","last_undegraded":"2023-01-02T18:18:20.094777+0000","last_fullsized":"2023-01-02T18:18:20.094777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":32,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":95,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756941+0000","last_change":"2023-01-02T18:16:49.305464+0000","last_active":"2023-01-02T18:18:19.756941+0000","last_peered":"2023-01-02T18:18:19.756941+0000","last_clean":"2023-01-02T18:18:19.756941+0000","last_became_active":"2023-01-02T18:16:46.315099+0000","last_became_peered":"2023-01-02T18:16:46.315099+0000","last_unstale":"2023-01-02T18:18:19.756941+0000","last_undegraded":"2023-01-02T18:18:19.756941+0000","last_fullsized":"2023-01-02T18:18:19.756941+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":92,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094079+0000","last_change":"2023-01-02T18:17:29.338386+0000","last_active":"2023-01-02T18:18:20.094079+0000","last_peered":"2023-01-02T18:18:20.094079+0000","last_clean":"2023-01-02T18:18:20.094079+0000","last_became_active":"2023-01-02T18:17:29.337596+0000","last_became_peered":"2023-01-02T18:17:29.337596+0000","last_unstale":"2023-01-02T18:18:20.094079+0000","last_undegraded":"2023-01-02T18:18:20.094079+0000","last_fullsized":"2023-01-02T18:18:20.094079+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319685+0000","last_change":"2023-01-02T18:18:14.400937+0000","last_active":"2023-01-02T18:18:19.319685+0000","last_peered":"2023-01-02T18:18:19.319685+0000","last_clean":"2023-01-02T18:18:19.319685+0000","last_became_active":"2023-01-02T18:18:14.400583+0000","last_became_peered":"2023-01-02T18:18:14.400583+0000","last_unstale":"2023-01-02T18:18:19.319685+0000","last_undegraded":"2023-01-02T18:18:19.319685+0000","last_fullsized":"2023-01-02T18:18:19.319685+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094319+0000","last_change":"2023-01-02T18:17:34.327117+0000","last_active":"2023-01-02T18:18:20.094319+0000","last_peered":"2023-01-02T18:18:20.094319+0000","last_clean":"2023-01-02T18:18:20.094319+0000","last_became_active":"2023-01-02T18:17:32.340616+0000","last_became_peered":"2023-01-02T18:17:32.340616+0000","last_unstale":"2023-01-02T18:18:20.094319+0000","last_undegraded":"2023-01-02T18:18:20.094319+0000","last_fullsized":"2023-01-02T18:18:20.094319+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094836+0000","last_change":"2023-01-02T18:18:14.403017+0000","last_active":"2023-01-02T18:18:20.094836+0000","last_peered":"2023-01-02T18:18:20.094836+0000","last_clean":"2023-01-02T18:18:20.094836+0000","last_became_active":"2023-01-02T18:18:14.402676+0000","last_became_peered":"2023-01-02T18:18:14.402676+0000","last_unstale":"2023-01-02T18:18:20.094836+0000","last_undegraded":"2023-01-02T18:18:20.094836+0000","last_fullsized":"2023-01-02T18:18:20.094836+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756380+0000","last_change":"2023-01-02T18:17:56.721236+0000","last_active":"2023-01-02T18:18:19.756380+0000","last_peered":"2023-01-02T18:18:19.756380+0000","last_clean":"2023-01-02T18:18:19.756380+0000","last_became_active":"2023-01-02T18:17:56.720930+0000","last_became_peered":"2023-01-02T18:17:56.720930+0000","last_unstale":"2023-01-02T18:18:19.756380+0000","last_undegraded":"2023-01-02T18:18:19.756380+0000","last_fullsized":"2023-01-02T18:18:19.756380+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.096037+0000","last_change":"2023-01-02T18:18:00.737111+0000","last_active":"2023-01-02T18:18:20.096037+0000","last_peered":"2023-01-02T18:18:20.096037+0000","last_clean":"2023-01-02T18:18:20.096037+0000","last_became_active":"2023-01-02T18:17:58.738285+0000","last_became_peered":"2023-01-02T18:17:58.738285+0000","last_unstale":"2023-01-02T18:18:20.096037+0000","last_undegraded":"2023-01-02T18:18:20.096037+0000","last_fullsized":"2023-01-02T18:18:20.096037+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":86,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757580+0000","last_change":"2023-01-02T18:16:57.311978+0000","last_active":"2023-01-02T18:18:19.757580+0000","last_peered":"2023-01-02T18:18:19.757580+0000","last_clean":"2023-01-02T18:18:19.757580+0000","last_became_active":"2023-01-02T18:16:55.311975+0000","last_became_peered":"2023-01-02T18:16:55.311975+0000","last_unstale":"2023-01-02T18:18:19.757580+0000","last_undegraded":"2023-01-02T18:18:19.757580+0000","last_fullsized":"2023-01-02T18:18:19.757580+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":100,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924155+0000","last_change":"2023-01-02T18:17:29.318734+0000","last_active":"2023-01-02T18:18:19.924155+0000","last_peered":"2023-01-02T18:18:19.924155+0000","last_clean":"2023-01-02T18:18:19.924155+0000","last_became_active":"2023-01-02T18:17:29.318419+0000","last_became_peered":"2023-01-02T18:17:29.318419+0000","last_unstale":"2023-01-02T18:18:19.924155+0000","last_undegraded":"2023-01-02T18:18:19.924155+0000","last_fullsized":"2023-01-02T18:18:19.924155+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328912+0000","last_change":"2023-01-02T18:17:29.326478+0000","last_active":"2023-01-02T18:18:19.328912+0000","last_peered":"2023-01-02T18:18:19.328912+0000","last_clean":"2023-01-02T18:18:19.328912+0000","last_became_active":"2023-01-02T18:17:29.325843+0000","last_became_peered":"2023-01-02T18:17:29.325843+0000","last_unstale":"2023-01-02T18:18:19.328912+0000","last_undegraded":"2023-01-02T18:18:19.328912+0000","last_fullsized":"2023-01-02T18:18:19.328912+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755686+0000","last_change":"2023-01-02T18:18:14.394782+0000","last_active":"2023-01-02T18:18:19.755686+0000","last_peered":"2023-01-02T18:18:19.755686+0000","last_clean":"2023-01-02T18:18:19.755686+0000","last_became_active":"2023-01-02T18:18:14.394456+0000","last_became_peered":"2023-01-02T18:18:14.394456+0000","last_unstale":"2023-01-02T18:18:19.755686+0000","last_undegraded":"2023-01-02T18:18:19.755686+0000","last_fullsized":"2023-01-02T18:18:19.755686+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"94'15","reported_seq":240,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319976+0000","last_change":"2023-01-02T18:18:02.812854+0000","last_active":"2023-01-02T18:18:19.319976+0000","last_peered":"2023-01-02T18:18:19.319976+0000","last_clean":"2023-01-02T18:18:19.319976+0000","last_became_active":"2023-01-02T18:18:02.774375+0000","last_became_peered":"2023-01-02T18:18:02.774375+0000","last_unstale":"2023-01-02T18:18:19.319976+0000","last_undegraded":"2023-01-02T18:18:19.319976+0000","last_fullsized":"2023-01-02T18:18:19.319976+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":60,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":93,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":120,"num_keys_recovered":32,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"51'2","reported_seq":104,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321061+0000","last_change":"2023-01-02T18:16:44.315052+0000","last_active":"2023-01-02T18:18:19.321061+0000","last_peered":"2023-01-02T18:18:19.321061+0000","last_clean":"2023-01-02T18:18:19.321061+0000","last_became_active":"2023-01-02T18:16:41.444343+0000","last_became_peered":"2023-01-02T18:16:41.444343+0000","last_unstale":"2023-01-02T18:18:19.321061+0000","last_undegraded":"2023-01-02T18:18:19.321061+0000","last_fullsized":"2023-01-02T18:18:19.321061+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"71'3","reported_seq":87,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923675+0000","last_change":"2023-01-02T18:17:01.308692+0000","last_active":"2023-01-02T18:18:19.923675+0000","last_peered":"2023-01-02T18:18:19.923675+0000","last_clean":"2023-01-02T18:18:19.923675+0000","last_became_active":"2023-01-02T18:16:59.305196+0000","last_became_peered":"2023-01-02T18:16:59.305196+0000","last_unstale":"2023-01-02T18:18:19.923675+0000","last_undegraded":"2023-01-02T18:18:19.923675+0000","last_fullsized":"2023-01-02T18:18:19.923675+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":76,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320694+0000","last_change":"2023-01-02T18:17:09.321395+0000","last_active":"2023-01-02T18:18:19.320694+0000","last_peered":"2023-01-02T18:18:19.320694+0000","last_clean":"2023-01-02T18:18:19.320694+0000","last_became_active":"2023-01-02T18:17:07.344789+0000","last_became_peered":"2023-01-02T18:17:07.344789+0000","last_unstale":"2023-01-02T18:18:19.320694+0000","last_undegraded":"2023-01-02T18:18:19.320694+0000","last_fullsized":"2023-01-02T18:18:19.320694+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319906+0000","last_change":"2023-01-02T18:17:34.316738+0000","last_active":"2023-01-02T18:18:19.319906+0000","last_peered":"2023-01-02T18:18:19.319906+0000","last_clean":"2023-01-02T18:18:19.319906+0000","last_became_active":"2023-01-02T18:17:32.340483+0000","last_became_peered":"2023-01-02T18:17:32.340483+0000","last_unstale":"2023-01-02T18:18:19.319906+0000","last_undegraded":"2023-01-02T18:18:19.319906+0000","last_fullsized":"2023-01-02T18:18:19.319906+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"117'5","reported_seq":49,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094626+0000","last_change":"2023-01-02T18:18:14.444017+0000","last_active":"2023-01-02T18:18:20.094626+0000","last_peered":"2023-01-02T18:18:20.094626+0000","last_clean":"2023-01-02T18:18:20.094626+0000","last_became_active":"2023-01-02T18:18:14.404569+0000","last_became_peered":"2023-01-02T18:18:14.404569+0000","last_unstale":"2023-01-02T18:18:20.094626+0000","last_undegraded":"2023-01-02T18:18:20.094626+0000","last_fullsized":"2023-01-02T18:18:20.094626+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321094+0000","last_change":"2023-01-02T18:18:02.787575+0000","last_active":"2023-01-02T18:18:19.321094+0000","last_peered":"2023-01-02T18:18:19.321094+0000","last_clean":"2023-01-02T18:18:19.321094+0000","last_became_active":"2023-01-02T18:18:02.787341+0000","last_became_peered":"2023-01-02T18:18:02.787341+0000","last_unstale":"2023-01-02T18:18:19.321094+0000","last_undegraded":"2023-01-02T18:18:19.321094+0000","last_fullsized":"2023-01-02T18:18:19.321094+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923105+0000","last_change":"2023-01-02T18:18:00.733618+0000","last_active":"2023-01-02T18:18:19.923105+0000","last_peered":"2023-01-02T18:18:19.923105+0000","last_clean":"2023-01-02T18:18:19.923105+0000","last_became_active":"2023-01-02T18:17:58.736383+0000","last_became_peered":"2023-01-02T18:17:58.736383+0000","last_unstale":"2023-01-02T18:18:19.923105+0000","last_undegraded":"2023-01-02T18:18:19.923105+0000","last_fullsized":"2023-01-02T18:18:19.923105+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326856+0000","last_change":"2023-01-02T18:17:29.326283+0000","last_active":"2023-01-02T18:18:19.326856+0000","last_peered":"2023-01-02T18:18:19.326856+0000","last_clean":"2023-01-02T18:18:19.326856+0000","last_became_active":"2023-01-02T18:17:29.325965+0000","last_became_peered":"2023-01-02T18:17:29.325965+0000","last_unstale":"2023-01-02T18:18:19.326856+0000","last_undegraded":"2023-01-02T18:18:19.326856+0000","last_fullsized":"2023-01-02T18:18:19.326856+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":92,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093830+0000","last_change":"2023-01-02T18:16:53.604106+0000","last_active":"2023-01-02T18:18:20.093830+0000","last_peered":"2023-01-02T18:18:20.093830+0000","last_clean":"2023-01-02T18:18:20.093830+0000","last_became_active":"2023-01-02T18:16:51.339809+0000","last_became_peered":"2023-01-02T18:16:51.339809+0000","last_unstale":"2023-01-02T18:18:20.093830+0000","last_undegraded":"2023-01-02T18:18:20.093830+0000","last_fullsized":"2023-01-02T18:18:20.093830+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":125,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756760+0000","last_change":"2023-01-02T18:15:42.582291+0000","last_active":"2023-01-02T18:18:19.756760+0000","last_peered":"2023-01-02T18:18:19.756760+0000","last_clean":"2023-01-02T18:18:19.756760+0000","last_became_active":"2023-01-02T18:15:42.581992+0000","last_became_peered":"2023-01-02T18:15:42.581992+0000","last_unstale":"2023-01-02T18:18:19.756760+0000","last_undegraded":"2023-01-02T18:18:19.756760+0000","last_fullsized":"2023-01-02T18:18:19.756760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"136'3","reported_seq":156,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:21.022887+0000","last_change":"2023-01-02T18:17:30.330076+0000","last_active":"2023-01-02T18:18:21.022887+0000","last_peered":"2023-01-02T18:18:21.022887+0000","last_clean":"2023-01-02T18:18:21.022887+0000","last_became_active":"2023-01-02T18:16:38.035566+0000","last_became_peered":"2023-01-02T18:16:38.035566+0000","last_unstale":"2023-01-02T18:18:21.022887+0000","last_undegraded":"2023-01-02T18:18:21.022887+0000","last_fullsized":"2023-01-02T18:18:21.022887+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":48,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"51'19","reported_seq":56,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328464+0000","last_change":"2023-01-02T18:17:29.344997+0000","last_active":"2023-01-02T18:18:19.328464+0000","last_peered":"2023-01-02T18:18:19.328464+0000","last_clean":"2023-01-02T18:18:19.328464+0000","last_became_active":"2023-01-02T18:17:29.323459+0000","last_became_peered":"2023-01-02T18:17:29.323459+0000","last_unstale":"2023-01-02T18:18:19.328464+0000","last_undegraded":"2023-01-02T18:18:19.328464+0000","last_fullsized":"2023-01-02T18:18:19.328464+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":92,"num_read_kb":81,"num_write":12,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"56'1","reported_seq":98,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094631+0000","last_change":"2023-01-02T18:16:49.317970+0000","last_active":"2023-01-02T18:18:20.094631+0000","last_peered":"2023-01-02T18:18:20.094631+0000","last_clean":"2023-01-02T18:18:20.094631+0000","last_became_active":"2023-01-02T18:16:46.314328+0000","last_became_peered":"2023-01-02T18:16:46.314328+0000","last_unstale":"2023-01-02T18:18:20.094631+0000","last_undegraded":"2023-01-02T18:18:20.094631+0000","last_fullsized":"2023-01-02T18:18:20.094631+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924324+0000","last_change":"2023-01-02T18:18:14.423760+0000","last_active":"2023-01-02T18:18:19.924324+0000","last_peered":"2023-01-02T18:18:19.924324+0000","last_clean":"2023-01-02T18:18:19.924324+0000","last_became_active":"2023-01-02T18:18:14.396046+0000","last_became_peered":"2023-01-02T18:18:14.396046+0000","last_unstale":"2023-01-02T18:18:19.924324+0000","last_undegraded":"2023-01-02T18:18:19.924324+0000","last_fullsized":"2023-01-02T18:18:19.924324+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":82,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757660+0000","last_change":"2023-01-02T18:18:02.796014+0000","last_active":"2023-01-02T18:18:19.757660+0000","last_peered":"2023-01-02T18:18:19.757660+0000","last_clean":"2023-01-02T18:18:19.757660+0000","last_became_active":"2023-01-02T18:18:02.795643+0000","last_became_peered":"2023-01-02T18:18:02.795643+0000","last_unstale":"2023-01-02T18:18:19.757660+0000","last_undegraded":"2023-01-02T18:18:19.757660+0000","last_fullsized":"2023-01-02T18:18:19.757660+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":71,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094543+0000","last_change":"2023-01-02T18:18:02.790473+0000","last_active":"2023-01-02T18:18:20.094543+0000","last_peered":"2023-01-02T18:18:20.094543+0000","last_clean":"2023-01-02T18:18:20.094543+0000","last_became_active":"2023-01-02T18:18:02.790105+0000","last_became_peered":"2023-01-02T18:18:02.790105+0000","last_unstale":"2023-01-02T18:18:20.094543+0000","last_undegraded":"2023-01-02T18:18:20.094543+0000","last_fullsized":"2023-01-02T18:18:20.094543+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":47,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923911+0000","last_change":"2023-01-02T18:17:38.469077+0000","last_active":"2023-01-02T18:18:19.923911+0000","last_peered":"2023-01-02T18:18:19.923911+0000","last_clean":"2023-01-02T18:18:19.923911+0000","last_became_active":"2023-01-02T18:17:36.436242+0000","last_became_peered":"2023-01-02T18:17:36.436242+0000","last_unstale":"2023-01-02T18:18:19.923911+0000","last_undegraded":"2023-01-02T18:18:19.923911+0000","last_fullsized":"2023-01-02T18:18:19.923911+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094005+0000","last_change":"2023-01-02T18:18:14.400830+0000","last_active":"2023-01-02T18:18:20.094005+0000","last_peered":"2023-01-02T18:18:20.094005+0000","last_clean":"2023-01-02T18:18:20.094005+0000","last_became_active":"2023-01-02T18:18:14.400514+0000","last_became_peered":"2023-01-02T18:18:14.400514+0000","last_unstale":"2023-01-02T18:18:20.094005+0000","last_undegraded":"2023-01-02T18:18:20.094005+0000","last_fullsized":"2023-01-02T18:18:20.094005+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326022+0000","last_change":"2023-01-02T18:18:00.733821+0000","last_active":"2023-01-02T18:18:19.326022+0000","last_peered":"2023-01-02T18:18:19.326022+0000","last_clean":"2023-01-02T18:18:19.326022+0000","last_became_active":"2023-01-02T18:17:58.740303+0000","last_became_peered":"2023-01-02T18:17:58.740303+0000","last_unstale":"2023-01-02T18:18:19.326022+0000","last_undegraded":"2023-01-02T18:18:19.326022+0000","last_fullsized":"2023-01-02T18:18:19.326022+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452508+0000","last_change":"2023-01-02T18:18:14.393858+0000","last_active":"2023-01-02T18:18:19.452508+0000","last_peered":"2023-01-02T18:18:19.452508+0000","last_clean":"2023-01-02T18:18:19.452508+0000","last_became_active":"2023-01-02T18:18:14.393529+0000","last_became_peered":"2023-01-02T18:18:14.393529+0000","last_unstale":"2023-01-02T18:18:19.452508+0000","last_undegraded":"2023-01-02T18:18:19.452508+0000","last_fullsized":"2023-01-02T18:18:19.452508+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":95,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325114+0000","last_change":"2023-01-02T18:18:14.397654+0000","last_active":"2023-01-02T18:18:19.325114+0000","last_peered":"2023-01-02T18:18:19.325114+0000","last_clean":"2023-01-02T18:18:19.325114+0000","last_became_active":"2023-01-02T18:18:14.396867+0000","last_became_peered":"2023-01-02T18:18:14.396867+0000","last_unstale":"2023-01-02T18:18:19.325114+0000","last_undegraded":"2023-01-02T18:18:19.325114+0000","last_fullsized":"2023-01-02T18:18:19.325114+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"92'13","reported_seq":140,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758176+0000","last_change":"2023-01-02T18:18:14.436876+0000","last_active":"2023-01-02T18:18:19.758176+0000","last_peered":"2023-01-02T18:18:19.758176+0000","last_clean":"2023-01-02T18:18:19.758176+0000","last_became_active":"2023-01-02T18:18:14.410062+0000","last_became_peered":"2023-01-02T18:18:14.410062+0000","last_unstale":"2023-01-02T18:18:19.758176+0000","last_undegraded":"2023-01-02T18:18:19.758176+0000","last_fullsized":"2023-01-02T18:18:19.758176+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":70,"num_keys_recovered":8,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":127,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.925028+0000","last_change":"2023-01-02T18:15:42.587552+0000","last_active":"2023-01-02T18:18:19.925028+0000","last_peered":"2023-01-02T18:18:19.925028+0000","last_clean":"2023-01-02T18:18:19.925028+0000","last_became_active":"2023-01-02T18:15:42.587124+0000","last_became_peered":"2023-01-02T18:15:42.587124+0000","last_unstale":"2023-01-02T18:18:19.925028+0000","last_undegraded":"2023-01-02T18:18:19.925028+0000","last_fullsized":"2023-01-02T18:18:19.925028+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755765+0000","last_change":"2023-01-02T18:18:14.407978+0000","last_active":"2023-01-02T18:18:19.755765+0000","last_peered":"2023-01-02T18:18:19.755765+0000","last_clean":"2023-01-02T18:18:19.755765+0000","last_became_active":"2023-01-02T18:18:14.407654+0000","last_became_peered":"2023-01-02T18:18:14.407654+0000","last_unstale":"2023-01-02T18:18:19.755765+0000","last_undegraded":"2023-01-02T18:18:19.755765+0000","last_fullsized":"2023-01-02T18:18:19.755765+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":28,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325073+0000","last_change":"2023-01-02T18:18:14.412190+0000","last_active":"2023-01-02T18:18:19.325073+0000","last_peered":"2023-01-02T18:18:19.325073+0000","last_clean":"2023-01-02T18:18:19.325073+0000","last_became_active":"2023-01-02T18:18:14.411683+0000","last_became_peered":"2023-01-02T18:18:14.411683+0000","last_unstale":"2023-01-02T18:18:19.325073+0000","last_undegraded":"2023-01-02T18:18:19.325073+0000","last_fullsized":"2023-01-02T18:18:19.325073+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":92,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320601+0000","last_change":"2023-01-02T18:18:14.411560+0000","last_active":"2023-01-02T18:18:19.320601+0000","last_peered":"2023-01-02T18:18:19.320601+0000","last_clean":"2023-01-02T18:18:19.320601+0000","last_became_active":"2023-01-02T18:18:14.411242+0000","last_became_peered":"2023-01-02T18:18:14.411242+0000","last_unstale":"2023-01-02T18:18:19.320601+0000","last_undegraded":"2023-01-02T18:18:19.320601+0000","last_fullsized":"2023-01-02T18:18:19.320601+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":90,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757666+0000","last_change":"2023-01-02T18:17:48.662784+0000","last_active":"2023-01-02T18:18:19.757666+0000","last_peered":"2023-01-02T18:18:19.757666+0000","last_clean":"2023-01-02T18:18:19.757666+0000","last_became_active":"2023-01-02T18:17:48.662397+0000","last_became_peered":"2023-01-02T18:17:48.662397+0000","last_unstale":"2023-01-02T18:18:19.757666+0000","last_undegraded":"2023-01-02T18:18:19.757666+0000","last_fullsized":"2023-01-02T18:18:19.757666+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"101'15","reported_seq":125,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095545+0000","last_change":"2023-01-02T18:18:08.363549+0000","last_active":"2023-01-02T18:18:20.095545+0000","last_peered":"2023-01-02T18:18:20.095545+0000","last_clean":"2023-01-02T18:18:20.095545+0000","last_became_active":"2023-01-02T18:18:08.362561+0000","last_became_peered":"2023-01-02T18:18:08.362561+0000","last_unstale":"2023-01-02T18:18:20.095545+0000","last_undegraded":"2023-01-02T18:18:20.095545+0000","last_fullsized":"2023-01-02T18:18:20.095545+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":45,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758139+0000","last_change":"2023-01-02T18:17:38.465060+0000","last_active":"2023-01-02T18:18:19.758139+0000","last_peered":"2023-01-02T18:18:19.758139+0000","last_clean":"2023-01-02T18:18:19.758139+0000","last_became_active":"2023-01-02T18:17:36.442117+0000","last_became_peered":"2023-01-02T18:17:36.442117+0000","last_unstale":"2023-01-02T18:18:19.758139+0000","last_undegraded":"2023-01-02T18:18:19.758139+0000","last_fullsized":"2023-01-02T18:18:19.758139+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319044+0000","last_change":"2023-01-02T18:18:14.390697+0000","last_active":"2023-01-02T18:18:19.319044+0000","last_peered":"2023-01-02T18:18:19.319044+0000","last_clean":"2023-01-02T18:18:19.319044+0000","last_became_active":"2023-01-02T18:18:14.390396+0000","last_became_peered":"2023-01-02T18:18:14.390396+0000","last_unstale":"2023-01-02T18:18:19.319044+0000","last_undegraded":"2023-01-02T18:18:19.319044+0000","last_fullsized":"2023-01-02T18:18:19.319044+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326236+0000","last_change":"2023-01-02T18:18:00.733046+0000","last_active":"2023-01-02T18:18:19.326236+0000","last_peered":"2023-01-02T18:18:19.326236+0000","last_clean":"2023-01-02T18:18:19.326236+0000","last_became_active":"2023-01-02T18:17:58.739684+0000","last_became_peered":"2023-01-02T18:17:58.739684+0000","last_unstale":"2023-01-02T18:18:19.326236+0000","last_undegraded":"2023-01-02T18:18:19.326236+0000","last_fullsized":"2023-01-02T18:18:19.326236+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923346+0000","last_change":"2023-01-02T18:18:14.395603+0000","last_active":"2023-01-02T18:18:19.923346+0000","last_peered":"2023-01-02T18:18:19.923346+0000","last_clean":"2023-01-02T18:18:19.923346+0000","last_became_active":"2023-01-02T18:18:14.395069+0000","last_became_peered":"2023-01-02T18:18:14.395069+0000","last_unstale":"2023-01-02T18:18:19.923346+0000","last_undegraded":"2023-01-02T18:18:19.923346+0000","last_fullsized":"2023-01-02T18:18:19.923346+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":90,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757019+0000","last_change":"2023-01-02T18:16:53.347064+0000","last_active":"2023-01-02T18:18:19.757019+0000","last_peered":"2023-01-02T18:18:19.757019+0000","last_clean":"2023-01-02T18:18:19.757019+0000","last_became_active":"2023-01-02T18:16:51.334767+0000","last_became_peered":"2023-01-02T18:16:51.334767+0000","last_unstale":"2023-01-02T18:18:19.757019+0000","last_undegraded":"2023-01-02T18:18:19.757019+0000","last_fullsized":"2023-01-02T18:18:19.757019+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":142,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095723+0000","last_change":"2023-01-02T18:17:52.712767+0000","last_active":"2023-01-02T18:18:20.095723+0000","last_peered":"2023-01-02T18:18:20.095723+0000","last_clean":"2023-01-02T18:18:20.095723+0000","last_became_active":"2023-01-02T18:17:52.712430+0000","last_became_peered":"2023-01-02T18:17:52.712430+0000","last_unstale":"2023-01-02T18:18:20.095723+0000","last_undegraded":"2023-01-02T18:18:20.095723+0000","last_fullsized":"2023-01-02T18:18:20.095723+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:15:41.564638+0000","last_clean_scrub_stamp":"2023-01-02T18:15:41.564638+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"86'7","reported_seq":157,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321001+0000","last_change":"2023-01-02T18:17:30.328637+0000","last_active":"2023-01-02T18:18:19.321001+0000","last_peered":"2023-01-02T18:18:19.321001+0000","last_clean":"2023-01-02T18:18:19.321001+0000","last_became_active":"2023-01-02T18:16:37.415671+0000","last_became_peered":"2023-01-02T18:16:37.415671+0000","last_unstale":"2023-01-02T18:18:19.321001+0000","last_undegraded":"2023-01-02T18:18:19.321001+0000","last_fullsized":"2023-01-02T18:18:19.321001+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":19,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"51'1","reported_seq":58,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328629+0000","last_change":"2023-01-02T18:18:08.359047+0000","last_active":"2023-01-02T18:18:19.328629+0000","last_peered":"2023-01-02T18:18:19.328629+0000","last_clean":"2023-01-02T18:18:19.328629+0000","last_became_active":"2023-01-02T18:18:08.358669+0000","last_became_peered":"2023-01-02T18:18:08.358669+0000","last_unstale":"2023-01-02T18:18:19.328629+0000","last_undegraded":"2023-01-02T18:18:19.328629+0000","last_fullsized":"2023-01-02T18:18:19.328629+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.922970+0000","last_change":"2023-01-02T18:18:14.396812+0000","last_active":"2023-01-02T18:18:19.922970+0000","last_peered":"2023-01-02T18:18:19.922970+0000","last_clean":"2023-01-02T18:18:19.922970+0000","last_became_active":"2023-01-02T18:18:14.396185+0000","last_became_peered":"2023-01-02T18:18:14.396185+0000","last_unstale":"2023-01-02T18:18:19.922970+0000","last_undegraded":"2023-01-02T18:18:19.922970+0000","last_fullsized":"2023-01-02T18:18:19.922970+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327494+0000","last_change":"2023-01-02T18:17:29.335050+0000","last_active":"2023-01-02T18:18:19.327494+0000","last_peered":"2023-01-02T18:18:19.327494+0000","last_clean":"2023-01-02T18:18:19.327494+0000","last_became_active":"2023-01-02T18:17:29.333986+0000","last_became_peered":"2023-01-02T18:17:29.333986+0000","last_unstale":"2023-01-02T18:18:19.327494+0000","last_undegraded":"2023-01-02T18:18:19.327494+0000","last_fullsized":"2023-01-02T18:18:19.327494+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756231+0000","last_change":"2023-01-02T18:18:14.410301+0000","last_active":"2023-01-02T18:18:19.756231+0000","last_peered":"2023-01-02T18:18:19.756231+0000","last_clean":"2023-01-02T18:18:19.756231+0000","last_became_active":"2023-01-02T18:18:14.409967+0000","last_became_peered":"2023-01-02T18:18:14.409967+0000","last_unstale":"2023-01-02T18:18:19.756231+0000","last_undegraded":"2023-01-02T18:18:19.756231+0000","last_fullsized":"2023-01-02T18:18:19.756231+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":71,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095761+0000","last_change":"2023-01-02T18:18:14.408182+0000","last_active":"2023-01-02T18:18:20.095761+0000","last_peered":"2023-01-02T18:18:20.095761+0000","last_clean":"2023-01-02T18:18:20.095761+0000","last_became_active":"2023-01-02T18:18:14.407882+0000","last_became_peered":"2023-01-02T18:18:14.407882+0000","last_unstale":"2023-01-02T18:18:20.095761+0000","last_undegraded":"2023-01-02T18:18:20.095761+0000","last_fullsized":"2023-01-02T18:18:20.095761+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325428+0000","last_change":"2023-01-02T18:18:02.786771+0000","last_active":"2023-01-02T18:18:19.325428+0000","last_peered":"2023-01-02T18:18:19.325428+0000","last_clean":"2023-01-02T18:18:19.325428+0000","last_became_active":"2023-01-02T18:18:02.783296+0000","last_became_peered":"2023-01-02T18:18:02.783296+0000","last_unstale":"2023-01-02T18:18:19.325428+0000","last_undegraded":"2023-01-02T18:18:19.325428+0000","last_fullsized":"2023-01-02T18:18:19.325428+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094227+0000","last_change":"2023-01-02T18:17:56.727543+0000","last_active":"2023-01-02T18:18:20.094227+0000","last_peered":"2023-01-02T18:18:20.094227+0000","last_clean":"2023-01-02T18:18:20.094227+0000","last_became_active":"2023-01-02T18:17:56.727311+0000","last_became_peered":"2023-01-02T18:17:56.727311+0000","last_unstale":"2023-01-02T18:18:20.094227+0000","last_undegraded":"2023-01-02T18:18:20.094227+0000","last_fullsized":"2023-01-02T18:18:20.094227+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":33,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320454+0000","last_change":"2023-01-02T18:18:08.359546+0000","last_active":"2023-01-02T18:18:19.320454+0000","last_peered":"2023-01-02T18:18:19.320454+0000","last_clean":"2023-01-02T18:18:19.320454+0000","last_became_active":"2023-01-02T18:18:08.359105+0000","last_became_peered":"2023-01-02T18:18:08.359105+0000","last_unstale":"2023-01-02T18:18:19.320454+0000","last_undegraded":"2023-01-02T18:18:19.320454+0000","last_fullsized":"2023-01-02T18:18:19.320454+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325900+0000","last_change":"2023-01-02T18:18:02.779106+0000","last_active":"2023-01-02T18:18:19.325900+0000","last_peered":"2023-01-02T18:18:19.325900+0000","last_clean":"2023-01-02T18:18:19.325900+0000","last_became_active":"2023-01-02T18:18:02.775467+0000","last_became_peered":"2023-01-02T18:18:02.775467+0000","last_unstale":"2023-01-02T18:18:19.325900+0000","last_undegraded":"2023-01-02T18:18:19.325900+0000","last_fullsized":"2023-01-02T18:18:19.325900+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327045+0000","last_change":"2023-01-02T18:18:02.785570+0000","last_active":"2023-01-02T18:18:19.327045+0000","last_peered":"2023-01-02T18:18:19.327045+0000","last_clean":"2023-01-02T18:18:19.327045+0000","last_became_active":"2023-01-02T18:18:02.784117+0000","last_became_peered":"2023-01-02T18:18:02.784117+0000","last_unstale":"2023-01-02T18:18:19.327045+0000","last_undegraded":"2023-01-02T18:18:19.327045+0000","last_fullsized":"2023-01-02T18:18:19.327045+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"46'1","reported_seq":174,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319953+0000","last_change":"2023-01-02T18:18:02.793472+0000","last_active":"2023-01-02T18:18:19.319953+0000","last_peered":"2023-01-02T18:18:19.319953+0000","last_clean":"2023-01-02T18:18:19.319953+0000","last_became_active":"2023-01-02T18:18:02.774343+0000","last_became_peered":"2023-01-02T18:18:02.774343+0000","last_unstale":"2023-01-02T18:18:19.319953+0000","last_undegraded":"2023-01-02T18:18:19.319953+0000","last_fullsized":"2023-01-02T18:18:19.319953+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":32,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"51'5","reported_seq":115,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452656+0000","last_change":"2023-01-02T18:16:44.297160+0000","last_active":"2023-01-02T18:18:19.452656+0000","last_peered":"2023-01-02T18:18:19.452656+0000","last_clean":"2023-01-02T18:18:19.452656+0000","last_became_active":"2023-01-02T18:16:41.443538+0000","last_became_peered":"2023-01-02T18:16:41.443538+0000","last_unstale":"2023-01-02T18:18:19.452656+0000","last_undegraded":"2023-01-02T18:18:19.452656+0000","last_fullsized":"2023-01-02T18:18:19.452656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":12,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":96,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095810+0000","last_change":"2023-01-02T18:18:02.778979+0000","last_active":"2023-01-02T18:18:20.095810+0000","last_peered":"2023-01-02T18:18:20.095810+0000","last_clean":"2023-01-02T18:18:20.095810+0000","last_became_active":"2023-01-02T18:18:02.778652+0000","last_became_peered":"2023-01-02T18:18:02.778652+0000","last_unstale":"2023-01-02T18:18:20.095810+0000","last_undegraded":"2023-01-02T18:18:20.095810+0000","last_fullsized":"2023-01-02T18:18:20.095810+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"72'17","reported_seq":221,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756226+0000","last_change":"2023-01-02T18:17:29.368980+0000","last_active":"2023-01-02T18:18:19.756226+0000","last_peered":"2023-01-02T18:18:19.756226+0000","last_clean":"2023-01-02T18:18:19.756226+0000","last_became_active":"2023-01-02T18:17:29.341397+0000","last_became_peered":"2023-01-02T18:17:29.341397+0000","last_unstale":"2023-01-02T18:18:19.756226+0000","last_undegraded":"2023-01-02T18:18:19.756226+0000","last_fullsized":"2023-01-02T18:18:19.756226+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":173,"num_read_kb":159,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":35,"num_keys_recovered":80,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.11","version":"76'79","reported_seq":608,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755967+0000","last_change":"2023-01-02T18:18:14.446571+0000","last_active":"2023-01-02T18:18:19.755967+0000","last_peered":"2023-01-02T18:18:19.755967+0000","last_clean":"2023-01-02T18:18:19.755967+0000","last_became_active":"2023-01-02T18:18:14.414819+0000","last_became_peered":"2023-01-02T18:18:14.414819+0000","last_unstale":"2023-01-02T18:18:19.755967+0000","last_undegraded":"2023-01-02T18:18:19.755967+0000","last_fullsized":"2023-01-02T18:18:19.755967+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":79,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1144,"num_read_kb":1037,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":78,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094534+0000","last_change":"2023-01-02T18:17:34.326763+0000","last_active":"2023-01-02T18:18:20.094534+0000","last_peered":"2023-01-02T18:18:20.094534+0000","last_clean":"2023-01-02T18:18:20.094534+0000","last_became_active":"2023-01-02T18:17:32.347186+0000","last_became_peered":"2023-01-02T18:17:32.347186+0000","last_unstale":"2023-01-02T18:18:20.094534+0000","last_undegraded":"2023-01-02T18:18:20.094534+0000","last_fullsized":"2023-01-02T18:18:20.094534+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":55,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328439+0000","last_change":"2023-01-02T18:18:02.798881+0000","last_active":"2023-01-02T18:18:19.328439+0000","last_peered":"2023-01-02T18:18:19.328439+0000","last_clean":"2023-01-02T18:18:19.328439+0000","last_became_active":"2023-01-02T18:18:02.798513+0000","last_became_peered":"2023-01-02T18:18:02.798513+0000","last_unstale":"2023-01-02T18:18:19.328439+0000","last_undegraded":"2023-01-02T18:18:19.328439+0000","last_fullsized":"2023-01-02T18:18:19.328439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327174+0000","last_change":"2023-01-02T18:18:14.395845+0000","last_active":"2023-01-02T18:18:19.327174+0000","last_peered":"2023-01-02T18:18:19.327174+0000","last_clean":"2023-01-02T18:18:19.327174+0000","last_became_active":"2023-01-02T18:18:14.395507+0000","last_became_peered":"2023-01-02T18:18:14.395507+0000","last_unstale":"2023-01-02T18:18:19.327174+0000","last_undegraded":"2023-01-02T18:18:19.327174+0000","last_fullsized":"2023-01-02T18:18:19.327174+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":21,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319369+0000","last_change":"2023-01-02T18:18:08.360020+0000","last_active":"2023-01-02T18:18:19.319369+0000","last_peered":"2023-01-02T18:18:19.319369+0000","last_clean":"2023-01-02T18:18:19.319369+0000","last_became_active":"2023-01-02T18:18:08.359426+0000","last_became_peered":"2023-01-02T18:18:08.359426+0000","last_unstale":"2023-01-02T18:18:19.319369+0000","last_undegraded":"2023-01-02T18:18:19.319369+0000","last_fullsized":"2023-01-02T18:18:19.319369+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"64'77","reported_seq":606,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093962+0000","last_change":"2023-01-02T18:16:57.305970+0000","last_active":"2023-01-02T18:18:20.093962+0000","last_peered":"2023-01-02T18:18:20.093962+0000","last_clean":"2023-01-02T18:18:20.093962+0000","last_became_active":"2023-01-02T18:16:55.312419+0000","last_became_peered":"2023-01-02T18:16:55.312419+0000","last_unstale":"2023-01-02T18:18:20.093962+0000","last_undegraded":"2023-01-02T18:18:20.093962+0000","last_fullsized":"2023-01-02T18:18:20.093962+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":77,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1142,"num_read_kb":1035,"num_write":73,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328446+0000","last_change":"2023-01-02T18:17:29.326893+0000","last_active":"2023-01-02T18:18:19.328446+0000","last_peered":"2023-01-02T18:18:19.328446+0000","last_clean":"2023-01-02T18:18:19.328446+0000","last_became_active":"2023-01-02T18:17:29.326037+0000","last_became_peered":"2023-01-02T18:17:29.326037+0000","last_unstale":"2023-01-02T18:18:19.328446+0000","last_undegraded":"2023-01-02T18:18:19.328446+0000","last_fullsized":"2023-01-02T18:18:19.328446+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"56'2","reported_seq":123,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.756130+0000","last_change":"2023-01-02T18:18:02.839359+0000","last_active":"2023-01-02T18:18:19.756130+0000","last_peered":"2023-01-02T18:18:19.756130+0000","last_clean":"2023-01-02T18:18:19.756130+0000","last_became_active":"2023-01-02T18:18:02.793479+0000","last_became_peered":"2023-01-02T18:18:02.793479+0000","last_unstale":"2023-01-02T18:18:19.756130+0000","last_undegraded":"2023-01-02T18:18:19.756130+0000","last_fullsized":"2023-01-02T18:18:19.756130+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"137'35","reported_seq":92,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-01-02T18:18:21.686795+0000","last_change":"2023-01-02T18:18:02.836963+0000","last_active":"2023-01-02T18:18:21.686795+0000","last_peered":"2023-01-02T18:18:21.686795+0000","last_clean":"2023-01-02T18:18:21.686795+0000","last_became_active":"2023-01-02T18:18:02.799693+0000","last_became_peered":"2023-01-02T18:18:02.799693+0000","last_unstale":"2023-01-02T18:18:21.686795+0000","last_undegraded":"2023-01-02T18:18:21.686795+0000","last_fullsized":"2023-01-02T18:18:21.686795+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":35,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":86,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":77,"num_read_kb":62,"num_write":32,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":223,"num_keys_recovered":110,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"51'1","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923881+0000","last_change":"2023-01-02T18:18:14.398289+0000","last_active":"2023-01-02T18:18:19.923881+0000","last_peered":"2023-01-02T18:18:19.923881+0000","last_clean":"2023-01-02T18:18:19.923881+0000","last_became_active":"2023-01-02T18:18:14.397939+0000","last_became_peered":"2023-01-02T18:18:14.397939+0000","last_unstale":"2023-01-02T18:18:19.923881+0000","last_undegraded":"2023-01-02T18:18:19.923881+0000","last_fullsized":"2023-01-02T18:18:19.923881+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":82,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.755635+0000","last_change":"2023-01-02T18:17:01.323139+0000","last_active":"2023-01-02T18:18:19.755635+0000","last_peered":"2023-01-02T18:18:19.755635+0000","last_clean":"2023-01-02T18:18:19.755635+0000","last_became_active":"2023-01-02T18:16:59.326023+0000","last_became_peered":"2023-01-02T18:16:59.326023+0000","last_unstale":"2023-01-02T18:18:19.755635+0000","last_undegraded":"2023-01-02T18:18:19.755635+0000","last_fullsized":"2023-01-02T18:18:19.755635+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.16","version":"76'1","reported_seq":24,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326193+0000","last_change":"2023-01-02T18:18:02.843092+0000","last_active":"2023-01-02T18:18:19.326193+0000","last_peered":"2023-01-02T18:18:19.326193+0000","last_clean":"2023-01-02T18:18:19.326193+0000","last_became_active":"2023-01-02T18:18:02.783876+0000","last_became_peered":"2023-01-02T18:18:02.783876+0000","last_unstale":"2023-01-02T18:18:19.326193+0000","last_undegraded":"2023-01-02T18:18:19.326193+0000","last_fullsized":"2023-01-02T18:18:19.326193+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.15","version":"101'8","reported_seq":54,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326984+0000","last_change":"2023-01-02T18:18:14.441832+0000","last_active":"2023-01-02T18:18:19.326984+0000","last_peered":"2023-01-02T18:18:19.326984+0000","last_clean":"2023-01-02T18:18:19.326984+0000","last_became_active":"2023-01-02T18:18:14.398797+0000","last_became_peered":"2023-01-02T18:18:14.398797+0000","last_unstale":"2023-01-02T18:18:19.326984+0000","last_undegraded":"2023-01-02T18:18:19.326984+0000","last_fullsized":"2023-01-02T18:18:19.326984+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":8,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.14","version":"117'5","reported_seq":64,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094439+0000","last_change":"2023-01-02T18:18:02.846871+0000","last_active":"2023-01-02T18:18:20.094439+0000","last_peered":"2023-01-02T18:18:20.094439+0000","last_clean":"2023-01-02T18:18:20.094439+0000","last_became_active":"2023-01-02T18:18:02.794306+0000","last_became_peered":"2023-01-02T18:18:02.794306+0000","last_unstale":"2023-01-02T18:18:20.094439+0000","last_undegraded":"2023-01-02T18:18:20.094439+0000","last_fullsized":"2023-01-02T18:18:20.094439+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319428+0000","last_change":"2023-01-02T18:17:56.728209+0000","last_active":"2023-01-02T18:18:19.319428+0000","last_peered":"2023-01-02T18:18:19.319428+0000","last_clean":"2023-01-02T18:18:19.319428+0000","last_became_active":"2023-01-02T18:17:56.727938+0000","last_became_peered":"2023-01-02T18:17:56.727938+0000","last_unstale":"2023-01-02T18:18:19.319428+0000","last_undegraded":"2023-01-02T18:18:19.319428+0000","last_fullsized":"2023-01-02T18:18:19.319428+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757554+0000","last_change":"2023-01-02T18:18:00.740684+0000","last_active":"2023-01-02T18:18:19.757554+0000","last_peered":"2023-01-02T18:18:19.757554+0000","last_clean":"2023-01-02T18:18:19.757554+0000","last_became_active":"2023-01-02T18:17:58.738424+0000","last_became_peered":"2023-01-02T18:17:58.738424+0000","last_unstale":"2023-01-02T18:18:19.757554+0000","last_undegraded":"2023-01-02T18:18:19.757554+0000","last_fullsized":"2023-01-02T18:18:19.757554+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":88,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093734+0000","last_change":"2023-01-02T18:16:57.307214+0000","last_active":"2023-01-02T18:18:20.093734+0000","last_peered":"2023-01-02T18:18:20.093734+0000","last_clean":"2023-01-02T18:18:20.093734+0000","last_became_active":"2023-01-02T18:16:55.309902+0000","last_became_peered":"2023-01-02T18:16:55.309902+0000","last_unstale":"2023-01-02T18:18:20.093734+0000","last_undegraded":"2023-01-02T18:18:20.093734+0000","last_fullsized":"2023-01-02T18:18:20.093734+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":92,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319575+0000","last_change":"2023-01-02T18:16:53.685760+0000","last_active":"2023-01-02T18:18:19.319575+0000","last_peered":"2023-01-02T18:18:19.319575+0000","last_clean":"2023-01-02T18:18:19.319575+0000","last_became_active":"2023-01-02T18:16:51.345811+0000","last_became_peered":"2023-01-02T18:16:51.345811+0000","last_unstale":"2023-01-02T18:18:19.319575+0000","last_undegraded":"2023-01-02T18:18:19.319575+0000","last_fullsized":"2023-01-02T18:18:19.319575+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"56'1","reported_seq":54,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327779+0000","last_change":"2023-01-02T18:17:29.356376+0000","last_active":"2023-01-02T18:18:19.327779+0000","last_peered":"2023-01-02T18:18:19.327779+0000","last_clean":"2023-01-02T18:18:19.327779+0000","last_became_active":"2023-01-02T18:17:29.327003+0000","last_became_peered":"2023-01-02T18:17:29.327003+0000","last_unstale":"2023-01-02T18:18:19.327779+0000","last_undegraded":"2023-01-02T18:18:19.327779+0000","last_fullsized":"2023-01-02T18:18:19.327779+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":16,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"86'2","reported_seq":80,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327233+0000","last_change":"2023-01-02T18:18:02.850718+0000","last_active":"2023-01-02T18:18:19.327233+0000","last_peered":"2023-01-02T18:18:19.327233+0000","last_clean":"2023-01-02T18:18:19.327233+0000","last_became_active":"2023-01-02T18:18:02.799591+0000","last_became_peered":"2023-01-02T18:18:02.799591+0000","last_unstale":"2023-01-02T18:18:19.327233+0000","last_undegraded":"2023-01-02T18:18:19.327233+0000","last_fullsized":"2023-01-02T18:18:19.327233+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":51,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":137,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"51'2","reported_seq":33,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325455+0000","last_change":"2023-01-02T18:18:14.427182+0000","last_active":"2023-01-02T18:18:19.325455+0000","last_peered":"2023-01-02T18:18:19.325455+0000","last_clean":"2023-01-02T18:18:19.325455+0000","last_became_active":"2023-01-02T18:18:14.400745+0000","last_became_peered":"2023-01-02T18:18:14.400745+0000","last_unstale":"2023-01-02T18:18:19.325455+0000","last_undegraded":"2023-01-02T18:18:19.325455+0000","last_fullsized":"2023-01-02T18:18:19.325455+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":38,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"72'4","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326563+0000","last_change":"2023-01-02T18:18:14.411072+0000","last_active":"2023-01-02T18:18:19.326563+0000","last_peered":"2023-01-02T18:18:19.326563+0000","last_clean":"2023-01-02T18:18:19.326563+0000","last_became_active":"2023-01-02T18:18:14.384025+0000","last_became_peered":"2023-01-02T18:18:14.384025+0000","last_unstale":"2023-01-02T18:18:19.326563+0000","last_undegraded":"2023-01-02T18:18:19.326563+0000","last_fullsized":"2023-01-02T18:18:19.326563+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":6,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.17","version":"76'1","reported_seq":77,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758217+0000","last_change":"2023-01-02T18:17:09.324016+0000","last_active":"2023-01-02T18:18:19.758217+0000","last_peered":"2023-01-02T18:18:19.758217+0000","last_clean":"2023-01-02T18:18:19.758217+0000","last_became_active":"2023-01-02T18:17:07.347854+0000","last_became_peered":"2023-01-02T18:17:07.347854+0000","last_unstale":"2023-01-02T18:18:19.758217+0000","last_undegraded":"2023-01-02T18:18:19.758217+0000","last_fullsized":"2023-01-02T18:18:19.758217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924258+0000","last_change":"2023-01-02T18:17:34.333930+0000","last_active":"2023-01-02T18:18:19.924258+0000","last_peered":"2023-01-02T18:18:19.924258+0000","last_clean":"2023-01-02T18:18:19.924258+0000","last_became_active":"2023-01-02T18:17:32.340028+0000","last_became_peered":"2023-01-02T18:17:32.340028+0000","last_unstale":"2023-01-02T18:18:19.924258+0000","last_undegraded":"2023-01-02T18:18:19.924258+0000","last_fullsized":"2023-01-02T18:18:19.924258+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.15","version":"117'5","reported_seq":51,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.452700+0000","last_change":"2023-01-02T18:17:38.542677+0000","last_active":"2023-01-02T18:18:19.452700+0000","last_peered":"2023-01-02T18:18:19.452700+0000","last_clean":"2023-01-02T18:18:19.452700+0000","last_became_active":"2023-01-02T18:17:36.441682+0000","last_became_peered":"2023-01-02T18:17:36.441682+0000","last_unstale":"2023-01-02T18:18:19.452700+0000","last_undegraded":"2023-01-02T18:18:19.452700+0000","last_fullsized":"2023-01-02T18:18:19.452700+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327405+0000","last_change":"2023-01-02T18:18:14.398827+0000","last_active":"2023-01-02T18:18:19.327405+0000","last_peered":"2023-01-02T18:18:19.327405+0000","last_clean":"2023-01-02T18:18:19.327405+0000","last_became_active":"2023-01-02T18:18:14.398488+0000","last_became_peered":"2023-01-02T18:18:14.398488+0000","last_unstale":"2023-01-02T18:18:19.327405+0000","last_undegraded":"2023-01-02T18:18:19.327405+0000","last_fullsized":"2023-01-02T18:18:19.327405+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.10","version":"136'8","reported_seq":37,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.991615+0000","last_change":"2023-01-02T18:18:00.731906+0000","last_active":"2023-01-02T18:18:20.991615+0000","last_peered":"2023-01-02T18:18:20.991615+0000","last_clean":"2023-01-02T18:18:20.991615+0000","last_became_active":"2023-01-02T18:17:58.735992+0000","last_became_peered":"2023-01-02T18:17:58.735992+0000","last_unstale":"2023-01-02T18:18:20.991615+0000","last_undegraded":"2023-01-02T18:18:20.991615+0000","last_fullsized":"2023-01-02T18:18:20.991615+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1a","version":"64'2","reported_seq":184,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094010+0000","last_change":"2023-01-02T18:18:08.364236+0000","last_active":"2023-01-02T18:18:20.094010+0000","last_peered":"2023-01-02T18:18:20.094010+0000","last_clean":"2023-01-02T18:18:20.094010+0000","last_became_active":"2023-01-02T18:18:08.363901+0000","last_became_peered":"2023-01-02T18:18:08.363901+0000","last_unstale":"2023-01-02T18:18:20.094010+0000","last_undegraded":"2023-01-02T18:18:20.094010+0000","last_fullsized":"2023-01-02T18:18:20.094010+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":19,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1b","version":"60'3","reported_seq":35,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757443+0000","last_change":"2023-01-02T18:18:14.443452+0000","last_active":"2023-01-02T18:18:19.757443+0000","last_peered":"2023-01-02T18:18:19.757443+0000","last_clean":"2023-01-02T18:18:19.757443+0000","last_became_active":"2023-01-02T18:18:14.411247+0000","last_became_peered":"2023-01-02T18:18:14.411247+0000","last_unstale":"2023-01-02T18:18:19.757443+0000","last_undegraded":"2023-01-02T18:18:19.757443+0000","last_fullsized":"2023-01-02T18:18:19.757443+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":1,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":35,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":102,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.093892+0000","last_change":"2023-01-02T18:18:08.364742+0000","last_active":"2023-01-02T18:18:20.093892+0000","last_peered":"2023-01-02T18:18:20.093892+0000","last_clean":"2023-01-02T18:18:20.093892+0000","last_became_active":"2023-01-02T18:18:08.364010+0000","last_became_peered":"2023-01-02T18:18:08.364010+0000","last_unstale":"2023-01-02T18:18:20.093892+0000","last_undegraded":"2023-01-02T18:18:20.093892+0000","last_fullsized":"2023-01-02T18:18:20.093892+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1e","version":"92'24","reported_seq":218,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095484+0000","last_change":"2023-01-02T18:18:14.441361+0000","last_active":"2023-01-02T18:18:20.095484+0000","last_peered":"2023-01-02T18:18:20.095484+0000","last_clean":"2023-01-02T18:18:20.095484+0000","last_became_active":"2023-01-02T18:18:14.407104+0000","last_became_peered":"2023-01-02T18:18:14.407104+0000","last_unstale":"2023-01-02T18:18:20.095484+0000","last_undegraded":"2023-01-02T18:18:20.095484+0000","last_fullsized":"2023-01-02T18:18:20.095484+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":24,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":270,"num_read_kb":225,"num_write":35,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":105,"num_keys_recovered":16,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319188+0000","last_change":"2023-01-02T18:18:14.399246+0000","last_active":"2023-01-02T18:18:19.319188+0000","last_peered":"2023-01-02T18:18:19.319188+0000","last_clean":"2023-01-02T18:18:19.319188+0000","last_became_active":"2023-01-02T18:18:14.398143+0000","last_became_peered":"2023-01-02T18:18:14.398143+0000","last_unstale":"2023-01-02T18:18:19.319188+0000","last_undegraded":"2023-01-02T18:18:19.319188+0000","last_fullsized":"2023-01-02T18:18:19.319188+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"72'22","reported_seq":304,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757671+0000","last_change":"2023-01-02T18:17:01.322933+0000","last_active":"2023-01-02T18:18:19.757671+0000","last_peered":"2023-01-02T18:18:19.757671+0000","last_clean":"2023-01-02T18:18:19.757671+0000","last_became_active":"2023-01-02T18:16:59.312547+0000","last_became_peered":"2023-01-02T18:16:59.312547+0000","last_unstale":"2023-01-02T18:18:19.757671+0000","last_undegraded":"2023-01-02T18:18:19.757671+0000","last_fullsized":"2023-01-02T18:18:19.757671+0000","mapping_epoch":65,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":66,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":35,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":292,"num_read_kb":276,"num_write":13,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":84,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.924778+0000","last_change":"2023-01-02T18:18:02.777628+0000","last_active":"2023-01-02T18:18:19.924778+0000","last_peered":"2023-01-02T18:18:19.924778+0000","last_clean":"2023-01-02T18:18:19.924778+0000","last_became_active":"2023-01-02T18:18:02.777073+0000","last_became_peered":"2023-01-02T18:18:02.777073+0000","last_unstale":"2023-01-02T18:18:19.924778+0000","last_undegraded":"2023-01-02T18:18:19.924778+0000","last_fullsized":"2023-01-02T18:18:19.924778+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"101'15","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.094527+0000","last_change":"2023-01-02T18:18:14.430899+0000","last_active":"2023-01-02T18:18:20.094527+0000","last_peered":"2023-01-02T18:18:20.094527+0000","last_clean":"2023-01-02T18:18:20.094527+0000","last_became_active":"2023-01-02T18:18:14.405014+0000","last_became_peered":"2023-01-02T18:18:14.405014+0000","last_unstale":"2023-01-02T18:18:20.094527+0000","last_undegraded":"2023-01-02T18:18:20.094527+0000","last_fullsized":"2023-01-02T18:18:20.094527+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":75,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":47,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.327030+0000","last_change":"2023-01-02T18:17:38.446984+0000","last_active":"2023-01-02T18:18:19.327030+0000","last_peered":"2023-01-02T18:18:19.327030+0000","last_clean":"2023-01-02T18:18:19.327030+0000","last_became_active":"2023-01-02T18:17:36.442630+0000","last_became_peered":"2023-01-02T18:17:36.442630+0000","last_unstale":"2023-01-02T18:18:19.327030+0000","last_undegraded":"2023-01-02T18:18:19.327030+0000","last_fullsized":"2023-01-02T18:18:19.327030+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":34,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326260+0000","last_change":"2023-01-02T18:18:02.794888+0000","last_active":"2023-01-02T18:18:19.326260+0000","last_peered":"2023-01-02T18:18:19.326260+0000","last_clean":"2023-01-02T18:18:19.326260+0000","last_became_active":"2023-01-02T18:18:02.794506+0000","last_became_peered":"2023-01-02T18:18:02.794506+0000","last_unstale":"2023-01-02T18:18:19.326260+0000","last_undegraded":"2023-01-02T18:18:19.326260+0000","last_fullsized":"2023-01-02T18:18:19.326260+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":29,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.923092+0000","last_change":"2023-01-02T18:18:00.734566+0000","last_active":"2023-01-02T18:18:19.923092+0000","last_peered":"2023-01-02T18:18:19.923092+0000","last_clean":"2023-01-02T18:18:19.923092+0000","last_became_active":"2023-01-02T18:17:58.736050+0000","last_became_peered":"2023-01-02T18:17:58.736050+0000","last_unstale":"2023-01-02T18:18:19.923092+0000","last_undegraded":"2023-01-02T18:18:19.923092+0000","last_fullsized":"2023-01-02T18:18:19.923092+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:57.708861+0000","last_clean_scrub_stamp":"2023-01-02T18:17:57.708861+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1b","version":"64'7","reported_seq":186,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.320652+0000","last_change":"2023-01-02T18:16:57.306090+0000","last_active":"2023-01-02T18:18:19.320652+0000","last_peered":"2023-01-02T18:18:19.320652+0000","last_clean":"2023-01-02T18:18:19.320652+0000","last_became_active":"2023-01-02T18:16:55.313805+0000","last_became_peered":"2023-01-02T18:16:55.313805+0000","last_unstale":"2023-01-02T18:18:19.320652+0000","last_undegraded":"2023-01-02T18:18:19.320652+0000","last_fullsized":"2023-01-02T18:18:19.320652+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:54.295694+0000","last_clean_scrub_stamp":"2023-01-02T18:16:54.295694+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":127,"num_read_kb":119,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"60'4","reported_seq":62,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.328527+0000","last_change":"2023-01-02T18:18:08.361384+0000","last_active":"2023-01-02T18:18:19.328527+0000","last_peered":"2023-01-02T18:18:19.328527+0000","last_clean":"2023-01-02T18:18:19.328527+0000","last_became_active":"2023-01-02T18:18:08.360943+0000","last_became_peered":"2023-01-02T18:18:08.360943+0000","last_unstale":"2023-01-02T18:18:19.328527+0000","last_undegraded":"2023-01-02T18:18:19.328527+0000","last_fullsized":"2023-01-02T18:18:19.328527+0000","mapping_epoch":128,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:50.315503+0000","last_clean_scrub_stamp":"2023-01-02T18:16:50.315503+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":76,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":50,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.326503+0000","last_change":"2023-01-02T18:17:29.327043+0000","last_active":"2023-01-02T18:18:19.326503+0000","last_peered":"2023-01-02T18:18:19.326503+0000","last_clean":"2023-01-02T18:18:19.326503+0000","last_became_active":"2023-01-02T18:17:29.326459+0000","last_became_peered":"2023-01-02T18:17:29.326459+0000","last_unstale":"2023-01-02T18:18:19.326503+0000","last_undegraded":"2023-01-02T18:18:19.326503+0000","last_fullsized":"2023-01-02T18:18:19.326503+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:45.298855+0000","last_clean_scrub_stamp":"2023-01-02T18:16:45.298855+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":162,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.321227+0000","last_change":"2023-01-02T18:17:30.328135+0000","last_active":"2023-01-02T18:18:19.321227+0000","last_peered":"2023-01-02T18:18:19.321227+0000","last_clean":"2023-01-02T18:18:19.321227+0000","last_became_active":"2023-01-02T18:17:29.335258+0000","last_became_peered":"2023-01-02T18:17:29.335258+0000","last_unstale":"2023-01-02T18:18:19.321227+0000","last_undegraded":"2023-01-02T18:18:19.321227+0000","last_fullsized":"2023-01-02T18:18:19.321227+0000","mapping_epoch":95,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":96,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:36.400276+0000","last_clean_scrub_stamp":"2023-01-02T18:16:36.400276+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.324694+0000","last_change":"2023-01-02T18:18:02.779537+0000","last_active":"2023-01-02T18:18:19.324694+0000","last_peered":"2023-01-02T18:18:19.324694+0000","last_clean":"2023-01-02T18:18:19.324694+0000","last_became_active":"2023-01-02T18:18:02.777653+0000","last_became_peered":"2023-01-02T18:18:02.777653+0000","last_unstale":"2023-01-02T18:18:19.324694+0000","last_undegraded":"2023-01-02T18:18:19.324694+0000","last_fullsized":"2023-01-02T18:18:19.324694+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:40.417506+0000","last_clean_scrub_stamp":"2023-01-02T18:16:40.417506+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":20,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.325682+0000","last_change":"2023-01-02T18:18:02.774200+0000","last_active":"2023-01-02T18:18:19.325682+0000","last_peered":"2023-01-02T18:18:19.325682+0000","last_clean":"2023-01-02T18:18:19.325682+0000","last_became_active":"2023-01-02T18:18:02.772028+0000","last_became_peered":"2023-01-02T18:18:02.772028+0000","last_unstale":"2023-01-02T18:18:19.325682+0000","last_undegraded":"2023-01-02T18:18:19.325682+0000","last_fullsized":"2023-01-02T18:18:19.325682+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":65,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:16:58.348301+0000","last_clean_scrub_stamp":"2023-01-02T18:16:58.348301+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":74,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.757744+0000","last_change":"2023-01-02T18:17:09.324265+0000","last_active":"2023-01-02T18:18:19.757744+0000","last_peered":"2023-01-02T18:18:19.757744+0000","last_clean":"2023-01-02T18:18:19.757744+0000","last_became_active":"2023-01-02T18:17:07.348058+0000","last_became_peered":"2023-01-02T18:17:07.348058+0000","last_unstale":"2023-01-02T18:18:19.757744+0000","last_undegraded":"2023-01-02T18:18:19.757744+0000","last_fullsized":"2023-01-02T18:18:19.757744+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:06.313775+0000","last_clean_scrub_stamp":"2023-01-02T18:17:06.313775+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":63,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:20.095385+0000","last_change":"2023-01-02T18:17:34.327371+0000","last_active":"2023-01-02T18:18:20.095385+0000","last_peered":"2023-01-02T18:18:20.095385+0000","last_clean":"2023-01-02T18:18:20.095385+0000","last_became_active":"2023-01-02T18:17:32.345158+0000","last_became_peered":"2023-01-02T18:17:32.345158+0000","last_unstale":"2023-01-02T18:18:20.095385+0000","last_undegraded":"2023-01-02T18:18:20.095385+0000","last_fullsized":"2023-01-02T18:18:20.095385+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:31.322061+0000","last_clean_scrub_stamp":"2023-01-02T18:17:31.322061+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":30,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.758257+0000","last_change":"2023-01-02T18:17:52.708234+0000","last_active":"2023-01-02T18:18:19.758257+0000","last_peered":"2023-01-02T18:18:19.758257+0000","last_clean":"2023-01-02T18:18:19.758257+0000","last_became_active":"2023-01-02T18:17:52.707885+0000","last_became_peered":"2023-01-02T18:17:52.707885+0000","last_unstale":"2023-01-02T18:18:19.758257+0000","last_undegraded":"2023-01-02T18:18:19.758257+0000","last_fullsized":"2023-01-02T18:18:19.758257+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:35.416665+0000","last_clean_scrub_stamp":"2023-01-02T18:17:35.416665+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":26,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-01-02T18:18:19.319128+0000","last_change":"2023-01-02T18:17:56.721443+0000","last_active":"2023-01-02T18:18:19.319128+0000","last_peered":"2023-01-02T18:18:19.319128+0000","last_clean":"2023-01-02T18:18:19.319128+0000","last_became_active":"2023-01-02T18:17:56.721166+0000","last_became_peered":"2023-01-02T18:17:56.721166+0000","last_unstale":"2023-01-02T18:18:19.319128+0000","last_undegraded":"2023-01-02T18:18:19.319128+0000","last_fullsized":"2023-01-02T18:18:19.319128+0000","mapping_epoch":118,"log_start":"0'0","ondisk_log_start":"0'0","created":118,"last_epoch_clean":119,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-01-02T18:17:55.701328+0000","last_clean_scrub_stamp":"2023-01-02T18:17:55.701328+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":18434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":196,"num_read_kb":166,"num_write":44,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":54,"num_keys_recovered":11,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":47,"ondisk_log_size":47,"up":64,"acting":64,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":317,"num_read_kb":268,"num_write":90,"num_write_kb":16414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":19,"num_keys_recovered":1,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":472,"num_read_kb":400,"num_write":105,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":171,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1372,"num_read_kb":1226,"num_write":98,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":120,"num_keys_recovered":234,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":465,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":2390,"num_read_kb":2146,"num_write":146,"num_write_kb":129,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":583,"num_keys_recovered":407,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":930,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1492,"num_read_kb":1360,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":210,"num_keys_recovered":90,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2098333,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":10350,"num_read_kb":5803,"num_write":312,"num_write_kb":2289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":1577,"num_keys_recovered":320,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":3408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":337,"ondisk_log_size":337,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":102,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":105,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":70,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":126,"num_read_kb":104,"num_write":31,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":35,"num_keys_recovered":4,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":172,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1494,"num_read_kb":1360,"num_write":90,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":156,"num_keys_recovered":240,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13848,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94357992,"statfs":{"total":96636764160,"available":96622583808,"internally_reserved":0,"allocated":1916928,"data_stored":1014268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.44800000000000001,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.443,"15min":0.42799999999999999},"min":{"1min":0.24299999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":0.251}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.45000000000000001,"15min":0.42899999999999999},"min":{"1min":0.28100000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.7769999999999999,"5min":1.7769999999999999,"15min":1.7769999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.54100000000000004,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.49399999999999999,"15min":0.48599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":0.29999999999999999}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.51700000000000002,"15min":0.51000000000000001},"min":{"1min":0.371,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.51400000000000001,"15min":0.504},"min":{"1min":0.32500000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.32500000000000001}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.48699999999999999,"15min":0.47699999999999998},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.308},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.497,"15min":0.48999999999999999},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.317}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.51400000000000001,"15min":0.502},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.766,"5min":1.766,"15min":1.766},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.60499999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.36799999999999999}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.34499999999999997,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.9159999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.56599999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":0.503}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15292,"kb_used_data":2044,"kb_used_omap":0,"kb_used_meta":12416,"kb_avail":94356548,"statfs":{"total":96636764160,"available":96621105152,"internally_reserved":0,"allocated":2093056,"data_stored":1227533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12713984},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.54200000000000004,"15min":0.55000000000000004},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64300000000000002,"5min":2.109,"15min":2.109},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.46300000000000002,"15min":0.45600000000000002},"min":{"1min":0.33600000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.442}]},{"osd":1,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.45700000000000002,"15min":0.44900000000000001},"min":{"1min":0.34699999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51000000000000001,"15min":0.50800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.62,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.37}]},{"osd":2,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.501,"15min":0.496},"min":{"1min":0.39500000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.505},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.78700000000000003,"5min":1.282,"15min":1.282},"last":0.52500000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.55500000000000005,"15min":0.55700000000000005},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.72499999999999998,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52100000000000002,"15min":0.52200000000000002},"min":{"1min":0.36499999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.48299999999999998}]},{"osd":4,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47699999999999998,"15min":0.47999999999999998},"min":{"1min":0.29499999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.68300000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.33100000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.40899999999999997}]},{"osd":5,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.33000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.624,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.39500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.72699999999999998,"5min":1.3779999999999999,"15min":1.3779999999999999},"last":0.38}]},{"osd":7,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.60299999999999998,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.73399999999999999,"5min":1.3,"15min":1.3},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13908,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94357932,"statfs":{"total":96636764160,"available":96622522368,"internally_reserved":0,"allocated":1912832,"data_stored":1014273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.434,"15min":0.44900000000000001},"min":{"1min":0.25,"5min":0.217,"15min":0.217},"max":{"1min":0.46200000000000002,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.377},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.36899999999999999,"15min":0.377},"min":{"1min":0.24099999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.45500000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.318}]},{"osd":2,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.39200000000000002,"15min":0.40699999999999997},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.43099999999999999,"5min":1.258,"15min":1.258},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.441,"15min":0.45300000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.48299999999999998,"5min":1.028,"15min":1.028},"last":0.47299999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.46500000000000002,"15min":0.47299999999999998},"min":{"1min":0.29099999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.51700000000000002,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42799999999999999,"15min":0.439},"min":{"1min":0.308,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.56399999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.57999999999999996,"15min":0.59799999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.67700000000000005,"5min":1.321,"15min":1.321},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.58799999999999997,"15min":0.59599999999999997},"min":{"1min":0.375,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.72899999999999998,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.432}]},{"osd":5,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.63800000000000001,"15min":0.65000000000000002},"min":{"1min":0.42699999999999999,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.79000000000000004,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.63700000000000001,"15min":0.65300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76700000000000002,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.499}]},{"osd":6,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.64600000000000002,"15min":0.66400000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.70099999999999996,"5min":1.371,"15min":1.371},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.63900000000000001,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.74099999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.505}]},{"osd":7,"last update":"Mon Jan 2 18:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.45700000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.755,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67200000000000004,"15min":0.68600000000000005},"min":{"1min":0.443,"5min":0.437,"15min":0.437},"max":{"1min":0.75900000000000001,"5min":1.4059999999999999,"15min":1.4059999999999999},"last":0.53800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574883,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13592,"kb_used_data":1872,"kb_used_omap":0,"kb_used_meta":11712,"kb_avail":94358248,"statfs":{"total":96636764160,"available":96622845952,"internally_reserved":0,"allocated":1916928,"data_stored":1014306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11993088},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.38200000000000001,"15min":0.39100000000000001},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.503,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.182},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.48199999999999998,"15min":0.504},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.505,"5min":1.841,"15min":1.841},"last":0.224}]},{"osd":2,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.57299999999999995,"15min":0.60099999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.61499999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.318},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.51500000000000001,"15min":0.54300000000000004},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.52000000000000002,"5min":2.1899999999999999,"15min":2.1899999999999999},"last":0.26700000000000002}]},{"osd":3,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.55000000000000004,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.55000000000000004,"15min":0.57399999999999995},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.53300000000000003,"5min":1.875,"15min":1.875},"last":0.25900000000000001}]},{"osd":4,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.59299999999999997,"15min":0.60499999999999998},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.79100000000000004,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.308},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.67000000000000004,"15min":0.68400000000000005},"min":{"1min":0.38100000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6180000000000001,"5min":1.9330000000000001,"15min":1.9330000000000001},"last":0.34699999999999998}]},{"osd":5,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.78900000000000003,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.80700000000000005,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.39700000000000002}]},{"osd":6,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.73199999999999998,"15min":0.752},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.583,"5min":1.903,"15min":1.903},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.70599999999999996,"15min":0.72299999999999998},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.81299999999999994,"5min":2.1579999999999999,"15min":2.1579999999999999},"last":0.375}]},{"osd":7,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85299999999999998,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":0.438},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.70999999999999996,"15min":0.72599999999999998},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.81399999999999995,"5min":1.139,"15min":1.139},"last":0.442}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":13248,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":11392,"kb_avail":94358592,"statfs":{"total":96636764160,"available":96623198208,"internally_reserved":0,"allocated":1892352,"data_stored":1014072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11665408},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.46600000000000003,"15min":0.49299999999999999},"min":{"1min":0.24399999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.432,"5min":2.665,"15min":2.665},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.44,"15min":0.45800000000000002},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.42099999999999999,"5min":1.5249999999999999,"15min":1.5249999999999999},"last":0.26400000000000001}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.498,"15min":0.52500000000000002},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.47799999999999998,"5min":2.6890000000000001,"15min":2.6890000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.48999999999999999,"15min":0.51200000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.45800000000000002,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.34200000000000003}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.443,"15min":0.45900000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.50600000000000001,"5min":1.359,"15min":1.359},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.61499999999999999,"15min":0.65500000000000003},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.46700000000000003,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":0.38300000000000001}]},{"osd":4,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.67400000000000004,"15min":0.69399999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.749,"5min":2.601,"15min":2.601},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.63800000000000001,"15min":0.65300000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82099999999999995,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.39600000000000002}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.63200000000000001,"15min":0.64600000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76100000000000001,"5min":1.25,"15min":1.25},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.76300000000000001,"15min":0.79800000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.68899999999999995,"5min":2.637,"15min":2.637},"last":0.51600000000000001}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.65900000000000003,"15min":0.67600000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77600000000000002,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.497},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.68200000000000005,"15min":0.69599999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81599999999999995,"5min":1.321,"15min":1.321},"last":0.37}]},{"osd":7,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.68300000000000005,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73899999999999999,"5min":1.478,"15min":1.478},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.67300000000000004,"15min":0.68899999999999995},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.78800000000000003,"5min":1.286,"15min":1.286},"last":0.45700000000000002}]}]},{"osd":3,"up_from":0,"seq":55834574884,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":106,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10440,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":7488,"kb_avail":94361400,"statfs":{"total":96636764160,"available":96626073600,"internally_reserved":0,"allocated":2170880,"data_stored":1227956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7667712},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.57399999999999995}]},{"osd":1,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48099999999999998,"15min":0.48599999999999999},"min":{"1min":0.27800000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.45200000000000001,"15min":0.44700000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.86099999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.46400000000000002}]},{"osd":2,"last update":"Mon Jan 2 18:17:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"min":{"1min":0.29299999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.82799999999999996,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.56200000000000006},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.89000000000000001,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.56000000000000005,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.98499999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.58199999999999996,"15min":0.59499999999999997},"min":{"1min":0.316,"5min":0.315,"15min":0.315},"max":{"1min":0.88300000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.27200000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.437,"5min":0.48099999999999998,"15min":0.48799999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.63600000000000001,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.40500000000000003}]},{"osd":6,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.47399999999999998,"15min":0.47599999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56899999999999995,"15min":0.57399999999999995},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.67900000000000005}]},{"osd":7,"last update":"Mon Jan 2 18:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.51600000000000001,"15min":0.52100000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.73299999999999998,"5min":0.745,"15min":0.745},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56699999999999995,"15min":0.56899999999999995},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.56100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574883,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9060,"kb_used_data":1884,"kb_used_omap":0,"kb_used_meta":7168,"kb_avail":94362780,"statfs":{"total":96636764160,"available":96627486720,"internally_reserved":0,"allocated":1929216,"data_stored":1014379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7340032},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.442},{"interface":"front","average":{"1min":0.496,"5min":0.48199999999999998,"15min":0.47999999999999998},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.27900000000000003}]},{"osd":1,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.83699999999999997,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51200000000000001},"min":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.311}]},{"osd":2,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.41499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.41799999999999998}]},{"osd":3,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.42799999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.60599999999999998,"15min":0.61199999999999999},"min":{"1min":0.40200000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57999999999999996,"15min":0.58399999999999996},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81399999999999995,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.34000000000000002}]},{"osd":6,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79300000000000004,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.60199999999999998},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86499999999999999,"5min":0.878,"15min":0.878},"last":0.434}]},{"osd":7,"last update":"Mon Jan 2 18:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.63800000000000001,"15min":0.64900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.89000000000000001,"5min":1.044,"15min":1.044},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.66700000000000004,"15min":0.67300000000000004},"min":{"1min":0.33100000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90300000000000002,"5min":1.359,"15min":1.359},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":1052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":311,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":32,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":54,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":89,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":86,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":51,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":35,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":69,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":16,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-01-02T18:18:24.898 INFO:tasks.thrashosds.thrasher:Setting 3.14 to [2, 0] 2023-01-02T18:18:24.898 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.14', '2', '0'] 2023-01-02T18:18:24.899 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.14 2 0 2023-01-02T18:18:24.900 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:24.901+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:24.928 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:18:24.975 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:24.976 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:24.985 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:25.026 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:25.027+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:25.101 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:25.101+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:25.152 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:25.152 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:25.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:25.202 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:25.202+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:25.287 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:25.287 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:25.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:25.303 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:25.303+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:25.404 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:25.405+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:25.423 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:25.423 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:25.434 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:25.518 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:25.519+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:25.600 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:25.600 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:25.605 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:25.605+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:25.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:25.706 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:25.707+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:25.774 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:25.775 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:25.784 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:25.806 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:25.806+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:25.907 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:25.907+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:25.929 INFO:teuthology.orchestra.run.smithi007.stderr:set 3.14 pg_upmap mapping to [2,0] 2023-01-02T18:18:25.955 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:25.956 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:25.966 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:26.023 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:26.023+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:26.042 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:26.107 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:26.108 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:26.109 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:26.109+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:26.118 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:26.186 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:26.209 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:26.210+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:26.221 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:26.239 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:26.272 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:26.277 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:26.277 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:26.277 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:26.277 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:26.278 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:26.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:26.298 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:26.310 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:26.310+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:26.319 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:26.337 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:26.355 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:26.356 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:26.357 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:26.358 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:26.410 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:26.411+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:26.422 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:26.422 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:26.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:26.423 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:26.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.423 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:11 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:26.423 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:18:26.424 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 106.988366861, 2023-01-02T18:18:26.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020029140000000002, 2023-01-02T18:18:26.424 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.424 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.424 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.424 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:26.425 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:26.425 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 11 2023-01-02T18:18:26.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.425 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:18:26.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433274+0000", 2023-01-02T18:18:26.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:26.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433272+0000", 2023-01-02T18:18:26.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8709999999999999e-06 2023-01-02T18:18:26.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433279+0000", 2023-01-02T18:18:26.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0445000000000001e-05 2023-01-02T18:18:26.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433289+0000", 2023-01-02T18:18:26.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9549999999999992e-06 2023-01-02T18:18:26.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433297+0000", 2023-01-02T18:18:26.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9743999999999997e-05 2023-01-02T18:18:26.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433347+0000", 2023-01-02T18:18:26.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012520899999999999 2023-01-02T18:18:26.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433472+0000", 2023-01-02T18:18:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000183139 2023-01-02T18:18:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:26.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.433655+0000", 2023-01-02T18:18:26.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00062228000000000001 2023-01-02T18:18:26.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.434278+0000", 2023-01-02T18:18:26.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00089530100000000004 2023-01-02T18:18:26.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435173+0000", 2023-01-02T18:18:26.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9444000000000002e-05 2023-01-02T18:18:26.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435232+0000", 2023-01-02T18:18:26.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4172000000000003e-05 2023-01-02T18:18:26.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.435277+0000", 2023-01-02T18:18:26.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020029140000000002 2023-01-02T18:18:26.442 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.442 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.443 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.443 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:24 3.1 3:826f36d4:::rbd_header.12a2b7720443:head [watch watch cookie 140115456398928] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:26.443 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:18:26.443 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 106.972731704, 2023-01-02T18:18:26.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671591, 2023-01-02T18:18:26.444 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.444 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.444 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:26.445 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:26.445 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 24 2023-01-02T18:18:26.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.445 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:18:26.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448909+0000", 2023-01-02T18:18:26.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:26.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448908+0000", 2023-01-02T18:18:26.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8049999999999997e-06 2023-01-02T18:18:26.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448913+0000", 2023-01-02T18:18:26.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6050000000000004e-06 2023-01-02T18:18:26.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448922+0000", 2023-01-02T18:18:26.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.296e-06 2023-01-02T18:18:26.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448927+0000", 2023-01-02T18:18:26.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2249999999999997e-05 2023-01-02T18:18:26.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.448969+0000", 2023-01-02T18:18:26.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1073000000000001e-05 2023-01-02T18:18:26.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449050+0000", 2023-01-02T18:18:26.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019599400000000001 2023-01-02T18:18:26.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:26.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449246+0000", 2023-01-02T18:18:26.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00055298399999999996 2023-01-02T18:18:26.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.449799+0000", 2023-01-02T18:18:26.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00067574099999999999 2023-01-02T18:18:26.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450475+0000", 2023-01-02T18:18:26.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2527999999999997e-05 2023-01-02T18:18:26.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450517+0000", 2023-01-02T18:18:26.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3255000000000003e-05 2023-01-02T18:18:26.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:39.450580+0000", 2023-01-02T18:18:26.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001671591 2023-01-02T18:18:26.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.459 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.459 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:370 7.1b 7:da80f00d:::rbd_id.image25:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:18:26.460 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:18:26.460 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 89.106440112000001, 2023-01-02T18:18:26.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002415571, 2023-01-02T18:18:26.460 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.461 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.461 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:26.462 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:26.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 370 2023-01-02T18:18:26.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.463 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:18:26.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315200+0000", 2023-01-02T18:18:26.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:26.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315198+0000", 2023-01-02T18:18:26.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2340999999999999e-05 2023-01-02T18:18:26.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315211+0000", 2023-01-02T18:18:26.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2734e-05 2023-01-02T18:18:26.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315233+0000", 2023-01-02T18:18:26.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7020000000000007e-06 2023-01-02T18:18:26.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315242+0000", 2023-01-02T18:18:26.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017169700000000001 2023-01-02T18:18:26.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315414+0000", 2023-01-02T18:18:26.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014588700000000001 2023-01-02T18:18:26.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315560+0000", 2023-01-02T18:18:26.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020772999999999999 2023-01-02T18:18:26.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:26.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.315767+0000", 2023-01-02T18:18:26.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001379641 2023-01-02T18:18:26.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317147+0000", 2023-01-02T18:18:26.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000359675 2023-01-02T18:18:26.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317507+0000", 2023-01-02T18:18:26.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2816000000000003e-05 2023-01-02T18:18:26.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317569+0000", 2023-01-02T18:18:26.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6452999999999997e-05 2023-01-02T18:18:26.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317616+0000", 2023-01-02T18:18:26.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002415571 2023-01-02T18:18:26.477 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.478 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.479 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:981 7.1b 7:dd2e5dcd:::rbd_header.11d52e7a19d9:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:18:26.479 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:18:26.479 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 88.763461191000005, 2023-01-02T18:18:26.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00147178, 2023-01-02T18:18:26.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.480 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.480 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:26.480 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:26.480 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 981 2023-01-02T18:18:26.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.481 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:18:26.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658179+0000", 2023-01-02T18:18:26.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:26.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658178+0000", 2023-01-02T18:18:26.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:18:26.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658184+0000", 2023-01-02T18:18:26.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0121e-05 2023-01-02T18:18:26.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658194+0000", 2023-01-02T18:18:26.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6249999999999998e-06 2023-01-02T18:18:26.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658199+0000", 2023-01-02T18:18:26.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4972000000000003e-05 2023-01-02T18:18:26.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658234+0000", 2023-01-02T18:18:26.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9951000000000003e-05 2023-01-02T18:18:26.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658284+0000", 2023-01-02T18:18:26.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036241799999999998 2023-01-02T18:18:26.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:26.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.658646+0000", 2023-01-02T18:18:26.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00064372099999999999 2023-01-02T18:18:26.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659290+0000", 2023-01-02T18:18:26.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029051100000000002 2023-01-02T18:18:26.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659580+0000", 2023-01-02T18:18:26.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3173999999999997e-05 2023-01-02T18:18:26.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659624+0000", 2023-01-02T18:18:26.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7484999999999999e-05 2023-01-02T18:18:26.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.659651+0000", 2023-01-02T18:18:26.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00147178 2023-01-02T18:18:26.493 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.494 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.494 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.495 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:1093 7.f 7:f3cee7db:::rbd_header.11d51c086ce8:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e64)", 2023-01-02T18:18:26.495 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:18:26.496 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 88.715422395999994, 2023-01-02T18:18:26.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001424745, 2023-01-02T18:18:26.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.497 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.497 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:26.498 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:26.498 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1093 2023-01-02T18:18:26.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.498 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:18:26.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706218+0000", 2023-01-02T18:18:26.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:26.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706217+0000", 2023-01-02T18:18:26.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0279999999999997e-06 2023-01-02T18:18:26.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706223+0000", 2023-01-02T18:18:26.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1197e-05 2023-01-02T18:18:26.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706234+0000", 2023-01-02T18:18:26.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1184e-05 2023-01-02T18:18:26.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706246+0000", 2023-01-02T18:18:26.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0102000000000001e-05 2023-01-02T18:18:26.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706276+0000", 2023-01-02T18:18:26.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9431000000000002e-05 2023-01-02T18:18:26.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706325+0000", 2023-01-02T18:18:26.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036410199999999999 2023-01-02T18:18:26.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:26.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.706689+0000", 2023-01-02T18:18:26.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059671500000000005 2023-01-02T18:18:26.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707286+0000", 2023-01-02T18:18:26.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030682099999999998 2023-01-02T18:18:26.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707593+0000", 2023-01-02T18:18:26.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7835e-05 2023-01-02T18:18:26.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707621+0000", 2023-01-02T18:18:26.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2303999999999999e-05 2023-01-02T18:18:26.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.707643+0000", 2023-01-02T18:18:26.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001424745 2023-01-02T18:18:26.517 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.517 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.518 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.518 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:1233 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:18:26.518 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:18:26.519 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.094656977, 2023-01-02T18:18:26.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001876817, 2023-01-02T18:18:26.519 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.519 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.519 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.520 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:26.520 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:26.520 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 1233 2023-01-02T18:18:26.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.520 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:18:26.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326983+0000", 2023-01-02T18:18:26.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:26.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.523 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326982+0000", 2023-01-02T18:18:26.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5199999999999997e-06 2023-01-02T18:18:26.523 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.524 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.524 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326990+0000", 2023-01-02T18:18:26.524 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.413e-05 2023-01-02T18:18:26.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327004+0000", 2023-01-02T18:18:26.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3750000000000002e-06 2023-01-02T18:18:26.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327010+0000", 2023-01-02T18:18:26.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4917999999999999e-05 2023-01-02T18:18:26.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327055+0000", 2023-01-02T18:18:26.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010794999999999999 2023-01-02T18:18:26.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327163+0000", 2023-01-02T18:18:26.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014037500000000001 2023-01-02T18:18:26.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:26.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327303+0000", 2023-01-02T18:18:26.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00063062999999999997 2023-01-02T18:18:26.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.327934+0000", 2023-01-02T18:18:26.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082138100000000004 2023-01-02T18:18:26.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328755+0000", 2023-01-02T18:18:26.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9277000000000002e-05 2023-01-02T18:18:26.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328814+0000", 2023-01-02T18:18:26.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6063000000000003e-05 2023-01-02T18:18:26.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.328860+0000", 2023-01-02T18:18:26.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001876817 2023-01-02T18:18:26.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.534 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.534 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.535 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2090 8.1f 8:fcdbab27:::rbd_object_map.12a230fb06bc:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected e69)", 2023-01-02T18:18:26.535 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:18:26.535 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 83.832734678999998, 2023-01-02T18:18:26.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016870089999999999, 2023-01-02T18:18:26.536 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.536 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.536 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.536 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:26.536 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:26.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2090 2023-01-02T18:18:26.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.537 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:18:26.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588906+0000", 2023-01-02T18:18:26.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:26.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588905+0000", 2023-01-02T18:18:26.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.205e-05 2023-01-02T18:18:26.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588917+0000", 2023-01-02T18:18:26.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1358999999999999e-05 2023-01-02T18:18:26.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588928+0000", 2023-01-02T18:18:26.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6299999999999997e-06 2023-01-02T18:18:26.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588933+0000", 2023-01-02T18:18:26.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9691999999999999e-05 2023-01-02T18:18:26.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.588973+0000", 2023-01-02T18:18:26.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2386999999999998e-05 2023-01-02T18:18:26.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589025+0000", 2023-01-02T18:18:26.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013092999999999999 2023-01-02T18:18:26.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:26.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589156+0000", 2023-01-02T18:18:26.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051767999999999996 2023-01-02T18:18:26.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.589674+0000", 2023-01-02T18:18:26.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086517400000000002 2023-01-02T18:18:26.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590539+0000", 2023-01-02T18:18:26.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0923999999999997e-05 2023-01-02T18:18:26.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590570+0000", 2023-01-02T18:18:26.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3048e-05 2023-01-02T18:18:26.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.550 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.550 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:02.590593+0000", 2023-01-02T18:18:26.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016870089999999999 2023-01-02T18:18:26.551 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.551 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.551 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.551 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.552 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2057 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:26.552 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.355857+0000", 2023-01-02T18:18:26.552 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.065783452000005, 2023-01-02T18:18:26.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001463378, 2023-01-02T18:18:26.552 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.553 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.553 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:26.553 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:26.554 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2057 2023-01-02T18:18:26.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.554 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355857+0000", 2023-01-02T18:18:26.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355857+0000", 2023-01-02T18:18:26.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:26.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355855+0000", 2023-01-02T18:18:26.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6350000000000001e-06 2023-01-02T18:18:26.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355865+0000", 2023-01-02T18:18:26.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6724000000000001e-05 2023-01-02T18:18:26.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355882+0000", 2023-01-02T18:18:26.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6210000000000004e-06 2023-01-02T18:18:26.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355889+0000", 2023-01-02T18:18:26.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2030000000000002e-05 2023-01-02T18:18:26.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.355931+0000", 2023-01-02T18:18:26.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3496000000000002e-05 2023-01-02T18:18:26.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356015+0000", 2023-01-02T18:18:26.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000118177 2023-01-02T18:18:26.562 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.563 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:26.563 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356133+0000", 2023-01-02T18:18:26.563 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00068564099999999996 2023-01-02T18:18:26.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.564 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.564 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.564 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.356819+0000", 2023-01-02T18:18:26.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000447766 2023-01-02T18:18:26.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.565 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357266+0000", 2023-01-02T18:18:26.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8379999999999999e-05 2023-01-02T18:18:26.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357295+0000", 2023-01-02T18:18:26.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5585e-05 2023-01-02T18:18:26.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.357320+0000", 2023-01-02T18:18:26.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001463378 2023-01-02T18:18:26.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.569 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.569 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.571 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2086 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e83)", 2023-01-02T18:18:26.571 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:26.571 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 70.097425944999998, 2023-01-02T18:18:26.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435, 2023-01-02T18:18:26.572 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.572 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:26.573 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.573 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:26.574 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:26.574 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2086 2023-01-02T18:18:26.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.575 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:26.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.578 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:26.578 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:26.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.579 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324212+0000", 2023-01-02T18:18:26.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2366e-05 2023-01-02T18:18:26.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324224+0000", 2023-01-02T18:18:26.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4462000000000001e-05 2023-01-02T18:18:26.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324249+0000", 2023-01-02T18:18:26.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5980000000000003e-06 2023-01-02T18:18:26.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324259+0000", 2023-01-02T18:18:26.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6119999999999999e-05 2023-01-02T18:18:26.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324305+0000", 2023-01-02T18:18:26.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7069999999999997e-06 2023-01-02T18:18:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324310+0000", 2023-01-02T18:18:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003133828 2023-01-02T18:18:26.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.590 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327444+0000", 2023-01-02T18:18:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1573999999999998e-05 2023-01-02T18:18:26.591 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.592 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327496+0000", 2023-01-02T18:18:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1179000000000004e-05 2023-01-02T18:18:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327567+0000", 2023-01-02T18:18:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435 2023-01-02T18:18:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.595 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2088 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [call lock.assert_locked in=17b,call] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:26.597 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.329737+0000", 2023-01-02T18:18:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 70.091903282000004, 2023-01-02T18:18:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017236249999999999, 2023-01-02T18:18:26.598 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.599 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:26.600 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2088 2023-01-02T18:18:26.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.601 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329737+0000", 2023-01-02T18:18:26.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.604 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.604 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329737+0000", 2023-01-02T18:18:26.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:26.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.606 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.606 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.606 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329736+0000", 2023-01-02T18:18:26.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3629999999999996e-06 2023-01-02T18:18:26.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329743+0000", 2023-01-02T18:18:26.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2119999999999999e-05 2023-01-02T18:18:26.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329755+0000", 2023-01-02T18:18:26.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8800000000000002e-06 2023-01-02T18:18:26.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329762+0000", 2023-01-02T18:18:26.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2735000000000002e-05 2023-01-02T18:18:26.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329815+0000", 2023-01-02T18:18:26.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7809000000000002e-05 2023-01-02T18:18:26.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329873+0000", 2023-01-02T18:18:26.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001588049 2023-01-02T18:18:26.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.331461+0000", 2023-01-02T18:18:26.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017236249999999999 2023-01-02T18:18:26.619 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.619 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.619 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.621 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2319 3.1 3:83da4b60:::rbd_object_map.11d54907a3eb.0000000000000014:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:26.621 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:26.622 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 60.047326312000003, 2023-01-02T18:18:26.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001, 2023-01-02T18:18:26.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.623 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.623 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:26.624 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:26.624 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2319 2023-01-02T18:18:26.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.625 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:26.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:26.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:26.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374312+0000", 2023-01-02T18:18:26.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2023-01-02T18:18:26.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374323+0000", 2023-01-02T18:18:26.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8349e-05 2023-01-02T18:18:26.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374341+0000", 2023-01-02T18:18:26.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9909999999999997e-06 2023-01-02T18:18:26.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374351+0000", 2023-01-02T18:18:26.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.617e-05 2023-01-02T18:18:26.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374398+0000", 2023-01-02T18:18:26.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:18:26.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:26.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374403+0000", 2023-01-02T18:18:26.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001918765 2023-01-02T18:18:26.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376322+0000", 2023-01-02T18:18:26.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015418100000000001 2023-01-02T18:18:26.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376476+0000", 2023-01-02T18:18:26.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016648999999999999 2023-01-02T18:18:26.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:26.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376642+0000", 2023-01-02T18:18:26.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001972976 2023-01-02T18:18:26.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.378615+0000", 2023-01-02T18:18:26.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020004570000000002 2023-01-02T18:18:26.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380616+0000", 2023-01-02T18:18:26.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3064000000000005e-05 2023-01-02T18:18:26.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380679+0000", 2023-01-02T18:18:26.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9119000000000002e-05 2023-01-02T18:18:26.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380728+0000", 2023-01-02T18:18:26.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001 2023-01-02T18:18:26.642 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.643 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.643 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.643 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2812 10.1a e101/98 10:5cea7035:::rbd_info:head v 101'6, mlcod=100'3)", 2023-01-02T18:18:26.643 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.321652+0000", 2023-01-02T18:18:26.644 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.099988029999999, 2023-01-02T18:18:26.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001751287, 2023-01-02T18:18:26.644 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.644 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.644 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.321652+0000", 2023-01-02T18:18:26.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.321652+0000", 2023-01-02T18:18:26.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:26.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.321652+0000", 2023-01-02T18:18:26.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8910000000000003e-06 2023-01-02T18:18:26.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.321657+0000", 2023-01-02T18:18:26.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035466600000000001 2023-01-02T18:18:26.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322012+0000", 2023-01-02T18:18:26.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0229999999999998e-06 2023-01-02T18:18:26.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322018+0000", 2023-01-02T18:18:26.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019021700000000001 2023-01-02T18:18:26.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322208+0000", 2023-01-02T18:18:26.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9089e-05 2023-01-02T18:18:26.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322227+0000", 2023-01-02T18:18:26.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011435250000000001 2023-01-02T18:18:26.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.323371+0000", 2023-01-02T18:18:26.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3216000000000002e-05 2023-01-02T18:18:26.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.323404+0000", 2023-01-02T18:18:26.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001751287 2023-01-02T18:18:26.654 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.654 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.655 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.655 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2814 10.1a e101/98 10:5cea7035:::rbd_info:head v 101'8, mlcod=100'3)", 2023-01-02T18:18:26.655 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.322113+0000", 2023-01-02T18:18:26.656 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.099527424999998, 2023-01-02T18:18:26.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016775169999999999, 2023-01-02T18:18:26.656 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.656 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.656 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322113+0000", 2023-01-02T18:18:26.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322113+0000", 2023-01-02T18:18:26.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:26.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322112+0000", 2023-01-02T18:18:26.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2717e-05 2023-01-02T18:18:26.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322125+0000", 2023-01-02T18:18:26.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2687000000000001e-05 2023-01-02T18:18:26.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322138+0000", 2023-01-02T18:18:26.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2200000000000003e-06 2023-01-02T18:18:26.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322145+0000", 2023-01-02T18:18:26.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00060906399999999998 2023-01-02T18:18:26.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.663 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.663 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322754+0000", 2023-01-02T18:18:26.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6765e-05 2023-01-02T18:18:26.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.664 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.664 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.322771+0000", 2023-01-02T18:18:26.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098660499999999999 2023-01-02T18:18:26.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.323757+0000", 2023-01-02T18:18:26.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3073e-05 2023-01-02T18:18:26.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.323791+0000", 2023-01-02T18:18:26.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016775169999999999 2023-01-02T18:18:26.666 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.666 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.666 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.667 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2826 10.5 10:a7db2459:::rbd_id.image44:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:26.667 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.347430+0000", 2023-01-02T18:18:26.667 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.074210440000002, 2023-01-02T18:18:26.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002517189, 2023-01-02T18:18:26.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.668 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.668 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.668 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:26.669 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:26.669 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2826 2023-01-02T18:18:26.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.669 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347430+0000", 2023-01-02T18:18:26.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347430+0000", 2023-01-02T18:18:26.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:26.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347428+0000", 2023-01-02T18:18:26.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5142e-05 2023-01-02T18:18:26.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347443+0000", 2023-01-02T18:18:26.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7326999999999999e-05 2023-01-02T18:18:26.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347460+0000", 2023-01-02T18:18:26.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6279000000000001e-05 2023-01-02T18:18:26.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347477+0000", 2023-01-02T18:18:26.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5903999999999999e-05 2023-01-02T18:18:26.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347533+0000", 2023-01-02T18:18:26.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012700799999999999 2023-01-02T18:18:26.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.676 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.676 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347660+0000", 2023-01-02T18:18:26.677 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020591199999999999 2023-01-02T18:18:26.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:26.677 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.347866+0000", 2023-01-02T18:18:26.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017400250000000001 2023-01-02T18:18:26.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349606+0000", 2023-01-02T18:18:26.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00024724399999999998 2023-01-02T18:18:26.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349853+0000", 2023-01-02T18:18:26.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6672000000000002e-05 2023-01-02T18:18:26.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349910+0000", 2023-01-02T18:18:26.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7694999999999997e-05 2023-01-02T18:18:26.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349947+0000", 2023-01-02T18:18:26.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002517189 2023-01-02T18:18:26.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.682 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.682 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.683 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2827 10.1e 10:7803159c:::rbd_object_map.12a2d48fcbc5:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:26.683 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348565+0000", 2023-01-02T18:18:26.683 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.073075600999999, 2023-01-02T18:18:26.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016998409999999999, 2023-01-02T18:18:26.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.684 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:26.684 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:26.684 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2827 2023-01-02T18:18:26.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.685 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348565+0000", 2023-01-02T18:18:26.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348565+0000", 2023-01-02T18:18:26.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:26.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348564+0000", 2023-01-02T18:18:26.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8889999999999996e-06 2023-01-02T18:18:26.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.688 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.688 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348571+0000", 2023-01-02T18:18:26.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4718999999999999e-05 2023-01-02T18:18:26.689 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.689 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.689 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348585+0000", 2023-01-02T18:18:26.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0129999999999996e-06 2023-01-02T18:18:26.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348592+0000", 2023-01-02T18:18:26.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5031999999999998e-05 2023-01-02T18:18:26.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348637+0000", 2023-01-02T18:18:26.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012184300000000001 2023-01-02T18:18:26.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348759+0000", 2023-01-02T18:18:26.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020117900000000001 2023-01-02T18:18:26.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:26.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348960+0000", 2023-01-02T18:18:26.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010771649999999999 2023-01-02T18:18:26.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350038+0000", 2023-01-02T18:18:26.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013388699999999999 2023-01-02T18:18:26.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350171+0000", 2023-01-02T18:18:26.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2533e-05 2023-01-02T18:18:26.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350224+0000", 2023-01-02T18:18:26.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0695000000000003e-05 2023-01-02T18:18:26.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.350265+0000", 2023-01-02T18:18:26.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016998409999999999 2023-01-02T18:18:26.697 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.698 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.698 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.698 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3486 13.18 e125/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 125'1, mlcod=0'0)", 2023-01-02T18:18:26.698 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:26.699 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.608071148000001, 2023-01-02T18:18:26.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030098360000000001, 2023-01-02T18:18:26.699 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.699 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.699 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.700 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.700 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:26.700 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.701 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.701 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:26.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:26.701 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813568+0000", 2023-01-02T18:18:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001267661 2023-01-02T18:18:26.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814836+0000", 2023-01-02T18:18:26.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7289999999999995e-06 2023-01-02T18:18:26.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814846+0000", 2023-01-02T18:18:26.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4719999999999997e-06 2023-01-02T18:18:26.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814850+0000", 2023-01-02T18:18:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6375000000000001e-05 2023-01-02T18:18:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814877+0000", 2023-01-02T18:18:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5054e-05 2023-01-02T18:18:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814892+0000", 2023-01-02T18:18:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001659436 2023-01-02T18:18:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.816551+0000", 2023-01-02T18:18:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7994999999999999e-05 2023-01-02T18:18:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.816579+0000", 2023-01-02T18:18:26.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030098360000000001 2023-01-02T18:18:26.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.709 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.709 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.710 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3487 13.18 e125/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 125'2, mlcod=0'0)", 2023-01-02T18:18:26.710 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:26.710 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 22.603033112999999, 2023-01-02T18:18:26.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003251852, 2023-01-02T18:18:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.712 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:26.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.712 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:26.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:26.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818606+0000", 2023-01-02T18:18:26.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001527369 2023-01-02T18:18:26.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820133+0000", 2023-01-02T18:18:26.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.535e-05 2023-01-02T18:18:26.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820148+0000", 2023-01-02T18:18:26.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.348e-06 2023-01-02T18:18:26.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820155+0000", 2023-01-02T18:18:26.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6463e-05 2023-01-02T18:18:26.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820191+0000", 2023-01-02T18:18:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9545999999999999e-05 2023-01-02T18:18:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820211+0000", 2023-01-02T18:18:26.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016198460000000001 2023-01-02T18:18:26.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.821831+0000", 2023-01-02T18:18:26.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8520000000000001e-05 2023-01-02T18:18:26.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.821859+0000", 2023-01-02T18:18:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003251852 2023-01-02T18:18:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3488 13.18 e126/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 126'3, mlcod=125'1)", 2023-01-02T18:18:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:26.722 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.598235704, 2023-01-02T18:18:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036086859999999998, 2023-01-02T18:18:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:26.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:26.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823402+0000", 2023-01-02T18:18:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001376291 2023-01-02T18:18:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824779+0000", 2023-01-02T18:18:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4474999999999999e-05 2023-01-02T18:18:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824793+0000", 2023-01-02T18:18:26.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2280000000000003e-06 2023-01-02T18:18:26.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824799+0000", 2023-01-02T18:18:26.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4951999999999997e-05 2023-01-02T18:18:26.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824864+0000", 2023-01-02T18:18:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7657e-05 2023-01-02T18:18:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824892+0000", 2023-01-02T18:18:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020817040000000002 2023-01-02T18:18:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.826974+0000", 2023-01-02T18:18:26.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9675999999999998e-05 2023-01-02T18:18:26.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.827013+0000", 2023-01-02T18:18:26.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036086859999999998 2023-01-02T18:18:26.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.733 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.734 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3507 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:26.734 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:26.734 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.5279004629999999, 2023-01-02T18:18:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002, 2023-01-02T18:18:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:26.735 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3507 2023-01-02T18:18:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:26.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893738+0000", 2023-01-02T18:18:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4447000000000001e-05 2023-01-02T18:18:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893752+0000", 2023-01-02T18:18:26.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8085999999999999e-05 2023-01-02T18:18:26.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893770+0000", 2023-01-02T18:18:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5949999999999999e-06 2023-01-02T18:18:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893779+0000", 2023-01-02T18:18:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4619000000000001e-05 2023-01-02T18:18:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893824+0000", 2023-01-02T18:18:26.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0294000000000002e-05 2023-01-02T18:18:26.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893894+0000", 2023-01-02T18:18:26.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034635200000000002 2023-01-02T18:18:26.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:26.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.894240+0000", 2023-01-02T18:18:26.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024283040000000001 2023-01-02T18:18:26.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.896669+0000", 2023-01-02T18:18:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018365300000000001 2023-01-02T18:18:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898505+0000", 2023-01-02T18:18:26.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2230000000000001e-05 2023-01-02T18:18:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898537+0000", 2023-01-02T18:18:26.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6251e-05 2023-01-02T18:18:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898564+0000", 2023-01-02T18:18:26.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002 2023-01-02T18:18:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3508 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.522796906, 2023-01-02T18:18:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001, 2023-01-02T18:18:26.750 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:26.751 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:26.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:26.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:26.751 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:26.751 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3508 2023-01-02T18:18:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:26.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:26.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:26.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:26.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:26.754 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:26.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:26.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898841+0000", 2023-01-02T18:18:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:18:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898867+0000", 2023-01-02T18:18:26.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323999999999999e-05 2023-01-02T18:18:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898890+0000", 2023-01-02T18:18:26.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8820000000000007e-06 2023-01-02T18:18:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898899+0000", 2023-01-02T18:18:26.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1070999999999999e-05 2023-01-02T18:18:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898950+0000", 2023-01-02T18:18:26.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2550000000000002e-05 2023-01-02T18:18:26.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:26.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899022+0000", 2023-01-02T18:18:26.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317836 2023-01-02T18:18:26.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:26.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899340+0000", 2023-01-02T18:18:26.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002728931 2023-01-02T18:18:26.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:26.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.902069+0000", 2023-01-02T18:18:26.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014209419999999999 2023-01-02T18:18:26.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:26.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903490+0000", 2023-01-02T18:18:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3368000000000003e-05 2023-01-02T18:18:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903523+0000", 2023-01-02T18:18:26.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5165999999999999e-05 2023-01-02T18:18:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903549+0000", 2023-01-02T18:18:26.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001 2023-01-02T18:18:26.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.765 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.765 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:26.765 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:26.766 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:26.767 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:26.768 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:26.767+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:26.868 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:26.868+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:26.894 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:26.894 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:26.894 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:26.904 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:26.941 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:18:26.969 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:26.970+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:27.070 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:27.071+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:27.082 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:27.082 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:27.083 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:27.083 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:27.096 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:27.171 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:27.171+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:27.224 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:27.225 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.226 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 98.894501195999993, 2023-01-02T18:18:27.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.228 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:27.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:27.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:27.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:27.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:27.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:27.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:27.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.248 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:18:27.250 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.589547471000003, 2023-01-02T18:18:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:18:27.251 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:27.252 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:18:27.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:18:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:18:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:18:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:18:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:18:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:18:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:18:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:18:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:18:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:27.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:18:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:18:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:18:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:18:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:18:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:18:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:18:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:18:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.885005801000005, 2023-01-02T18:18:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:27.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:27.268 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:27.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:27.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:27.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:27.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:27.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:27.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:27.283 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.871948209999999, 2023-01-02T18:18:27.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:27.286 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:27.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:27.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.297 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:27.298 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 65.861872980000001, 2023-01-02T18:18:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:27.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:27.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:27.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:27.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:27.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:27.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:27.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.317 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:27.318 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 61.898723195999999, 2023-01-02T18:18:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:27.319 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:27.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:27.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:27.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:27.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:27.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.331 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2816 10.1c e101/98 10:3831950c:::rbd_directory:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:27.332 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.893959731000002, 2023-01-02T18:18:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001, 2023-01-02T18:18:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.333 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329069+0000", 2023-01-02T18:18:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:27.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329068+0000", 2023-01-02T18:18:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8700000000000003e-06 2023-01-02T18:18:27.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329075+0000", 2023-01-02T18:18:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:27.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329085+0000", 2023-01-02T18:18:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9330000000000001e-06 2023-01-02T18:18:27.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329093+0000", 2023-01-02T18:18:27.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030738599999999999 2023-01-02T18:18:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329400+0000", 2023-01-02T18:18:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9228e-05 2023-01-02T18:18:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329419+0000", 2023-01-02T18:18:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020227019999999999 2023-01-02T18:18:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331442+0000", 2023-01-02T18:18:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5568e-05 2023-01-02T18:18:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.331468+0000", 2023-01-02T18:18:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023986260000000001 2023-01-02T18:18:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:27.345 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.893426505999997, 2023-01-02T18:18:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.346 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:27.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.840977688000002, 2023-01-02T18:18:27.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:27.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:27.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:27.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:27.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:27.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.369 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:27.370 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 41.833496799999999, 2023-01-02T18:18:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.371 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:27.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:27.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:27.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:27.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:27.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:27.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:27.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:27.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.785844144999999, 2023-01-02T18:18:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.383 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:27.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:27.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:27.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:27.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:27.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:27.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:27.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:27.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:27.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.781471566999997, 2023-01-02T18:18:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:27.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:27.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:27.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:27.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:27.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:27.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:27.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:27.405 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.406 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3438 11.15 e117/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 117'5, mlcod=116'3)", 2023-01-02T18:18:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.689737069, 2023-01-02T18:18:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987, 2023-01-02T18:18:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.407 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533292+0000", 2023-01-02T18:18:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:27.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533291+0000", 2023-01-02T18:18:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4139999999999997e-06 2023-01-02T18:18:27.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533299+0000", 2023-01-02T18:18:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1438e-05 2023-01-02T18:18:27.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533310+0000", 2023-01-02T18:18:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.5089999999999996e-06 2023-01-02T18:18:27.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533318+0000", 2023-01-02T18:18:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6567999999999998e-05 2023-01-02T18:18:27.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533374+0000", 2023-01-02T18:18:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5011000000000002e-05 2023-01-02T18:18:27.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533399+0000", 2023-01-02T18:18:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024056519999999999 2023-01-02T18:18:27.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535805+0000", 2023-01-02T18:18:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5862000000000003e-05 2023-01-02T18:18:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535841+0000", 2023-01-02T18:18:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002548987 2023-01-02T18:18:27.417 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3436 11.14 e117/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 117'5, mlcod=108'3)", 2023-01-02T18:18:27.418 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.68964604, 2023-01-02T18:18:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999, 2023-01-02T18:18:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.419 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533383+0000", 2023-01-02T18:18:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:27.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533382+0000", 2023-01-02T18:18:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.476e-06 2023-01-02T18:18:27.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533387+0000", 2023-01-02T18:18:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0322999999999999e-05 2023-01-02T18:18:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533397+0000", 2023-01-02T18:18:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2950000000000001e-06 2023-01-02T18:18:27.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533403+0000", 2023-01-02T18:18:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1789000000000002e-05 2023-01-02T18:18:27.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533454+0000", 2023-01-02T18:18:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9650999999999999e-05 2023-01-02T18:18:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533474+0000", 2023-01-02T18:18:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019917419999999999 2023-01-02T18:18:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535466+0000", 2023-01-02T18:18:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4618999999999999e-05 2023-01-02T18:18:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535490+0000", 2023-01-02T18:18:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021075949999999999 2023-01-02T18:18:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.429 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:27.430 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.490162438999999, 2023-01-02T18:18:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.431 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:27.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:27.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:27.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:27.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:27.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:27.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:27.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3493 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e127)", 2023-01-02T18:18:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.381365113000001, 2023-01-02T18:18:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998, 2023-01-02T18:18:27.443 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:27.444 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3493 2023-01-02T18:18:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841661+0000", 2023-01-02T18:18:27.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8811999999999999e-05 2023-01-02T18:18:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841680+0000", 2023-01-02T18:18:27.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9380000000000001e-05 2023-01-02T18:18:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841699+0000", 2023-01-02T18:18:27.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841709+0000", 2023-01-02T18:18:27.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010059 2023-01-02T18:18:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841809+0000", 2023-01-02T18:18:27.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3533e-05 2023-01-02T18:18:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841903+0000", 2023-01-02T18:18:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036800899999999998 2023-01-02T18:18:27.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842271+0000", 2023-01-02T18:18:27.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033624560000000002 2023-01-02T18:18:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845633+0000", 2023-01-02T18:18:27.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020175099999999999 2023-01-02T18:18:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845835+0000", 2023-01-02T18:18:27.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1019999999999998e-05 2023-01-02T18:18:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845866+0000", 2023-01-02T18:18:27.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7328999999999999e-05 2023-01-02T18:18:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845893+0000", 2023-01-02T18:18:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998 2023-01-02T18:18:27.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3494 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e128)", 2023-01-02T18:18:27.461 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.376835804999999, 2023-01-02T18:18:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999, 2023-01-02T18:18:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.462 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3494 2023-01-02T18:18:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.463 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:27.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846191+0000", 2023-01-02T18:18:27.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4089e-05 2023-01-02T18:18:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846205+0000", 2023-01-02T18:18:27.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8082000000000001e-05 2023-01-02T18:18:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846223+0000", 2023-01-02T18:18:27.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2023-01-02T18:18:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846231+0000", 2023-01-02T18:18:27.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100853 2023-01-02T18:18:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846332+0000", 2023-01-02T18:18:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4294000000000004e-05 2023-01-02T18:18:27.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846406+0000", 2023-01-02T18:18:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000381035 2023-01-02T18:18:27.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846787+0000", 2023-01-02T18:18:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029262089999999999 2023-01-02T18:18:27.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849713+0000", 2023-01-02T18:18:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022129699999999999 2023-01-02T18:18:27.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:27.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849934+0000", 2023-01-02T18:18:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6384000000000003e-05 2023-01-02T18:18:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849971+0000", 2023-01-02T18:18:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9811e-05 2023-01-02T18:18:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.850001+0000", 2023-01-02T18:18:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999 2023-01-02T18:18:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3500 13.1c e131/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 131'3, mlcod=130'1)", 2023-01-02T18:18:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.350868014, 2023-01-02T18:18:27.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999, 2023-01-02T18:18:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872160+0000", 2023-01-02T18:18:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022329899999999998 2023-01-02T18:18:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874393+0000", 2023-01-02T18:18:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.252e-05 2023-01-02T18:18:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874406+0000", 2023-01-02T18:18:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0240000000000003e-06 2023-01-02T18:18:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874415+0000", 2023-01-02T18:18:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0895000000000005e-05 2023-01-02T18:18:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874486+0000", 2023-01-02T18:18:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4266e-05 2023-01-02T18:18:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874520+0000", 2023-01-02T18:18:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023338909999999998 2023-01-02T18:18:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876854+0000", 2023-01-02T18:18:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3161000000000001e-05 2023-01-02T18:18:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876907+0000", 2023-01-02T18:18:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999 2023-01-02T18:18:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.489 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3501 13.1c e132/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 132'4, mlcod=130'2)", 2023-01-02T18:18:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:27.490 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.3444377, 2023-01-02T18:18:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001, 2023-01-02T18:18:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878589+0000", 2023-01-02T18:18:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011789120000000001 2023-01-02T18:18:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879768+0000", 2023-01-02T18:18:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6392000000000002e-05 2023-01-02T18:18:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879785+0000", 2023-01-02T18:18:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3309999999999998e-06 2023-01-02T18:18:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879792+0000", 2023-01-02T18:18:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4100000000000001e-05 2023-01-02T18:18:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879836+0000", 2023-01-02T18:18:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1690000000000001e-05 2023-01-02T18:18:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879858+0000", 2023-01-02T18:18:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001682692 2023-01-02T18:18:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881541+0000", 2023-01-02T18:18:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7658999999999999e-05 2023-01-02T18:18:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881588+0000", 2023-01-02T18:18:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001 2023-01-02T18:18:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.501 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3510 13.10 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:18:27.502 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3118861479999993, 2023-01-02T18:18:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999, 2023-01-02T18:18:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3510 2023-01-02T18:18:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:27.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911139+0000", 2023-01-02T18:18:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9587000000000001e-05 2023-01-02T18:18:27.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911159+0000", 2023-01-02T18:18:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2842000000000002e-05 2023-01-02T18:18:27.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911192+0000", 2023-01-02T18:18:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5116999999999999e-05 2023-01-02T18:18:27.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911207+0000", 2023-01-02T18:18:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000120098 2023-01-02T18:18:27.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911327+0000", 2023-01-02T18:18:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.536e-06 2023-01-02T18:18:27.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911332+0000", 2023-01-02T18:18:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025961489999999999 2023-01-02T18:18:27.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.913928+0000", 2023-01-02T18:18:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016713700000000001 2023-01-02T18:18:27.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914096+0000", 2023-01-02T18:18:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044610400000000001 2023-01-02T18:18:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914542+0000", 2023-01-02T18:18:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027693449999999999 2023-01-02T18:18:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917311+0000", 2023-01-02T18:18:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079338599999999998 2023-01-02T18:18:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918104+0000", 2023-01-02T18:18:27.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8297000000000003e-05 2023-01-02T18:18:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918143+0000", 2023-01-02T18:18:27.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7084e-05 2023-01-02T18:18:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918170+0000", 2023-01-02T18:18:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999 2023-01-02T18:18:27.519 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.520 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.520 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:27.522 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:27.523 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:27.522+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:27.623 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:27.623+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:27.688 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:27.688 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:27.688 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:27.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:27.723 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:27.724+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:27.823 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:27.824 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:27.824 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:27.825 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:27.825+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:27.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:27.925 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:27.925+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:27.940 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:18:27.984 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:27.984 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:18:27.985 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 94.634131155000006, 2023-01-02T18:18:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:18:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.986 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:18:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:18:27.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:18:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:18:27.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:18:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:18:27.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:18:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:18:27.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:18:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:18:27.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:18:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:18:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:18:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:18:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:18:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:18:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.996 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:18:27.997 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 90.667303270999994, 2023-01-02T18:18:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:18:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:27.998 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:27.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:18:28.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:18:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:18:28.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:18:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:18:28.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:18:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:18:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:18:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:18:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:18:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:18:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:18:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:18:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:18:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:18:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:18:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:28.009 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.659813024000002, 2023-01-02T18:18:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:18:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:18:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:18:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:18:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:18:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:18:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:18:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:18:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:18:28.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:18:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:18:28.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:18:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:18:28.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:18:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:18:28.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:18:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.020 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:18:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.658019938999999, 2023-01-02T18:18:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:18:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:28.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:28.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:18:28.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:18:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:18:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:18:28.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:18:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:18:28.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:18:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:18:28.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:18:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:18:28.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:18:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:18:28.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:18:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:18:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:18:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:18:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.031 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:18:28.032 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.655128594999994, 2023-01-02T18:18:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:18:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.033 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:28.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:18:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:18:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:18:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:18:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:18:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:18:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:18:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:18:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:18:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:18:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:18:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:18:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:18:28.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:18:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:18:28.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:18:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:18:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.618847780999999, 2023-01-02T18:18:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:18:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.044 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:28.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:28.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:28.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:18:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:18:28.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:18:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:18:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:18:28.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:18:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:18:28.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:18:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:18:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:18:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:18:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:18:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:18:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:18:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:18:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.054 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:18:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:28.055 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.643212916000003, 2023-01-02T18:18:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:18:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:18:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:18:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:18:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:18:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:18:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:18:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:18:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:18:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:18:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:18:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:18:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:18:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:18:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:18:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:18:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:18:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.641474066999997, 2023-01-02T18:18:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:18:28.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:28.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:28.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:18:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:18:28.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:18:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:18:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:18:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:18:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:18:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:18:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:18:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:18:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:18:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:18:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:18:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:18:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:18:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:18:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:18:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.649148812999996, 2023-01-02T18:18:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:18:28.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:18:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:18:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:18:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:18:28.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:18:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:18:28.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:18:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:18:28.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:18:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:18:28.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:18:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:18:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:18:28.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:18:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:18:28.088 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.089 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.64800597, 2023-01-02T18:18:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:18:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.090 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:28.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:18:28.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:18:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:18:28.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:18:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:18:28.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:18:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:18:28.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:18:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:18:28.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:18:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:18:28.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:18:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:18:28.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:18:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:18:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.100 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:28.101 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.635452176000001, 2023-01-02T18:18:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:18:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.102 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:18:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:18:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:18:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:18:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:18:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:18:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:18:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:18:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:18:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:18:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:18:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:18:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:18:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:18:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:18:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.618049867000003, 2023-01-02T18:18:28.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:18:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:18:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:18:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:18:28.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:18:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:18:28.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:18:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:18:28.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:18:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:18:28.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:18:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:18:28.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:18:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:18:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:18:28.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:18:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:18:28.123 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.124 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:18:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 53.567996321000003, 2023-01-02T18:18:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:18:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.125 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:28.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:18:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:18:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:18:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:18:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:18:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:18:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:18:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:18:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:18:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:18:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:18:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:18:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:18:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:18:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:18:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:18:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:18:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.547338541999999, 2023-01-02T18:18:28.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:18:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:28.137 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:18:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:28.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:18:28.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:18:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:18:28.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:18:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:18:28.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:18:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:18:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:18:28.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:18:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:18:28.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:18:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:18:28.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:18:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:18:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:18:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:18:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:18:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:18:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:18:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:18:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:18:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:18:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3347 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e116)", 2023-01-02T18:18:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:28.151 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.542840591000001, 2023-01-02T18:18:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004, 2023-01-02T18:18:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:28.152 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3347 2023-01-02T18:18:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440699+0000", 2023-01-02T18:18:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5150000000000001e-05 2023-01-02T18:18:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440724+0000", 2023-01-02T18:18:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2691e-05 2023-01-02T18:18:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440747+0000", 2023-01-02T18:18:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9449999999999999e-06 2023-01-02T18:18:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440756+0000", 2023-01-02T18:18:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0661999999999997e-05 2023-01-02T18:18:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440807+0000", 2023-01-02T18:18:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4629999999999996e-05 2023-01-02T18:18:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440871+0000", 2023-01-02T18:18:28.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034606300000000002 2023-01-02T18:18:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441217+0000", 2023-01-02T18:18:28.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031920429999999999 2023-01-02T18:18:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444409+0000", 2023-01-02T18:18:28.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032486499999999997 2023-01-02T18:18:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444734+0000", 2023-01-02T18:18:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5741000000000002e-05 2023-01-02T18:18:28.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444770+0000", 2023-01-02T18:18:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7988e-05 2023-01-02T18:18:28.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444798+0000", 2023-01-02T18:18:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004 2023-01-02T18:18:28.165 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3438 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:28.166 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.450593003999998, 2023-01-02T18:18:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158, 2023-01-02T18:18:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.167 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3438 2023-01-02T18:18:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.168 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532948+0000", 2023-01-02T18:18:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:18:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532956+0000", 2023-01-02T18:18:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3448999999999999e-05 2023-01-02T18:18:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532969+0000", 2023-01-02T18:18:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4170000000000003e-06 2023-01-02T18:18:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532977+0000", 2023-01-02T18:18:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5679000000000001e-05 2023-01-02T18:18:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533023+0000", 2023-01-02T18:18:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2023-01-02T18:18:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533080+0000", 2023-01-02T18:18:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8567999999999997e-05 2023-01-02T18:18:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:28.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533159+0000", 2023-01-02T18:18:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018926119999999999 2023-01-02T18:18:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:28.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535051+0000", 2023-01-02T18:18:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088907299999999999 2023-01-02T18:18:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535940+0000", 2023-01-02T18:18:28.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7307e-05 2023-01-02T18:18:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535988+0000", 2023-01-02T18:18:28.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5602e-05 2023-01-02T18:18:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536013+0000", 2023-01-02T18:18:28.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158 2023-01-02T18:18:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3460 13.1a 13:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e122)", 2023-01-02T18:18:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.251613871, 2023-01-02T18:18:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004, 2023-01-02T18:18:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.182 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3460 2023-01-02T18:18:28.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:28.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:28.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731925+0000", 2023-01-02T18:18:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.447e-05 2023-01-02T18:18:28.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731940+0000", 2023-01-02T18:18:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4263e-05 2023-01-02T18:18:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731954+0000", 2023-01-02T18:18:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6684000000000002e-05 2023-01-02T18:18:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731971+0000", 2023-01-02T18:18:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1316999999999996e-05 2023-01-02T18:18:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732032+0000", 2023-01-02T18:18:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012202200000000001 2023-01-02T18:18:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732154+0000", 2023-01-02T18:18:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015345800000000001 2023-01-02T18:18:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:28.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732308+0000", 2023-01-02T18:18:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003479481 2023-01-02T18:18:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:28.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735787+0000", 2023-01-02T18:18:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087823000000000003 2023-01-02T18:18:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:28.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736665+0000", 2023-01-02T18:18:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7332000000000001e-05 2023-01-02T18:18:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736703+0000", 2023-01-02T18:18:28.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1186999999999998e-05 2023-01-02T18:18:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736734+0000", 2023-01-02T18:18:28.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004 2023-01-02T18:18:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3493 13.10 e128/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 128'2, mlcod=0'0)", 2023-01-02T18:18:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 20.140904729999999, 2023-01-02T18:18:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999, 2023-01-02T18:18:28.197 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:28.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:28.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:28.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050436299999999997 2023-01-02T18:18:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843141+0000", 2023-01-02T18:18:28.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2051e-05 2023-01-02T18:18:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843153+0000", 2023-01-02T18:18:28.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.558e-06 2023-01-02T18:18:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843159+0000", 2023-01-02T18:18:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1963000000000003e-05 2023-01-02T18:18:28.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843221+0000", 2023-01-02T18:18:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6831000000000001e-05 2023-01-02T18:18:28.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843248+0000", 2023-01-02T18:18:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024489630000000002 2023-01-02T18:18:28.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845697+0000", 2023-01-02T18:18:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3207999999999998e-05 2023-01-02T18:18:28.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845730+0000", 2023-01-02T18:18:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999 2023-01-02T18:18:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.207 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3494 13.10 e129/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 129'3, mlcod=127'1)", 2023-01-02T18:18:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:28.208 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.136375156, 2023-01-02T18:18:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998, 2023-01-02T18:18:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047132700000000001 2023-01-02T18:18:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847638+0000", 2023-01-02T18:18:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6300999999999999e-05 2023-01-02T18:18:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847654+0000", 2023-01-02T18:18:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1022999999999999e-05 2023-01-02T18:18:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847665+0000", 2023-01-02T18:18:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1383999999999994e-05 2023-01-02T18:18:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847727+0000", 2023-01-02T18:18:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7688999999999999e-05 2023-01-02T18:18:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847754+0000", 2023-01-02T18:18:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002026501 2023-01-02T18:18:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849781+0000", 2023-01-02T18:18:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2506999999999997e-05 2023-01-02T18:18:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849834+0000", 2023-01-02T18:18:28.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998 2023-01-02T18:18:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3510 13.10 e135/120 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head v 135'5, mlcod=129'3)", 2023-01-02T18:18:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.0684501780000009, 2023-01-02T18:18:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028970319999999999, 2023-01-02T18:18:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:28.220 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:28.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:28.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059833399999999995 2023-01-02T18:18:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915690+0000", 2023-01-02T18:18:28.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2251e-05 2023-01-02T18:18:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915702+0000", 2023-01-02T18:18:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0260000000000004e-06 2023-01-02T18:18:28.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915708+0000", 2023-01-02T18:18:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9144000000000002e-05 2023-01-02T18:18:28.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915767+0000", 2023-01-02T18:18:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8093999999999999e-05 2023-01-02T18:18:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915795+0000", 2023-01-02T18:18:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021551000000000001 2023-01-02T18:18:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917951+0000", 2023-01-02T18:18:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8435e-05 2023-01-02T18:18:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:28.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917989+0000", 2023-01-02T18:18:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028970319999999999 2023-01-02T18:18:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.230 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:28.231 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:28.231 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:28.233 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:28.233 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:28.232+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:28.334 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:28.334+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:28.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:28.429 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:28.430 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:28.431 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:28.431 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:28.437 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:28.438+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:28.443 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:28.530 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:28.544 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:28.544+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:28.550 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:28.573 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:28.593 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:28.603 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:28.603 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:28.612 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:28.614 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:28.637 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:28.639 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:28.640+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:28.660 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:28.684 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:28.685 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:28.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:28.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:28.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:28.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:28.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:28.686 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:28.687 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:28.742 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:28.742+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:28.785 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:28.785 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:28.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:28.845 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:28.845+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:28.939 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:28.940 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:28.943 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:28.944+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:28.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:29.045 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:29.045+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:29.116 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:29.116 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:29.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:29.169 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:29.169+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:29.246 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:29.246+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:29.294 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:29.294 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:29.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:29.346 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:29.346+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:29.447 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:29.448+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:29.470 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:29.470 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:29.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:29.547 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:29.548+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:29.563 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:29.564 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:29.564 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:29.564 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:29.564 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:29.564 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.565 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:29.565 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.565 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.565 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:29.565 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.566 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:29.566 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.566 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.566 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:29.566 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.567 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:29.567 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.567 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.567 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:29.568 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.568 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:29.568 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.568 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.568 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:29.569 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.569 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:29.569 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.569 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.569 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:29.570 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:29.570 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:29.570 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:29.570 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:29.570 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:29.571 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:29.571 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:29.571 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:29.571 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:29.571 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:29.571 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.572 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:29.572 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.572 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.572 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:29.572 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.572 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:29.573 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.573 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.573 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:29.573 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.573 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:29.574 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.574 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.574 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:29.574 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.574 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:29.574 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.575 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.575 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:29.575 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.575 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:29.575 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.576 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.576 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:29.576 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.576 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.576 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.576 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.577 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.577 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.577 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:29.577 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:29.577 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:29.578 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.578 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:29.578 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:29.578 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:29.578 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.578 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:29.579 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:29.579 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:29.579 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.579 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:29.579 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:29.580 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:29.580 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.580 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:29.580 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:29.580 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:29.580 INFO:tasks.workunit.client.0.smithi007.stdout:discard: 512~512 = 512 2023-01-02T18:18:29.581 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.581 INFO:tasks.workunit.client.0.smithi007.stdout:aio discard: 1536~512 = 0 2023-01-02T18:18:29.581 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.581 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.581 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.582 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.582 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:29.582 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:29.582 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.582 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.582 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:29.583 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.583 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.583 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:29.583 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.583 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.584 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:29.584 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.584 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.584 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.584 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.585 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:29.585 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.585 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.585 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:29.585 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.585 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.586 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:29.586 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.586 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.586 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:29.586 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.587 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.587 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.587 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.587 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:29.587 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.587 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.588 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:29.588 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.588 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.588 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:29.588 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.588 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.589 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:29.589 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.589 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.589 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.589 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.590 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:29.590 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.590 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.590 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:29.590 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.590 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.591 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:29.591 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.591 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.591 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:29.591 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.592 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.592 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.592 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.592 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:29.592 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.592 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.593 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:29.593 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.593 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.593 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:29.593 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.594 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.594 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:29.594 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.594 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.594 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.594 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.595 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.595 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:29.595 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.595 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.595 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:29.596 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.596 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.596 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.596 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:29.596 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.596 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.597 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:29.597 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.597 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.597 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.597 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:29.598 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.598 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.598 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:29.598 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.598 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.598 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.599 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:29.599 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.599 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.599 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:29.599 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.600 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.600 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.600 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:29.600 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.600 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.600 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:29.601 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:29.601 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.601 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:29.601 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.601 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.602 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:29.602 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.602 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.602 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.602 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:29.603 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:29.603 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:29.603 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:29.603 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:29.603 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:29.604 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:29.645 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:29.646 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:29.648 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:29.649+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:29.655 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:29.749 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:29.749+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:29.821 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:29.822 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:29.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:29.850 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:29.851+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:29.950 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:29.951+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:29.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:18:29.996 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:29.997 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:30.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:30.051 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:30.052+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:30.151 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:30.152+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:30.171 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:30.172 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:30.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:30.253 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:30.254+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:30.346 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:30.347 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:30.353 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:30.354+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:30.356 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:30.454 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:30.455+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:30.523 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:30.524 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:30.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:30.577 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:30.578+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:30.655 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:30.656+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:30.658 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:30.658 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:30.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:30.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:30.756 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:30.757+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:30.833 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:30.834 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:30.844 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:30.850 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:30.858 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:30.858+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:30.874 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:30.893 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:30.913 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:30.937 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:30.941 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 5, 4] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:30.941 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:30.942 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2023-01-02T18:18:30.942 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:18:30.942 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:18:30.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2023-01-02T18:18:30.948 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:18:30.958 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:30.959+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:30.972 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:30.995 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:30.996 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28755 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 197632~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e143)", 2023-01-02T18:18:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:30.996949+0000", 2023-01-02T18:18:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.00018715999999999999, 2023-01-02T18:18:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000218564, 2023-01-02T18:18:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28755 2023-01-02T18:18:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.996949+0000", 2023-01-02T18:18:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.996949+0000", 2023-01-02T18:18:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.996948+0000", 2023-01-02T18:18:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9210000000000003e-06 2023-01-02T18:18:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.996955+0000", 2023-01-02T18:18:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5994999999999998e-05 2023-01-02T18:18:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.996971+0000", 2023-01-02T18:18:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6599999999999995e-06 2023-01-02T18:18:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.996978+0000", 2023-01-02T18:18:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5198000000000003e-05 2023-01-02T18:18:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.997024+0000", 2023-01-02T18:18:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9999000000000004e-05 2023-01-02T18:18:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.997104+0000", 2023-01-02T18:18:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000154594 2023-01-02T18:18:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.007 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:31.007 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 1 2023-01-02T18:18:31.007 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:31.008 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:31.030 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:31.032 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:31.032 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:31.032 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:31.032 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:31.032 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:31.033 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:31.033 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:31.033 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:31.059 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:31.060+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:31.100 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:31.100 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-01-02T18:18:31.100 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:31.156 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:31.156 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:31.157 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:31.157 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:31.160 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:31.161+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:31.166 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:31.261 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:31.262+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:31.293 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:31.294 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:31.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:31.294 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:31.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.295 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2086 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e83)", 2023-01-02T18:18:31.295 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:31.295 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 74.968559365999994, 2023-01-02T18:18:31.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435, 2023-01-02T18:18:31.295 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.295 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:31.296 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.296 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:31.296 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:31.296 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2086 2023-01-02T18:18:31.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.297 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:31.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:31.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:31.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324212+0000", 2023-01-02T18:18:31.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2366e-05 2023-01-02T18:18:31.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324224+0000", 2023-01-02T18:18:31.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4462000000000001e-05 2023-01-02T18:18:31.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324249+0000", 2023-01-02T18:18:31.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5980000000000003e-06 2023-01-02T18:18:31.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324259+0000", 2023-01-02T18:18:31.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6119999999999999e-05 2023-01-02T18:18:31.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324305+0000", 2023-01-02T18:18:31.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7069999999999997e-06 2023-01-02T18:18:31.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:31.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324310+0000", 2023-01-02T18:18:31.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003133828 2023-01-02T18:18:31.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327444+0000", 2023-01-02T18:18:31.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1573999999999998e-05 2023-01-02T18:18:31.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327496+0000", 2023-01-02T18:18:31.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1179000000000004e-05 2023-01-02T18:18:31.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327567+0000", 2023-01-02T18:18:31.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435 2023-01-02T18:18:31.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.307 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.307 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.308 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2319 3.1 3:83da4b60:::rbd_object_map.11d54907a3eb.0000000000000014:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:31.308 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:31.308 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.918459733000006, 2023-01-02T18:18:31.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001, 2023-01-02T18:18:31.308 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.308 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.309 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.309 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:31.309 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:31.309 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2319 2023-01-02T18:18:31.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.310 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:31.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:31.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:31.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374312+0000", 2023-01-02T18:18:31.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2023-01-02T18:18:31.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374323+0000", 2023-01-02T18:18:31.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8349e-05 2023-01-02T18:18:31.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374341+0000", 2023-01-02T18:18:31.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9909999999999997e-06 2023-01-02T18:18:31.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374351+0000", 2023-01-02T18:18:31.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.617e-05 2023-01-02T18:18:31.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374398+0000", 2023-01-02T18:18:31.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:18:31.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:31.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374403+0000", 2023-01-02T18:18:31.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001918765 2023-01-02T18:18:31.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376322+0000", 2023-01-02T18:18:31.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015418100000000001 2023-01-02T18:18:31.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376476+0000", 2023-01-02T18:18:31.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016648999999999999 2023-01-02T18:18:31.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:31.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376642+0000", 2023-01-02T18:18:31.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001972976 2023-01-02T18:18:31.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.378615+0000", 2023-01-02T18:18:31.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020004570000000002 2023-01-02T18:18:31.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380616+0000", 2023-01-02T18:18:31.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3064000000000005e-05 2023-01-02T18:18:31.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380679+0000", 2023-01-02T18:18:31.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9119000000000002e-05 2023-01-02T18:18:31.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380728+0000", 2023-01-02T18:18:31.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001 2023-01-02T18:18:31.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.324 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.324 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3486 13.18 e125/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 125'1, mlcod=0'0)", 2023-01-02T18:18:31.325 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:31.325 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.479204569, 2023-01-02T18:18:31.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030098360000000001, 2023-01-02T18:18:31.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.326 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:31.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:31.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:31.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813568+0000", 2023-01-02T18:18:31.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001267661 2023-01-02T18:18:31.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814836+0000", 2023-01-02T18:18:31.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7289999999999995e-06 2023-01-02T18:18:31.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814846+0000", 2023-01-02T18:18:31.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4719999999999997e-06 2023-01-02T18:18:31.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814850+0000", 2023-01-02T18:18:31.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6375000000000001e-05 2023-01-02T18:18:31.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814877+0000", 2023-01-02T18:18:31.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5054e-05 2023-01-02T18:18:31.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814892+0000", 2023-01-02T18:18:31.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001659436 2023-01-02T18:18:31.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.816551+0000", 2023-01-02T18:18:31.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7994999999999999e-05 2023-01-02T18:18:31.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.816579+0000", 2023-01-02T18:18:31.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030098360000000001 2023-01-02T18:18:31.335 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.335 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.335 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.336 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3487 13.18 e125/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 125'2, mlcod=0'0)", 2023-01-02T18:18:31.336 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:31.336 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 27.474166533999998, 2023-01-02T18:18:31.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003251852, 2023-01-02T18:18:31.337 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.337 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.337 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:31.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:31.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:31.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818606+0000", 2023-01-02T18:18:31.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001527369 2023-01-02T18:18:31.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820133+0000", 2023-01-02T18:18:31.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.535e-05 2023-01-02T18:18:31.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820148+0000", 2023-01-02T18:18:31.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.348e-06 2023-01-02T18:18:31.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820155+0000", 2023-01-02T18:18:31.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6463e-05 2023-01-02T18:18:31.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820191+0000", 2023-01-02T18:18:31.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9545999999999999e-05 2023-01-02T18:18:31.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820211+0000", 2023-01-02T18:18:31.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016198460000000001 2023-01-02T18:18:31.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.821831+0000", 2023-01-02T18:18:31.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8520000000000001e-05 2023-01-02T18:18:31.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.821859+0000", 2023-01-02T18:18:31.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003251852 2023-01-02T18:18:31.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.346 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.347 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3488 13.18 e126/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 126'3, mlcod=125'1)", 2023-01-02T18:18:31.347 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:31.347 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 26.469369125, 2023-01-02T18:18:31.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036086859999999998, 2023-01-02T18:18:31.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.348 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.348 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:31.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:31.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:31.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823402+0000", 2023-01-02T18:18:31.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001376291 2023-01-02T18:18:31.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824779+0000", 2023-01-02T18:18:31.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4474999999999999e-05 2023-01-02T18:18:31.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824793+0000", 2023-01-02T18:18:31.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2280000000000003e-06 2023-01-02T18:18:31.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824799+0000", 2023-01-02T18:18:31.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4951999999999997e-05 2023-01-02T18:18:31.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824864+0000", 2023-01-02T18:18:31.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7657e-05 2023-01-02T18:18:31.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824892+0000", 2023-01-02T18:18:31.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020817040000000002 2023-01-02T18:18:31.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.826974+0000", 2023-01-02T18:18:31.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9675999999999998e-05 2023-01-02T18:18:31.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.827013+0000", 2023-01-02T18:18:31.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036086859999999998 2023-01-02T18:18:31.357 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.358 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.358 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.358 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3507 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:31.359 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:31.359 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.399033884, 2023-01-02T18:18:31.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002, 2023-01-02T18:18:31.359 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.359 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.360 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.360 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.360 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.360 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3507 2023-01-02T18:18:31.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.360 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:31.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:31.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:31.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893738+0000", 2023-01-02T18:18:31.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4447000000000001e-05 2023-01-02T18:18:31.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893752+0000", 2023-01-02T18:18:31.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8085999999999999e-05 2023-01-02T18:18:31.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893770+0000", 2023-01-02T18:18:31.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5949999999999999e-06 2023-01-02T18:18:31.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893779+0000", 2023-01-02T18:18:31.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4619000000000001e-05 2023-01-02T18:18:31.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893824+0000", 2023-01-02T18:18:31.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0294000000000002e-05 2023-01-02T18:18:31.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893894+0000", 2023-01-02T18:18:31.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034635200000000002 2023-01-02T18:18:31.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:31.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.894240+0000", 2023-01-02T18:18:31.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024283040000000001 2023-01-02T18:18:31.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.896669+0000", 2023-01-02T18:18:31.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018365300000000001 2023-01-02T18:18:31.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898505+0000", 2023-01-02T18:18:31.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2230000000000001e-05 2023-01-02T18:18:31.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898537+0000", 2023-01-02T18:18:31.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6251e-05 2023-01-02T18:18:31.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898564+0000", 2023-01-02T18:18:31.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002 2023-01-02T18:18:31.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.373 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.373 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.374 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3508 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:31.374 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:31.374 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.393930327, 2023-01-02T18:18:31.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001, 2023-01-02T18:18:31.374 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.375 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.375 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.375 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.375 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3508 2023-01-02T18:18:31.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.376 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:31.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:31.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:31.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898841+0000", 2023-01-02T18:18:31.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:18:31.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898867+0000", 2023-01-02T18:18:31.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323999999999999e-05 2023-01-02T18:18:31.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898890+0000", 2023-01-02T18:18:31.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8820000000000007e-06 2023-01-02T18:18:31.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898899+0000", 2023-01-02T18:18:31.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1070999999999999e-05 2023-01-02T18:18:31.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898950+0000", 2023-01-02T18:18:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2550000000000002e-05 2023-01-02T18:18:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899022+0000", 2023-01-02T18:18:31.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317836 2023-01-02T18:18:31.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:31.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899340+0000", 2023-01-02T18:18:31.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002728931 2023-01-02T18:18:31.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.902069+0000", 2023-01-02T18:18:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014209419999999999 2023-01-02T18:18:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903490+0000", 2023-01-02T18:18:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3368000000000003e-05 2023-01-02T18:18:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903523+0000", 2023-01-02T18:18:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5165999999999999e-05 2023-01-02T18:18:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903549+0000", 2023-01-02T18:18:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001 2023-01-02T18:18:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16196 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3959470110000001, 2023-01-02T18:18:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027283379999999999, 2023-01-02T18:18:31.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.390 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16196 2023-01-02T18:18:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:31.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:31.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896826+0000", 2023-01-02T18:18:31.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.066e-06 2023-01-02T18:18:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896830+0000", 2023-01-02T18:18:31.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8240000000000001e-06 2023-01-02T18:18:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896833+0000", 2023-01-02T18:18:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.525e-06 2023-01-02T18:18:31.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896836+0000", 2023-01-02T18:18:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061799399999999997 2023-01-02T18:18:31.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897454+0000", 2023-01-02T18:18:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9257000000000003e-05 2023-01-02T18:18:31.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897543+0000", 2023-01-02T18:18:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017217600000000001 2023-01-02T18:18:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897715+0000", 2023-01-02T18:18:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017227259999999999 2023-01-02T18:18:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899438+0000", 2023-01-02T18:18:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8192000000000003e-05 2023-01-02T18:18:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899476+0000", 2023-01-02T18:18:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3977000000000003e-05 2023-01-02T18:18:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899520+0000", 2023-01-02T18:18:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5029e-05 2023-01-02T18:18:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899555+0000", 2023-01-02T18:18:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027283379999999999 2023-01-02T18:18:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16197 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1024~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3959335789999998, 2023-01-02T18:18:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003274819, 2023-01-02T18:18:31.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16197 2023-01-02T18:18:31.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:31.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4080000000000001e-06 2023-01-02T18:18:31.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896842+0000", 2023-01-02T18:18:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1650000000000002e-06 2023-01-02T18:18:31.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896846+0000", 2023-01-02T18:18:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2709999999999999e-06 2023-01-02T18:18:31.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896848+0000", 2023-01-02T18:18:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012347090000000001 2023-01-02T18:18:31.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898083+0000", 2023-01-02T18:18:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016879500000000001 2023-01-02T18:18:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898251+0000", 2023-01-02T18:18:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016736999999999999 2023-01-02T18:18:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898419+0000", 2023-01-02T18:18:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001147447 2023-01-02T18:18:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899566+0000", 2023-01-02T18:18:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047601400000000003 2023-01-02T18:18:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900042+0000", 2023-01-02T18:18:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1649999999999997e-05 2023-01-02T18:18:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900074+0000", 2023-01-02T18:18:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1284e-05 2023-01-02T18:18:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900115+0000", 2023-01-02T18:18:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003274819 2023-01-02T18:18:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16198 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1536~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3959080199999998, 2023-01-02T18:18:31.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003, 2023-01-02T18:18:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16198 2023-01-02T18:18:31.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:31.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:31.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896865+0000", 2023-01-02T18:18:31.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6900000000000001e-06 2023-01-02T18:18:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896868+0000", 2023-01-02T18:18:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:18:31.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896874+0000", 2023-01-02T18:18:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.447e-06 2023-01-02T18:18:31.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896876+0000", 2023-01-02T18:18:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001873179 2023-01-02T18:18:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.426 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898750+0000", 2023-01-02T18:18:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7626000000000005e-05 2023-01-02T18:18:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898827+0000", 2023-01-02T18:18:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012927899999999999 2023-01-02T18:18:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898957+0000", 2023-01-02T18:18:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023139749999999998 2023-01-02T18:18:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901271+0000", 2023-01-02T18:18:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4455000000000005e-05 2023-01-02T18:18:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901335+0000", 2023-01-02T18:18:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7706999999999994e-05 2023-01-02T18:18:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901403+0000", 2023-01-02T18:18:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3409999999999999e-05 2023-01-02T18:18:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901446+0000", 2023-01-02T18:18:31.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003 2023-01-02T18:18:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16199 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2048~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.395894932, 2023-01-02T18:18:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004, 2023-01-02T18:18:31.434 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.435 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16199 2023-01-02T18:18:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:31.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:31.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:31.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.69e-06 2023-01-02T18:18:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896883+0000", 2023-01-02T18:18:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2909999999999999e-06 2023-01-02T18:18:31.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896887+0000", 2023-01-02T18:18:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.238e-06 2023-01-02T18:18:31.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896889+0000", 2023-01-02T18:18:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002707919 2023-01-02T18:18:31.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899597+0000", 2023-01-02T18:18:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2546000000000002e-05 2023-01-02T18:18:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899639+0000", 2023-01-02T18:18:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4080999999999996e-05 2023-01-02T18:18:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899733+0000", 2023-01-02T18:18:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001771826 2023-01-02T18:18:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901505+0000", 2023-01-02T18:18:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6619999999999994e-06 2023-01-02T18:18:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901514+0000", 2023-01-02T18:18:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0059999999999998e-05 2023-01-02T18:18:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901564+0000", 2023-01-02T18:18:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1318e-05 2023-01-02T18:18:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901605+0000", 2023-01-02T18:18:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004 2023-01-02T18:18:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16200 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2560~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3958827450000002, 2023-01-02T18:18:31.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998, 2023-01-02T18:18:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.450 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16200 2023-01-02T18:18:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0820000000000001e-06 2023-01-02T18:18:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896893+0000", 2023-01-02T18:18:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8679999999999999e-06 2023-01-02T18:18:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896896+0000", 2023-01-02T18:18:31.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1390000000000002e-06 2023-01-02T18:18:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896898+0000", 2023-01-02T18:18:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032553590000000002 2023-01-02T18:18:31.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900153+0000", 2023-01-02T18:18:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8237000000000003e-05 2023-01-02T18:18:31.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900232+0000", 2023-01-02T18:18:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018062300000000001 2023-01-02T18:18:31.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900412+0000", 2023-01-02T18:18:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012047169999999999 2023-01-02T18:18:31.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901617+0000", 2023-01-02T18:18:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042531099999999999 2023-01-02T18:18:31.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902042+0000", 2023-01-02T18:18:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1499000000000003e-05 2023-01-02T18:18:31.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902094+0000", 2023-01-02T18:18:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9249000000000003e-05 2023-01-02T18:18:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902133+0000", 2023-01-02T18:18:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998 2023-01-02T18:18:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.463 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16201 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.464 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3958738610000001, 2023-01-02T18:18:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004, 2023-01-02T18:18:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.465 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16201 2023-01-02T18:18:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4200000000000001e-06 2023-01-02T18:18:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896902+0000", 2023-01-02T18:18:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8849999999999999e-06 2023-01-02T18:18:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896905+0000", 2023-01-02T18:18:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2500000000000001e-06 2023-01-02T18:18:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896907+0000", 2023-01-02T18:18:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038386549999999998 2023-01-02T18:18:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900746+0000", 2023-01-02T18:18:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8287000000000004e-05 2023-01-02T18:18:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900834+0000", 2023-01-02T18:18:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016278899999999999 2023-01-02T18:18:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900997+0000", 2023-01-02T18:18:31.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011903720000000001 2023-01-02T18:18:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902187+0000", 2023-01-02T18:18:31.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634200000000004 2023-01-02T18:18:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902704+0000", 2023-01-02T18:18:31.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.957e-05 2023-01-02T18:18:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902733+0000", 2023-01-02T18:18:31.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4341e-05 2023-01-02T18:18:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902758+0000", 2023-01-02T18:18:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004 2023-01-02T18:18:31.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.479 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16202 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3958644439999999, 2023-01-02T18:18:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001, 2023-01-02T18:18:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.480 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16202 2023-01-02T18:18:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.481 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.092e-06 2023-01-02T18:18:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896911+0000", 2023-01-02T18:18:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1019999999999999e-06 2023-01-02T18:18:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896915+0000", 2023-01-02T18:18:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7930000000000002e-06 2023-01-02T18:18:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896918+0000", 2023-01-02T18:18:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047231770000000003 2023-01-02T18:18:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901641+0000", 2023-01-02T18:18:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2209000000000002e-05 2023-01-02T18:18:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901684+0000", 2023-01-02T18:18:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104726 2023-01-02T18:18:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901788+0000", 2023-01-02T18:18:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015539740000000001 2023-01-02T18:18:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903342+0000", 2023-01-02T18:18:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1817999999999998e-05 2023-01-02T18:18:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903394+0000", 2023-01-02T18:18:31.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8734999999999998e-05 2023-01-02T18:18:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903423+0000", 2023-01-02T18:18:31.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9155000000000001e-05 2023-01-02T18:18:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903452+0000", 2023-01-02T18:18:31.493 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001 2023-01-02T18:18:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16203 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3958533499999999, 2023-01-02T18:18:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998, 2023-01-02T18:18:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.495 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16203 2023-01-02T18:18:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.496 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896920+0000", 2023-01-02T18:18:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1600000000000001e-06 2023-01-02T18:18:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896922+0000", 2023-01-02T18:18:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5219999999999999e-06 2023-01-02T18:18:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896926+0000", 2023-01-02T18:18:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9470000000000002e-06 2023-01-02T18:18:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896928+0000", 2023-01-02T18:18:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052862669999999999 2023-01-02T18:18:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902214+0000", 2023-01-02T18:18:31.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3084999999999994e-05 2023-01-02T18:18:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902307+0000", 2023-01-02T18:18:31.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013711100000000001 2023-01-02T18:18:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902444+0000", 2023-01-02T18:18:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090387900000000001 2023-01-02T18:18:31.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903348+0000", 2023-01-02T18:18:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015428300000000001 2023-01-02T18:18:31.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903503+0000", 2023-01-02T18:18:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7078999999999999e-05 2023-01-02T18:18:31.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903530+0000", 2023-01-02T18:18:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9266000000000002e-05 2023-01-02T18:18:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903549+0000", 2023-01-02T18:18:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998 2023-01-02T18:18:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.508 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16204 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:31.509 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3958439010000001, 2023-01-02T18:18:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996, 2023-01-02T18:18:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.510 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16204 2023-01-02T18:18:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1679999999999997e-06 2023-01-02T18:18:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896934+0000", 2023-01-02T18:18:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.039e-06 2023-01-02T18:18:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896937+0000", 2023-01-02T18:18:31.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0389999999999999e-06 2023-01-02T18:18:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896939+0000", 2023-01-02T18:18:31.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058543179999999998 2023-01-02T18:18:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902793+0000", 2023-01-02T18:18:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5451999999999996e-05 2023-01-02T18:18:31.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902859+0000", 2023-01-02T18:18:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5087999999999996e-05 2023-01-02T18:18:31.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902944+0000", 2023-01-02T18:18:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086757900000000005 2023-01-02T18:18:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903811+0000", 2023-01-02T18:18:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9238000000000002e-05 2023-01-02T18:18:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903901+0000", 2023-01-02T18:18:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0630000000000001e-05 2023-01-02T18:18:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903951+0000", 2023-01-02T18:18:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6187999999999998e-05 2023-01-02T18:18:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904007+0000", 2023-01-02T18:18:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996 2023-01-02T18:18:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16205 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 0~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e140)", 2023-01-02T18:18:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:31.524 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.3931008820000002, 2023-01-02T18:18:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868, 2023-01-02T18:18:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.525 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16205 2023-01-02T18:18:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899672+0000", 2023-01-02T18:18:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2650000000000004e-06 2023-01-02T18:18:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899677+0000", 2023-01-02T18:18:31.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1850000000000004e-06 2023-01-02T18:18:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899686+0000", 2023-01-02T18:18:31.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4259999999999996e-06 2023-01-02T18:18:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899690+0000", 2023-01-02T18:18:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576512 2023-01-02T18:18:31.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903266+0000", 2023-01-02T18:18:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5141000000000005e-05 2023-01-02T18:18:31.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903332+0000", 2023-01-02T18:18:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070156899999999998 2023-01-02T18:18:31.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904033+0000", 2023-01-02T18:18:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0550000000000003e-05 2023-01-02T18:18:31.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904074+0000", 2023-01-02T18:18:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7970000000000001e-05 2023-01-02T18:18:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.535 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904142+0000", 2023-01-02T18:18:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868 2023-01-02T18:18:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.536 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16266 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 5632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e141)", 2023-01-02T18:18:31.537 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 3.356082346, 2023-01-02T18:18:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034084089999999998, 2023-01-02T18:18:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:31.538 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16266 2023-01-02T18:18:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936690+0000", 2023-01-02T18:18:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0029e-05 2023-01-02T18:18:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936700+0000", 2023-01-02T18:18:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7252999999999999e-05 2023-01-02T18:18:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936717+0000", 2023-01-02T18:18:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2790000000000001e-06 2023-01-02T18:18:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936724+0000", 2023-01-02T18:18:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4746999999999997e-05 2023-01-02T18:18:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936769+0000", 2023-01-02T18:18:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4490000000000002e-06 2023-01-02T18:18:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936776+0000", 2023-01-02T18:18:31.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003181367 2023-01-02T18:18:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.939958+0000", 2023-01-02T18:18:31.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8536999999999998e-05 2023-01-02T18:18:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.940026+0000", 2023-01-02T18:18:31.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3569e-05 2023-01-02T18:18:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.940100+0000", 2023-01-02T18:18:31.549 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034084089999999998 2023-01-02T18:18:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.550 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28602 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 146432~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e143)", 2023-01-02T18:18:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.35511647899999998, 2023-01-02T18:18:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996, 2023-01-02T18:18:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:31.551 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28602 2023-01-02T18:18:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.552 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937656+0000", 2023-01-02T18:18:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3520000000000003e-06 2023-01-02T18:18:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937663+0000", 2023-01-02T18:18:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4744e-05 2023-01-02T18:18:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937677+0000", 2023-01-02T18:18:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5119999999999997e-06 2023-01-02T18:18:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937684+0000", 2023-01-02T18:18:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2098999999999997e-05 2023-01-02T18:18:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937736+0000", 2023-01-02T18:18:31.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:18:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937745+0000", 2023-01-02T18:18:31.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073198109999999999 2023-01-02T18:18:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945065+0000", 2023-01-02T18:18:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1624000000000002e-05 2023-01-02T18:18:31.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945156+0000", 2023-01-02T18:18:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123879 2023-01-02T18:18:31.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945280+0000", 2023-01-02T18:18:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996 2023-01-02T18:18:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.562 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28808 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [assert-version v64,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:18:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:31.563 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.27993820000000003, 2023-01-02T18:18:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002, 2023-01-02T18:18:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:31.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28808 2023-01-02T18:18:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.565 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012835+0000", 2023-01-02T18:18:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0229999999999998e-06 2023-01-02T18:18:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012841+0000", 2023-01-02T18:18:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1938e-05 2023-01-02T18:18:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:31.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012853+0000", 2023-01-02T18:18:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5520000000000004e-06 2023-01-02T18:18:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:31.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012858+0000", 2023-01-02T18:18:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9961999999999999e-05 2023-01-02T18:18:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:31.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012888+0000", 2023-01-02T18:18:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2904e-05 2023-01-02T18:18:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012941+0000", 2023-01-02T18:18:31.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016403699999999999 2023-01-02T18:18:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013105+0000", 2023-01-02T18:18:31.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074456399999999997 2023-01-02T18:18:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013850+0000", 2023-01-02T18:18:31.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027539999999999999 2023-01-02T18:18:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016604+0000", 2023-01-02T18:18:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4141999999999999e-05 2023-01-02T18:18:31.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016638+0000", 2023-01-02T18:18:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7827000000000002e-05 2023-01-02T18:18:31.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016676+0000", 2023-01-02T18:18:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002 2023-01-02T18:18:31.577 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:31.578 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:31.578 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:31.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:31.580 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:31.580+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:31.681 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:31.681+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:31.746 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:31.746 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:31.746 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:31.747 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:31.756 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:31.782 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:31.782+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:31.881 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:31.881 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:31.881 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:31.882 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:31.882 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:31.883 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:31.884+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:31.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:31.984 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:31.985+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:32.019 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:32.019 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:32.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:32.020 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:32.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.020 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:32.020 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:32.020 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 103.69002007100001, 2023-01-02T18:18:32.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:32.021 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.021 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.021 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:32.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:32.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:32.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:32.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:32.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:32.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:32.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:32.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:32.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:32.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:32.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:32.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:32.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:32.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:32.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:32.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:32.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:32.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.031 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.031 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.032 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2681 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e78)", 2023-01-02T18:18:32.032 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:32.032 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.385066346000002, 2023-01-02T18:18:32.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999, 2023-01-02T18:18:32.032 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.033 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:32.033 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.033 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.033 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.034 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2681 2023-01-02T18:18:32.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.034 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:32.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633481+0000", 2023-01-02T18:18:32.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:32.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633479+0000", 2023-01-02T18:18:32.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2839999999999995e-06 2023-01-02T18:18:32.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633489+0000", 2023-01-02T18:18:32.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6920999999999999e-05 2023-01-02T18:18:32.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633506+0000", 2023-01-02T18:18:32.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0859999999999998e-06 2023-01-02T18:18:32.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633512+0000", 2023-01-02T18:18:32.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3940000000000002e-05 2023-01-02T18:18:32.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633566+0000", 2023-01-02T18:18:32.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:32.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:32.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.633575+0000", 2023-01-02T18:18:32.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023765520000000001 2023-01-02T18:18:32.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.635951+0000", 2023-01-02T18:18:32.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7255999999999994e-05 2023-01-02T18:18:32.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636029+0000", 2023-01-02T18:18:32.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000105293 2023-01-02T18:18:32.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:11.636134+0000", 2023-01-02T18:18:32.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026525939999999999 2023-01-02T18:18:32.045 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.045 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.045 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.046 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:32.046 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:32.046 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.680524676000005, 2023-01-02T18:18:32.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:32.046 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:32.047 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.047 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.047 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.047 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:32.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.048 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:32.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:32.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:32.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:32.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:32.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:32.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:32.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:32.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:32.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:32.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:32.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:32.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:32.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:32.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:32.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:32.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:32.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:32.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:32.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:32.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:32.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:32.058 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.058 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.059 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.059 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:32.059 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:32.059 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.667467084999998, 2023-01-02T18:18:32.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:32.060 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.060 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:32.060 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.060 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:32.060 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:32.061 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:32.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.061 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:32.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:32.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:32.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:32.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:32.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:32.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:32.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:32.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:32.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:32.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:32.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:32.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:32.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:32.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:32.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:32.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:32.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:32.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:32.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:32.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:32.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:32.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.072 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.072 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.073 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:32.073 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:32.073 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 70.657391855, 2023-01-02T18:18:32.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:32.073 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.074 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.074 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.074 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:32.074 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:32.074 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:32.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.075 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:32.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:32.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:32.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:32.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:32.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:32.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:32.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:32.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:32.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:32.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:32.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:32.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:32.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:32.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:32.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:32.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:32.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:32.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:32.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:32.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:32.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:32.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:32.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:32.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:32.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:32.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:32.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:32.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:32.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:32.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:32.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:32.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:32.089 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.089 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.090 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.090 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:32.090 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:32.090 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.694242071000005, 2023-01-02T18:18:32.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:32.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:32.091 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.091 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:32.092 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:32.092 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:32.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.092 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:32.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:32.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:32.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:32.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:32.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:32.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:32.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:32.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:32.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:32.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:32.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:32.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:32.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:32.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:32.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:32.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:32.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:32.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:32.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:32.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:32.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:32.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.103 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.103 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.104 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:32.104 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:32.104 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.688945381000003, 2023-01-02T18:18:32.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:32.105 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.105 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.105 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:32.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:32.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:32.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:32.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:32.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:32.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:32.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:32.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:32.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:32.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:32.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:32.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:32.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:32.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:32.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:32.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:32.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:32.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:32.115 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.115 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.115 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.116 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:32.116 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:32.116 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 47.636496563000001, 2023-01-02T18:18:32.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:32.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.117 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.117 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:32.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:32.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:32.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:32.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:32.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:32.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:32.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:32.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:32.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:32.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:32.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:32.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:32.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:32.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:32.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:32.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:32.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:32.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:32.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.127 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.127 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.127 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:32.128 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:32.128 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 46.629015674999998, 2023-01-02T18:18:32.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:32.128 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.128 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.129 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:32.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:32.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:32.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:32.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:32.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:32.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:32.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:32.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:32.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:32.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:32.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:32.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:32.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:32.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:32.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:32.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:32.138 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.138 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.138 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.139 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:32.139 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:32.139 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.581363019999998, 2023-01-02T18:18:32.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:32.140 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.140 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:32.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:32.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:32.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:32.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:32.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:32.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:32.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:32.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:32.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:32.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:32.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:32.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:32.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:32.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:32.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:32.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:32.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:32.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:32.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.150 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.150 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.151 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:32.151 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:32.151 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.576990442000003, 2023-01-02T18:18:32.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:32.151 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.152 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.152 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:32.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:32.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:32.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:32.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:32.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:32.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:32.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:32.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:32.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.157 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:32.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:32.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:32.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:32.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:32.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:32.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:32.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:32.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:32.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:32.161 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.161 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.162 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.162 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:32.162 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:32.163 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.285681314000001, 2023-01-02T18:18:32.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:32.163 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.163 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.163 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:32.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:32.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:32.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:32.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:32.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:32.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:32.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:32.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:32.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:32.169 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.169 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.169 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:32.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:32.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.170 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.170 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:32.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:32.171 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:32.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:32.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:32.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:32.173 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.173 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.173 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.174 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3493 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e127)", 2023-01-02T18:18:32.174 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:32.174 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.176883988, 2023-01-02T18:18:32.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998, 2023-01-02T18:18:32.175 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.175 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.175 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.175 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.175 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.176 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3493 2023-01-02T18:18:32.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.176 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:32.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:32.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:32.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841661+0000", 2023-01-02T18:18:32.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8811999999999999e-05 2023-01-02T18:18:32.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841680+0000", 2023-01-02T18:18:32.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9380000000000001e-05 2023-01-02T18:18:32.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841699+0000", 2023-01-02T18:18:32.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:32.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841709+0000", 2023-01-02T18:18:32.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010059 2023-01-02T18:18:32.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841809+0000", 2023-01-02T18:18:32.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3533e-05 2023-01-02T18:18:32.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841903+0000", 2023-01-02T18:18:32.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036800899999999998 2023-01-02T18:18:32.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:32.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842271+0000", 2023-01-02T18:18:32.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033624560000000002 2023-01-02T18:18:32.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:32.185 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845633+0000", 2023-01-02T18:18:32.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020175099999999999 2023-01-02T18:18:32.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:32.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845835+0000", 2023-01-02T18:18:32.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1019999999999998e-05 2023-01-02T18:18:32.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845866+0000", 2023-01-02T18:18:32.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7328999999999999e-05 2023-01-02T18:18:32.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845893+0000", 2023-01-02T18:18:32.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998 2023-01-02T18:18:32.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.188 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.189 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.189 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3494 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e128)", 2023-01-02T18:18:32.189 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:32.190 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.172354680000002, 2023-01-02T18:18:32.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999, 2023-01-02T18:18:32.190 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.190 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.190 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.191 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.191 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.191 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3494 2023-01-02T18:18:32.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.191 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:32.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:32.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:32.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846191+0000", 2023-01-02T18:18:32.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4089e-05 2023-01-02T18:18:32.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846205+0000", 2023-01-02T18:18:32.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8082000000000001e-05 2023-01-02T18:18:32.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846223+0000", 2023-01-02T18:18:32.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2023-01-02T18:18:32.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846231+0000", 2023-01-02T18:18:32.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100853 2023-01-02T18:18:32.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846332+0000", 2023-01-02T18:18:32.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4294000000000004e-05 2023-01-02T18:18:32.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846406+0000", 2023-01-02T18:18:32.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000381035 2023-01-02T18:18:32.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:32.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846787+0000", 2023-01-02T18:18:32.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029262089999999999 2023-01-02T18:18:32.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:32.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849713+0000", 2023-01-02T18:18:32.201 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022129699999999999 2023-01-02T18:18:32.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.201 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:32.201 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849934+0000", 2023-01-02T18:18:32.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6384000000000003e-05 2023-01-02T18:18:32.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.202 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849971+0000", 2023-01-02T18:18:32.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9811e-05 2023-01-02T18:18:32.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.850001+0000", 2023-01-02T18:18:32.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999 2023-01-02T18:18:32.204 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.204 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.204 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.205 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3500 13.1c e131/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 131'3, mlcod=130'1)", 2023-01-02T18:18:32.205 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:32.205 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.146386888999999, 2023-01-02T18:18:32.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999, 2023-01-02T18:18:32.205 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.206 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.206 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:32.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:32.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872160+0000", 2023-01-02T18:18:32.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022329899999999998 2023-01-02T18:18:32.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874393+0000", 2023-01-02T18:18:32.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.252e-05 2023-01-02T18:18:32.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874406+0000", 2023-01-02T18:18:32.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0240000000000003e-06 2023-01-02T18:18:32.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874415+0000", 2023-01-02T18:18:32.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0895000000000005e-05 2023-01-02T18:18:32.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874486+0000", 2023-01-02T18:18:32.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4266e-05 2023-01-02T18:18:32.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874520+0000", 2023-01-02T18:18:32.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023338909999999998 2023-01-02T18:18:32.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876854+0000", 2023-01-02T18:18:32.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3161000000000001e-05 2023-01-02T18:18:32.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876907+0000", 2023-01-02T18:18:32.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999 2023-01-02T18:18:32.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.216 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.216 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.217 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3501 13.1c e132/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 132'4, mlcod=130'2)", 2023-01-02T18:18:32.217 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:32.217 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.139956574999999, 2023-01-02T18:18:32.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001, 2023-01-02T18:18:32.217 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.217 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.218 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:32.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:32.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:32.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878589+0000", 2023-01-02T18:18:32.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011789120000000001 2023-01-02T18:18:32.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879768+0000", 2023-01-02T18:18:32.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6392000000000002e-05 2023-01-02T18:18:32.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879785+0000", 2023-01-02T18:18:32.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3309999999999998e-06 2023-01-02T18:18:32.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879792+0000", 2023-01-02T18:18:32.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4100000000000001e-05 2023-01-02T18:18:32.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879836+0000", 2023-01-02T18:18:32.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1690000000000001e-05 2023-01-02T18:18:32.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879858+0000", 2023-01-02T18:18:32.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001682692 2023-01-02T18:18:32.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881541+0000", 2023-01-02T18:18:32.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7658999999999999e-05 2023-01-02T18:18:32.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881588+0000", 2023-01-02T18:18:32.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001 2023-01-02T18:18:32.227 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.227 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.228 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3510 13.10 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:18:32.228 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:32.229 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.107405023, 2023-01-02T18:18:32.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999, 2023-01-02T18:18:32.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3510 2023-01-02T18:18:32.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.230 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:32.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:32.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:32.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911139+0000", 2023-01-02T18:18:32.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9587000000000001e-05 2023-01-02T18:18:32.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911159+0000", 2023-01-02T18:18:32.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2842000000000002e-05 2023-01-02T18:18:32.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911192+0000", 2023-01-02T18:18:32.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5116999999999999e-05 2023-01-02T18:18:32.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911207+0000", 2023-01-02T18:18:32.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000120098 2023-01-02T18:18:32.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911327+0000", 2023-01-02T18:18:32.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.536e-06 2023-01-02T18:18:32.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:32.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911332+0000", 2023-01-02T18:18:32.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025961489999999999 2023-01-02T18:18:32.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.913928+0000", 2023-01-02T18:18:32.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016713700000000001 2023-01-02T18:18:32.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914096+0000", 2023-01-02T18:18:32.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044610400000000001 2023-01-02T18:18:32.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:32.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914542+0000", 2023-01-02T18:18:32.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027693449999999999 2023-01-02T18:18:32.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:32.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917311+0000", 2023-01-02T18:18:32.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079338599999999998 2023-01-02T18:18:32.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:32.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918104+0000", 2023-01-02T18:18:32.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8297000000000003e-05 2023-01-02T18:18:32.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918143+0000", 2023-01-02T18:18:32.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7084e-05 2023-01-02T18:18:32.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918170+0000", 2023-01-02T18:18:32.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999 2023-01-02T18:18:32.245 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.245 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.245 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.246 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16265 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 5632~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e141)", 2023-01-02T18:18:32.246 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:32.246 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.0875624400000001, 2023-01-02T18:18:32.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055750219999999998, 2023-01-02T18:18:32.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.247 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:18:32.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.247 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.248 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.248 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16265 2023-01-02T18:18:32.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.248 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:32.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:32.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:32.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930984+0000", 2023-01-02T18:18:32.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:18:32.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930991+0000", 2023-01-02T18:18:32.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4295e-05 2023-01-02T18:18:32.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931005+0000", 2023-01-02T18:18:32.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4080000000000001e-06 2023-01-02T18:18:32.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931013+0000", 2023-01-02T18:18:32.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051094699999999999 2023-01-02T18:18:32.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931524+0000", 2023-01-02T18:18:32.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2660000000000001e-06 2023-01-02T18:18:32.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:32.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931532+0000", 2023-01-02T18:18:32.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049429119999999998 2023-01-02T18:18:32.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936475+0000", 2023-01-02T18:18:32.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5248999999999996e-05 2023-01-02T18:18:32.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936560+0000", 2023-01-02T18:18:32.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055750219999999998 2023-01-02T18:18:32.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.258 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.259 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:28804 3.1a e143/124 3:5dc8c609:::rbd_data.12a211eeb54d.0000000000000007:head v 143'6, mlcod=0'0)", 2023-01-02T18:18:32.259 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:32.259 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.0060048500000001, 2023-01-02T18:18:32.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039422229999999999, 2023-01-02T18:18:32.259 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.260 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.260 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:32.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:32.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:32.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:32.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2570000000000001e-06 2023-01-02T18:18:32.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012547+0000", 2023-01-02T18:18:32.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3016999999999999e-05 2023-01-02T18:18:32.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012560+0000", 2023-01-02T18:18:32.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0260000000000001e-06 2023-01-02T18:18:32.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012564+0000", 2023-01-02T18:18:32.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6282000000000003e-05 2023-01-02T18:18:32.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012600+0000", 2023-01-02T18:18:32.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4978e-05 2023-01-02T18:18:32.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012615+0000", 2023-01-02T18:18:32.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038441149999999999 2023-01-02T18:18:32.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016459+0000", 2023-01-02T18:18:32.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5772e-05 2023-01-02T18:18:32.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016485+0000", 2023-01-02T18:18:32.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039422229999999999 2023-01-02T18:18:32.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.269 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.270 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.270 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:28808 3.6 e143/43 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head v 143'65, mlcod=142'63)", 2023-01-02T18:18:32.270 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:32.270 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.005372932, 2023-01-02T18:18:32.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033349730000000002, 2023-01-02T18:18:32.271 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.271 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.271 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:32.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:32.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:32.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013174+0000", 2023-01-02T18:18:32.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:18:32.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013180+0000", 2023-01-02T18:18:32.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7759999999999992e-06 2023-01-02T18:18:32.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013190+0000", 2023-01-02T18:18:32.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1320000000000004e-06 2023-01-02T18:18:32.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013194+0000", 2023-01-02T18:18:32.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0168999999999999e-05 2023-01-02T18:18:32.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013224+0000", 2023-01-02T18:18:32.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.819e-05 2023-01-02T18:18:32.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013242+0000", 2023-01-02T18:18:32.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003244963 2023-01-02T18:18:32.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016487+0000", 2023-01-02T18:18:32.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2412000000000002e-05 2023-01-02T18:18:32.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016510+0000", 2023-01-02T18:18:32.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033349730000000002 2023-01-02T18:18:32.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.281 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.281 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.282 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.282 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.282 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:32.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:32.284 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:32.284+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:32.384 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:32.385+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:32.451 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:32.451 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:32.451 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:32.461 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:32.502 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:32.503+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:32.587 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:32.588+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:32.626 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:32.626 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:32.626 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:32.627 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:32.627 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:32.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:32.687 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:32.688+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:32.788 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:32.789+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:32.803 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:32.803 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:404 6.12 e60/57 6:4936286e:::rbd_id.image22:head v 60'1, mlcod=0'0)", 2023-01-02T18:18:32.804 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 99.453149173, 2023-01-02T18:18:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656, 2023-01-02T18:18:32.805 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349411+0000", 2023-01-02T18:18:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349410+0000", 2023-01-02T18:18:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8739999999999995e-06 2023-01-02T18:18:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349418+0000", 2023-01-02T18:18:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2149e-05 2023-01-02T18:18:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349430+0000", 2023-01-02T18:18:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2789000000000001e-05 2023-01-02T18:18:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349443+0000", 2023-01-02T18:18:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000125079 2023-01-02T18:18:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349568+0000", 2023-01-02T18:18:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9395e-05 2023-01-02T18:18:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.349587+0000", 2023-01-02T18:18:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014468899999999999 2023-01-02T18:18:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351034+0000", 2023-01-02T18:18:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.834e-05 2023-01-02T18:18:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:53.351063+0000", 2023-01-02T18:18:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001651656 2023-01-02T18:18:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:370 7.1b e64/61 7:da80f00d:::rbd_id.image25:head v 64'1, mlcod=0'0)", 2023-01-02T18:18:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 95.486321289000003, 2023-01-02T18:18:32.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001, 2023-01-02T18:18:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316239+0000", 2023-01-02T18:18:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0769999999999996e-06 2023-01-02T18:18:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316245+0000", 2023-01-02T18:18:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0739e-05 2023-01-02T18:18:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316255+0000", 2023-01-02T18:18:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7574000000000001e-05 2023-01-02T18:18:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316273+0000", 2023-01-02T18:18:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8909999999999997e-05 2023-01-02T18:18:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316332+0000", 2023-01-02T18:18:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9429999999999999e-05 2023-01-02T18:18:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.316351+0000", 2023-01-02T18:18:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097116800000000001 2023-01-02T18:18:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317322+0000", 2023-01-02T18:18:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4377e-05 2023-01-02T18:18:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:57.317357+0000", 2023-01-02T18:18:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011179530000000001 2023-01-02T18:18:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1231 8.1b e68/65 8:d8cae014:::rbd_id.image28:head v 68'1, mlcod=0'0)", 2023-01-02T18:18:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 91.478831041999996, 2023-01-02T18:18:32.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001, 2023-01-02T18:18:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323729+0000", 2023-01-02T18:18:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3330000000000002e-06 2023-01-02T18:18:32.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323735+0000", 2023-01-02T18:18:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6569999999999999e-05 2023-01-02T18:18:32.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323752+0000", 2023-01-02T18:18:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1060000000000006e-06 2023-01-02T18:18:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323761+0000", 2023-01-02T18:18:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4122999999999998e-05 2023-01-02T18:18:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323805+0000", 2023-01-02T18:18:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0866e-05 2023-01-02T18:18:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.323826+0000", 2023-01-02T18:18:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088031600000000002 2023-01-02T18:18:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324706+0000", 2023-01-02T18:18:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4709000000000003e-05 2023-01-02T18:18:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.324741+0000", 2023-01-02T18:18:32.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010117660000000001 2023-01-02T18:18:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:1232 8.1b e68/65 8:debe2b3d:::rbd_header.12a230fb06bc:head v 68'2, mlcod=0'0)", 2023-01-02T18:18:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 91.477037956999993, 2023-01-02T18:18:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001, 2023-01-02T18:18:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:32.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325522+0000", 2023-01-02T18:18:32.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325521+0000", 2023-01-02T18:18:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8620000000000003e-06 2023-01-02T18:18:32.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325529+0000", 2023-01-02T18:18:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1088e-05 2023-01-02T18:18:32.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325540+0000", 2023-01-02T18:18:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0170000000000002e-06 2023-01-02T18:18:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325546+0000", 2023-01-02T18:18:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00029381699999999998 2023-01-02T18:18:32.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325840+0000", 2023-01-02T18:18:32.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8706999999999999e-05 2023-01-02T18:18:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.325859+0000", 2023-01-02T18:18:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074887900000000004 2023-01-02T18:18:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326608+0000", 2023-01-02T18:18:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1776e-05 2023-01-02T18:18:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:01.326629+0000", 2023-01-02T18:18:32.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011071200000000001 2023-01-02T18:18:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2087 3.1a e83/54 3:5b0736ff:::rbd_object_map.11d574d0a887.000000000000000a:head v 83'4, mlcod=46'2)", 2023-01-02T18:18:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.474146613000002, 2023-01-02T18:18:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999, 2023-01-02T18:18:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.854 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:32.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328414+0000", 2023-01-02T18:18:32.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328413+0000", 2023-01-02T18:18:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4569999999999996e-06 2023-01-02T18:18:32.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328419+0000", 2023-01-02T18:18:32.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9752e-05 2023-01-02T18:18:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328438+0000", 2023-01-02T18:18:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0990000000000001e-06 2023-01-02T18:18:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328446+0000", 2023-01-02T18:18:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5516999999999998e-05 2023-01-02T18:18:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328491+0000", 2023-01-02T18:18:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1764e-05 2023-01-02T18:18:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.328513+0000", 2023-01-02T18:18:32.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088099399999999996 2023-01-02T18:18:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329394+0000", 2023-01-02T18:18:32.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7287999999999999e-05 2023-01-02T18:18:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.329441+0000", 2023-01-02T18:18:32.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010275729999999999 2023-01-02T18:18:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2209 3.0 e88/43 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head v 88'8, mlcod=46'6)", 2023-01-02T18:18:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.437865798999994, 2023-01-02T18:18:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998, 2023-01-02T18:18:32.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.867 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364694+0000", 2023-01-02T18:18:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2964e-05 2023-01-02T18:18:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364707+0000", 2023-01-02T18:18:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8479999999999999e-05 2023-01-02T18:18:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364725+0000", 2023-01-02T18:18:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.8439999999999993e-06 2023-01-02T18:18:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364735+0000", 2023-01-02T18:18:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000112848 2023-01-02T18:18:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364848+0000", 2023-01-02T18:18:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4006e-05 2023-01-02T18:18:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.364872+0000", 2023-01-02T18:18:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019719120000000001 2023-01-02T18:18:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366844+0000", 2023-01-02T18:18:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6952e-05 2023-01-02T18:18:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.366891+0000", 2023-01-02T18:18:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021966389999999998 2023-01-02T18:18:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.877 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2292 3.13 e92/54 3:ce42dc77:::rbd_id.image41:head v 92'6, mlcod=90'4)", 2023-01-02T18:18:32.878 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.462230934000004, 2023-01-02T18:18:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995, 2023-01-02T18:18:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.879 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340329+0000", 2023-01-02T18:18:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6160000000000004e-06 2023-01-02T18:18:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340334+0000", 2023-01-02T18:18:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0288e-05 2023-01-02T18:18:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340344+0000", 2023-01-02T18:18:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5799999999999997e-06 2023-01-02T18:18:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340350+0000", 2023-01-02T18:18:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0145999999999997e-05 2023-01-02T18:18:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340401+0000", 2023-01-02T18:18:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7580999999999999e-05 2023-01-02T18:18:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.340428+0000", 2023-01-02T18:18:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00082555599999999997 2023-01-02T18:18:32.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341254+0000", 2023-01-02T18:18:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9671000000000001e-05 2023-01-02T18:18:32.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.341283+0000", 2023-01-02T18:18:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00095422499999999995 2023-01-02T18:18:32.889 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.890 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2293 3.13 e92/54 3:ce472256:::rbd_header.11d54907a3eb:head v 92'7, mlcod=91'5)", 2023-01-02T18:18:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.460492084999998, 2023-01-02T18:18:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001, 2023-01-02T18:18:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.891 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342068+0000", 2023-01-02T18:18:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.893 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342067+0000", 2023-01-02T18:18:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2559999999999996e-06 2023-01-02T18:18:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342075+0000", 2023-01-02T18:18:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1301000000000001e-05 2023-01-02T18:18:32.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342086+0000", 2023-01-02T18:18:32.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3100000000000001e-06 2023-01-02T18:18:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342094+0000", 2023-01-02T18:18:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00045179699999999998 2023-01-02T18:18:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342546+0000", 2023-01-02T18:18:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4669e-05 2023-01-02T18:18:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.342561+0000", 2023-01-02T18:18:32.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053647899999999997 2023-01-02T18:18:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343097+0000", 2023-01-02T18:18:32.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2773999999999999e-05 2023-01-02T18:18:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.343120+0000", 2023-01-02T18:18:32.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0010518260000000001 2023-01-02T18:18:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:2397 3.13 e97/54 3:ce472256:::rbd_header.11d54907a3eb:head v 97'18, mlcod=95'16)", 2023-01-02T18:18:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.468166830999998, 2023-01-02T18:18:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001, 2023-01-02T18:18:32.903 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334393+0000", 2023-01-02T18:18:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6610000000000002e-06 2023-01-02T18:18:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334397+0000", 2023-01-02T18:18:32.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8639999999999996e-06 2023-01-02T18:18:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334405+0000", 2023-01-02T18:18:32.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8349999999999998e-06 2023-01-02T18:18:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334411+0000", 2023-01-02T18:18:32.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6334999999999994e-05 2023-01-02T18:18:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334478+0000", 2023-01-02T18:18:32.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4357000000000003e-05 2023-01-02T18:18:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.334512+0000", 2023-01-02T18:18:32.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00077367500000000004 2023-01-02T18:18:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335286+0000", 2023-01-02T18:18:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4969000000000003e-05 2023-01-02T18:18:32.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:30.335331+0000", 2023-01-02T18:18:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00093747500000000001 2023-01-02T18:18:32.913 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2821 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:32.914 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.467023988000001, 2023-01-02T18:18:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268, 2023-01-02T18:18:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.915 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335536+0000", 2023-01-02T18:18:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1059999999999996e-06 2023-01-02T18:18:32.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335542+0000", 2023-01-02T18:18:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1220000000000001e-06 2023-01-02T18:18:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335551+0000", 2023-01-02T18:18:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3369999999999996e-06 2023-01-02T18:18:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335557+0000", 2023-01-02T18:18:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6839000000000002e-05 2023-01-02T18:18:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335624+0000", 2023-01-02T18:18:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2101000000000001e-05 2023-01-02T18:18:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.335646+0000", 2023-01-02T18:18:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019780209999999999 2023-01-02T18:18:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337624+0000", 2023-01-02T18:18:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7221999999999997e-05 2023-01-02T18:18:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.337661+0000", 2023-01-02T18:18:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002125268 2023-01-02T18:18:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.925 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2826 10.5 e101/98 10:a7db2459:::rbd_id.image44:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.454470194000002, 2023-01-02T18:18:32.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999, 2023-01-02T18:18:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348090+0000", 2023-01-02T18:18:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9609999999999996e-06 2023-01-02T18:18:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348095+0000", 2023-01-02T18:18:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1348999999999999e-05 2023-01-02T18:18:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348106+0000", 2023-01-02T18:18:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.61e-06 2023-01-02T18:18:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348113+0000", 2023-01-02T18:18:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00030726899999999999 2023-01-02T18:18:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348421+0000", 2023-01-02T18:18:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3232000000000003e-05 2023-01-02T18:18:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.348454+0000", 2023-01-02T18:18:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00097845700000000007 2023-01-02T18:18:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349432+0000", 2023-01-02T18:18:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6525e-05 2023-01-02T18:18:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.349469+0000", 2023-01-02T18:18:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0013789989999999999 2023-01-02T18:18:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.937 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2843 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'2, mlcod=0'0)", 2023-01-02T18:18:32.938 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.437067884999998, 2023-01-02T18:18:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513, 2023-01-02T18:18:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.939 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:32.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365492+0000", 2023-01-02T18:18:32.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365490+0000", 2023-01-02T18:18:32.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5902000000000001e-05 2023-01-02T18:18:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365506+0000", 2023-01-02T18:18:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1333000000000001e-05 2023-01-02T18:18:32.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365528+0000", 2023-01-02T18:18:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9050000000000003e-06 2023-01-02T18:18:32.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365537+0000", 2023-01-02T18:18:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0773000000000002e-05 2023-01-02T18:18:32.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365597+0000", 2023-01-02T18:18:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0394000000000001e-05 2023-01-02T18:18:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.365628+0000", 2023-01-02T18:18:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00081135300000000001 2023-01-02T18:18:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366439+0000", 2023-01-02T18:18:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0748000000000003e-05 2023-01-02T18:18:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.366490+0000", 2023-01-02T18:18:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000997513 2023-01-02T18:18:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.949 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2915 10.3 e101/98 10:c1d27dae:::rbd_header.12a2b7acd9c1:head v 101'17, mlcod=101'15)", 2023-01-02T18:18:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:32.950 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.387014338999997, 2023-01-02T18:18:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269, 2023-01-02T18:18:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415546+0000", 2023-01-02T18:18:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415545+0000", 2023-01-02T18:18:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.6450000000000005e-06 2023-01-02T18:18:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415552+0000", 2023-01-02T18:18:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3585e-05 2023-01-02T18:18:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415566+0000", 2023-01-02T18:18:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7719999999999997e-06 2023-01-02T18:18:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415573+0000", 2023-01-02T18:18:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5351000000000001e-05 2023-01-02T18:18:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415608+0000", 2023-01-02T18:18:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1118e-05 2023-01-02T18:18:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.415629+0000", 2023-01-02T18:18:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001821593 2023-01-02T18:18:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417451+0000", 2023-01-02T18:18:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1332999999999999e-05 2023-01-02T18:18:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.417492+0000", 2023-01-02T18:18:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001946269 2023-01-02T18:18:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3346 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e115)", 2023-01-02T18:18:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.36635656, 2023-01-02T18:18:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998, 2023-01-02T18:18:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.963 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3346 2023-01-02T18:18:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436204+0000", 2023-01-02T18:18:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436201+0000", 2023-01-02T18:18:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7507999999999999e-05 2023-01-02T18:18:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436218+0000", 2023-01-02T18:18:32.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2589999999999999e-05 2023-01-02T18:18:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436241+0000", 2023-01-02T18:18:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.3899999999999993e-06 2023-01-02T18:18:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436249+0000", 2023-01-02T18:18:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8639000000000003e-05 2023-01-02T18:18:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436338+0000", 2023-01-02T18:18:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000113618 2023-01-02T18:18:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436451+0000", 2023-01-02T18:18:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00035813199999999999 2023-01-02T18:18:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:32.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.436810+0000", 2023-01-02T18:18:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032909049999999998 2023-01-02T18:18:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:32.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440100+0000", 2023-01-02T18:18:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00023258999999999999 2023-01-02T18:18:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:32.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440333+0000", 2023-01-02T18:18:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6143999999999998e-05 2023-01-02T18:18:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440369+0000", 2023-01-02T18:18:32.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0015999999999999e-05 2023-01-02T18:18:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440399+0000", 2023-01-02T18:18:32.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0041956429999999998 2023-01-02T18:18:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.977 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3347 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e116)", 2023-01-02T18:18:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.361858609000002, 2023-01-02T18:18:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004, 2023-01-02T18:18:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.978 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3347 2023-01-02T18:18:32.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:32.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440702+0000", 2023-01-02T18:18:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440699+0000", 2023-01-02T18:18:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5150000000000001e-05 2023-01-02T18:18:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440724+0000", 2023-01-02T18:18:32.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2691e-05 2023-01-02T18:18:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440747+0000", 2023-01-02T18:18:32.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9449999999999999e-06 2023-01-02T18:18:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440756+0000", 2023-01-02T18:18:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0661999999999997e-05 2023-01-02T18:18:32.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440807+0000", 2023-01-02T18:18:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4629999999999996e-05 2023-01-02T18:18:32.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.440871+0000", 2023-01-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034606300000000002 2023-01-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441217+0000", 2023-01-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031920429999999999 2023-01-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444409+0000", 2023-01-02T18:18:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00032486499999999997 2023-01-02T18:18:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444734+0000", 2023-01-02T18:18:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5741000000000002e-05 2023-01-02T18:18:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444770+0000", 2023-01-02T18:18:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7988e-05 2023-01-02T18:18:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444798+0000", 2023-01-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0040963680000000004 2023-01-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.992 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3438 11.15 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:32.993 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.269611021999999, 2023-01-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158, 2023-01-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:32.994 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3438 2023-01-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532949+0000", 2023-01-02T18:18:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532948+0000", 2023-01-02T18:18:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:18:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532956+0000", 2023-01-02T18:18:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3448999999999999e-05 2023-01-02T18:18:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:32.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532969+0000", 2023-01-02T18:18:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4170000000000003e-06 2023-01-02T18:18:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.532977+0000", 2023-01-02T18:18:33.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5679000000000001e-05 2023-01-02T18:18:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:33.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533023+0000", 2023-01-02T18:18:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7544999999999999e-05 2023-01-02T18:18:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533080+0000", 2023-01-02T18:18:33.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8567999999999997e-05 2023-01-02T18:18:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.533159+0000", 2023-01-02T18:18:33.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018926119999999999 2023-01-02T18:18:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535051+0000", 2023-01-02T18:18:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088907299999999999 2023-01-02T18:18:33.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535940+0000", 2023-01-02T18:18:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7307e-05 2023-01-02T18:18:33.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.535988+0000", 2023-01-02T18:18:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5602e-05 2023-01-02T18:18:33.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:55.536013+0000", 2023-01-02T18:18:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003064158 2023-01-02T18:18:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.007 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3460 13.1a 13:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e122)", 2023-01-02T18:18:33.008 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.070631888999998, 2023-01-02T18:18:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004, 2023-01-02T18:18:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:33.009 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3460 2023-01-02T18:18:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:33.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731928+0000", 2023-01-02T18:18:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731925+0000", 2023-01-02T18:18:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.447e-05 2023-01-02T18:18:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731940+0000", 2023-01-02T18:18:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4263e-05 2023-01-02T18:18:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731954+0000", 2023-01-02T18:18:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6684000000000002e-05 2023-01-02T18:18:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.731971+0000", 2023-01-02T18:18:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1316999999999996e-05 2023-01-02T18:18:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:33.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732032+0000", 2023-01-02T18:18:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012202200000000001 2023-01-02T18:18:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:33.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732154+0000", 2023-01-02T18:18:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015345800000000001 2023-01-02T18:18:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:33.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732308+0000", 2023-01-02T18:18:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003479481 2023-01-02T18:18:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:33.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735787+0000", 2023-01-02T18:18:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00087823000000000003 2023-01-02T18:18:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736665+0000", 2023-01-02T18:18:33.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7332000000000001e-05 2023-01-02T18:18:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736703+0000", 2023-01-02T18:18:33.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1186999999999998e-05 2023-01-02T18:18:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.736734+0000", 2023-01-02T18:18:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048056160000000004 2023-01-02T18:18:33.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.023 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3493 13.10 e128/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 128'2, mlcod=0'0)", 2023-01-02T18:18:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.959922748, 2023-01-02T18:18:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999, 2023-01-02T18:18:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:33.024 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:33.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:33.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842637+0000", 2023-01-02T18:18:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050436299999999997 2023-01-02T18:18:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843141+0000", 2023-01-02T18:18:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2051e-05 2023-01-02T18:18:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843153+0000", 2023-01-02T18:18:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.558e-06 2023-01-02T18:18:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843159+0000", 2023-01-02T18:18:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1963000000000003e-05 2023-01-02T18:18:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843221+0000", 2023-01-02T18:18:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6831000000000001e-05 2023-01-02T18:18:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:33.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.843248+0000", 2023-01-02T18:18:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024489630000000002 2023-01-02T18:18:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:33.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845697+0000", 2023-01-02T18:18:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3207999999999998e-05 2023-01-02T18:18:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845730+0000", 2023-01-02T18:18:33.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030925779999999999 2023-01-02T18:18:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3494 13.10 e129/120 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head v 129'3, mlcod=127'1)", 2023-01-02T18:18:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.955393174000001, 2023-01-02T18:18:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998, 2023-01-02T18:18:33.035 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:33.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:33.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847167+0000", 2023-01-02T18:18:33.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047132700000000001 2023-01-02T18:18:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847638+0000", 2023-01-02T18:18:33.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6300999999999999e-05 2023-01-02T18:18:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847654+0000", 2023-01-02T18:18:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1022999999999999e-05 2023-01-02T18:18:33.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847665+0000", 2023-01-02T18:18:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1383999999999994e-05 2023-01-02T18:18:33.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847727+0000", 2023-01-02T18:18:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7688999999999999e-05 2023-01-02T18:18:33.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.847754+0000", 2023-01-02T18:18:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002026501 2023-01-02T18:18:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849781+0000", 2023-01-02T18:18:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2506999999999997e-05 2023-01-02T18:18:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849834+0000", 2023-01-02T18:18:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0026665209999999998 2023-01-02T18:18:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.045 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3510 13.10 e135/120 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head v 135'5, mlcod=129'3)", 2023-01-02T18:18:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:33.046 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.887468196, 2023-01-02T18:18:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028970319999999999, 2023-01-02T18:18:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:33.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915092+0000", 2023-01-02T18:18:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00059833399999999995 2023-01-02T18:18:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915690+0000", 2023-01-02T18:18:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2251e-05 2023-01-02T18:18:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915702+0000", 2023-01-02T18:18:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0260000000000004e-06 2023-01-02T18:18:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:33.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915708+0000", 2023-01-02T18:18:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.9144000000000002e-05 2023-01-02T18:18:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:33.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915767+0000", 2023-01-02T18:18:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8093999999999999e-05 2023-01-02T18:18:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:33.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.915795+0000", 2023-01-02T18:18:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021551000000000001 2023-01-02T18:18:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917951+0000", 2023-01-02T18:18:33.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8435e-05 2023-01-02T18:18:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917989+0000", 2023-01-02T18:18:33.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028970319999999999 2023-01-02T18:18:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:33.057 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:33.058 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:33.058 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:18:33.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:33.060 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:33.060+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:33.061 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:33.117 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.117 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.118 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.118 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.118 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.118 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.118 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.119 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.119 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.119 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.119 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.119 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.119 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.120 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.120 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.120 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:33.120 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.120 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.121 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:33.121 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.121 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.121 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.121 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.121 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.122 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.122 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.122 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.122 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.122 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.123 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.123 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.123 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.123 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.123 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.123 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.124 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.124 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.124 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.124 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.124 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.124 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.125 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.125 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.125 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.125 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.125 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.126 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.126 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.126 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.126 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:33.126 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.126 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.127 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:33.127 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.127 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.127 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.127 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.128 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.128 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.128 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.128 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.128 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.128 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.129 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.129 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.129 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.129 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.129 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.130 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.130 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.130 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.130 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.130 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.131 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.131 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.131 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.131 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.131 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.132 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.132 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.132 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.132 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.132 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.132 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:33.133 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.133 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.133 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:33.133 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.133 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.134 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.134 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.134 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.134 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.134 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.134 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.135 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.135 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.135 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.135 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.135 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.136 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.136 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.136 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.136 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.136 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.136 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.137 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.137 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.137 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.137 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.137 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:33.138 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:33.138 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:33.138 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:33.138 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:33.138 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.139 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.139 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:33.139 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:33.139 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:33.139 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:33.140 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:33.140 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:33.140 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:33.140 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:33.140 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 4 2023-01-02T18:18:33.140 INFO:tasks.workunit.client.0.smithi007.stdout:read: 4 2023-01-02T18:18:33.141 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS1 (8623 ms) 2023-01-02T18:18:33.141 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestEncryptionLUKS2 2023-01-02T18:18:33.141 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:33.160 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:33.161+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:33.251 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:33.251 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:33.251 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:33.252 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:33.261 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:33.262+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:33.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:33.282 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:33.301 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:33.332 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:33.361 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:33.362+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:33.364 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:33.382 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:33.401 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:33.411 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:33.411 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:33.419 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:33.421 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:33.421 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:33.421 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:33.421 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:33.422 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:33.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:33.463 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:33.463+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:33.564 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:33.565+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:33.600 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:33.600 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:33.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:33.665 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:33.666+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:33.749 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:33.749 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:33.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:33.766 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:33.767+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:33.867 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:33.867+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:33.885 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:33.885 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:33.895 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:33.948 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:18:34.001 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:34.002+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:34.023 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:34.023 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:34.033 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:34.077 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:34.078+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:34.158 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:34.159 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:34.168 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:34.209 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:34.210+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:34.270 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:34.270+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:34.333 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:34.334 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:34.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:34.385 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:34.385+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:34.472 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:34.473+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:34.509 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:34.510 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:34.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:34.602 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:34.603+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:34.675 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:34.675+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:34.685 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:34.686 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:34.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:34.779 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:34.780+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:34.862 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:34.862 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:34.871 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:34.877 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:34.878+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:34.978 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:34.978+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:35.036 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:35.037 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:35.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:35.088 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:35.088+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:35.180 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:35.180+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:35.211 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:35.212 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:35.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:35.305 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:35.306+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:35.382 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:35.383+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:35.394 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:35.395 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:35.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:35.436 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:35.488 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:35.489+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:35.569 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:35.570 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:35.579 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:35.620 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:35.621+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:35.664 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:35.684 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:35.685+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:35.697 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:35.717 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:35.736 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:35.756 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:35.776 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:35.785 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:35.786+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:35.795 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:35.807 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:35.807 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:35.807 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:35.807 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:35.815 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:35.817 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:35.818 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:35.819 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:35.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:35.924 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:35.925+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:35.961 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:18:35.987 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:35.988+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:36.046 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:36.046 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:36.046 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:36.046 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:36.047 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:36.064 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:36.109 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:36.110+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:36.111 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 5, 4] out_osds: [3] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:36.111 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:36.112 INFO:tasks.thrashosds.thrasher:Removing osd 5, in_osds are: [0, 1, 2, 6, 7, 5, 4] 2023-01-02T18:18:36.112 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 5 2023-01-02T18:18:36.188 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:36.189+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:36.284 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:36.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2086 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e83)", 2023-01-02T18:18:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 79.958047164999996, 2023-01-02T18:18:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435, 2023-01-02T18:18:36.286 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:36.287 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2086 2023-01-02T18:18:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:36.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324212+0000", 2023-01-02T18:18:36.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2366e-05 2023-01-02T18:18:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324224+0000", 2023-01-02T18:18:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4462000000000001e-05 2023-01-02T18:18:36.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324249+0000", 2023-01-02T18:18:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5980000000000003e-06 2023-01-02T18:18:36.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324259+0000", 2023-01-02T18:18:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6119999999999999e-05 2023-01-02T18:18:36.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324305+0000", 2023-01-02T18:18:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7069999999999997e-06 2023-01-02T18:18:36.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324310+0000", 2023-01-02T18:18:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003133828 2023-01-02T18:18:36.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327444+0000", 2023-01-02T18:18:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1573999999999998e-05 2023-01-02T18:18:36.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327496+0000", 2023-01-02T18:18:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1179000000000004e-05 2023-01-02T18:18:36.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327567+0000", 2023-01-02T18:18:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435 2023-01-02T18:18:36.298 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2319 3.1 3:83da4b60:::rbd_object_map.11d54907a3eb.0000000000000014:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:36.299 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 69.907947531999994, 2023-01-02T18:18:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001, 2023-01-02T18:18:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.300 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2319 2023-01-02T18:18:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.301 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374312+0000", 2023-01-02T18:18:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2023-01-02T18:18:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374323+0000", 2023-01-02T18:18:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8349e-05 2023-01-02T18:18:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374341+0000", 2023-01-02T18:18:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9909999999999997e-06 2023-01-02T18:18:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374351+0000", 2023-01-02T18:18:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.617e-05 2023-01-02T18:18:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374398+0000", 2023-01-02T18:18:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:18:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374403+0000", 2023-01-02T18:18:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001918765 2023-01-02T18:18:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376322+0000", 2023-01-02T18:18:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015418100000000001 2023-01-02T18:18:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376476+0000", 2023-01-02T18:18:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016648999999999999 2023-01-02T18:18:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376642+0000", 2023-01-02T18:18:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001972976 2023-01-02T18:18:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.378615+0000", 2023-01-02T18:18:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020004570000000002 2023-01-02T18:18:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380616+0000", 2023-01-02T18:18:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3064000000000005e-05 2023-01-02T18:18:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380679+0000", 2023-01-02T18:18:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9119000000000002e-05 2023-01-02T18:18:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380728+0000", 2023-01-02T18:18:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001 2023-01-02T18:18:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3486 13.18 e125/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 125'1, mlcod=0'0)", 2023-01-02T18:18:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.468692367999999, 2023-01-02T18:18:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030098360000000001, 2023-01-02T18:18:36.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:36.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813568+0000", 2023-01-02T18:18:36.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001267661 2023-01-02T18:18:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814836+0000", 2023-01-02T18:18:36.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7289999999999995e-06 2023-01-02T18:18:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814846+0000", 2023-01-02T18:18:36.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4719999999999997e-06 2023-01-02T18:18:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814850+0000", 2023-01-02T18:18:36.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6375000000000001e-05 2023-01-02T18:18:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814877+0000", 2023-01-02T18:18:36.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5054e-05 2023-01-02T18:18:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814892+0000", 2023-01-02T18:18:36.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001659436 2023-01-02T18:18:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.816551+0000", 2023-01-02T18:18:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7994999999999999e-05 2023-01-02T18:18:36.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.816579+0000", 2023-01-02T18:18:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030098360000000001 2023-01-02T18:18:36.327 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.328 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3487 13.18 e125/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 125'2, mlcod=0'0)", 2023-01-02T18:18:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 32.463654333000001, 2023-01-02T18:18:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003251852, 2023-01-02T18:18:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.329 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:36.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:36.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818606+0000", 2023-01-02T18:18:36.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001527369 2023-01-02T18:18:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820133+0000", 2023-01-02T18:18:36.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.535e-05 2023-01-02T18:18:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820148+0000", 2023-01-02T18:18:36.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.348e-06 2023-01-02T18:18:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820155+0000", 2023-01-02T18:18:36.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6463e-05 2023-01-02T18:18:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820191+0000", 2023-01-02T18:18:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9545999999999999e-05 2023-01-02T18:18:36.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820211+0000", 2023-01-02T18:18:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016198460000000001 2023-01-02T18:18:36.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.821831+0000", 2023-01-02T18:18:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8520000000000001e-05 2023-01-02T18:18:36.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.821859+0000", 2023-01-02T18:18:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003251852 2023-01-02T18:18:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.339 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3488 13.18 e126/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 126'3, mlcod=125'1)", 2023-01-02T18:18:36.340 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 31.458856923999999, 2023-01-02T18:18:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036086859999999998, 2023-01-02T18:18:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.341 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823402+0000", 2023-01-02T18:18:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001376291 2023-01-02T18:18:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824779+0000", 2023-01-02T18:18:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4474999999999999e-05 2023-01-02T18:18:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824793+0000", 2023-01-02T18:18:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2280000000000003e-06 2023-01-02T18:18:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824799+0000", 2023-01-02T18:18:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4951999999999997e-05 2023-01-02T18:18:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824864+0000", 2023-01-02T18:18:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7657e-05 2023-01-02T18:18:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824892+0000", 2023-01-02T18:18:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020817040000000002 2023-01-02T18:18:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.826974+0000", 2023-01-02T18:18:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9675999999999998e-05 2023-01-02T18:18:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.827013+0000", 2023-01-02T18:18:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036086859999999998 2023-01-02T18:18:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3507 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.388521683, 2023-01-02T18:18:36.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002, 2023-01-02T18:18:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.353 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3507 2023-01-02T18:18:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893738+0000", 2023-01-02T18:18:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4447000000000001e-05 2023-01-02T18:18:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893752+0000", 2023-01-02T18:18:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8085999999999999e-05 2023-01-02T18:18:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893770+0000", 2023-01-02T18:18:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5949999999999999e-06 2023-01-02T18:18:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893779+0000", 2023-01-02T18:18:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4619000000000001e-05 2023-01-02T18:18:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893824+0000", 2023-01-02T18:18:36.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0294000000000002e-05 2023-01-02T18:18:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893894+0000", 2023-01-02T18:18:36.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034635200000000002 2023-01-02T18:18:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.894240+0000", 2023-01-02T18:18:36.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024283040000000001 2023-01-02T18:18:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.896669+0000", 2023-01-02T18:18:36.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018365300000000001 2023-01-02T18:18:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898505+0000", 2023-01-02T18:18:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2230000000000001e-05 2023-01-02T18:18:36.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898537+0000", 2023-01-02T18:18:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6251e-05 2023-01-02T18:18:36.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898564+0000", 2023-01-02T18:18:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002 2023-01-02T18:18:36.366 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.367 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3508 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.383418125999999, 2023-01-02T18:18:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001, 2023-01-02T18:18:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.368 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3508 2023-01-02T18:18:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.369 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:36.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898841+0000", 2023-01-02T18:18:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:18:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898867+0000", 2023-01-02T18:18:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323999999999999e-05 2023-01-02T18:18:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898890+0000", 2023-01-02T18:18:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8820000000000007e-06 2023-01-02T18:18:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898899+0000", 2023-01-02T18:18:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1070999999999999e-05 2023-01-02T18:18:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898950+0000", 2023-01-02T18:18:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2550000000000002e-05 2023-01-02T18:18:36.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899022+0000", 2023-01-02T18:18:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317836 2023-01-02T18:18:36.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899340+0000", 2023-01-02T18:18:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002728931 2023-01-02T18:18:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.902069+0000", 2023-01-02T18:18:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014209419999999999 2023-01-02T18:18:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903490+0000", 2023-01-02T18:18:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3368000000000003e-05 2023-01-02T18:18:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903523+0000", 2023-01-02T18:18:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5165999999999999e-05 2023-01-02T18:18:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903549+0000", 2023-01-02T18:18:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001 2023-01-02T18:18:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.382 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16196 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:36.383 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3854348099999996, 2023-01-02T18:18:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027283379999999999, 2023-01-02T18:18:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.384 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16196 2023-01-02T18:18:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896826+0000", 2023-01-02T18:18:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.066e-06 2023-01-02T18:18:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896830+0000", 2023-01-02T18:18:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8240000000000001e-06 2023-01-02T18:18:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896833+0000", 2023-01-02T18:18:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.525e-06 2023-01-02T18:18:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896836+0000", 2023-01-02T18:18:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061799399999999997 2023-01-02T18:18:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897454+0000", 2023-01-02T18:18:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9257000000000003e-05 2023-01-02T18:18:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897543+0000", 2023-01-02T18:18:36.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017217600000000001 2023-01-02T18:18:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897715+0000", 2023-01-02T18:18:36.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017227259999999999 2023-01-02T18:18:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899438+0000", 2023-01-02T18:18:36.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8192000000000003e-05 2023-01-02T18:18:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899476+0000", 2023-01-02T18:18:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3977000000000003e-05 2023-01-02T18:18:36.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899520+0000", 2023-01-02T18:18:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5029e-05 2023-01-02T18:18:36.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899555+0000", 2023-01-02T18:18:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027283379999999999 2023-01-02T18:18:36.397 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.398 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16197 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1024~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3854213780000002, 2023-01-02T18:18:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003274819, 2023-01-02T18:18:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.399 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16197 2023-01-02T18:18:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.400 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4080000000000001e-06 2023-01-02T18:18:36.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896842+0000", 2023-01-02T18:18:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1650000000000002e-06 2023-01-02T18:18:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896846+0000", 2023-01-02T18:18:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2709999999999999e-06 2023-01-02T18:18:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896848+0000", 2023-01-02T18:18:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012347090000000001 2023-01-02T18:18:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898083+0000", 2023-01-02T18:18:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016879500000000001 2023-01-02T18:18:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898251+0000", 2023-01-02T18:18:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016736999999999999 2023-01-02T18:18:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898419+0000", 2023-01-02T18:18:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001147447 2023-01-02T18:18:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899566+0000", 2023-01-02T18:18:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047601400000000003 2023-01-02T18:18:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900042+0000", 2023-01-02T18:18:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1649999999999997e-05 2023-01-02T18:18:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900074+0000", 2023-01-02T18:18:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1284e-05 2023-01-02T18:18:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.412 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900115+0000", 2023-01-02T18:18:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003274819 2023-01-02T18:18:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16198 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1536~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3853958189999993, 2023-01-02T18:18:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003, 2023-01-02T18:18:36.414 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16198 2023-01-02T18:18:36.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:36.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:36.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896865+0000", 2023-01-02T18:18:36.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6900000000000001e-06 2023-01-02T18:18:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896868+0000", 2023-01-02T18:18:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:18:36.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896874+0000", 2023-01-02T18:18:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.447e-06 2023-01-02T18:18:36.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896876+0000", 2023-01-02T18:18:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001873179 2023-01-02T18:18:36.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898750+0000", 2023-01-02T18:18:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7626000000000005e-05 2023-01-02T18:18:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898827+0000", 2023-01-02T18:18:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012927899999999999 2023-01-02T18:18:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898957+0000", 2023-01-02T18:18:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023139749999999998 2023-01-02T18:18:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901271+0000", 2023-01-02T18:18:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4455000000000005e-05 2023-01-02T18:18:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901335+0000", 2023-01-02T18:18:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7706999999999994e-05 2023-01-02T18:18:36.426 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901403+0000", 2023-01-02T18:18:36.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3409999999999999e-05 2023-01-02T18:18:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901446+0000", 2023-01-02T18:18:36.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003 2023-01-02T18:18:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16199 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2048~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.385382731, 2023-01-02T18:18:36.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004, 2023-01-02T18:18:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.431 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16199 2023-01-02T18:18:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.69e-06 2023-01-02T18:18:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896883+0000", 2023-01-02T18:18:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2909999999999999e-06 2023-01-02T18:18:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896887+0000", 2023-01-02T18:18:36.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.238e-06 2023-01-02T18:18:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896889+0000", 2023-01-02T18:18:36.437 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002707919 2023-01-02T18:18:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899597+0000", 2023-01-02T18:18:36.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2546000000000002e-05 2023-01-02T18:18:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899639+0000", 2023-01-02T18:18:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4080999999999996e-05 2023-01-02T18:18:36.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899733+0000", 2023-01-02T18:18:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001771826 2023-01-02T18:18:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901505+0000", 2023-01-02T18:18:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6619999999999994e-06 2023-01-02T18:18:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901514+0000", 2023-01-02T18:18:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0059999999999998e-05 2023-01-02T18:18:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901564+0000", 2023-01-02T18:18:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1318e-05 2023-01-02T18:18:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901605+0000", 2023-01-02T18:18:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004 2023-01-02T18:18:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.444 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16200 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2560~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:36.445 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3853705440000006, 2023-01-02T18:18:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998, 2023-01-02T18:18:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.446 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16200 2023-01-02T18:18:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.448 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.449 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0820000000000001e-06 2023-01-02T18:18:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.450 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896893+0000", 2023-01-02T18:18:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8679999999999999e-06 2023-01-02T18:18:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896896+0000", 2023-01-02T18:18:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1390000000000002e-06 2023-01-02T18:18:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896898+0000", 2023-01-02T18:18:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032553590000000002 2023-01-02T18:18:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900153+0000", 2023-01-02T18:18:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8237000000000003e-05 2023-01-02T18:18:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900232+0000", 2023-01-02T18:18:36.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018062300000000001 2023-01-02T18:18:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900412+0000", 2023-01-02T18:18:36.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012047169999999999 2023-01-02T18:18:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901617+0000", 2023-01-02T18:18:36.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042531099999999999 2023-01-02T18:18:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902042+0000", 2023-01-02T18:18:36.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1499000000000003e-05 2023-01-02T18:18:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902094+0000", 2023-01-02T18:18:36.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9249000000000003e-05 2023-01-02T18:18:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902133+0000", 2023-01-02T18:18:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998 2023-01-02T18:18:36.459 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.460 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16201 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3853616599999992, 2023-01-02T18:18:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004, 2023-01-02T18:18:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.461 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16201 2023-01-02T18:18:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.462 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4200000000000001e-06 2023-01-02T18:18:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896902+0000", 2023-01-02T18:18:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8849999999999999e-06 2023-01-02T18:18:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.466 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896905+0000", 2023-01-02T18:18:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2500000000000001e-06 2023-01-02T18:18:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896907+0000", 2023-01-02T18:18:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038386549999999998 2023-01-02T18:18:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900746+0000", 2023-01-02T18:18:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8287000000000004e-05 2023-01-02T18:18:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900834+0000", 2023-01-02T18:18:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016278899999999999 2023-01-02T18:18:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900997+0000", 2023-01-02T18:18:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011903720000000001 2023-01-02T18:18:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.471 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902187+0000", 2023-01-02T18:18:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634200000000004 2023-01-02T18:18:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902704+0000", 2023-01-02T18:18:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.957e-05 2023-01-02T18:18:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902733+0000", 2023-01-02T18:18:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4341e-05 2023-01-02T18:18:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902758+0000", 2023-01-02T18:18:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004 2023-01-02T18:18:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16202 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3853522429999998, 2023-01-02T18:18:36.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001, 2023-01-02T18:18:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.477 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16202 2023-01-02T18:18:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.478 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.479 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.480 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.092e-06 2023-01-02T18:18:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896911+0000", 2023-01-02T18:18:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1019999999999999e-06 2023-01-02T18:18:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896915+0000", 2023-01-02T18:18:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7930000000000002e-06 2023-01-02T18:18:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896918+0000", 2023-01-02T18:18:36.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047231770000000003 2023-01-02T18:18:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901641+0000", 2023-01-02T18:18:36.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2209000000000002e-05 2023-01-02T18:18:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901684+0000", 2023-01-02T18:18:36.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104726 2023-01-02T18:18:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901788+0000", 2023-01-02T18:18:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015539740000000001 2023-01-02T18:18:36.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903342+0000", 2023-01-02T18:18:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1817999999999998e-05 2023-01-02T18:18:36.487 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903394+0000", 2023-01-02T18:18:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8734999999999998e-05 2023-01-02T18:18:36.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903423+0000", 2023-01-02T18:18:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9155000000000001e-05 2023-01-02T18:18:36.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903452+0000", 2023-01-02T18:18:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001 2023-01-02T18:18:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.490 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16203 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.491 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3853411490000003, 2023-01-02T18:18:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998, 2023-01-02T18:18:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.492 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16203 2023-01-02T18:18:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896920+0000", 2023-01-02T18:18:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1600000000000001e-06 2023-01-02T18:18:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896922+0000", 2023-01-02T18:18:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5219999999999999e-06 2023-01-02T18:18:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896926+0000", 2023-01-02T18:18:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9470000000000002e-06 2023-01-02T18:18:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896928+0000", 2023-01-02T18:18:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052862669999999999 2023-01-02T18:18:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902214+0000", 2023-01-02T18:18:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3084999999999994e-05 2023-01-02T18:18:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902307+0000", 2023-01-02T18:18:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013711100000000001 2023-01-02T18:18:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902444+0000", 2023-01-02T18:18:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090387900000000001 2023-01-02T18:18:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903348+0000", 2023-01-02T18:18:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015428300000000001 2023-01-02T18:18:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903503+0000", 2023-01-02T18:18:36.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7078999999999999e-05 2023-01-02T18:18:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903530+0000", 2023-01-02T18:18:36.504 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9266000000000002e-05 2023-01-02T18:18:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903549+0000", 2023-01-02T18:18:36.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998 2023-01-02T18:18:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.506 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16204 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3853317000000001, 2023-01-02T18:18:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996, 2023-01-02T18:18:36.507 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.508 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16204 2023-01-02T18:18:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:36.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:36.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:36.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1679999999999997e-06 2023-01-02T18:18:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896934+0000", 2023-01-02T18:18:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.039e-06 2023-01-02T18:18:36.512 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896937+0000", 2023-01-02T18:18:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0389999999999999e-06 2023-01-02T18:18:36.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896939+0000", 2023-01-02T18:18:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058543179999999998 2023-01-02T18:18:36.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902793+0000", 2023-01-02T18:18:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5451999999999996e-05 2023-01-02T18:18:36.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902859+0000", 2023-01-02T18:18:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5087999999999996e-05 2023-01-02T18:18:36.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902944+0000", 2023-01-02T18:18:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086757900000000005 2023-01-02T18:18:36.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903811+0000", 2023-01-02T18:18:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9238000000000002e-05 2023-01-02T18:18:36.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903901+0000", 2023-01-02T18:18:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0630000000000001e-05 2023-01-02T18:18:36.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903951+0000", 2023-01-02T18:18:36.520 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6187999999999998e-05 2023-01-02T18:18:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904007+0000", 2023-01-02T18:18:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996 2023-01-02T18:18:36.521 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.522 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16205 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 0~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e140)", 2023-01-02T18:18:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3825886809999997, 2023-01-02T18:18:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868, 2023-01-02T18:18:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.523 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16205 2023-01-02T18:18:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.524 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.525 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:36.526 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899672+0000", 2023-01-02T18:18:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2650000000000004e-06 2023-01-02T18:18:36.527 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899677+0000", 2023-01-02T18:18:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1850000000000004e-06 2023-01-02T18:18:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.528 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899686+0000", 2023-01-02T18:18:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4259999999999996e-06 2023-01-02T18:18:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.529 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899690+0000", 2023-01-02T18:18:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576512 2023-01-02T18:18:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.530 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903266+0000", 2023-01-02T18:18:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5141000000000005e-05 2023-01-02T18:18:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.531 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903332+0000", 2023-01-02T18:18:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070156899999999998 2023-01-02T18:18:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.532 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904033+0000", 2023-01-02T18:18:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0550000000000003e-05 2023-01-02T18:18:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.533 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904074+0000", 2023-01-02T18:18:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7970000000000001e-05 2023-01-02T18:18:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.534 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904142+0000", 2023-01-02T18:18:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868 2023-01-02T18:18:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16266 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 5632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e141)", 2023-01-02T18:18:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 8.3455701449999999, 2023-01-02T18:18:36.536 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034084089999999998, 2023-01-02T18:18:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.537 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16266 2023-01-02T18:18:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.538 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.539 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.540 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936690+0000", 2023-01-02T18:18:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0029e-05 2023-01-02T18:18:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.541 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936700+0000", 2023-01-02T18:18:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7252999999999999e-05 2023-01-02T18:18:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.542 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936717+0000", 2023-01-02T18:18:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2790000000000001e-06 2023-01-02T18:18:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.543 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936724+0000", 2023-01-02T18:18:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4746999999999997e-05 2023-01-02T18:18:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936769+0000", 2023-01-02T18:18:36.544 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4490000000000002e-06 2023-01-02T18:18:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936776+0000", 2023-01-02T18:18:36.545 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003181367 2023-01-02T18:18:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.939958+0000", 2023-01-02T18:18:36.546 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8536999999999998e-05 2023-01-02T18:18:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.940026+0000", 2023-01-02T18:18:36.547 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3569e-05 2023-01-02T18:18:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.940100+0000", 2023-01-02T18:18:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034084089999999998 2023-01-02T18:18:36.548 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.549 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28602 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 146432~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e143)", 2023-01-02T18:18:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.3446042780000003, 2023-01-02T18:18:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996, 2023-01-02T18:18:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.550 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28602 2023-01-02T18:18:36.551 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:36.553 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937656+0000", 2023-01-02T18:18:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3520000000000003e-06 2023-01-02T18:18:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937663+0000", 2023-01-02T18:18:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4744e-05 2023-01-02T18:18:36.555 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937677+0000", 2023-01-02T18:18:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5119999999999997e-06 2023-01-02T18:18:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.556 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937684+0000", 2023-01-02T18:18:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2098999999999997e-05 2023-01-02T18:18:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.557 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937736+0000", 2023-01-02T18:18:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:18:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.558 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937745+0000", 2023-01-02T18:18:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073198109999999999 2023-01-02T18:18:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.559 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945065+0000", 2023-01-02T18:18:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1624000000000002e-05 2023-01-02T18:18:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.560 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945156+0000", 2023-01-02T18:18:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123879 2023-01-02T18:18:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.561 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945280+0000", 2023-01-02T18:18:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996 2023-01-02T18:18:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.562 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28808 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [assert-version v64,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:18:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:36.563 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 5.2694259990000001, 2023-01-02T18:18:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002, 2023-01-02T18:18:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:36.564 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28808 2023-01-02T18:18:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:36.565 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.566 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.567 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012835+0000", 2023-01-02T18:18:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0229999999999998e-06 2023-01-02T18:18:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.568 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012841+0000", 2023-01-02T18:18:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1938e-05 2023-01-02T18:18:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.569 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012853+0000", 2023-01-02T18:18:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5520000000000004e-06 2023-01-02T18:18:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:36.570 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012858+0000", 2023-01-02T18:18:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9961999999999999e-05 2023-01-02T18:18:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:36.571 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012888+0000", 2023-01-02T18:18:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2904e-05 2023-01-02T18:18:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012941+0000", 2023-01-02T18:18:36.572 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016403699999999999 2023-01-02T18:18:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013105+0000", 2023-01-02T18:18:36.573 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074456399999999997 2023-01-02T18:18:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013850+0000", 2023-01-02T18:18:36.574 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027539999999999999 2023-01-02T18:18:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016604+0000", 2023-01-02T18:18:36.575 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4141999999999999e-05 2023-01-02T18:18:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016638+0000", 2023-01-02T18:18:36.576 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7827000000000002e-05 2023-01-02T18:18:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016676+0000", 2023-01-02T18:18:36.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002 2023-01-02T18:18:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:36.578 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:36.579 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:36.580 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:36.581 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:36.581+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:36.618 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-01-02T18:18:36.619+0000 7fe18f96e700 -1 mon.a@0(leader).osd e146 definitely_dead 0 2023-01-02T18:18:36.681 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:36.682+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:36.782 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:36.783+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:36.786 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:36.787 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:36.787 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:36.804 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:36.888 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:36.889+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:36.983 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:36.984+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:37.010 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:37.011 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:37.011 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:37.026 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:37.110 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:37.111+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:37.185 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:37.186+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:37.251 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:37.251 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.252 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 108.921023342, 2023-01-02T18:18:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:37.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:37.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:37.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:37.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:37.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:37.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:37.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:37.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:37.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:37.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.264 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.911527946999996, 2023-01-02T18:18:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.265 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.266 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:37.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:37.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:37.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:37.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:37.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:37.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:37.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:37.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:37.279 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.898470356000004, 2023-01-02T18:18:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:37.280 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.292 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.888395126000006, 2023-01-02T18:18:37.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:37.294 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:37.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:37.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:37.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:37.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:37.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:37.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.309 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:37.310 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 71.925245341999997, 2023-01-02T18:18:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:37.311 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.312 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.316 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:37.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:37.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.323 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:37.324 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.919948652000002, 2023-01-02T18:18:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:37.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:37.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:37.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:37.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:37.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:37.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.335 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 52.867499834, 2023-01-02T18:18:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:37.337 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 51.860018945999997, 2023-01-02T18:18:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:37.349 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:37.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:37.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:37.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:37.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:37.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:37.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.359 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.812366290999996, 2023-01-02T18:18:37.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.363 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.364 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.365 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:37.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:37.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:37.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:37.370 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.371 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.807993713000002, 2023-01-02T18:18:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.372 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:37.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:37.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:37.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:37.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:37.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:37.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:37.379 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:37.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:37.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:37.382 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.516684585, 2023-01-02T18:18:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:37.384 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:37.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:37.386 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:37.387 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:37.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:37.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:37.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.394 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3493 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e127)", 2023-01-02T18:18:37.395 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.407887258999999, 2023-01-02T18:18:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998, 2023-01-02T18:18:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.396 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3493 2023-01-02T18:18:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841661+0000", 2023-01-02T18:18:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8811999999999999e-05 2023-01-02T18:18:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.400 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841680+0000", 2023-01-02T18:18:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9380000000000001e-05 2023-01-02T18:18:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.401 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841699+0000", 2023-01-02T18:18:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.402 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841709+0000", 2023-01-02T18:18:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010059 2023-01-02T18:18:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841809+0000", 2023-01-02T18:18:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3533e-05 2023-01-02T18:18:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841903+0000", 2023-01-02T18:18:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036800899999999998 2023-01-02T18:18:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842271+0000", 2023-01-02T18:18:37.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033624560000000002 2023-01-02T18:18:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845633+0000", 2023-01-02T18:18:37.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020175099999999999 2023-01-02T18:18:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845835+0000", 2023-01-02T18:18:37.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1019999999999998e-05 2023-01-02T18:18:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845866+0000", 2023-01-02T18:18:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7328999999999999e-05 2023-01-02T18:18:37.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845893+0000", 2023-01-02T18:18:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998 2023-01-02T18:18:37.409 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3494 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e128)", 2023-01-02T18:18:37.410 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.403357951, 2023-01-02T18:18:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999, 2023-01-02T18:18:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.411 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3494 2023-01-02T18:18:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.412 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.413 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.414 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846191+0000", 2023-01-02T18:18:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4089e-05 2023-01-02T18:18:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.415 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846205+0000", 2023-01-02T18:18:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8082000000000001e-05 2023-01-02T18:18:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.416 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846223+0000", 2023-01-02T18:18:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2023-01-02T18:18:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.417 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846231+0000", 2023-01-02T18:18:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100853 2023-01-02T18:18:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.418 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846332+0000", 2023-01-02T18:18:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4294000000000004e-05 2023-01-02T18:18:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.419 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846406+0000", 2023-01-02T18:18:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000381035 2023-01-02T18:18:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846787+0000", 2023-01-02T18:18:37.420 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029262089999999999 2023-01-02T18:18:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:37.421 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849713+0000", 2023-01-02T18:18:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022129699999999999 2023-01-02T18:18:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:37.422 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849934+0000", 2023-01-02T18:18:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6384000000000003e-05 2023-01-02T18:18:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.423 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849971+0000", 2023-01-02T18:18:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9811e-05 2023-01-02T18:18:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.850001+0000", 2023-01-02T18:18:37.424 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999 2023-01-02T18:18:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.425 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3500 13.1c e131/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 131'3, mlcod=130'1)", 2023-01-02T18:18:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.377390160000001, 2023-01-02T18:18:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999, 2023-01-02T18:18:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.426 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:37.427 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:37.428 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872160+0000", 2023-01-02T18:18:37.429 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022329899999999998 2023-01-02T18:18:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874393+0000", 2023-01-02T18:18:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.252e-05 2023-01-02T18:18:37.430 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874406+0000", 2023-01-02T18:18:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0240000000000003e-06 2023-01-02T18:18:37.431 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874415+0000", 2023-01-02T18:18:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0895000000000005e-05 2023-01-02T18:18:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.432 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874486+0000", 2023-01-02T18:18:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4266e-05 2023-01-02T18:18:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.433 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874520+0000", 2023-01-02T18:18:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023338909999999998 2023-01-02T18:18:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.434 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876854+0000", 2023-01-02T18:18:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3161000000000001e-05 2023-01-02T18:18:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.435 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876907+0000", 2023-01-02T18:18:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999 2023-01-02T18:18:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.436 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3501 13.1c e132/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 132'4, mlcod=130'2)", 2023-01-02T18:18:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:37.437 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.370959846000002, 2023-01-02T18:18:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001, 2023-01-02T18:18:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.438 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.439 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.440 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878589+0000", 2023-01-02T18:18:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011789120000000001 2023-01-02T18:18:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.441 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879768+0000", 2023-01-02T18:18:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6392000000000002e-05 2023-01-02T18:18:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.442 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879785+0000", 2023-01-02T18:18:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3309999999999998e-06 2023-01-02T18:18:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.443 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879792+0000", 2023-01-02T18:18:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4100000000000001e-05 2023-01-02T18:18:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.444 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879836+0000", 2023-01-02T18:18:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1690000000000001e-05 2023-01-02T18:18:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879858+0000", 2023-01-02T18:18:37.445 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001682692 2023-01-02T18:18:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881541+0000", 2023-01-02T18:18:37.446 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7658999999999999e-05 2023-01-02T18:18:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881588+0000", 2023-01-02T18:18:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001 2023-01-02T18:18:37.447 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.448 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3510 13.10 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:18:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 18.338408294000001, 2023-01-02T18:18:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999, 2023-01-02T18:18:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.449 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3510 2023-01-02T18:18:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.450 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.451 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.452 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911139+0000", 2023-01-02T18:18:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9587000000000001e-05 2023-01-02T18:18:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.453 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911159+0000", 2023-01-02T18:18:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2842000000000002e-05 2023-01-02T18:18:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.454 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911192+0000", 2023-01-02T18:18:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5116999999999999e-05 2023-01-02T18:18:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.455 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911207+0000", 2023-01-02T18:18:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000120098 2023-01-02T18:18:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.456 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911327+0000", 2023-01-02T18:18:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.536e-06 2023-01-02T18:18:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:37.457 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911332+0000", 2023-01-02T18:18:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025961489999999999 2023-01-02T18:18:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.458 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.913928+0000", 2023-01-02T18:18:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016713700000000001 2023-01-02T18:18:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914096+0000", 2023-01-02T18:18:37.459 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044610400000000001 2023-01-02T18:18:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914542+0000", 2023-01-02T18:18:37.460 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027693449999999999 2023-01-02T18:18:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917311+0000", 2023-01-02T18:18:37.461 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079338599999999998 2023-01-02T18:18:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:37.462 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918104+0000", 2023-01-02T18:18:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8297000000000003e-05 2023-01-02T18:18:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.463 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918143+0000", 2023-01-02T18:18:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7084e-05 2023-01-02T18:18:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918170+0000", 2023-01-02T18:18:37.464 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999 2023-01-02T18:18:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.465 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16265 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 5632~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e141)", 2023-01-02T18:18:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.3185657109999998, 2023-01-02T18:18:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055750219999999998, 2023-01-02T18:18:37.466 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:18:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16265 2023-01-02T18:18:37.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:37.468 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.469 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.470 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930984+0000", 2023-01-02T18:18:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:18:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.471 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930991+0000", 2023-01-02T18:18:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4295e-05 2023-01-02T18:18:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.472 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931005+0000", 2023-01-02T18:18:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4080000000000001e-06 2023-01-02T18:18:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.473 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931013+0000", 2023-01-02T18:18:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051094699999999999 2023-01-02T18:18:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.474 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931524+0000", 2023-01-02T18:18:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2660000000000001e-06 2023-01-02T18:18:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.475 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931532+0000", 2023-01-02T18:18:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049429119999999998 2023-01-02T18:18:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.476 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936475+0000", 2023-01-02T18:18:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5248999999999996e-05 2023-01-02T18:18:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.477 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936560+0000", 2023-01-02T18:18:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055750219999999998 2023-01-02T18:18:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:28804 3.1a e143/124 3:5dc8c609:::rbd_data.12a211eeb54d.0000000000000007:head v 143'6, mlcod=0'0)", 2023-01-02T18:18:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.2370081209999997, 2023-01-02T18:18:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039422229999999999, 2023-01-02T18:18:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2570000000000001e-06 2023-01-02T18:18:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012547+0000", 2023-01-02T18:18:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3016999999999999e-05 2023-01-02T18:18:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012560+0000", 2023-01-02T18:18:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0260000000000001e-06 2023-01-02T18:18:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012564+0000", 2023-01-02T18:18:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6282000000000003e-05 2023-01-02T18:18:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012600+0000", 2023-01-02T18:18:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4978e-05 2023-01-02T18:18:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012615+0000", 2023-01-02T18:18:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038441149999999999 2023-01-02T18:18:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016459+0000", 2023-01-02T18:18:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5772e-05 2023-01-02T18:18:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016485+0000", 2023-01-02T18:18:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039422229999999999 2023-01-02T18:18:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:28808 3.6 e143/43 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head v 143'65, mlcod=142'63)", 2023-01-02T18:18:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.2363762029999998, 2023-01-02T18:18:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033349730000000002, 2023-01-02T18:18:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013174+0000", 2023-01-02T18:18:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:18:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013180+0000", 2023-01-02T18:18:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7759999999999992e-06 2023-01-02T18:18:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013190+0000", 2023-01-02T18:18:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1320000000000004e-06 2023-01-02T18:18:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013194+0000", 2023-01-02T18:18:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0168999999999999e-05 2023-01-02T18:18:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013224+0000", 2023-01-02T18:18:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.819e-05 2023-01-02T18:18:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.500 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013242+0000", 2023-01-02T18:18:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003244963 2023-01-02T18:18:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016487+0000", 2023-01-02T18:18:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2412000000000002e-05 2023-01-02T18:18:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016510+0000", 2023-01-02T18:18:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033349730000000002 2023-01-02T18:18:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28849 3.0 3:04b18237:::rbd_object_map.12a229f0e522:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:18:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:33.128189+0000", 2023-01-02T18:18:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 4.1213622540000001, 2023-01-02T18:18:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028951620000000002, 2023-01-02T18:18:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28849 2023-01-02T18:18:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128189+0000", 2023-01-02T18:18:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128189+0000", 2023-01-02T18:18:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128185+0000", 2023-01-02T18:18:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9068000000000001e-05 2023-01-02T18:18:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128204+0000", 2023-01-02T18:18:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3564e-05 2023-01-02T18:18:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128228+0000", 2023-01-02T18:18:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2999e-05 2023-01-02T18:18:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128241+0000", 2023-01-02T18:18:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7799999999999995e-05 2023-01-02T18:18:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128309+0000", 2023-01-02T18:18:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019309700000000001 2023-01-02T18:18:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128502+0000", 2023-01-02T18:18:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028643800000000002 2023-01-02T18:18:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128788+0000", 2023-01-02T18:18:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001263803 2023-01-02T18:18:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.130052+0000", 2023-01-02T18:18:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091507100000000005 2023-01-02T18:18:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.130967+0000", 2023-01-02T18:18:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8299000000000005e-05 2023-01-02T18:18:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.131036+0000", 2023-01-02T18:18:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8313000000000003e-05 2023-01-02T18:18:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.131084+0000", 2023-01-02T18:18:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028951620000000002 2023-01-02T18:18:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:37.521 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:37.522 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:37.523 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:18:37.523 INFO:teuthology.orchestra.run.smithi007.stderr:marked out osd.5. 2023-01-02T18:18:37.525 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:37.523+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:37.623 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:37.624+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:37.724 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:37.725+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:37.725 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:37.726 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:37.726 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:37.726 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:37.739 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:37.827 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:37.828+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:37.841 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:37.926 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:37.927+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:37.940 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:37.940 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:37.941 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:37.941 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:37.941 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:37.959 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:38.043 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:38.044+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:38.070 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:38.090 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:38.108 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:38.127 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:38.128 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:38.128+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:38.147 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:38.166 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:38.185 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:38.205 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:38.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:38.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:38.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:38.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:38.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:38.212 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:38.212 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:38.212 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:38.220 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:38.221 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:38.245 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:38.245 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:38.245+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:38.329 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:38.330+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:38.437 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:38.438+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:38.512 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:38.512 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:38.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:38.530 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:38.532+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:38.631 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:38.632+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:38.716 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:38.716 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:38.733 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:38.733+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:38.735 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:38.833 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:38.834+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:38.934 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:38.935+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:38.965 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:38.966 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:38.983 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:39.034 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:39.035+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:39.124 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:39.124 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:39.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:39.136 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:39.136+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:39.236 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:39.236+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:39.307 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:39.308 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:39.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:39.361 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:39.362+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:39.437 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:39.438+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:39.494 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:39.494 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:39.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:39.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:18:39.549 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:39.550+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:39.636 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:39.637 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:39.638 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:39.639+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:39.647 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:39.738 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:39.739+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:39.827 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:39.828 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:39.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:39.840 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:39.841+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:39.941 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:39.942+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:39.972 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:39.972 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:39.982 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:40.042 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:40.043+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:40.119 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:40.120 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:40.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:40.143 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:40.144+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:40.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:40.268 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:40.269 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:40.271 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:40.272+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:40.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:40.344 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:40.345+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:40.363 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:18:40.385 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:40.403 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:40.413 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:40.413 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:40.420 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:40.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:40.438 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:40.457 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:40.465 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:40.466+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:40.475 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:40.493 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:40.512 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:40.514 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:40.515 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:40.546 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:40.546+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:40.600 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:40.600 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:40.600 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:40.601 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:40.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:40.647 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:40.648+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:40.748 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:40.749+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:40.786 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:40.787 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:40.787 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:40.787 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:40.787 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:40.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:40.849 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:40.850+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:40.932 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:40.933 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:40.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:40.933 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:40.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.934 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:53 3.f 3:f5b90545:::rbd_header.12a279b662cb:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:40.934 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:40.934 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 121.423902196, 2023-01-02T18:18:40.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038254109999999999, 2023-01-02T18:18:40.934 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:40.935 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:40.935 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:40.935 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:40.935 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:40.935 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 53 2023-01-02T18:18:40.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.936 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:40.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:40.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:40.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:40.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:40.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:40.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:40.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:40.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507237+0000", 2023-01-02T18:18:40.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2023-01-02T18:18:40.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:40.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507245+0000", 2023-01-02T18:18:40.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2310000000000002e-06 2023-01-02T18:18:40.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:40.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507254+0000", 2023-01-02T18:18:40.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.49e-06 2023-01-02T18:18:40.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:40.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507262+0000", 2023-01-02T18:18:40.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3300000000000001e-05 2023-01-02T18:18:40.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:40.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507316+0000", 2023-01-02T18:18:40.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2240000000000003e-06 2023-01-02T18:18:40.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:40.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507321+0000", 2023-01-02T18:18:40.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019239249999999999 2023-01-02T18:18:40.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:40.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509245+0000", 2023-01-02T18:18:40.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133907 2023-01-02T18:18:40.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:40.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509379+0000", 2023-01-02T18:18:40.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000258886 2023-01-02T18:18:40.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:40.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509638+0000", 2023-01-02T18:18:40.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001055587 2023-01-02T18:18:40.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:40.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510693+0000", 2023-01-02T18:18:40.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256445 2023-01-02T18:18:40.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:40.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510950+0000", 2023-01-02T18:18:40.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7262000000000002e-05 2023-01-02T18:18:40.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:40.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511007+0000", 2023-01-02T18:18:40.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7481000000000001e-05 2023-01-02T18:18:40.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:40.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511064+0000", 2023-01-02T18:18:40.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038254109999999999 2023-01-02T18:18:40.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:40.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:40.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:40.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:18:40.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:40.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 113.613090919, 2023-01-02T18:18:40.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:18:40.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:40.953 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:40.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:40.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:40.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:40.953 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:18:40.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.954 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:40.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:40.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:40.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:40.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:40.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:40.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:40.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:40.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:18:40.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:18:40.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:40.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:18:40.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:18:40.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:40.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:18:40.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:18:40.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:40.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:18:40.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:18:40.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:40.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:18:40.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:18:40.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:40.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:18:40.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:18:40.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:40.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:18:40.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:18:40.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:40.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:18:40.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:18:40.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:40.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:18:40.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:18:40.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:40.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:18:40.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:18:40.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:40.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:18:40.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:18:40.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:40.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:18:40.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:18:40.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:40.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:18:40.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:18:40.968 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:40.968 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:18:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:40.970 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 108.598007463, 2023-01-02T18:18:40.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:18:40.970 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:40.970 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:40.970 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:40.971 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:40.971 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:40.971 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:18:40.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.971 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:40.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:40.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:40.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:40.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:40.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:40.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:40.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:40.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:18:40.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:18:40.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:40.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:18:40.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:18:40.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:40.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:18:40.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:18:40.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:40.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:18:40.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:18:40.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:40.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:18:40.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:18:40.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:40.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:18:40.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:18:40.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:40.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:18:40.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:18:40.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:40.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:18:40.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:18:40.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:40.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:18:40.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:18:40.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:40.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:18:40.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:18:40.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:40.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:18:40.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:18:40.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:40.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:18:40.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:18:40.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:40.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:18:40.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:18:40.985 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:40.986 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:40.986 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:40.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.986 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:18:40.987 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:40.987 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.613309885999996, 2023-01-02T18:18:40.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:18:40.987 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:40.987 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:40.988 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:40.988 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:40.988 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:40.988 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:18:40.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.988 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:40.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:40.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:40.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:40.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:40.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:40.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:40.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:40.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:18:40.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:18:40.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:40.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:18:40.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:18:40.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:40.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:18:40.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:18:40.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:40.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:18:40.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:18:40.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:40.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:18:40.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:18:40.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:40.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:18:40.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:18:40.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:40.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:18:40.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:18:40.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:40.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:18:40.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:18:40.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:40.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:18:40.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:18:40.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:40.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:40.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:40.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:18:41.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:18:41.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:18:41.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:18:41.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:18:41.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:18:41.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:18:41.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:18:41.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.003 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.003 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.004 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:41.004 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:41.004 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.615285194999998, 2023-01-02T18:18:41.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:18:41.004 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.005 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:41.005 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.005 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:18:41.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.006 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:41.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:41.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:41.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:18:41.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:18:41.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:18:41.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:18:41.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:18:41.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:18:41.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:18:41.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:18:41.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:18:41.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:18:41.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:18:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:18:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:18:41.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:18:41.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:18:41.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:18:41.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:41.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:18:41.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:18:41.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:18:41.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:18:41.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:18:41.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:18:41.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:18:41.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:18:41.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:18:41.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:18:41.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.020 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.021 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:41.021 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:41.021 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.614226740999996, 2023-01-02T18:18:41.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:18:41.021 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.022 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:41.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.022 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:18:41.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.023 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:41.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:41.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:41.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:18:41.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:18:41.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:18:41.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:18:41.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:18:41.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:18:41.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:18:41.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:18:41.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:18:41.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:18:41.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:18:41.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:18:41.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:18:41.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:18:41.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:18:41.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:18:41.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:41.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:18:41.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:18:41.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:18:41.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:18:41.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:18:41.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:18:41.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:18:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:18:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:18:41.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:18:41.037 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.037 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.037 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.038 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:18:41.038 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:41.038 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 83.608862094000003, 2023-01-02T18:18:41.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:18:41.039 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.039 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.039 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.039 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:41.039 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.039 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:18:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:18:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:18:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:18:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:18:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:18:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:18:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:18:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:18:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:18:41.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:18:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:18:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:18:41.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:18:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:18:41.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:18:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:18:41.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:18:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:18:41.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:18:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:18:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:18:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:18:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:18:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:18:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:18:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:18:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2191 3.13 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:18:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:41.055 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.591023480000004, 2023-01-02T18:18:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996, 2023-01-02T18:18:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.056 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2191 2023-01-02T18:18:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340115+0000", 2023-01-02T18:18:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2921999999999999e-05 2023-01-02T18:18:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340128+0000", 2023-01-02T18:18:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9213000000000001e-05 2023-01-02T18:18:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340147+0000", 2023-01-02T18:18:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0695e-05 2023-01-02T18:18:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340158+0000", 2023-01-02T18:18:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1227000000000001e-05 2023-01-02T18:18:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340229+0000", 2023-01-02T18:18:41.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7239999999999992e-06 2023-01-02T18:18:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340237+0000", 2023-01-02T18:18:41.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001423248 2023-01-02T18:18:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341660+0000", 2023-01-02T18:18:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158319 2023-01-02T18:18:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341818+0000", 2023-01-02T18:18:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019205099999999999 2023-01-02T18:18:41.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.342011+0000", 2023-01-02T18:18:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001641558 2023-01-02T18:18:41.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.343652+0000", 2023-01-02T18:18:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001445895 2023-01-02T18:18:41.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345098+0000", 2023-01-02T18:18:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4589000000000003e-05 2023-01-02T18:18:41.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345143+0000", 2023-01-02T18:18:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9351000000000001e-05 2023-01-02T18:18:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345172+0000", 2023-01-02T18:18:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996 2023-01-02T18:18:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.071 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:41.072 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.568530593999995, 2023-01-02T18:18:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:18:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.073 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:18:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:18:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:18:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:18:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:18:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:18:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:18:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:18:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:18:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:18:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:18:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:18:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:18:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:18:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:18:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:18:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:18:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:18:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:18:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:18:41.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:18:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:18:41.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:18:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:18:41.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:18:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:18:41.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:18:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.089 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 74.563960343999995, 2023-01-02T18:18:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:18:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.090 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:18:41.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:41.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:18:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:18:41.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:18:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:18:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:18:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:18:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:18:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:18:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:18:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:18:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:18:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:18:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:18:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:18:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:18:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:18:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:18:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:18:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:18:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:18:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:18:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:18:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:18:41.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:18:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:18:41.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:18:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:18:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 73.551128328000004, 2023-01-02T18:18:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:18:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.107 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:18:41.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:41.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:41.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:18:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:18:41.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:18:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:18:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:18:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:18:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:18:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:18:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:18:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:18:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:18:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:18:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:18:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:18:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:18:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:41.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:18:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:18:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:18:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:18:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:18:41.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:18:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:18:41.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:18:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:18:41.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:18:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:18:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.602394829000005, 2023-01-02T18:18:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:18:41.124 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:18:41.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:41.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:18:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:18:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:18:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:18:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:18:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:18:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:18:41.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:18:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:18:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:18:41.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:18:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:18:41.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:18:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:18:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:18:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:18:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:18:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:18:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:18:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:18:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:18:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:18:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:18:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:18:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:18:41.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:18:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.140 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.602551775000002, 2023-01-02T18:18:41.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:18:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.142 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:18:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:18:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:18:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:18:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:18:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:18:41.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:18:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:18:41.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:18:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:18:41.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:18:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:18:41.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:18:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:18:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:18:41.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:18:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:18:41.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:18:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:18:41.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:18:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:18:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:18:41.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:18:41.155 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.156 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.156 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.156 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3381 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch unwatch cookie 140114584663936] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:41.156 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:41.157 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.453858269999998, 2023-01-02T18:18:41.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047545959999999998, 2023-01-02T18:18:41.157 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.157 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.157 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:41.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.158 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3381 2023-01-02T18:18:41.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.158 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:41.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:41.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:41.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477282+0000", 2023-01-02T18:18:41.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0690000000000003e-06 2023-01-02T18:18:41.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477286+0000", 2023-01-02T18:18:41.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.61e-06 2023-01-02T18:18:41.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477294+0000", 2023-01-02T18:18:41.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.19e-06 2023-01-02T18:18:41.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477297+0000", 2023-01-02T18:18:41.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016576899999999999 2023-01-02T18:18:41.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477463+0000", 2023-01-02T18:18:41.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4697999999999996e-05 2023-01-02T18:18:41.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477527+0000", 2023-01-02T18:18:41.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012896699999999999 2023-01-02T18:18:41.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:41.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477656+0000", 2023-01-02T18:18:41.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092177700000000003 2023-01-02T18:18:41.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.478578+0000", 2023-01-02T18:18:41.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033212659999999998 2023-01-02T18:18:41.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.481899+0000", 2023-01-02T18:18:41.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8207999999999997e-05 2023-01-02T18:18:41.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.481938+0000", 2023-01-02T18:18:41.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9822999999999996e-05 2023-01-02T18:18:41.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482037+0000", 2023-01-02T18:18:41.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047545959999999998 2023-01-02T18:18:41.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.171 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.172 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3382 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+full_try e117)", 2023-01-02T18:18:41.172 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:41.172 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.453623401999998, 2023-01-02T18:18:41.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046394139999999997, 2023-01-02T18:18:41.173 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.173 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:41.173 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.173 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:41.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.174 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3382 2023-01-02T18:18:41.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.174 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:41.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:41.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:41.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477516+0000", 2023-01-02T18:18:41.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0870000000000001e-06 2023-01-02T18:18:41.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477523+0000", 2023-01-02T18:18:41.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7181999999999999e-05 2023-01-02T18:18:41.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477541+0000", 2023-01-02T18:18:41.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.276e-05 2023-01-02T18:18:41.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477553+0000", 2023-01-02T18:18:41.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000346912 2023-01-02T18:18:41.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477900+0000", 2023-01-02T18:18:41.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7819999999999996e-05 2023-01-02T18:18:41.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:41.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477988+0000", 2023-01-02T18:18:41.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762630000000001 2023-01-02T18:18:41.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482064+0000", 2023-01-02T18:18:41.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0998000000000003e-05 2023-01-02T18:18:41.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482105+0000", 2023-01-02T18:18:41.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1690999999999997e-05 2023-01-02T18:18:41.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482157+0000", 2023-01-02T18:18:41.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046394139999999997 2023-01-02T18:18:41.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.185 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.186 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3409 11.3 e117/102 11:c4c92e5a:::rbd_trash:head v 117'10, mlcod=117'8)", 2023-01-02T18:18:41.186 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:41.186 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.424898446999997, 2023-01-02T18:18:41.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042507309999999998, 2023-01-02T18:18:41.187 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.187 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.187 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:41.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:41.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:41.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506242+0000", 2023-01-02T18:18:41.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3999999999999998e-06 2023-01-02T18:18:41.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506251+0000", 2023-01-02T18:18:41.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1779e-05 2023-01-02T18:18:41.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506263+0000", 2023-01-02T18:18:41.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2020000000000003e-06 2023-01-02T18:18:41.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506268+0000", 2023-01-02T18:18:41.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6593e-05 2023-01-02T18:18:41.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506305+0000", 2023-01-02T18:18:41.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2292e-05 2023-01-02T18:18:41.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506317+0000", 2023-01-02T18:18:41.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004147548 2023-01-02T18:18:41.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.510465+0000", 2023-01-02T18:18:41.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8863000000000001e-05 2023-01-02T18:18:41.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.510493+0000", 2023-01-02T18:18:41.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042507309999999998 2023-01-02T18:18:41.197 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.197 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.197 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.198 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3486 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:18:41.198 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:41.198 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.118741772, 2023-01-02T18:18:41.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004, 2023-01-02T18:18:41.199 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.199 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.199 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.199 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:41.199 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.200 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3486 2023-01-02T18:18:41.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.200 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:41.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:41.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:41.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812397+0000", 2023-01-02T18:18:41.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0736e-05 2023-01-02T18:18:41.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812408+0000", 2023-01-02T18:18:41.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8725000000000001e-05 2023-01-02T18:18:41.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812427+0000", 2023-01-02T18:18:41.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6719999999999993e-06 2023-01-02T18:18:41.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812435+0000", 2023-01-02T18:18:41.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8585000000000003e-05 2023-01-02T18:18:41.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812484+0000", 2023-01-02T18:18:41.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014839399999999999 2023-01-02T18:18:41.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812632+0000", 2023-01-02T18:18:41.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00048733700000000001 2023-01-02T18:18:41.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:41.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.813120+0000", 2023-01-02T18:18:41.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031693730000000001 2023-01-02T18:18:41.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.816289+0000", 2023-01-02T18:18:41.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00079880000000000001 2023-01-02T18:18:41.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817088+0000", 2023-01-02T18:18:41.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9833000000000001e-05 2023-01-02T18:18:41.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817148+0000", 2023-01-02T18:18:41.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2119000000000001e-05 2023-01-02T18:18:41.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817190+0000", 2023-01-02T18:18:41.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004 2023-01-02T18:18:41.213 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.213 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.213 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.214 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3487 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:18:41.214 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:41.214 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.113582975999996, 2023-01-02T18:18:41.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045799999999999999, 2023-01-02T18:18:41.214 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.214 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.215 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.215 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:41.215 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.215 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3487 2023-01-02T18:18:41.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.215 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:41.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:41.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:41.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817555+0000", 2023-01-02T18:18:41.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3555e-05 2023-01-02T18:18:41.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817568+0000", 2023-01-02T18:18:41.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8287e-05 2023-01-02T18:18:41.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817587+0000", 2023-01-02T18:18:41.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6570000000000003e-06 2023-01-02T18:18:41.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817595+0000", 2023-01-02T18:18:41.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3665000000000002e-05 2023-01-02T18:18:41.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817649+0000", 2023-01-02T18:18:41.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2825999999999996e-05 2023-01-02T18:18:41.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817732+0000", 2023-01-02T18:18:41.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042540399999999999 2023-01-02T18:18:41.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:41.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.818157+0000", 2023-01-02T18:18:41.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033449220000000002 2023-01-02T18:18:41.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.821502+0000", 2023-01-02T18:18:41.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052594299999999996 2023-01-02T18:18:41.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822028+0000", 2023-01-02T18:18:41.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2504999999999999e-05 2023-01-02T18:18:41.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822091+0000", 2023-01-02T18:18:41.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7435999999999998e-05 2023-01-02T18:18:41.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822138+0000", 2023-01-02T18:18:41.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045799999999999999 2023-01-02T18:18:41.228 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.228 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.228 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.229 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3488 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e126)", 2023-01-02T18:18:41.229 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:41.229 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.108664179000002, 2023-01-02T18:18:41.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004, 2023-01-02T18:18:41.229 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.229 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.230 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.230 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:41.230 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.230 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3488 2023-01-02T18:18:41.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.231 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:41.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:41.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:41.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822474+0000", 2023-01-02T18:18:41.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8097999999999999e-05 2023-01-02T18:18:41.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822492+0000", 2023-01-02T18:18:41.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4201000000000001e-05 2023-01-02T18:18:41.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822516+0000", 2023-01-02T18:18:41.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1077000000000001e-05 2023-01-02T18:18:41.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822527+0000", 2023-01-02T18:18:41.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0508999999999998e-05 2023-01-02T18:18:41.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822608+0000", 2023-01-02T18:18:41.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1670999999999999e-05 2023-01-02T18:18:41.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822679+0000", 2023-01-02T18:18:41.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030685400000000001 2023-01-02T18:18:41.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:41.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822986+0000", 2023-01-02T18:18:41.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002756896 2023-01-02T18:18:41.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.825743+0000", 2023-01-02T18:18:41.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014320229999999999 2023-01-02T18:18:41.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827175+0000", 2023-01-02T18:18:41.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6622999999999998e-05 2023-01-02T18:18:41.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827212+0000", 2023-01-02T18:18:41.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3500000000000001e-05 2023-01-02T18:18:41.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827245+0000", 2023-01-02T18:18:41.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004 2023-01-02T18:18:41.243 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.243 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.243 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.244 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.244 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:41.244 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.059512550999999, 2023-01-02T18:18:41.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:18:41.244 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:41.244 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.245 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:41.245 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:41.245 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.245 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:18:41.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:18:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:18:41.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:41.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:18:41.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:18:41.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:41.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:18:41.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:18:41.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:18:41.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:18:41.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:41.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:18:41.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:18:41.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:41.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:18:41.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:18:41.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:41.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:18:41.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:18:41.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:41.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:18:41.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:18:41.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:18:41.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:18:41.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:41.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:18:41.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:18:41.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:41.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:41.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:41.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:18:41.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:18:41.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.258 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:41.259 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:41.259 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:41.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:41.262 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:41.261+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:41.362 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:41.362+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:41.395 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:41.395 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:41.395 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:41.396 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:41.405 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:41.458 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:41.459 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:41.459 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:41.459 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:41.459 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:41.459 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.459 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:41.460 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.460 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.460 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:41.460 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.460 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:41.461 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.461 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.461 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:41.461 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.461 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:41.462 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.462 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.462 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:41.462 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.462 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:41.462 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.463 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.463 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:41.463 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.463 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:41.463 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.464 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.464 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:41.464 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:41.464 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:41.464 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:41.464 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:41.465 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:41.465 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:41.465 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:41.465 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:41.465 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:41.466 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:41.466 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.466 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:41.466 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.466 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.467 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:41.467 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.467 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:41.467 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.467 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.467 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:41.468 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.468 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:41.468 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.468 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.468 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:41.469 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.469 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:41.469 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.469 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.469 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:41.470 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.470 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:41.470 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.470 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.470 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:41.471 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.471 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.471 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.471 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.471 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.471 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.472 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:41.472 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:41.472 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:41.472 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.472 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:41.473 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:41.473 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:41.473 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.473 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:41.473 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:41.473 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:41.474 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.474 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:41.474 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:41.474 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:41.474 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.475 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:41.475 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:41.475 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:41.475 INFO:tasks.workunit.client.0.smithi007.stdout:discard: 512~512 = 512 2023-01-02T18:18:41.475 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.475 INFO:tasks.workunit.client.0.smithi007.stdout:aio discard: 1536~512 = 0 2023-01-02T18:18:41.476 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.476 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.476 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.476 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.476 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:41.477 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:41.477 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.477 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.477 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:41.477 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.478 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.478 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:41.478 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.478 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.478 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:41.478 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.479 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.479 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.479 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.479 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:41.479 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.479 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.480 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:41.480 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.480 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.480 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:41.480 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.480 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.481 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:41.481 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.481 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.481 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.481 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.482 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:41.482 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.482 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.482 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:41.482 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.483 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.483 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:41.483 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.483 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.483 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:41.483 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.484 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.484 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.484 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.484 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:41.484 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.485 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.485 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:41.485 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.485 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.485 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:41.486 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.486 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.486 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:41.486 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.486 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.487 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.487 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.487 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:41.487 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.487 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.487 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:41.488 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.488 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.488 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:41.488 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.488 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.488 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:41.489 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.489 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.489 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.489 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.489 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.490 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:41.490 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.490 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.490 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:41.490 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.490 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.491 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.491 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:41.491 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.491 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.491 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:41.492 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.492 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.492 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.492 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:41.492 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.493 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.493 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:41.493 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.493 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.493 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.494 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:41.494 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.494 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.494 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:41.494 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.494 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.495 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.495 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:41.495 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.495 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.495 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:41.496 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:41.496 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.496 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:41.496 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.496 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.496 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:41.497 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.497 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.497 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.497 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:41.497 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:41.498 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:41.498 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:41.498 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:41.498 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:41.498 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:41.499 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:41.499+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:41.575 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:41.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:41.576 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:41.576 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:41.576 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:41.586 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:41.627 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:41.628+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:41.701 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:41.702+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:41.759 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.760 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2086 3.6 3:6334c7d3:::rbd_object_map.11d574d0a887:head [read 0~35] snapc 0=[] ondisk+read+known_if_redirected e83)", 2023-01-02T18:18:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.434146937999998, 2023-01-02T18:18:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435, 2023-01-02T18:18:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.761 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2086 2023-01-02T18:18:41.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324215+0000", 2023-01-02T18:18:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324212+0000", 2023-01-02T18:18:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2366e-05 2023-01-02T18:18:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324224+0000", 2023-01-02T18:18:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4462000000000001e-05 2023-01-02T18:18:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324249+0000", 2023-01-02T18:18:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5980000000000003e-06 2023-01-02T18:18:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324259+0000", 2023-01-02T18:18:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6119999999999999e-05 2023-01-02T18:18:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324305+0000", 2023-01-02T18:18:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7069999999999997e-06 2023-01-02T18:18:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.769 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.324310+0000", 2023-01-02T18:18:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003133828 2023-01-02T18:18:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327444+0000", 2023-01-02T18:18:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1573999999999998e-05 2023-01-02T18:18:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327496+0000", 2023-01-02T18:18:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1179000000000004e-05 2023-01-02T18:18:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:16.327567+0000", 2023-01-02T18:18:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003352435 2023-01-02T18:18:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2319 3.1 3:83da4b60:::rbd_object_map.11d54907a3eb.0000000000000014:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 75.384047304999996, 2023-01-02T18:18:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001, 2023-01-02T18:18:41.774 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2319 2023-01-02T18:18:41.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:41.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374312+0000", 2023-01-02T18:18:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2023-01-02T18:18:41.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374323+0000", 2023-01-02T18:18:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8349e-05 2023-01-02T18:18:41.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374341+0000", 2023-01-02T18:18:41.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9909999999999997e-06 2023-01-02T18:18:41.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374351+0000", 2023-01-02T18:18:41.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.617e-05 2023-01-02T18:18:41.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374398+0000", 2023-01-02T18:18:41.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:18:41.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:41.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374403+0000", 2023-01-02T18:18:41.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001918765 2023-01-02T18:18:41.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376322+0000", 2023-01-02T18:18:41.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015418100000000001 2023-01-02T18:18:41.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376476+0000", 2023-01-02T18:18:41.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016648999999999999 2023-01-02T18:18:41.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:41.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376642+0000", 2023-01-02T18:18:41.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001972976 2023-01-02T18:18:41.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.378615+0000", 2023-01-02T18:18:41.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020004570000000002 2023-01-02T18:18:41.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380616+0000", 2023-01-02T18:18:41.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3064000000000005e-05 2023-01-02T18:18:41.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380679+0000", 2023-01-02T18:18:41.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9119000000000002e-05 2023-01-02T18:18:41.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380728+0000", 2023-01-02T18:18:41.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001 2023-01-02T18:18:41.790 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.790 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.790 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.791 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3486 13.18 e125/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 125'1, mlcod=0'0)", 2023-01-02T18:18:41.791 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:41.791 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 38.944792141000001, 2023-01-02T18:18:41.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030098360000000001, 2023-01-02T18:18:41.791 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.792 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.792 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:41.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813569+0000", 2023-01-02T18:18:41.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:41.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.813568+0000", 2023-01-02T18:18:41.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001267661 2023-01-02T18:18:41.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814836+0000", 2023-01-02T18:18:41.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7289999999999995e-06 2023-01-02T18:18:41.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814846+0000", 2023-01-02T18:18:41.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4719999999999997e-06 2023-01-02T18:18:41.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814850+0000", 2023-01-02T18:18:41.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6375000000000001e-05 2023-01-02T18:18:41.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814877+0000", 2023-01-02T18:18:41.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5054e-05 2023-01-02T18:18:41.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.814892+0000", 2023-01-02T18:18:41.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001659436 2023-01-02T18:18:41.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.816551+0000", 2023-01-02T18:18:41.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7994999999999999e-05 2023-01-02T18:18:41.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:02.816579+0000", 2023-01-02T18:18:41.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030098360000000001 2023-01-02T18:18:41.801 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.802 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.802 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.802 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3487 13.18 e125/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 125'2, mlcod=0'0)", 2023-01-02T18:18:41.803 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:41.803 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 37.939754106000002, 2023-01-02T18:18:41.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003251852, 2023-01-02T18:18:41.803 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.803 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.803 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:41.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818607+0000", 2023-01-02T18:18:41.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:41.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.818606+0000", 2023-01-02T18:18:41.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001527369 2023-01-02T18:18:41.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820133+0000", 2023-01-02T18:18:41.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.535e-05 2023-01-02T18:18:41.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820148+0000", 2023-01-02T18:18:41.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.348e-06 2023-01-02T18:18:41.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820155+0000", 2023-01-02T18:18:41.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6463e-05 2023-01-02T18:18:41.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820191+0000", 2023-01-02T18:18:41.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9545999999999999e-05 2023-01-02T18:18:41.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.820211+0000", 2023-01-02T18:18:41.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0016198460000000001 2023-01-02T18:18:41.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.821831+0000", 2023-01-02T18:18:41.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8520000000000001e-05 2023-01-02T18:18:41.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:03.821859+0000", 2023-01-02T18:18:41.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003251852 2023-01-02T18:18:41.813 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.813 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.813 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.814 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3488 13.18 e126/120 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head v 126'3, mlcod=125'1)", 2023-01-02T18:18:41.814 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:41.814 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 36.934956696999997, 2023-01-02T18:18:41.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036086859999999998, 2023-01-02T18:18:41.815 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.815 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.815 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:41.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823405+0000", 2023-01-02T18:18:41.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:41.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.823402+0000", 2023-01-02T18:18:41.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001376291 2023-01-02T18:18:41.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824779+0000", 2023-01-02T18:18:41.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4474999999999999e-05 2023-01-02T18:18:41.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824793+0000", 2023-01-02T18:18:41.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2280000000000003e-06 2023-01-02T18:18:41.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824799+0000", 2023-01-02T18:18:41.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4951999999999997e-05 2023-01-02T18:18:41.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824864+0000", 2023-01-02T18:18:41.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7657e-05 2023-01-02T18:18:41.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.824892+0000", 2023-01-02T18:18:41.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020817040000000002 2023-01-02T18:18:41.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.826974+0000", 2023-01-02T18:18:41.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9675999999999998e-05 2023-01-02T18:18:41.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:04.827013+0000", 2023-01-02T18:18:41.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036086859999999998 2023-01-02T18:18:41.825 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.825 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.825 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.826 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3507 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:41.826 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:41.826 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.864621455999998, 2023-01-02T18:18:41.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002, 2023-01-02T18:18:41.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.827 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.827 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.827 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3507 2023-01-02T18:18:41.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.828 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:41.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:41.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:41.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893738+0000", 2023-01-02T18:18:41.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4447000000000001e-05 2023-01-02T18:18:41.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893752+0000", 2023-01-02T18:18:41.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8085999999999999e-05 2023-01-02T18:18:41.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893770+0000", 2023-01-02T18:18:41.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5949999999999999e-06 2023-01-02T18:18:41.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893779+0000", 2023-01-02T18:18:41.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4619000000000001e-05 2023-01-02T18:18:41.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893824+0000", 2023-01-02T18:18:41.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0294000000000002e-05 2023-01-02T18:18:41.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893894+0000", 2023-01-02T18:18:41.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034635200000000002 2023-01-02T18:18:41.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:41.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.894240+0000", 2023-01-02T18:18:41.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024283040000000001 2023-01-02T18:18:41.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.896669+0000", 2023-01-02T18:18:41.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018365300000000001 2023-01-02T18:18:41.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898505+0000", 2023-01-02T18:18:41.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2230000000000001e-05 2023-01-02T18:18:41.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898537+0000", 2023-01-02T18:18:41.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6251e-05 2023-01-02T18:18:41.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898564+0000", 2023-01-02T18:18:41.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002 2023-01-02T18:18:41.840 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.841 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.841 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.841 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3508 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:41.842 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:41.842 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.859517899, 2023-01-02T18:18:41.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001, 2023-01-02T18:18:41.842 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.842 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.842 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.843 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.843 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.843 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3508 2023-01-02T18:18:41.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.843 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:41.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:41.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:41.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898841+0000", 2023-01-02T18:18:41.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:18:41.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898867+0000", 2023-01-02T18:18:41.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323999999999999e-05 2023-01-02T18:18:41.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898890+0000", 2023-01-02T18:18:41.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8820000000000007e-06 2023-01-02T18:18:41.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898899+0000", 2023-01-02T18:18:41.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1070999999999999e-05 2023-01-02T18:18:41.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898950+0000", 2023-01-02T18:18:41.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2550000000000002e-05 2023-01-02T18:18:41.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899022+0000", 2023-01-02T18:18:41.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317836 2023-01-02T18:18:41.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:41.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899340+0000", 2023-01-02T18:18:41.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002728931 2023-01-02T18:18:41.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.902069+0000", 2023-01-02T18:18:41.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014209419999999999 2023-01-02T18:18:41.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903490+0000", 2023-01-02T18:18:41.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3368000000000003e-05 2023-01-02T18:18:41.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903523+0000", 2023-01-02T18:18:41.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5165999999999999e-05 2023-01-02T18:18:41.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.857 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903549+0000", 2023-01-02T18:18:41.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001 2023-01-02T18:18:41.857 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.858 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.858 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.858 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16196 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.859 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:41.859 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861534582999999, 2023-01-02T18:18:41.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027283379999999999, 2023-01-02T18:18:41.859 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.859 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.860 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.860 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.860 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.860 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16196 2023-01-02T18:18:41.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.861 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:41.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896827+0000", 2023-01-02T18:18:41.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896826+0000", 2023-01-02T18:18:41.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.066e-06 2023-01-02T18:18:41.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896830+0000", 2023-01-02T18:18:41.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8240000000000001e-06 2023-01-02T18:18:41.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.865 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.865 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896833+0000", 2023-01-02T18:18:41.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.525e-06 2023-01-02T18:18:41.866 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.866 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896836+0000", 2023-01-02T18:18:41.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061799399999999997 2023-01-02T18:18:41.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897454+0000", 2023-01-02T18:18:41.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9257000000000003e-05 2023-01-02T18:18:41.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897543+0000", 2023-01-02T18:18:41.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00017217600000000001 2023-01-02T18:18:41.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.897715+0000", 2023-01-02T18:18:41.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0017227259999999999 2023-01-02T18:18:41.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899438+0000", 2023-01-02T18:18:41.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8192000000000003e-05 2023-01-02T18:18:41.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899476+0000", 2023-01-02T18:18:41.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3977000000000003e-05 2023-01-02T18:18:41.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899520+0000", 2023-01-02T18:18:41.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5029e-05 2023-01-02T18:18:41.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899555+0000", 2023-01-02T18:18:41.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027283379999999999 2023-01-02T18:18:41.874 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.874 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.874 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.875 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16197 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1024~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.875 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:41.875 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861521151, 2023-01-02T18:18:41.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003274819, 2023-01-02T18:18:41.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.876 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.876 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.877 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.877 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16197 2023-01-02T18:18:41.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.877 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:41.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:41.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896840+0000", 2023-01-02T18:18:41.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4080000000000001e-06 2023-01-02T18:18:41.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896842+0000", 2023-01-02T18:18:41.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1650000000000002e-06 2023-01-02T18:18:41.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896846+0000", 2023-01-02T18:18:41.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2709999999999999e-06 2023-01-02T18:18:41.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896848+0000", 2023-01-02T18:18:41.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012347090000000001 2023-01-02T18:18:41.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898083+0000", 2023-01-02T18:18:41.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016879500000000001 2023-01-02T18:18:41.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898251+0000", 2023-01-02T18:18:41.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016736999999999999 2023-01-02T18:18:41.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898419+0000", 2023-01-02T18:18:41.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001147447 2023-01-02T18:18:41.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899566+0000", 2023-01-02T18:18:41.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00047601400000000003 2023-01-02T18:18:41.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.888 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900042+0000", 2023-01-02T18:18:41.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1649999999999997e-05 2023-01-02T18:18:41.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900074+0000", 2023-01-02T18:18:41.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1284e-05 2023-01-02T18:18:41.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900115+0000", 2023-01-02T18:18:41.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003274819 2023-01-02T18:18:41.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.891 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.891 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.891 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16198 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1536~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.892 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:41.892 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861495592000001, 2023-01-02T18:18:41.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003, 2023-01-02T18:18:41.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.893 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.893 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16198 2023-01-02T18:18:41.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.894 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:41.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:41.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.896 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896865+0000", 2023-01-02T18:18:41.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6900000000000001e-06 2023-01-02T18:18:41.897 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.897 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896868+0000", 2023-01-02T18:18:41.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:18:41.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.898 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896874+0000", 2023-01-02T18:18:41.898 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.447e-06 2023-01-02T18:18:41.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896876+0000", 2023-01-02T18:18:41.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001873179 2023-01-02T18:18:41.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898750+0000", 2023-01-02T18:18:41.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7626000000000005e-05 2023-01-02T18:18:41.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.901 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898827+0000", 2023-01-02T18:18:41.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012927899999999999 2023-01-02T18:18:41.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898957+0000", 2023-01-02T18:18:41.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023139749999999998 2023-01-02T18:18:41.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901271+0000", 2023-01-02T18:18:41.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4455000000000005e-05 2023-01-02T18:18:41.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901335+0000", 2023-01-02T18:18:41.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7706999999999994e-05 2023-01-02T18:18:41.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901403+0000", 2023-01-02T18:18:41.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3409999999999999e-05 2023-01-02T18:18:41.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901446+0000", 2023-01-02T18:18:41.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003 2023-01-02T18:18:41.906 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.907 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.907 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.907 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16199 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2048~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.908 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:41.908 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861482504, 2023-01-02T18:18:41.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004, 2023-01-02T18:18:41.908 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.908 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.908 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.909 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.909 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.909 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16199 2023-01-02T18:18:41.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.909 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:41.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:41.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:41.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.69e-06 2023-01-02T18:18:41.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896883+0000", 2023-01-02T18:18:41.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2909999999999999e-06 2023-01-02T18:18:41.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896887+0000", 2023-01-02T18:18:41.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.238e-06 2023-01-02T18:18:41.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896889+0000", 2023-01-02T18:18:41.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002707919 2023-01-02T18:18:41.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899597+0000", 2023-01-02T18:18:41.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2546000000000002e-05 2023-01-02T18:18:41.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899639+0000", 2023-01-02T18:18:41.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4080999999999996e-05 2023-01-02T18:18:41.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899733+0000", 2023-01-02T18:18:41.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001771826 2023-01-02T18:18:41.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901505+0000", 2023-01-02T18:18:41.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6619999999999994e-06 2023-01-02T18:18:41.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901514+0000", 2023-01-02T18:18:41.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0059999999999998e-05 2023-01-02T18:18:41.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901564+0000", 2023-01-02T18:18:41.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1318e-05 2023-01-02T18:18:41.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901605+0000", 2023-01-02T18:18:41.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004 2023-01-02T18:18:41.922 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.922 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.922 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.923 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16200 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2560~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.923 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:41.923 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861470317, 2023-01-02T18:18:41.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998, 2023-01-02T18:18:41.924 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.924 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.924 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.924 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.925 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.925 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16200 2023-01-02T18:18:41.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.925 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:41.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.926 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.926 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.927 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:41.927 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:41.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0820000000000001e-06 2023-01-02T18:18:41.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896893+0000", 2023-01-02T18:18:41.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8679999999999999e-06 2023-01-02T18:18:41.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896896+0000", 2023-01-02T18:18:41.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1390000000000002e-06 2023-01-02T18:18:41.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896898+0000", 2023-01-02T18:18:41.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032553590000000002 2023-01-02T18:18:41.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900153+0000", 2023-01-02T18:18:41.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8237000000000003e-05 2023-01-02T18:18:41.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900232+0000", 2023-01-02T18:18:41.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018062300000000001 2023-01-02T18:18:41.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900412+0000", 2023-01-02T18:18:41.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012047169999999999 2023-01-02T18:18:41.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901617+0000", 2023-01-02T18:18:41.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042531099999999999 2023-01-02T18:18:41.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902042+0000", 2023-01-02T18:18:41.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1499000000000003e-05 2023-01-02T18:18:41.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902094+0000", 2023-01-02T18:18:41.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9249000000000003e-05 2023-01-02T18:18:41.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902133+0000", 2023-01-02T18:18:41.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998 2023-01-02T18:18:41.938 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.938 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.938 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.939 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16201 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.939 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:41.939 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861461433000001, 2023-01-02T18:18:41.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004, 2023-01-02T18:18:41.940 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.940 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.940 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.940 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.940 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.941 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16201 2023-01-02T18:18:41.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.941 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.942 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:41.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:41.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4200000000000001e-06 2023-01-02T18:18:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896902+0000", 2023-01-02T18:18:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8849999999999999e-06 2023-01-02T18:18:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896905+0000", 2023-01-02T18:18:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2500000000000001e-06 2023-01-02T18:18:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896907+0000", 2023-01-02T18:18:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038386549999999998 2023-01-02T18:18:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900746+0000", 2023-01-02T18:18:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8287000000000004e-05 2023-01-02T18:18:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900834+0000", 2023-01-02T18:18:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016278899999999999 2023-01-02T18:18:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900997+0000", 2023-01-02T18:18:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011903720000000001 2023-01-02T18:18:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902187+0000", 2023-01-02T18:18:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634200000000004 2023-01-02T18:18:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902704+0000", 2023-01-02T18:18:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.957e-05 2023-01-02T18:18:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902733+0000", 2023-01-02T18:18:41.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4341e-05 2023-01-02T18:18:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902758+0000", 2023-01-02T18:18:41.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004 2023-01-02T18:18:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16202 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861452015999999, 2023-01-02T18:18:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001, 2023-01-02T18:18:41.955 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.956 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16202 2023-01-02T18:18:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:41.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.092e-06 2023-01-02T18:18:41.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896911+0000", 2023-01-02T18:18:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1019999999999999e-06 2023-01-02T18:18:41.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896915+0000", 2023-01-02T18:18:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7930000000000002e-06 2023-01-02T18:18:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896918+0000", 2023-01-02T18:18:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047231770000000003 2023-01-02T18:18:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901641+0000", 2023-01-02T18:18:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2209000000000002e-05 2023-01-02T18:18:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901684+0000", 2023-01-02T18:18:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104726 2023-01-02T18:18:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901788+0000", 2023-01-02T18:18:41.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015539740000000001 2023-01-02T18:18:41.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903342+0000", 2023-01-02T18:18:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1817999999999998e-05 2023-01-02T18:18:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903394+0000", 2023-01-02T18:18:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8734999999999998e-05 2023-01-02T18:18:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903423+0000", 2023-01-02T18:18:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9155000000000001e-05 2023-01-02T18:18:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903452+0000", 2023-01-02T18:18:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001 2023-01-02T18:18:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16203 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861440922, 2023-01-02T18:18:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998, 2023-01-02T18:18:41.970 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16203 2023-01-02T18:18:41.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:41.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896920+0000", 2023-01-02T18:18:41.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1600000000000001e-06 2023-01-02T18:18:41.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896922+0000", 2023-01-02T18:18:41.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5219999999999999e-06 2023-01-02T18:18:41.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896926+0000", 2023-01-02T18:18:41.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9470000000000002e-06 2023-01-02T18:18:41.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896928+0000", 2023-01-02T18:18:41.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052862669999999999 2023-01-02T18:18:41.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902214+0000", 2023-01-02T18:18:41.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3084999999999994e-05 2023-01-02T18:18:41.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902307+0000", 2023-01-02T18:18:41.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013711100000000001 2023-01-02T18:18:41.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902444+0000", 2023-01-02T18:18:41.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090387900000000001 2023-01-02T18:18:41.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903348+0000", 2023-01-02T18:18:41.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015428300000000001 2023-01-02T18:18:41.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903503+0000", 2023-01-02T18:18:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7078999999999999e-05 2023-01-02T18:18:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903530+0000", 2023-01-02T18:18:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9266000000000002e-05 2023-01-02T18:18:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903549+0000", 2023-01-02T18:18:41.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998 2023-01-02T18:18:41.984 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.984 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.985 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.985 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16204 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:41.985 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:41.986 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.861431473, 2023-01-02T18:18:41.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996, 2023-01-02T18:18:41.986 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:41.986 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:41.986 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:41.986 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:41.987 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:41.987 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16204 2023-01-02T18:18:41.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.987 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:41.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:41.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:41.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:41.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:41.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:41.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:41.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:41.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:41.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1679999999999997e-06 2023-01-02T18:18:41.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:41.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896934+0000", 2023-01-02T18:18:41.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.039e-06 2023-01-02T18:18:41.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:41.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896937+0000", 2023-01-02T18:18:41.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0389999999999999e-06 2023-01-02T18:18:41.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:41.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896939+0000", 2023-01-02T18:18:41.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058543179999999998 2023-01-02T18:18:41.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:41.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902793+0000", 2023-01-02T18:18:41.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5451999999999996e-05 2023-01-02T18:18:41.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:41.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902859+0000", 2023-01-02T18:18:41.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5087999999999996e-05 2023-01-02T18:18:41.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:41.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902944+0000", 2023-01-02T18:18:41.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086757900000000005 2023-01-02T18:18:41.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:41.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903811+0000", 2023-01-02T18:18:41.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9238000000000002e-05 2023-01-02T18:18:41.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:41.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903901+0000", 2023-01-02T18:18:41.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0630000000000001e-05 2023-01-02T18:18:41.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:41.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903951+0000", 2023-01-02T18:18:41.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6187999999999998e-05 2023-01-02T18:18:41.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:41.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:41.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904007+0000", 2023-01-02T18:18:41.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996 2023-01-02T18:18:41.999 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.999 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:41.999 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:41.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:41.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.000 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16205 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 0~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e140)", 2023-01-02T18:18:42.000 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:42.000 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.858688453999999, 2023-01-02T18:18:42.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868, 2023-01-02T18:18:42.000 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.001 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:42.001 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.001 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.001 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.001 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16205 2023-01-02T18:18:42.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.002 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:42.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:42.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:42.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899672+0000", 2023-01-02T18:18:42.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2650000000000004e-06 2023-01-02T18:18:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899677+0000", 2023-01-02T18:18:42.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1850000000000004e-06 2023-01-02T18:18:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899686+0000", 2023-01-02T18:18:42.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4259999999999996e-06 2023-01-02T18:18:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899690+0000", 2023-01-02T18:18:42.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576512 2023-01-02T18:18:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903266+0000", 2023-01-02T18:18:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5141000000000005e-05 2023-01-02T18:18:42.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903332+0000", 2023-01-02T18:18:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070156899999999998 2023-01-02T18:18:42.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904033+0000", 2023-01-02T18:18:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0550000000000003e-05 2023-01-02T18:18:42.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904074+0000", 2023-01-02T18:18:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7970000000000001e-05 2023-01-02T18:18:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904142+0000", 2023-01-02T18:18:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868 2023-01-02T18:18:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.012 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16266 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 5632~1024] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e141)", 2023-01-02T18:18:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:42.013 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 13.821669918, 2023-01-02T18:18:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034084089999999998, 2023-01-02T18:18:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.014 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16266 2023-01-02T18:18:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936692+0000", 2023-01-02T18:18:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936690+0000", 2023-01-02T18:18:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0029e-05 2023-01-02T18:18:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936700+0000", 2023-01-02T18:18:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7252999999999999e-05 2023-01-02T18:18:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936717+0000", 2023-01-02T18:18:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2790000000000001e-06 2023-01-02T18:18:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936724+0000", 2023-01-02T18:18:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4746999999999997e-05 2023-01-02T18:18:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936769+0000", 2023-01-02T18:18:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4490000000000002e-06 2023-01-02T18:18:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936776+0000", 2023-01-02T18:18:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003181367 2023-01-02T18:18:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.939958+0000", 2023-01-02T18:18:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8536999999999998e-05 2023-01-02T18:18:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.940026+0000", 2023-01-02T18:18:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3569e-05 2023-01-02T18:18:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.940100+0000", 2023-01-02T18:18:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034084089999999998 2023-01-02T18:18:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28602 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 146432~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e143)", 2023-01-02T18:18:42.027 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.820704051, 2023-01-02T18:18:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996, 2023-01-02T18:18:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:42.028 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28602 2023-01-02T18:18:42.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:42.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:42.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937656+0000", 2023-01-02T18:18:42.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3520000000000003e-06 2023-01-02T18:18:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937663+0000", 2023-01-02T18:18:42.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4744e-05 2023-01-02T18:18:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937677+0000", 2023-01-02T18:18:42.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5119999999999997e-06 2023-01-02T18:18:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937684+0000", 2023-01-02T18:18:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2098999999999997e-05 2023-01-02T18:18:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937736+0000", 2023-01-02T18:18:42.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:18:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937745+0000", 2023-01-02T18:18:42.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073198109999999999 2023-01-02T18:18:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945065+0000", 2023-01-02T18:18:42.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1624000000000002e-05 2023-01-02T18:18:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945156+0000", 2023-01-02T18:18:42.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123879 2023-01-02T18:18:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945280+0000", 2023-01-02T18:18:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996 2023-01-02T18:18:42.040 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.041 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28808 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [assert-version v64,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:18:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 10.745525772000001, 2023-01-02T18:18:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002, 2023-01-02T18:18:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.042 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28808 2023-01-02T18:18:42.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:42.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:42.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012835+0000", 2023-01-02T18:18:42.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0229999999999998e-06 2023-01-02T18:18:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012841+0000", 2023-01-02T18:18:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1938e-05 2023-01-02T18:18:42.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012853+0000", 2023-01-02T18:18:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5520000000000004e-06 2023-01-02T18:18:42.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012858+0000", 2023-01-02T18:18:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9961999999999999e-05 2023-01-02T18:18:42.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012888+0000", 2023-01-02T18:18:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2904e-05 2023-01-02T18:18:42.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012941+0000", 2023-01-02T18:18:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016403699999999999 2023-01-02T18:18:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013105+0000", 2023-01-02T18:18:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074456399999999997 2023-01-02T18:18:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013850+0000", 2023-01-02T18:18:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027539999999999999 2023-01-02T18:18:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016604+0000", 2023-01-02T18:18:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4141999999999999e-05 2023-01-02T18:18:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016638+0000", 2023-01-02T18:18:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7827000000000002e-05 2023-01-02T18:18:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016676+0000", 2023-01-02T18:18:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002 2023-01-02T18:18:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.057 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.057 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.057 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:42.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:42.059 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:42.059+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:42.159 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:42.159+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:42.228 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:42.229 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:42.229 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:42.229 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:42.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:42.260 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:42.259+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:42.360 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:42.360+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:42.368 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:42.369 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:42.369 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:42.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:18:42.380 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:42.461 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:42.461+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:42.525 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 4] out_osds: [3, 5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:42.525 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:42.526 INFO:tasks.thrashosds.thrasher:inject_pause on osd.4 2023-01-02T18:18:42.526 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:18:42.526 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:18:42.526 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok config set filestore_inject_stall 3 2023-01-02T18:18:42.527 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:42.570 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:42.570+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:42.577 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:42.577 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:42.577 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:42.578 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:42.578 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.578 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:18:42.578 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:42.578 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 114.247041063, 2023-01-02T18:18:42.579 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:18:42.579 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.579 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.579 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.579 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.579 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.580 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:42.580 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.580 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.580 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.581 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.581 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:18:42.581 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:42.581 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.582 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.582 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.582 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:18:42.582 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:18:42.582 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.583 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.583 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.583 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:18:42.583 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:18:42.583 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.584 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.584 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:18:42.584 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:42.584 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.585 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.585 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:18:42.585 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:18:42.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.586 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.586 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:18:42.586 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:18:42.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.586 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.587 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.587 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:18:42.587 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:18:42.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.588 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:18:42.588 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:18:42.588 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.588 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.589 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:18:42.589 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:18:42.589 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.589 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.589 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.590 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:18:42.590 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:42.591 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 87.237545667999996, 2023-01-02T18:18:42.591 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:18:42.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.591 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:18:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.592 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:42.593 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:18:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:42.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:18:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:18:42.595 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:18:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:18:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:18:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:18:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.597 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.598 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.598 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:18:42.598 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:18:42.598 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.598 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.599 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.599 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:18:42.599 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:18:42.599 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.600 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:42.600 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:18:42.600 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:18:42.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.601 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.601 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.601 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:18:42.602 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:18:42.602 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.602 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.602 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:18:42.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:18:42.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.603 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.603 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:18:42.603 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:18:42.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.604 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.604 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.604 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:18:42.605 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:42.605 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 82.224488077000004, 2023-01-02T18:18:42.605 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:18:42.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.605 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:42.606 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.606 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:42.606 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:42.606 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:18:42.606 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.606 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.607 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.607 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:42.607 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.608 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:18:42.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:42.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.608 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.609 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:18:42.609 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:18:42.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.610 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.610 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:18:42.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:18:42.610 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:18:42.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:18:42.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:18:42.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:18:42.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:18:42.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:18:42.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:42.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:18:42.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:18:42.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:18:42.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:18:42.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:18:42.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:18:42.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:18:42.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:18:42.617 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.618 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.618 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.618 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:18:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 81.214412847000006, 2023-01-02T18:18:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:18:42.619 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.620 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.620 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.620 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:42.620 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:42.621 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:18:42.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.621 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.621 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.622 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.622 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:42.622 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:18:42.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:42.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:18:42.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:18:42.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:18:42.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:18:42.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:18:42.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:18:42.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:18:42.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:18:42.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:18:42.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:18:42.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:42.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:18:42.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:18:42.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:18:42.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:18:42.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:18:42.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:18:42.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:42.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:18:42.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:18:42.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.633 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:42.633 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:18:42.633 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:18:42.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.634 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:42.634 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:18:42.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:18:42.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.635 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:18:42.635 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:18:42.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:18:42.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:18:42.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.636 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.637 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.637 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:18:42.637 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:42.638 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 77.251263062999996, 2023-01-02T18:18:42.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:18:42.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.638 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:42.638 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.638 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:42.639 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:42.639 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:18:42.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.639 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:42.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:18:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:18:42.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:18:42.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:18:42.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:18:42.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:18:42.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:42.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:18:42.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:18:42.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.646 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.646 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:18:42.646 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:18:42.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.647 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:42.647 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:18:42.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:18:42.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:18:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:18:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:18:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:18:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:18:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:18:42.650 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:18:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 68.245966373000002, 2023-01-02T18:18:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:18:42.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:18:42.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:18:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:18:42.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:18:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:18:42.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:18:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:18:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:18:42.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:18:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:18:42.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:18:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:18:42.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:18:42.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:18:42.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.662 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.662 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:18:42.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:18:42.663 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.663 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.663 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.664 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.664 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:18:42.664 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:42.664 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 58.193517555, 2023-01-02T18:18:42.664 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:18:42.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.665 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.665 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:42.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:18:42.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:42.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:18:42.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:18:42.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:18:42.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:18:42.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:18:42.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:18:42.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:18:42.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:18:42.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:18:42.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:18:42.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:18:42.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:18:42.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.673 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:18:42.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:18:42.674 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:18:42.675 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:18:42.675 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.675 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.675 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:18:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 57.186036667000003, 2023-01-02T18:18:42.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:18:42.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.677 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.677 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.677 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:42.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.678 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.678 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.678 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:18:42.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:42.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:18:42.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:18:42.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:18:42.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:18:42.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:18:42.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:18:42.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:18:42.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:18:42.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:18:42.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:18:42.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:18:42.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:18:42.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:18:42.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:18:42.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:18:42.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:18:42.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.687 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.687 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.688 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.688 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3346 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'3, mlcod=114'1)", 2023-01-02T18:18:42.688 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:42.688 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.138384012000003, 2023-01-02T18:18:42.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001, 2023-01-02T18:18:42.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.689 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.689 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.690 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:42.690 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437185+0000", 2023-01-02T18:18:42.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437183+0000", 2023-01-02T18:18:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00061258099999999995 2023-01-02T18:18:42.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437795+0000", 2023-01-02T18:18:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1458999999999999e-05 2023-01-02T18:18:42.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437817+0000", 2023-01-02T18:18:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0474e-05 2023-01-02T18:18:42.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437827+0000", 2023-01-02T18:18:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8547e-05 2023-01-02T18:18:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437886+0000", 2023-01-02T18:18:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6406000000000001e-05 2023-01-02T18:18:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.437912+0000", 2023-01-02T18:18:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002246938 2023-01-02T18:18:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440159+0000", 2023-01-02T18:18:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5339000000000002e-05 2023-01-02T18:18:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:53.440195+0000", 2023-01-02T18:18:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030099760000000001 2023-01-02T18:18:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.699 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:18:42.700 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 48.134011434000001, 2023-01-02T18:18:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:18:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:42.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:18:42.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:18:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:18:42.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:18:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:18:42.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:18:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:18:42.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:18:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:18:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:18:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:18:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:18:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:18:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:18:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:18:42.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.711 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.711 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:18:42.711 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:18:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.712 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3460 13.1a e122/120 13:5cea7035:::rbd_info:head v 122'1, mlcod=0'0)", 2023-01-02T18:18:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 42.842702306, 2023-01-02T18:18:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091, 2023-01-02T18:18:42.713 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:42.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:42.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732866+0000", 2023-01-02T18:18:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7909999999999999e-06 2023-01-02T18:18:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732873+0000", 2023-01-02T18:18:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1732e-05 2023-01-02T18:18:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732885+0000", 2023-01-02T18:18:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7209999999999997e-06 2023-01-02T18:18:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.732891+0000", 2023-01-02T18:18:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014994499999999999 2023-01-02T18:18:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733041+0000", 2023-01-02T18:18:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9561000000000001e-05 2023-01-02T18:18:42.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.733061+0000", 2023-01-02T18:18:42.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025305760000000001 2023-01-02T18:18:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735591+0000", 2023-01-02T18:18:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7117999999999998e-05 2023-01-02T18:18:42.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:59.735638+0000", 2023-01-02T18:18:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002772091 2023-01-02T18:18:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.723 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3493 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e127)", 2023-01-02T18:18:42.724 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.733904979999998, 2023-01-02T18:18:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998, 2023-01-02T18:18:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.725 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3493 2023-01-02T18:18:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:18:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841661+0000", 2023-01-02T18:18:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8811999999999999e-05 2023-01-02T18:18:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841680+0000", 2023-01-02T18:18:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9380000000000001e-05 2023-01-02T18:18:42.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841699+0000", 2023-01-02T18:18:42.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:18:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841709+0000", 2023-01-02T18:18:42.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010059 2023-01-02T18:18:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841809+0000", 2023-01-02T18:18:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3533e-05 2023-01-02T18:18:42.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841903+0000", 2023-01-02T18:18:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036800899999999998 2023-01-02T18:18:42.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842271+0000", 2023-01-02T18:18:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033624560000000002 2023-01-02T18:18:42.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845633+0000", 2023-01-02T18:18:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020175099999999999 2023-01-02T18:18:42.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845835+0000", 2023-01-02T18:18:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1019999999999998e-05 2023-01-02T18:18:42.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845866+0000", 2023-01-02T18:18:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7328999999999999e-05 2023-01-02T18:18:42.738 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845893+0000", 2023-01-02T18:18:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998 2023-01-02T18:18:42.739 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3494 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e128)", 2023-01-02T18:18:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 33.729375672000003, 2023-01-02T18:18:42.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999, 2023-01-02T18:18:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.742 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3494 2023-01-02T18:18:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:18:42.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846191+0000", 2023-01-02T18:18:42.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4089e-05 2023-01-02T18:18:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846205+0000", 2023-01-02T18:18:42.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8082000000000001e-05 2023-01-02T18:18:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846223+0000", 2023-01-02T18:18:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2023-01-02T18:18:42.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846231+0000", 2023-01-02T18:18:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100853 2023-01-02T18:18:42.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846332+0000", 2023-01-02T18:18:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4294000000000004e-05 2023-01-02T18:18:42.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846406+0000", 2023-01-02T18:18:42.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000381035 2023-01-02T18:18:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846787+0000", 2023-01-02T18:18:42.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029262089999999999 2023-01-02T18:18:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849713+0000", 2023-01-02T18:18:42.752 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022129699999999999 2023-01-02T18:18:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849934+0000", 2023-01-02T18:18:42.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6384000000000003e-05 2023-01-02T18:18:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849971+0000", 2023-01-02T18:18:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9811e-05 2023-01-02T18:18:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.850001+0000", 2023-01-02T18:18:42.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999 2023-01-02T18:18:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3500 13.1c e131/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 131'3, mlcod=130'1)", 2023-01-02T18:18:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.703407881, 2023-01-02T18:18:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999, 2023-01-02T18:18:42.757 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:42.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:18:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872160+0000", 2023-01-02T18:18:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022329899999999998 2023-01-02T18:18:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874393+0000", 2023-01-02T18:18:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.252e-05 2023-01-02T18:18:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874406+0000", 2023-01-02T18:18:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0240000000000003e-06 2023-01-02T18:18:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874415+0000", 2023-01-02T18:18:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0895000000000005e-05 2023-01-02T18:18:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.764 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874486+0000", 2023-01-02T18:18:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4266e-05 2023-01-02T18:18:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.765 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874520+0000", 2023-01-02T18:18:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023338909999999998 2023-01-02T18:18:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876854+0000", 2023-01-02T18:18:42.766 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3161000000000001e-05 2023-01-02T18:18:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876907+0000", 2023-01-02T18:18:42.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999 2023-01-02T18:18:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.768 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3501 13.1c e132/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 132'4, mlcod=130'2)", 2023-01-02T18:18:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 28.696977567000001, 2023-01-02T18:18:42.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001, 2023-01-02T18:18:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878591+0000", 2023-01-02T18:18:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.878589+0000", 2023-01-02T18:18:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011789120000000001 2023-01-02T18:18:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879768+0000", 2023-01-02T18:18:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6392000000000002e-05 2023-01-02T18:18:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879785+0000", 2023-01-02T18:18:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3309999999999998e-06 2023-01-02T18:18:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879792+0000", 2023-01-02T18:18:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4100000000000001e-05 2023-01-02T18:18:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879836+0000", 2023-01-02T18:18:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1690000000000001e-05 2023-01-02T18:18:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.879858+0000", 2023-01-02T18:18:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001682692 2023-01-02T18:18:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881541+0000", 2023-01-02T18:18:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7658999999999999e-05 2023-01-02T18:18:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:13.881588+0000", 2023-01-02T18:18:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029971450000000001 2023-01-02T18:18:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.780 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.781 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3510 13.10 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:18:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 23.664426015, 2023-01-02T18:18:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999, 2023-01-02T18:18:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.782 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3510 2023-01-02T18:18:42.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:42.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:18:42.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911139+0000", 2023-01-02T18:18:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9587000000000001e-05 2023-01-02T18:18:42.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911159+0000", 2023-01-02T18:18:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2842000000000002e-05 2023-01-02T18:18:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911192+0000", 2023-01-02T18:18:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5116999999999999e-05 2023-01-02T18:18:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911207+0000", 2023-01-02T18:18:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000120098 2023-01-02T18:18:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911327+0000", 2023-01-02T18:18:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.536e-06 2023-01-02T18:18:42.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911332+0000", 2023-01-02T18:18:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025961489999999999 2023-01-02T18:18:42.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.913928+0000", 2023-01-02T18:18:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016713700000000001 2023-01-02T18:18:42.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914096+0000", 2023-01-02T18:18:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044610400000000001 2023-01-02T18:18:42.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914542+0000", 2023-01-02T18:18:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027693449999999999 2023-01-02T18:18:42.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917311+0000", 2023-01-02T18:18:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079338599999999998 2023-01-02T18:18:42.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918104+0000", 2023-01-02T18:18:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8297000000000003e-05 2023-01-02T18:18:42.796 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918143+0000", 2023-01-02T18:18:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7084e-05 2023-01-02T18:18:42.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918170+0000", 2023-01-02T18:18:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999 2023-01-02T18:18:42.798 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16265 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 5632~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e141)", 2023-01-02T18:18:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 14.644583431999999, 2023-01-02T18:18:42.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055750219999999998, 2023-01-02T18:18:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:18:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.801 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16265 2023-01-02T18:18:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:18:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930984+0000", 2023-01-02T18:18:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:18:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930991+0000", 2023-01-02T18:18:42.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4295e-05 2023-01-02T18:18:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931005+0000", 2023-01-02T18:18:42.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4080000000000001e-06 2023-01-02T18:18:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931013+0000", 2023-01-02T18:18:42.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051094699999999999 2023-01-02T18:18:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931524+0000", 2023-01-02T18:18:42.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2660000000000001e-06 2023-01-02T18:18:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:42.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931532+0000", 2023-01-02T18:18:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049429119999999998 2023-01-02T18:18:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936475+0000", 2023-01-02T18:18:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5248999999999996e-05 2023-01-02T18:18:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936560+0000", 2023-01-02T18:18:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055750219999999998 2023-01-02T18:18:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:28804 3.1a e143/124 3:5dc8c609:::rbd_data.12a211eeb54d.0000000000000007:head v 143'6, mlcod=0'0)", 2023-01-02T18:18:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.563025842, 2023-01-02T18:18:42.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039422229999999999, 2023-01-02T18:18:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:18:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:18:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2570000000000001e-06 2023-01-02T18:18:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012547+0000", 2023-01-02T18:18:42.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3016999999999999e-05 2023-01-02T18:18:42.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012560+0000", 2023-01-02T18:18:42.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0260000000000001e-06 2023-01-02T18:18:42.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012564+0000", 2023-01-02T18:18:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6282000000000003e-05 2023-01-02T18:18:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012600+0000", 2023-01-02T18:18:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4978e-05 2023-01-02T18:18:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012615+0000", 2023-01-02T18:18:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038441149999999999 2023-01-02T18:18:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016459+0000", 2023-01-02T18:18:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5772e-05 2023-01-02T18:18:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016485+0000", 2023-01-02T18:18:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039422229999999999 2023-01-02T18:18:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:28808 3.6 e143/43 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head v 143'65, mlcod=142'63)", 2023-01-02T18:18:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 11.562393924, 2023-01-02T18:18:42.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033349730000000002, 2023-01-02T18:18:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:18:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013174+0000", 2023-01-02T18:18:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:18:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013180+0000", 2023-01-02T18:18:42.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7759999999999992e-06 2023-01-02T18:18:42.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013190+0000", 2023-01-02T18:18:42.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1320000000000004e-06 2023-01-02T18:18:42.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013194+0000", 2023-01-02T18:18:42.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0168999999999999e-05 2023-01-02T18:18:42.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.833 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013224+0000", 2023-01-02T18:18:42.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.819e-05 2023-01-02T18:18:42.833 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.833 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.834 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.834 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013242+0000", 2023-01-02T18:18:42.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003244963 2023-01-02T18:18:42.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016487+0000", 2023-01-02T18:18:42.835 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2412000000000002e-05 2023-01-02T18:18:42.835 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016510+0000", 2023-01-02T18:18:42.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033349730000000002 2023-01-02T18:18:42.836 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.836 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.836 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.837 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28849 3.0 3:04b18237:::rbd_object_map.12a229f0e522:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:18:42.837 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:33.128189+0000", 2023-01-02T18:18:42.837 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 9.4473799750000005, 2023-01-02T18:18:42.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028951620000000002, 2023-01-02T18:18:42.838 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:42.838 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:42.838 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:42.838 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:42.839 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:42.839 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28849 2023-01-02T18:18:42.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.839 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:42.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:42.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128189+0000", 2023-01-02T18:18:42.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:42.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:42.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128189+0000", 2023-01-02T18:18:42.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:42.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:42.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128185+0000", 2023-01-02T18:18:42.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9068000000000001e-05 2023-01-02T18:18:42.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:42.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128204+0000", 2023-01-02T18:18:42.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3564e-05 2023-01-02T18:18:42.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128228+0000", 2023-01-02T18:18:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2999e-05 2023-01-02T18:18:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128241+0000", 2023-01-02T18:18:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7799999999999995e-05 2023-01-02T18:18:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:42.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128309+0000", 2023-01-02T18:18:42.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00019309700000000001 2023-01-02T18:18:42.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:42.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128502+0000", 2023-01-02T18:18:42.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028643800000000002 2023-01-02T18:18:42.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:42.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.128788+0000", 2023-01-02T18:18:42.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001263803 2023-01-02T18:18:42.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:42.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.130052+0000", 2023-01-02T18:18:42.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00091507100000000005 2023-01-02T18:18:42.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.850 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:42.850 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.130967+0000", 2023-01-02T18:18:42.850 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8299000000000005e-05 2023-01-02T18:18:42.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:42.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.131036+0000", 2023-01-02T18:18:42.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8313000000000003e-05 2023-01-02T18:18:42.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:42.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:42.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:42.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:33.131084+0000", 2023-01-02T18:18:42.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028951620000000002 2023-01-02T18:18:42.852 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.853 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.853 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.853 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:42.853 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:42.853 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:42.855 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:42.856 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-01-02T18:18:42.856 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:42.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:42.857 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:42.854+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:42.858 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:42.859 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:42.859 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:42.859 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:42.859 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:42.860 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:42.860 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:42.860 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:42.861 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:42.861 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:42.861 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:42.861 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:42.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:42.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:42.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:42.862 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:42.956 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:42.955+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:43.037 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:43.037 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:43.048 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:43.056 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:43.056+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:43.157 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:43.157+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:43.183 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:43.183 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:43.194 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:43.258 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:43.259+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:43.329 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:43.329 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:43.349 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:43.390 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:43.391+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:43.460 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:43.460+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:43.560 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:43.560+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:43.575 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:43.575 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:43.602 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:43.665 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:18:43.666 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:43.666+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:43.761 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:43.761+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:43.812 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:43.813 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:43.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:43.862 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:43.862+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:43.963 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:43.964+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:43.982 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:43.982 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:43.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:44.064 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:44.064+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:44.127 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:44.127 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:44.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:44.178 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:44.178+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:44.266 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:44.265+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:44.302 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:44.302 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:44.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:44.396 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:44.396+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:44.468 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:44.468+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:44.477 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:44.478 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:44.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:44.571 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:44.571+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:44.653 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:44.653 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:44.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:44.669 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:44.670+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:44.770 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:44.771+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:44.827 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:44.828 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:44.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:44.864 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:44.880 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:44.880+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:44.962 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:44.963 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:44.971 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:44.972+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:44.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:45.072 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:45.073+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:45.078 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:45.097 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:45.116 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:45.135 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:45.139 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:45.139 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:45.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:45.154 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:45.173 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:45.174+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:45.173 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:45.193 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:45.211 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:45.213 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:45.214 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:45.215 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:45.274 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:45.274 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:45.274 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:45.274 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:45.275 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:45.275 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:45.275+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:45.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:45.354 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.354 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.354 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.355 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.355 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.355 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.355 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.355 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.355 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.356 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.356 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.356 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.356 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.356 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.357 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.357 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:45.357 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.357 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.357 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:45.358 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.358 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.358 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.358 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.359 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.359 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.359 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.359 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.359 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.360 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.360 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.360 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.360 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.360 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.361 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.361 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.361 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.361 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.361 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.361 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.362 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.362 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.362 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.362 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.362 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.362 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.363 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.363 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.363 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.363 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.363 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:45.363 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.364 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.364 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:45.364 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.364 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.364 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.365 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.365 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.365 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.365 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.365 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.365 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.366 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.366 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.366 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.366 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.366 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.367 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.367 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.367 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.367 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.367 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.367 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.368 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.368 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.368 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.368 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.369 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.369 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.369 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.369 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.369 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.370 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.370 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:45.370 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.370 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.370 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:45.370 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.371 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.371 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.371 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.371 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.371 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.372 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.372 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.372 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.372 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.372 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.373 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.373 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.373 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.373 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.373 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.373 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.374 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.374 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.374 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.374 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.374 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.374 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.375 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:45.375 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:45.375 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:45.375 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:45.375 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:45.376 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.376 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.376 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:45.376 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:45.376 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:45.376 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:45.377 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:45.377 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:45.377 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:45.377 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:45.377 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 4 2023-01-02T18:18:45.377 INFO:tasks.workunit.client.0.smithi007.stdout:read: 4 2023-01-02T18:18:45.378 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestEncryptionLUKS2 (12237 ms) 2023-01-02T18:18:45.378 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestIOWithIOHint 2023-01-02T18:18:45.378 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:45.379 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:45.380+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:45.417 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.418 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:18:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.111854123, 2023-01-02T18:18:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:18:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.419 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:18:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.420 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:45.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:18:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:18:45.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:18:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:18:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:18:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:18:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:18:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:18:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:18:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:18:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:18:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:18:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:18:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:18:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:18:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:18:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:18:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:18:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:18:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:18:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:18:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:18:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:18:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:18:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:18:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:18:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.10672590199999, 2023-01-02T18:18:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:18:45.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.437 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:18:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:45.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:45.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:18:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:18:45.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:18:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:18:45.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:18:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:18:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:18:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:18:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:18:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:18:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:18:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:18:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:18:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:18:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:18:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:18:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:18:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:18:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:18:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:18:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:18:45.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:18:45.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:18:45.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:18:45.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:18:45.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:18:45.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.452 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.453 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:18:45.453 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:45.454 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.816661409000005, 2023-01-02T18:18:45.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:18:45.454 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.454 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.454 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.455 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.455 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.455 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:18:45.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.455 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:45.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:45.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:45.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:18:45.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:18:45.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:18:45.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:18:45.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:18:45.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:18:45.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:18:45.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:18:45.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:18:45.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:18:45.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:45.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:18:45.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:18:45.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:18:45.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:18:45.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:18:45.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:18:45.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:45.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:18:45.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:18:45.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:18:45.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:18:45.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:18:45.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:18:45.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:18:45.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:18:45.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:18:45.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:18:45.471 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.471 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.471 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.471 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:18:45.472 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:45.472 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.817936066000001, 2023-01-02T18:18:45.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:18:45.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.472 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.473 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:18:45.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.474 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:45.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:45.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:45.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:18:45.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:18:45.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:18:45.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:18:45.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:18:45.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:18:45.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:18:45.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:18:45.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:18:45.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:18:45.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:45.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:18:45.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:18:45.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:18:45.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:18:45.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:18:45.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:18:45.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:45.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:18:45.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:18:45.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:18:45.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:18:45.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:18:45.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:18:45.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:18:45.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:18:45.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:18:45.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:18:45.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.489 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.490 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:18:45.490 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:45.490 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.793574301999996, 2023-01-02T18:18:45.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:18:45.490 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.491 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.491 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.491 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.491 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.491 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:18:45.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.492 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:45.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:45.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:45.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:18:45.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:18:45.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:18:45.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:18:45.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:18:45.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:18:45.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:18:45.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:18:45.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:18:45.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:18:45.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:18:45.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:18:45.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:45.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:18:45.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:18:45.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:18:45.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:18:45.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:18:45.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:18:45.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:18:45.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:18:45.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:18:45.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:18:45.505 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.505 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.505 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.506 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:45.506 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:45.506 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.087979634000007, 2023-01-02T18:18:45.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:18:45.506 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.507 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.507 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.507 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.507 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.508 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:18:45.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.508 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:45.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:45.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:45.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:18:45.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:18:45.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:18:45.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:18:45.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:18:45.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:18:45.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:18:45.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:18:45.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:18:45.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:18:45.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:18:45.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:18:45.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:45.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:18:45.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:18:45.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:18:45.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:18:45.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:18:45.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:18:45.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:18:45.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:18:45.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:18:45.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:18:45.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.521 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.521 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.522 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3321 11.1 11:81555d77:::rbd_object_map.12a2d6b452e6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:45.522 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:45.522 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.080274566, 2023-01-02T18:18:45.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002, 2023-01-02T18:18:45.523 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.523 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.523 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.523 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.523 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.524 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3321 2023-01-02T18:18:45.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.524 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:45.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:45.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:45.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336122+0000", 2023-01-02T18:18:45.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000004e-06 2023-01-02T18:18:45.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336130+0000", 2023-01-02T18:18:45.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4102e-05 2023-01-02T18:18:45.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336144+0000", 2023-01-02T18:18:45.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8210000000000004e-06 2023-01-02T18:18:45.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336151+0000", 2023-01-02T18:18:45.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6598999999999998e-05 2023-01-02T18:18:45.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336208+0000", 2023-01-02T18:18:45.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8439999999999998e-06 2023-01-02T18:18:45.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:45.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336216+0000", 2023-01-02T18:18:45.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028909740000000001 2023-01-02T18:18:45.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339107+0000", 2023-01-02T18:18:45.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1304999999999994e-05 2023-01-02T18:18:45.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339198+0000", 2023-01-02T18:18:45.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030390899999999999 2023-01-02T18:18:45.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:45.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339502+0000", 2023-01-02T18:18:45.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00165285 2023-01-02T18:18:45.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341155+0000", 2023-01-02T18:18:45.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00047942200000000002 2023-01-02T18:18:45.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341634+0000", 2023-01-02T18:18:45.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1620999999999998e-05 2023-01-02T18:18:45.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341696+0000", 2023-01-02T18:18:45.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0988999999999997e-05 2023-01-02T18:18:45.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341737+0000", 2023-01-02T18:18:45.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002 2023-01-02T18:18:45.539 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.539 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.539 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.540 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3327 11.9 e106/102 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head v 106'2, mlcod=0'0)", 2023-01-02T18:18:45.540 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:40.350682+0000", 2023-01-02T18:18:45.540 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.065716159999994, 2023-01-02T18:18:45.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051016009999999999, 2023-01-02T18:18:45.540 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.541 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.541 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.350682+0000", 2023-01-02T18:18:45.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.350682+0000", 2023-01-02T18:18:45.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:45.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.350681+0000", 2023-01-02T18:18:45.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00096689599999999997 2023-01-02T18:18:45.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351648+0000", 2023-01-02T18:18:45.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3237999999999999e-05 2023-01-02T18:18:45.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351661+0000", 2023-01-02T18:18:45.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2079999999999997e-06 2023-01-02T18:18:45.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351667+0000", 2023-01-02T18:18:45.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5334000000000002e-05 2023-01-02T18:18:45.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351723+0000", 2023-01-02T18:18:45.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4102999999999999e-05 2023-01-02T18:18:45.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351747+0000", 2023-01-02T18:18:45.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039982309999999997 2023-01-02T18:18:45.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.355745+0000", 2023-01-02T18:18:45.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8974999999999999e-05 2023-01-02T18:18:45.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.355784+0000", 2023-01-02T18:18:45.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051016009999999999 2023-01-02T18:18:45.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.550 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.551 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.551 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:18:45.551 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:45.551 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.035571816999997, 2023-01-02T18:18:45.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:18:45.552 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.552 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.552 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.552 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.553 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.553 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:18:45.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.553 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:45.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:45.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:18:45.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:18:45.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:18:45.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:18:45.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:18:45.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:18:45.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:18:45.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:18:45.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:18:45.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:18:45.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:18:45.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:18:45.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:18:45.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:45.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:18:45.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:18:45.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:18:45.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:18:45.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:18:45.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:18:45.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:18:45.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:18:45.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:18:45.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:18:45.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.566 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.566 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.567 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:18:45.567 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:45.567 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 56.005242301000003, 2023-01-02T18:18:45.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:18:45.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.568 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.568 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.568 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.568 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.568 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:18:45.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.569 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:45.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:45.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:18:45.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:18:45.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:18:45.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:18:45.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:18:45.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:18:45.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:18:45.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:18:45.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:18:45.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:18:45.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:18:45.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:18:45.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:18:45.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:45.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:18:45.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:18:45.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:18:45.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:18:45.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:18:45.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:18:45.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:18:45.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:18:45.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:18:45.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:18:45.581 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.581 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.581 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.582 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3341 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e112)", 2023-01-02T18:18:45.582 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:45.582 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 54.996459035999997, 2023-01-02T18:18:45.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051817290000000004, 2023-01-02T18:18:45.583 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.583 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.583 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.583 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.584 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3341 2023-01-02T18:18:45.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.584 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:45.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419937+0000", 2023-01-02T18:18:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6713000000000001e-05 2023-01-02T18:18:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419953+0000", 2023-01-02T18:18:45.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2670000000000001e-05 2023-01-02T18:18:45.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419976+0000", 2023-01-02T18:18:45.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4169999999999998e-06 2023-01-02T18:18:45.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419985+0000", 2023-01-02T18:18:45.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012351199999999999 2023-01-02T18:18:45.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420109+0000", 2023-01-02T18:18:45.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5488999999999995e-05 2023-01-02T18:18:45.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420184+0000", 2023-01-02T18:18:45.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035263699999999999 2023-01-02T18:18:45.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:45.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420537+0000", 2023-01-02T18:18:45.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038774510000000001 2023-01-02T18:18:45.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.424414+0000", 2023-01-02T18:18:45.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063741700000000004 2023-01-02T18:18:45.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425052+0000", 2023-01-02T18:18:45.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5787999999999997e-05 2023-01-02T18:18:45.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425088+0000", 2023-01-02T18:18:45.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3402999999999999e-05 2023-01-02T18:18:45.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425121+0000", 2023-01-02T18:18:45.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051817290000000004 2023-01-02T18:18:45.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.597 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.597 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.597 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:45.598 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:45.598 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 49.904795636000003, 2023-01-02T18:18:45.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:18:45.598 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.598 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.599 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:18:45.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.599 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:45.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:45.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:45.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:18:45.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:18:45.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:18:45.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:18:45.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:18:45.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:18:45.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:18:45.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:18:45.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:18:45.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:18:45.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:18:45.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:18:45.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:45.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:18:45.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:18:45.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:18:45.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:18:45.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:18:45.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:18:45.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:18:45.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:18:45.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:18:45.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:18:45.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.612 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.613 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:18:45.613 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:45.613 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.549258389999999, 2023-01-02T18:18:45.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:18:45.613 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.614 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.614 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:18:45.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.615 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:45.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:45.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:45.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:18:45.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:18:45.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:18:45.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:18:45.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:18:45.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:18:45.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:18:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:18:45.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:18:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:18:45.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:18:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:18:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:18:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:18:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:18:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:18:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:18:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:18:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:18:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:18:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:18:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:18:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:18:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:18:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:18:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:18:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:18:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.538353746999999, 2023-01-02T18:18:45.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:18:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.631 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:18:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:18:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:18:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:18:45.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:18:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:18:45.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:18:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:18:45.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:18:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:18:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:18:45.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:18:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:18:45.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:18:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:18:45.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:18:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:18:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:18:45.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:18:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:18:45.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:18:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:18:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:18:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:18:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.644 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:18:45.645 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.512410908, 2023-01-02T18:18:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:18:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.646 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:18:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:18:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:18:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:18:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:18:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:18:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:18:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:18:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:18:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:18:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:18:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:18:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:18:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:18:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:18:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:18:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:18:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:18:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:18:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:18:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:18:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:18:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:18:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:18:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:18:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:18:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:18:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:18:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.737633793000001, 2023-01-02T18:18:45.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:18:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.664 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:18:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:18:45.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:18:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:18:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:18:45.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:18:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:18:45.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:18:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:18:45.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:18:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:18:45.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:18:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:18:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:18:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:18:45.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:18:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:18:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:18:45.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:18:45.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.675 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.676 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:18:45.676 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:45.677 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.69312876, 2023-01-02T18:18:45.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:18:45.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.678 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:18:45.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.678 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:45.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:45.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:45.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:18:45.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:18:45.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:18:45.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:18:45.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:18:45.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:18:45.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:18:45.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:18:45.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:18:45.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:18:45.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:18:45.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:18:45.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:45.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:18:45.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:18:45.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:18:45.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:18:45.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:18:45.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:18:45.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:18:45.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:18:45.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:18:45.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:18:45.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.691 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.692 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:18:45.692 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:45.692 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.4921455039999998, 2023-01-02T18:18:45.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:18:45.692 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.693 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.693 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:18:45.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.694 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:45.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:45.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:45.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:18:45.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:18:45.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:18:45.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:18:45.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:18:45.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:18:45.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:18:45.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:18:45.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:18:45.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:18:45.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:18:45.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:18:45.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:45.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:18:45.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:18:45.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:18:45.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:18:45.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:18:45.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:18:45.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:18:45.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:18:45.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:18:45.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:18:45.706 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.706 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.707 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.707 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:18:45.707 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:45.707 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.290892801, 2023-01-02T18:18:45.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:18:45.708 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.708 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:45.708 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.708 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.709 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.709 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:18:45.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.709 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:45.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:45.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:45.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:18:45.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:18:45.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:18:45.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:18:45.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:18:45.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:18:45.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:18:45.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:18:45.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:18:45.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:18:45.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:18:45.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:18:45.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:45.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:18:45.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:18:45.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:45.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:18:45.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:18:45.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:45.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:18:45.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:18:45.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:45.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:18:45.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:18:45.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:18:45.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:18:45.721 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.722 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.722 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35555 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [read 45056~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e149)", 2023-01-02T18:18:45.723 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:45.723 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.0190663359999999, 2023-01-02T18:18:45.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997, 2023-01-02T18:18:45.723 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:45.723 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:45.724 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:45.724 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:45.724 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:45.724 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35555 2023-01-02T18:18:45.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.724 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:45.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:45.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:45.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:45.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:45.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:45.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:45.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:45.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:45.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5999999999999998e-06 2023-01-02T18:18:45.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:45.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397335+0000", 2023-01-02T18:18:45.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0539999999999997e-06 2023-01-02T18:18:45.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:45.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397342+0000", 2023-01-02T18:18:45.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2090000000000001e-06 2023-01-02T18:18:45.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:45.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397345+0000", 2023-01-02T18:18:45.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5210000000000002e-05 2023-01-02T18:18:45.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:45.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397401+0000", 2023-01-02T18:18:45.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8177999999999996e-05 2023-01-02T18:18:45.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:45.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397479+0000", 2023-01-02T18:18:45.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052113059999999998 2023-01-02T18:18:45.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:45.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:45.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:45.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.402690+0000", 2023-01-02T18:18:45.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997 2023-01-02T18:18:45.733 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.733 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.733 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:45.734 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:45.734 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:45.735 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:18:45.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:45.737 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:45.735+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:45.836 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:45.835+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:45.908 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:45.908 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:45.908 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:45.918 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:45.958 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:45.958+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:46.038 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:46.039+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:46.084 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:46.085 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:46.085 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:46.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:46.139 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:46.140+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:46.223 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:46.223 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:46.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:53 3.f 3:f5b90545:::rbd_header.12a279b662cb:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:46.224 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 126.71475022200001, 2023-01-02T18:18:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038254109999999999, 2023-01-02T18:18:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.225 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 53 2023-01-02T18:18:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.226 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:46.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:46.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507237+0000", 2023-01-02T18:18:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2023-01-02T18:18:46.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507245+0000", 2023-01-02T18:18:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2310000000000002e-06 2023-01-02T18:18:46.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507254+0000", 2023-01-02T18:18:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.49e-06 2023-01-02T18:18:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507262+0000", 2023-01-02T18:18:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3300000000000001e-05 2023-01-02T18:18:46.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507316+0000", 2023-01-02T18:18:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2240000000000003e-06 2023-01-02T18:18:46.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507321+0000", 2023-01-02T18:18:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019239249999999999 2023-01-02T18:18:46.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509245+0000", 2023-01-02T18:18:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133907 2023-01-02T18:18:46.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509379+0000", 2023-01-02T18:18:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000258886 2023-01-02T18:18:46.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509638+0000", 2023-01-02T18:18:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001055587 2023-01-02T18:18:46.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510693+0000", 2023-01-02T18:18:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256445 2023-01-02T18:18:46.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510950+0000", 2023-01-02T18:18:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7262000000000002e-05 2023-01-02T18:18:46.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511007+0000", 2023-01-02T18:18:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7481000000000001e-05 2023-01-02T18:18:46.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511064+0000", 2023-01-02T18:18:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038254109999999999 2023-01-02T18:18:46.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.242 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:18:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 118.90393894499999, 2023-01-02T18:18:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:18:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.243 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:18:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.244 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:46.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:46.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:18:46.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:18:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:18:46.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:18:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:18:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:18:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:18:46.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:18:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:18:46.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:18:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:18:46.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:18:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:18:46.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:18:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:18:46.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:18:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:18:46.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:18:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:18:46.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:18:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:18:46.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:18:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:18:46.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:18:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:18:46.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:18:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:18:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 113.88885548899999, 2023-01-02T18:18:46.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:18:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:18:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:18:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:18:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:18:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:18:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:18:46.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:18:46.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:18:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:18:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:18:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:18:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:18:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:18:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:18:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:18:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:18:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:18:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:18:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:18:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:18:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:18:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:18:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:18:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:18:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:18:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:18:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:18:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.278 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:18:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:46.279 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.904157912, 2023-01-02T18:18:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:18:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.280 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:18:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:18:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:18:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:18:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:18:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:18:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:18:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:18:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:18:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:18:46.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:18:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:18:46.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:18:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:18:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:18:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:18:46.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:18:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:18:46.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:18:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:18:46.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:18:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:18:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:18:46.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:18:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:18:46.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:18:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:18:46.295 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.906133221000005, 2023-01-02T18:18:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:18:46.297 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:18:46.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:46.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:46.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:18:46.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:18:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:18:46.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:18:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:18:46.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:18:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:18:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:18:46.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:18:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:18:46.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:18:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:18:46.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:18:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:18:46.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:18:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:18:46.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:18:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:18:46.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:18:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:18:46.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:18:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:18:46.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:18:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:18:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:18:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:18:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.313 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:46.314 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.905074767000002, 2023-01-02T18:18:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:18:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.315 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:18:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:18:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:18:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:18:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:18:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:18:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:18:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:18:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:18:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:18:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:18:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:18:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:18:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:18:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:18:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:18:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:18:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:18:46.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:18:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:18:46.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:18:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:18:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:18:46.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:18:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:18:46.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:18:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:18:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:18:46.331 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.899710119999995, 2023-01-02T18:18:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:18:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:18:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:18:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:18:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:18:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:18:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:18:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:18:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:18:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:18:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:18:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:18:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:18:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:18:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:18:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:18:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:18:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:18:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:18:46.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:18:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:18:46.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:18:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:18:46.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:18:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:18:46.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:18:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:18:46.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:18:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2191 3.13 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:18:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.881871505999996, 2023-01-02T18:18:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996, 2023-01-02T18:18:46.349 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:46.350 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2191 2023-01-02T18:18:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340115+0000", 2023-01-02T18:18:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2921999999999999e-05 2023-01-02T18:18:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340128+0000", 2023-01-02T18:18:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9213000000000001e-05 2023-01-02T18:18:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340147+0000", 2023-01-02T18:18:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0695e-05 2023-01-02T18:18:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340158+0000", 2023-01-02T18:18:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1227000000000001e-05 2023-01-02T18:18:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340229+0000", 2023-01-02T18:18:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7239999999999992e-06 2023-01-02T18:18:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340237+0000", 2023-01-02T18:18:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001423248 2023-01-02T18:18:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341660+0000", 2023-01-02T18:18:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158319 2023-01-02T18:18:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341818+0000", 2023-01-02T18:18:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019205099999999999 2023-01-02T18:18:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:46.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.342011+0000", 2023-01-02T18:18:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001641558 2023-01-02T18:18:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.343652+0000", 2023-01-02T18:18:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001445895 2023-01-02T18:18:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345098+0000", 2023-01-02T18:18:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4589000000000003e-05 2023-01-02T18:18:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345143+0000", 2023-01-02T18:18:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9351000000000001e-05 2023-01-02T18:18:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345172+0000", 2023-01-02T18:18:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996 2023-01-02T18:18:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 83.859378620000001, 2023-01-02T18:18:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:18:46.367 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:46.368 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:18:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:18:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:18:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:18:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:18:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:18:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:18:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:18:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:18:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:18:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:18:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:18:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:18:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:18:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:18:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:18:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:18:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:46.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:18:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:18:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:18:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:18:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:18:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:18:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:18:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:18:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:18:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:18:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.854808370000001, 2023-01-02T18:18:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:18:46.385 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:46.386 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:18:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:18:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:18:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:18:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:18:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:18:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:18:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:18:46.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:18:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:18:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:18:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:18:46.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:18:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:18:46.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:18:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:18:46.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:18:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:18:46.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:18:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:18:46.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:18:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:18:46.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:18:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:18:46.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:18:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:18:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:18:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:18:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.841976353999996, 2023-01-02T18:18:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:18:46.403 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:46.404 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:18:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:46.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:46.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:18:46.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:18:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:18:46.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:18:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:18:46.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:18:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:18:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:18:46.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:18:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:18:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:18:46.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:18:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:18:46.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:18:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:18:46.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:18:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:18:46.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:18:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:18:46.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:18:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:18:46.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:18:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:18:46.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:18:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:18:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.420 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:18:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.893242854999997, 2023-01-02T18:18:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:18:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.421 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:18:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.422 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:18:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:18:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:18:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:18:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:18:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:18:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:18:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:18:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:18:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:18:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:18:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:18:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:18:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:18:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:18:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:18:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:46.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:18:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:18:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:18:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:18:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:18:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:18:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:18:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:18:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:18:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:18:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.893399801000001, 2023-01-02T18:18:46.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:18:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:18:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:18:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:18:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:18:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:18:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:18:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:18:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:18:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:18:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:18:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:18:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:18:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:18:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:18:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:18:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:18:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:18:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:18:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:18:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:18:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:18:46.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:18:46.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:18:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3381 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch unwatch cookie 140114584663936] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 50.744706295999997, 2023-01-02T18:18:46.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047545959999999998, 2023-01-02T18:18:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.456 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3381 2023-01-02T18:18:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477282+0000", 2023-01-02T18:18:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0690000000000003e-06 2023-01-02T18:18:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477286+0000", 2023-01-02T18:18:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.61e-06 2023-01-02T18:18:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477294+0000", 2023-01-02T18:18:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.19e-06 2023-01-02T18:18:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477297+0000", 2023-01-02T18:18:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016576899999999999 2023-01-02T18:18:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477463+0000", 2023-01-02T18:18:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4697999999999996e-05 2023-01-02T18:18:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477527+0000", 2023-01-02T18:18:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012896699999999999 2023-01-02T18:18:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477656+0000", 2023-01-02T18:18:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092177700000000003 2023-01-02T18:18:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.478578+0000", 2023-01-02T18:18:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033212659999999998 2023-01-02T18:18:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.481899+0000", 2023-01-02T18:18:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8207999999999997e-05 2023-01-02T18:18:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.481938+0000", 2023-01-02T18:18:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9822999999999996e-05 2023-01-02T18:18:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482037+0000", 2023-01-02T18:18:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047545959999999998 2023-01-02T18:18:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.470 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3382 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+full_try e117)", 2023-01-02T18:18:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:46.471 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 50.744471427999997, 2023-01-02T18:18:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046394139999999997, 2023-01-02T18:18:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.472 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3382 2023-01-02T18:18:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477516+0000", 2023-01-02T18:18:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0870000000000001e-06 2023-01-02T18:18:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477523+0000", 2023-01-02T18:18:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7181999999999999e-05 2023-01-02T18:18:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477541+0000", 2023-01-02T18:18:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.276e-05 2023-01-02T18:18:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477553+0000", 2023-01-02T18:18:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000346912 2023-01-02T18:18:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477900+0000", 2023-01-02T18:18:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7819999999999996e-05 2023-01-02T18:18:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477988+0000", 2023-01-02T18:18:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762630000000001 2023-01-02T18:18:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482064+0000", 2023-01-02T18:18:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0998000000000003e-05 2023-01-02T18:18:46.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482105+0000", 2023-01-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1690999999999997e-05 2023-01-02T18:18:46.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482157+0000", 2023-01-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046394139999999997 2023-01-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.484 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.485 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3409 11.3 e117/102 11:c4c92e5a:::rbd_trash:head v 117'10, mlcod=117'8)", 2023-01-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 50.715746473000003, 2023-01-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042507309999999998, 2023-01-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.486 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506242+0000", 2023-01-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3999999999999998e-06 2023-01-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506251+0000", 2023-01-02T18:18:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1779e-05 2023-01-02T18:18:46.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506263+0000", 2023-01-02T18:18:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2020000000000003e-06 2023-01-02T18:18:46.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506268+0000", 2023-01-02T18:18:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6593e-05 2023-01-02T18:18:46.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506305+0000", 2023-01-02T18:18:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2292e-05 2023-01-02T18:18:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506317+0000", 2023-01-02T18:18:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004147548 2023-01-02T18:18:46.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.510465+0000", 2023-01-02T18:18:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8863000000000001e-05 2023-01-02T18:18:46.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.510493+0000", 2023-01-02T18:18:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042507309999999998 2023-01-02T18:18:46.496 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.497 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3486 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:18:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 43.409589797999999, 2023-01-02T18:18:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004, 2023-01-02T18:18:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.498 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3486 2023-01-02T18:18:46.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:46.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812397+0000", 2023-01-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0736e-05 2023-01-02T18:18:46.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812408+0000", 2023-01-02T18:18:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8725000000000001e-05 2023-01-02T18:18:46.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812427+0000", 2023-01-02T18:18:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6719999999999993e-06 2023-01-02T18:18:46.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812435+0000", 2023-01-02T18:18:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8585000000000003e-05 2023-01-02T18:18:46.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812484+0000", 2023-01-02T18:18:46.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014839399999999999 2023-01-02T18:18:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812632+0000", 2023-01-02T18:18:46.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00048733700000000001 2023-01-02T18:18:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.813120+0000", 2023-01-02T18:18:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031693730000000001 2023-01-02T18:18:46.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.816289+0000", 2023-01-02T18:18:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00079880000000000001 2023-01-02T18:18:46.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817088+0000", 2023-01-02T18:18:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9833000000000001e-05 2023-01-02T18:18:46.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817148+0000", 2023-01-02T18:18:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2119000000000001e-05 2023-01-02T18:18:46.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817190+0000", 2023-01-02T18:18:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004 2023-01-02T18:18:46.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.513 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3487 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:18:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.404431002000003, 2023-01-02T18:18:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045799999999999999, 2023-01-02T18:18:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.514 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3487 2023-01-02T18:18:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.515 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:46.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817555+0000", 2023-01-02T18:18:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3555e-05 2023-01-02T18:18:46.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817568+0000", 2023-01-02T18:18:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8287e-05 2023-01-02T18:18:46.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817587+0000", 2023-01-02T18:18:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6570000000000003e-06 2023-01-02T18:18:46.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817595+0000", 2023-01-02T18:18:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3665000000000002e-05 2023-01-02T18:18:46.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817649+0000", 2023-01-02T18:18:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2825999999999996e-05 2023-01-02T18:18:46.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817732+0000", 2023-01-02T18:18:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042540399999999999 2023-01-02T18:18:46.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.818157+0000", 2023-01-02T18:18:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033449220000000002 2023-01-02T18:18:46.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.821502+0000", 2023-01-02T18:18:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052594299999999996 2023-01-02T18:18:46.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822028+0000", 2023-01-02T18:18:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2504999999999999e-05 2023-01-02T18:18:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822091+0000", 2023-01-02T18:18:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7435999999999998e-05 2023-01-02T18:18:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822138+0000", 2023-01-02T18:18:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045799999999999999 2023-01-02T18:18:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.528 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3488 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e126)", 2023-01-02T18:18:46.529 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.399512205000001, 2023-01-02T18:18:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004, 2023-01-02T18:18:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3488 2023-01-02T18:18:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.531 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822474+0000", 2023-01-02T18:18:46.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8097999999999999e-05 2023-01-02T18:18:46.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822492+0000", 2023-01-02T18:18:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4201000000000001e-05 2023-01-02T18:18:46.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822516+0000", 2023-01-02T18:18:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1077000000000001e-05 2023-01-02T18:18:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822527+0000", 2023-01-02T18:18:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0508999999999998e-05 2023-01-02T18:18:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822608+0000", 2023-01-02T18:18:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1670999999999999e-05 2023-01-02T18:18:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822679+0000", 2023-01-02T18:18:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030685400000000001 2023-01-02T18:18:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822986+0000", 2023-01-02T18:18:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002756896 2023-01-02T18:18:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.825743+0000", 2023-01-02T18:18:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014320229999999999 2023-01-02T18:18:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827175+0000", 2023-01-02T18:18:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6622999999999998e-05 2023-01-02T18:18:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827212+0000", 2023-01-02T18:18:46.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3500000000000001e-05 2023-01-02T18:18:46.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827245+0000", 2023-01-02T18:18:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004 2023-01-02T18:18:46.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.545 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.350360577, 2023-01-02T18:18:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:18:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:46.547 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:46.547 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:46.547 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:46.547 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:18:46.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.547 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:46.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:46.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:46.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:46.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:46.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:46.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:46.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:18:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:18:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:18:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:18:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:18:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:18:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:18:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:18:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:46.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:18:46.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:18:46.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:46.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:18:46.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:18:46.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:18:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:18:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:18:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:18:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:46.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:18:46.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:18:46.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:18:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:18:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:46.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:46.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:46.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:18:46.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:18:46.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.560 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:46.561 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:46.561 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:46.563 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:46.562+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:46.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:46.663 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:46.663+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:46.677 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:18:46.700 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:46.700 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:46.700 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:46.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:46.796 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:46.797+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:46.866 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:46.866+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:46.889 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:46.889 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:46.890 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:46.890 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:46.890 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:46.900 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:46.985 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:46.986+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:47.068 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:47.067+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:47.081 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:47.081 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:47.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:47.081 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:47.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.082 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2319 3.1 3:83da4b60:::rbd_object_map.11d54907a3eb.0000000000000014:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:47.082 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:47.082 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 80.705500083000004, 2023-01-02T18:18:47.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001, 2023-01-02T18:18:47.083 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.083 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.083 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.083 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:47.084 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:47.084 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2319 2023-01-02T18:18:47.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.084 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:47.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:47.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:47.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374312+0000", 2023-01-02T18:18:47.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2023-01-02T18:18:47.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374323+0000", 2023-01-02T18:18:47.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8349e-05 2023-01-02T18:18:47.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374341+0000", 2023-01-02T18:18:47.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9909999999999997e-06 2023-01-02T18:18:47.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374351+0000", 2023-01-02T18:18:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.617e-05 2023-01-02T18:18:47.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374398+0000", 2023-01-02T18:18:47.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:18:47.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:47.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374403+0000", 2023-01-02T18:18:47.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001918765 2023-01-02T18:18:47.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376322+0000", 2023-01-02T18:18:47.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015418100000000001 2023-01-02T18:18:47.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376476+0000", 2023-01-02T18:18:47.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016648999999999999 2023-01-02T18:18:47.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:47.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376642+0000", 2023-01-02T18:18:47.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001972976 2023-01-02T18:18:47.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.378615+0000", 2023-01-02T18:18:47.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020004570000000002 2023-01-02T18:18:47.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380616+0000", 2023-01-02T18:18:47.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3064000000000005e-05 2023-01-02T18:18:47.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380679+0000", 2023-01-02T18:18:47.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9119000000000002e-05 2023-01-02T18:18:47.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380728+0000", 2023-01-02T18:18:47.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001 2023-01-02T18:18:47.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.100 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.101 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3507 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:47.101 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:47.101 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.186074233999999, 2023-01-02T18:18:47.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002, 2023-01-02T18:18:47.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.102 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.102 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3507 2023-01-02T18:18:47.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.103 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:47.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:47.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:47.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893738+0000", 2023-01-02T18:18:47.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4447000000000001e-05 2023-01-02T18:18:47.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893752+0000", 2023-01-02T18:18:47.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8085999999999999e-05 2023-01-02T18:18:47.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893770+0000", 2023-01-02T18:18:47.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5949999999999999e-06 2023-01-02T18:18:47.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893779+0000", 2023-01-02T18:18:47.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4619000000000001e-05 2023-01-02T18:18:47.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893824+0000", 2023-01-02T18:18:47.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0294000000000002e-05 2023-01-02T18:18:47.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893894+0000", 2023-01-02T18:18:47.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034635200000000002 2023-01-02T18:18:47.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:47.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.894240+0000", 2023-01-02T18:18:47.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024283040000000001 2023-01-02T18:18:47.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.896669+0000", 2023-01-02T18:18:47.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018365300000000001 2023-01-02T18:18:47.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898505+0000", 2023-01-02T18:18:47.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2230000000000001e-05 2023-01-02T18:18:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898537+0000", 2023-01-02T18:18:47.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6251e-05 2023-01-02T18:18:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898564+0000", 2023-01-02T18:18:47.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002 2023-01-02T18:18:47.117 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.117 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.117 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.118 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3508 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:47.118 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:47.118 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 29.180970677000001, 2023-01-02T18:18:47.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001, 2023-01-02T18:18:47.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.119 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.119 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.119 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.120 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.120 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3508 2023-01-02T18:18:47.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.120 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:47.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.122 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:47.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:47.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898841+0000", 2023-01-02T18:18:47.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:18:47.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898867+0000", 2023-01-02T18:18:47.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323999999999999e-05 2023-01-02T18:18:47.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.125 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898890+0000", 2023-01-02T18:18:47.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8820000000000007e-06 2023-01-02T18:18:47.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898899+0000", 2023-01-02T18:18:47.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1070999999999999e-05 2023-01-02T18:18:47.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898950+0000", 2023-01-02T18:18:47.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2550000000000002e-05 2023-01-02T18:18:47.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899022+0000", 2023-01-02T18:18:47.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317836 2023-01-02T18:18:47.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:47.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899340+0000", 2023-01-02T18:18:47.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002728931 2023-01-02T18:18:47.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.902069+0000", 2023-01-02T18:18:47.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014209419999999999 2023-01-02T18:18:47.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903490+0000", 2023-01-02T18:18:47.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3368000000000003e-05 2023-01-02T18:18:47.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903523+0000", 2023-01-02T18:18:47.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5165999999999999e-05 2023-01-02T18:18:47.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903549+0000", 2023-01-02T18:18:47.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001 2023-01-02T18:18:47.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.134 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.134 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16198 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1536~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:47.135 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.182948369999998, 2023-01-02T18:18:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003, 2023-01-02T18:18:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.136 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16198 2023-01-02T18:18:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896865+0000", 2023-01-02T18:18:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6900000000000001e-06 2023-01-02T18:18:47.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896868+0000", 2023-01-02T18:18:47.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:18:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896874+0000", 2023-01-02T18:18:47.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.447e-06 2023-01-02T18:18:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896876+0000", 2023-01-02T18:18:47.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001873179 2023-01-02T18:18:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898750+0000", 2023-01-02T18:18:47.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7626000000000005e-05 2023-01-02T18:18:47.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898827+0000", 2023-01-02T18:18:47.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012927899999999999 2023-01-02T18:18:47.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:47.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898957+0000", 2023-01-02T18:18:47.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023139749999999998 2023-01-02T18:18:47.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901271+0000", 2023-01-02T18:18:47.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4455000000000005e-05 2023-01-02T18:18:47.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901335+0000", 2023-01-02T18:18:47.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7706999999999994e-05 2023-01-02T18:18:47.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901403+0000", 2023-01-02T18:18:47.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3409999999999999e-05 2023-01-02T18:18:47.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901446+0000", 2023-01-02T18:18:47.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003 2023-01-02T18:18:47.151 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.151 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.151 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.152 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16199 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2048~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:47.152 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:47.152 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.182935281999999, 2023-01-02T18:18:47.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004, 2023-01-02T18:18:47.153 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.153 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.153 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.153 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.153 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.154 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16199 2023-01-02T18:18:47.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.154 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.155 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.155 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:47.155 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.156 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:47.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.156 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.156 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.156 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.157 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:47.157 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.69e-06 2023-01-02T18:18:47.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896883+0000", 2023-01-02T18:18:47.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2909999999999999e-06 2023-01-02T18:18:47.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896887+0000", 2023-01-02T18:18:47.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.238e-06 2023-01-02T18:18:47.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896889+0000", 2023-01-02T18:18:47.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002707919 2023-01-02T18:18:47.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899597+0000", 2023-01-02T18:18:47.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2546000000000002e-05 2023-01-02T18:18:47.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899639+0000", 2023-01-02T18:18:47.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4080999999999996e-05 2023-01-02T18:18:47.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:47.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899733+0000", 2023-01-02T18:18:47.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001771826 2023-01-02T18:18:47.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901505+0000", 2023-01-02T18:18:47.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6619999999999994e-06 2023-01-02T18:18:47.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901514+0000", 2023-01-02T18:18:47.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0059999999999998e-05 2023-01-02T18:18:47.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901564+0000", 2023-01-02T18:18:47.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1318e-05 2023-01-02T18:18:47.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901605+0000", 2023-01-02T18:18:47.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004 2023-01-02T18:18:47.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.168 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.168 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.168 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16200 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2560~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:47.169 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:47.169 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.182923095, 2023-01-02T18:18:47.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998, 2023-01-02T18:18:47.169 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.169 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.170 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.170 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.170 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.170 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16200 2023-01-02T18:18:47.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.171 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.171 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.171 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.171 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:47.172 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:47.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:47.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0820000000000001e-06 2023-01-02T18:18:47.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896893+0000", 2023-01-02T18:18:47.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8679999999999999e-06 2023-01-02T18:18:47.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896896+0000", 2023-01-02T18:18:47.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1390000000000002e-06 2023-01-02T18:18:47.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896898+0000", 2023-01-02T18:18:47.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032553590000000002 2023-01-02T18:18:47.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900153+0000", 2023-01-02T18:18:47.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8237000000000003e-05 2023-01-02T18:18:47.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900232+0000", 2023-01-02T18:18:47.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018062300000000001 2023-01-02T18:18:47.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:47.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900412+0000", 2023-01-02T18:18:47.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012047169999999999 2023-01-02T18:18:47.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901617+0000", 2023-01-02T18:18:47.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042531099999999999 2023-01-02T18:18:47.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902042+0000", 2023-01-02T18:18:47.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1499000000000003e-05 2023-01-02T18:18:47.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902094+0000", 2023-01-02T18:18:47.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9249000000000003e-05 2023-01-02T18:18:47.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902133+0000", 2023-01-02T18:18:47.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998 2023-01-02T18:18:47.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.184 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.185 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.185 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16201 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:47.185 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:47.186 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.182914211, 2023-01-02T18:18:47.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004, 2023-01-02T18:18:47.186 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.186 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.187 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.187 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.187 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16201 2023-01-02T18:18:47.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.187 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:47.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:47.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:47.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4200000000000001e-06 2023-01-02T18:18:47.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896902+0000", 2023-01-02T18:18:47.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8849999999999999e-06 2023-01-02T18:18:47.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896905+0000", 2023-01-02T18:18:47.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2500000000000001e-06 2023-01-02T18:18:47.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896907+0000", 2023-01-02T18:18:47.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038386549999999998 2023-01-02T18:18:47.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900746+0000", 2023-01-02T18:18:47.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8287000000000004e-05 2023-01-02T18:18:47.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900834+0000", 2023-01-02T18:18:47.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016278899999999999 2023-01-02T18:18:47.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:47.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900997+0000", 2023-01-02T18:18:47.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011903720000000001 2023-01-02T18:18:47.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902187+0000", 2023-01-02T18:18:47.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634200000000004 2023-01-02T18:18:47.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902704+0000", 2023-01-02T18:18:47.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.957e-05 2023-01-02T18:18:47.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.199 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.199 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902733+0000", 2023-01-02T18:18:47.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4341e-05 2023-01-02T18:18:47.200 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.200 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.200 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902758+0000", 2023-01-02T18:18:47.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004 2023-01-02T18:18:47.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.201 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.201 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.201 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.201 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.202 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16202 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:47.202 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:47.202 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.182904793999999, 2023-01-02T18:18:47.202 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001, 2023-01-02T18:18:47.202 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.203 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.203 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.203 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.203 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.204 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16202 2023-01-02T18:18:47.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.204 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:47.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:47.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:47.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.092e-06 2023-01-02T18:18:47.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896911+0000", 2023-01-02T18:18:47.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1019999999999999e-06 2023-01-02T18:18:47.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896915+0000", 2023-01-02T18:18:47.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7930000000000002e-06 2023-01-02T18:18:47.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896918+0000", 2023-01-02T18:18:47.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047231770000000003 2023-01-02T18:18:47.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901641+0000", 2023-01-02T18:18:47.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2209000000000002e-05 2023-01-02T18:18:47.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901684+0000", 2023-01-02T18:18:47.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104726 2023-01-02T18:18:47.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:47.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901788+0000", 2023-01-02T18:18:47.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015539740000000001 2023-01-02T18:18:47.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.214 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903342+0000", 2023-01-02T18:18:47.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1817999999999998e-05 2023-01-02T18:18:47.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.215 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.215 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903394+0000", 2023-01-02T18:18:47.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8734999999999998e-05 2023-01-02T18:18:47.215 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.216 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.216 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903423+0000", 2023-01-02T18:18:47.216 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9155000000000001e-05 2023-01-02T18:18:47.216 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.216 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.217 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903452+0000", 2023-01-02T18:18:47.217 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001 2023-01-02T18:18:47.217 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.217 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.218 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.218 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16203 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:47.218 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:47.219 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.182893700000001, 2023-01-02T18:18:47.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998, 2023-01-02T18:18:47.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.219 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.219 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.220 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.220 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.220 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16203 2023-01-02T18:18:47.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.220 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:47.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:47.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896920+0000", 2023-01-02T18:18:47.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1600000000000001e-06 2023-01-02T18:18:47.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896922+0000", 2023-01-02T18:18:47.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5219999999999999e-06 2023-01-02T18:18:47.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896926+0000", 2023-01-02T18:18:47.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9470000000000002e-06 2023-01-02T18:18:47.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896928+0000", 2023-01-02T18:18:47.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052862669999999999 2023-01-02T18:18:47.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902214+0000", 2023-01-02T18:18:47.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3084999999999994e-05 2023-01-02T18:18:47.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.228 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.228 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902307+0000", 2023-01-02T18:18:47.228 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013711100000000001 2023-01-02T18:18:47.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.229 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:47.229 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902444+0000", 2023-01-02T18:18:47.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090387900000000001 2023-01-02T18:18:47.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.230 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.230 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903348+0000", 2023-01-02T18:18:47.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015428300000000001 2023-01-02T18:18:47.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903503+0000", 2023-01-02T18:18:47.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7078999999999999e-05 2023-01-02T18:18:47.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903530+0000", 2023-01-02T18:18:47.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9266000000000002e-05 2023-01-02T18:18:47.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903549+0000", 2023-01-02T18:18:47.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998 2023-01-02T18:18:47.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.234 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.234 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.235 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16204 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:47.235 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:47.235 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.182884251000001, 2023-01-02T18:18:47.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996, 2023-01-02T18:18:47.236 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.236 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.236 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.236 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.237 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.237 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16204 2023-01-02T18:18:47.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.237 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:47.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:47.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:47.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1679999999999997e-06 2023-01-02T18:18:47.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.241 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.241 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896934+0000", 2023-01-02T18:18:47.241 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.039e-06 2023-01-02T18:18:47.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.242 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.242 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.242 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896937+0000", 2023-01-02T18:18:47.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0389999999999999e-06 2023-01-02T18:18:47.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.243 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.243 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.243 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896939+0000", 2023-01-02T18:18:47.243 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058543179999999998 2023-01-02T18:18:47.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902793+0000", 2023-01-02T18:18:47.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5451999999999996e-05 2023-01-02T18:18:47.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902859+0000", 2023-01-02T18:18:47.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5087999999999996e-05 2023-01-02T18:18:47.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:47.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902944+0000", 2023-01-02T18:18:47.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086757900000000005 2023-01-02T18:18:47.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903811+0000", 2023-01-02T18:18:47.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9238000000000002e-05 2023-01-02T18:18:47.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903901+0000", 2023-01-02T18:18:47.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0630000000000001e-05 2023-01-02T18:18:47.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903951+0000", 2023-01-02T18:18:47.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6187999999999998e-05 2023-01-02T18:18:47.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904007+0000", 2023-01-02T18:18:47.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996 2023-01-02T18:18:47.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.251 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.252 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16205 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 0~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e140)", 2023-01-02T18:18:47.252 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:47.252 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 19.180141232, 2023-01-02T18:18:47.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868, 2023-01-02T18:18:47.252 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.253 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:47.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.253 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.253 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16205 2023-01-02T18:18:47.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.254 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:47.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:47.256 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:47.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.256 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.256 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899672+0000", 2023-01-02T18:18:47.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2650000000000004e-06 2023-01-02T18:18:47.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.257 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.258 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899677+0000", 2023-01-02T18:18:47.258 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1850000000000004e-06 2023-01-02T18:18:47.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.258 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899686+0000", 2023-01-02T18:18:47.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4259999999999996e-06 2023-01-02T18:18:47.259 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899690+0000", 2023-01-02T18:18:47.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576512 2023-01-02T18:18:47.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903266+0000", 2023-01-02T18:18:47.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5141000000000005e-05 2023-01-02T18:18:47.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:47.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903332+0000", 2023-01-02T18:18:47.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070156899999999998 2023-01-02T18:18:47.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904033+0000", 2023-01-02T18:18:47.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0550000000000003e-05 2023-01-02T18:18:47.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904074+0000", 2023-01-02T18:18:47.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7970000000000001e-05 2023-01-02T18:18:47.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904142+0000", 2023-01-02T18:18:47.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868 2023-01-02T18:18:47.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.266 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.266 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.266 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28602 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 146432~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e143)", 2023-01-02T18:18:47.267 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:47.267 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.142156829000001, 2023-01-02T18:18:47.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996, 2023-01-02T18:18:47.267 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.267 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:47.268 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.268 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.268 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.268 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28602 2023-01-02T18:18:47.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.269 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:47.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:47.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:47.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.271 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.271 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937656+0000", 2023-01-02T18:18:47.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3520000000000003e-06 2023-01-02T18:18:47.272 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.272 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.272 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.272 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937663+0000", 2023-01-02T18:18:47.273 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4744e-05 2023-01-02T18:18:47.273 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.273 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.273 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.273 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937677+0000", 2023-01-02T18:18:47.274 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5119999999999997e-06 2023-01-02T18:18:47.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937684+0000", 2023-01-02T18:18:47.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2098999999999997e-05 2023-01-02T18:18:47.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937736+0000", 2023-01-02T18:18:47.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:18:47.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:47.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937745+0000", 2023-01-02T18:18:47.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073198109999999999 2023-01-02T18:18:47.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945065+0000", 2023-01-02T18:18:47.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1624000000000002e-05 2023-01-02T18:18:47.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945156+0000", 2023-01-02T18:18:47.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123879 2023-01-02T18:18:47.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945280+0000", 2023-01-02T18:18:47.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996 2023-01-02T18:18:47.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.280 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.280 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.281 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28808 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [assert-version v64,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:18:47.281 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:47.281 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 16.066978550000002, 2023-01-02T18:18:47.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002, 2023-01-02T18:18:47.282 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.282 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.282 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.282 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.283 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.283 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28808 2023-01-02T18:18:47.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.283 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:47.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:47.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:47.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.286 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012835+0000", 2023-01-02T18:18:47.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0229999999999998e-06 2023-01-02T18:18:47.286 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.286 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.287 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.287 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012841+0000", 2023-01-02T18:18:47.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1938e-05 2023-01-02T18:18:47.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.288 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.288 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012853+0000", 2023-01-02T18:18:47.288 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5520000000000004e-06 2023-01-02T18:18:47.288 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.288 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.289 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012858+0000", 2023-01-02T18:18:47.289 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9961999999999999e-05 2023-01-02T18:18:47.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012888+0000", 2023-01-02T18:18:47.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2904e-05 2023-01-02T18:18:47.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012941+0000", 2023-01-02T18:18:47.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016403699999999999 2023-01-02T18:18:47.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:47.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013105+0000", 2023-01-02T18:18:47.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074456399999999997 2023-01-02T18:18:47.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013850+0000", 2023-01-02T18:18:47.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027539999999999999 2023-01-02T18:18:47.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016604+0000", 2023-01-02T18:18:47.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4141999999999999e-05 2023-01-02T18:18:47.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016638+0000", 2023-01-02T18:18:47.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7827000000000002e-05 2023-01-02T18:18:47.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016676+0000", 2023-01-02T18:18:47.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002 2023-01-02T18:18:47.296 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.297 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.297 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.298 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41665 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2560~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:47.298 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377475+0000", 2023-01-02T18:18:47.298 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.702338814, 2023-01-02T18:18:47.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038058060000000001, 2023-01-02T18:18:47.298 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.299 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.299 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.299 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41665 2023-01-02T18:18:47.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.300 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377475+0000", 2023-01-02T18:18:47.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.301 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.301 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377475+0000", 2023-01-02T18:18:47.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.302 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.302 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.302 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.302 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377475+0000", 2023-01-02T18:18:47.303 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6859999999999999e-06 2023-01-02T18:18:47.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.303 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.303 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.303 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377479+0000", 2023-01-02T18:18:47.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:18:47.304 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377486+0000", 2023-01-02T18:18:47.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2200000000000003e-06 2023-01-02T18:18:47.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377490+0000", 2023-01-02T18:18:47.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002389127 2023-01-02T18:18:47.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379879+0000", 2023-01-02T18:18:47.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6764000000000001e-05 2023-01-02T18:18:47.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379936+0000", 2023-01-02T18:18:47.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.0972999999999999e-05 2023-01-02T18:18:47.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:47.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380017+0000", 2023-01-02T18:18:47.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001179009 2023-01-02T18:18:47.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381196+0000", 2023-01-02T18:18:47.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.4290000000000001e-06 2023-01-02T18:18:47.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381205+0000", 2023-01-02T18:18:47.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4304999999999997e-05 2023-01-02T18:18:47.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381249+0000", 2023-01-02T18:18:47.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.235e-05 2023-01-02T18:18:47.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381281+0000", 2023-01-02T18:18:47.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038058060000000001 2023-01-02T18:18:47.313 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.313 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.313 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.314 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41666 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:47.314 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:18:47.315 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.7023198390000001, 2023-01-02T18:18:47.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043435039999999998, 2023-01-02T18:18:47.315 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.315 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.315 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.316 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.316 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.316 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41666 2023-01-02T18:18:47.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.316 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.317 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.317 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.317 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:18:47.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.317 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.318 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.318 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.318 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:18:47.318 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:18:47.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7869999999999999e-06 2023-01-02T18:18:47.319 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377498+0000", 2023-01-02T18:18:47.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7349999999999999e-06 2023-01-02T18:18:47.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377505+0000", 2023-01-02T18:18:47.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9289999999999997e-06 2023-01-02T18:18:47.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377509+0000", 2023-01-02T18:18:47.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028717389999999999 2023-01-02T18:18:47.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380381+0000", 2023-01-02T18:18:47.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2969999999999997e-05 2023-01-02T18:18:47.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380424+0000", 2023-01-02T18:18:47.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107729 2023-01-02T18:18:47.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:47.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380532+0000", 2023-01-02T18:18:47.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001230039 2023-01-02T18:18:47.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381762+0000", 2023-01-02T18:18:47.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0010000000000007e-06 2023-01-02T18:18:47.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381771+0000", 2023-01-02T18:18:47.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6591999999999997e-05 2023-01-02T18:18:47.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381818+0000", 2023-01-02T18:18:47.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0386000000000001e-05 2023-01-02T18:18:47.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381838+0000", 2023-01-02T18:18:47.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043435039999999998 2023-01-02T18:18:47.329 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.330 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.330 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.330 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41667 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:47.331 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:18:47.331 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.70230017, 2023-01-02T18:18:47.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048409819999999998, 2023-01-02T18:18:47.331 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.331 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.332 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.332 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.332 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.332 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41667 2023-01-02T18:18:47.332 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.333 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.333 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.333 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:18:47.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.334 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.334 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.334 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.334 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:18:47.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.335 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:18:47.335 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2910000000000001e-06 2023-01-02T18:18:47.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377518+0000", 2023-01-02T18:18:47.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9619999999999996e-06 2023-01-02T18:18:47.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377525+0000", 2023-01-02T18:18:47.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0780000000000001e-06 2023-01-02T18:18:47.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377531+0000", 2023-01-02T18:18:47.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032340340000000002 2023-01-02T18:18:47.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380765+0000", 2023-01-02T18:18:47.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1267999999999999e-05 2023-01-02T18:18:47.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380806+0000", 2023-01-02T18:18:47.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.975e-05 2023-01-02T18:18:47.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:47.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380886+0000", 2023-01-02T18:18:47.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098581100000000007 2023-01-02T18:18:47.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381872+0000", 2023-01-02T18:18:47.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042798899999999998 2023-01-02T18:18:47.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.344 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382300+0000", 2023-01-02T18:18:47.344 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2042000000000003e-05 2023-01-02T18:18:47.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.344 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.345 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382332+0000", 2023-01-02T18:18:47.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3221999999999999e-05 2023-01-02T18:18:47.345 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.345 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.345 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.346 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382355+0000", 2023-01-02T18:18:47.346 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048409819999999998 2023-01-02T18:18:47.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.346 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.346 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.347 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41668 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:47.347 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:18:47.347 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.702278575, 2023-01-02T18:18:47.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010315690000000001, 2023-01-02T18:18:47.348 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.348 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.348 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.348 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.349 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.349 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41668 2023-01-02T18:18:47.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.349 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:18:47.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:18:47.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377535+0000", 2023-01-02T18:18:47.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7050000000000001e-06 2023-01-02T18:18:47.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377539+0000", 2023-01-02T18:18:47.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:18:47.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377548+0000", 2023-01-02T18:18:47.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5299999999999998e-06 2023-01-02T18:18:47.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377552+0000", 2023-01-02T18:18:47.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037753740000000002 2023-01-02T18:18:47.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381328+0000", 2023-01-02T18:18:47.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7478000000000002e-05 2023-01-02T18:18:47.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381375+0000", 2023-01-02T18:18:47.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103408 2023-01-02T18:18:47.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:47.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381478+0000", 2023-01-02T18:18:47.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088558899999999999 2023-01-02T18:18:47.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382364+0000", 2023-01-02T18:18:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053292160000000003 2023-01-02T18:18:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387693+0000", 2023-01-02T18:18:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2136e-05 2023-01-02T18:18:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387785+0000", 2023-01-02T18:18:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5914000000000006e-05 2023-01-02T18:18:47.361 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387851+0000", 2023-01-02T18:18:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010315690000000001 2023-01-02T18:18:47.362 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.363 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41669 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:18:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.702257575, 2023-01-02T18:18:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010395639, 2023-01-02T18:18:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.364 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41669 2023-01-02T18:18:47.365 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:18:47.366 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:18:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377556+0000", 2023-01-02T18:18:47.368 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1570000000000003e-06 2023-01-02T18:18:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.369 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377563+0000", 2023-01-02T18:18:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1639999999999998e-06 2023-01-02T18:18:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.370 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377570+0000", 2023-01-02T18:18:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0329999999999999e-06 2023-01-02T18:18:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.371 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377575+0000", 2023-01-02T18:18:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043243480000000004 2023-01-02T18:18:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.372 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381899+0000", 2023-01-02T18:18:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7437e-05 2023-01-02T18:18:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.373 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381946+0000", 2023-01-02T18:18:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5799999999999998e-05 2023-01-02T18:18:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.374 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382042+0000", 2023-01-02T18:18:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054838499999999997 2023-01-02T18:18:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.375 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382591+0000", 2023-01-02T18:18:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053095540000000002 2023-01-02T18:18:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.376 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387900+0000", 2023-01-02T18:18:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5627e-05 2023-01-02T18:18:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.377 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387926+0000", 2023-01-02T18:18:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6576000000000001e-05 2023-01-02T18:18:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.378 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387952+0000", 2023-01-02T18:18:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010395639 2023-01-02T18:18:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.379 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41670 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [cmpext 0~512,write 0~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:47.380 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:18:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.70036309, 2023-01-02T18:18:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0096660940000000001, 2023-01-02T18:18:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:47.381 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41670 2023-01-02T18:18:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.382 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:18:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.383 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:18:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:47.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379450+0000", 2023-01-02T18:18:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1359999999999996e-06 2023-01-02T18:18:47.385 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.386 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379455+0000", 2023-01-02T18:18:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1508999999999999e-05 2023-01-02T18:18:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.388 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379467+0000", 2023-01-02T18:18:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0369999999999997e-06 2023-01-02T18:18:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.389 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379474+0000", 2023-01-02T18:18:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029082439999999999 2023-01-02T18:18:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.390 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382382+0000", 2023-01-02T18:18:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5390999999999998e-05 2023-01-02T18:18:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.391 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382448+0000", 2023-01-02T18:18:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055373549999999999 2023-01-02T18:18:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.392 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387985+0000", 2023-01-02T18:18:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2169999999999998e-05 2023-01-02T18:18:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388027+0000", 2023-01-02T18:18:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013321900000000001 2023-01-02T18:18:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.394 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388160+0000", 2023-01-02T18:18:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050349900000000003 2023-01-02T18:18:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.395 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388664+0000", 2023-01-02T18:18:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040003400000000001 2023-01-02T18:18:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.396 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389064+0000", 2023-01-02T18:18:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2549999999999998e-05 2023-01-02T18:18:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.397 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389096+0000", 2023-01-02T18:18:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0778999999999999e-05 2023-01-02T18:18:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.398 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389117+0000", 2023-01-02T18:18:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0096660940000000001 2023-01-02T18:18:47.399 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.400 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:42207 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [read 44548~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e150)", 2023-01-02T18:18:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:18:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 1.5402820960000001, 2023-01-02T18:18:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024391863999999999, 2023-01-02T18:18:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:47.401 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 42207 2023-01-02T18:18:47.402 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:18:47.403 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:18:47.404 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539531+0000", 2023-01-02T18:18:47.405 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.822e-06 2023-01-02T18:18:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539535+0000", 2023-01-02T18:18:47.406 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2060000000000004e-06 2023-01-02T18:18:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539541+0000", 2023-01-02T18:18:47.407 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0029999999999999e-06 2023-01-02T18:18:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539544+0000", 2023-01-02T18:18:47.408 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5829e-05 2023-01-02T18:18:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539570+0000", 2023-01-02T18:18:47.409 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5000999999999999e-05 2023-01-02T18:18:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539605+0000", 2023-01-02T18:18:47.410 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024318678999999999 2023-01-02T18:18:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.563924+0000", 2023-01-02T18:18:47.411 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024391863999999999 2023-01-02T18:18:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:47.412 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:47.413 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:47.413 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:47.415 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:47.414+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:47.416 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:47.416 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:47.417 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:47.417 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:47.417 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:47.417 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:47.417 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.418 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:47.418 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.418 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.418 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:47.418 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.419 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:47.419 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.419 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.419 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:47.419 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.420 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:47.420 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.420 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.420 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:47.421 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.421 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:47.421 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.421 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.421 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:47.422 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.422 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:47.422 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.422 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.423 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:47.423 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:47.423 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:47.423 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:47.423 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:47.424 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:47.424 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:47.424 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:47.424 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:47.424 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:47.425 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:47.425 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.425 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:47.425 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.425 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.426 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:47.426 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.426 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:47.426 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.427 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.427 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:47.427 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.427 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:47.427 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.428 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.428 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:47.428 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.428 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:47.428 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.429 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.429 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:47.429 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.429 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:47.429 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.430 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.430 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:47.430 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.430 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.430 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.431 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.431 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.431 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.431 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:47.431 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:47.432 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:47.432 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.432 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:47.432 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:47.432 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:47.433 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.433 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:47.433 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:47.433 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:47.433 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.434 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:47.434 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:47.434 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:47.434 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.435 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:47.435 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:47.435 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:47.435 INFO:tasks.workunit.client.0.smithi007.stdout:discard: 512~512 = 512 2023-01-02T18:18:47.435 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.436 INFO:tasks.workunit.client.0.smithi007.stdout:aio discard: 1536~512 = 0 2023-01-02T18:18:47.436 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.436 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.436 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.436 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.437 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:47.437 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:47.437 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.437 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.437 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:47.438 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.438 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.438 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:47.438 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.438 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.439 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:47.439 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.439 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.439 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.439 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.440 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:47.440 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.440 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.440 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:47.440 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.441 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.441 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:47.441 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.441 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.441 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:47.442 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.442 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.442 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.442 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.442 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:47.443 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.443 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.443 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:47.443 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.443 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.444 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:47.444 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.444 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.444 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:47.444 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.445 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.445 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.445 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.445 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:47.445 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.446 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.446 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:47.446 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.446 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.447 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:47.447 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.447 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.447 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:47.447 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.448 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.448 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.448 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.448 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:47.448 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.449 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.449 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:47.449 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.449 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.450 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:47.450 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.450 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.450 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:47.450 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.451 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.451 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.451 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.451 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.451 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:47.452 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.452 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.452 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:47.452 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.452 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.452 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.453 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:47.453 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.453 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.453 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:47.454 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.454 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.454 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.454 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:47.454 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.455 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.455 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:47.455 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.455 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.455 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.456 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:47.456 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.456 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.456 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:47.456 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.457 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.457 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.457 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:47.457 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.457 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.458 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:47.458 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:47.458 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.458 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:47.458 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.459 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.459 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:47.459 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.459 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.459 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.460 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:47.460 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:47.460 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:47.460 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:47.460 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:47.461 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:47.461 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:47.515 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:47.515+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:47.610 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:47.611 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:47.611 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:47.611 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:47.615 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:47.615+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:47.621 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:47.623 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:47.644 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:47.664 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:47.687 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:47.716 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:47.716+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:47.764 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:47.765 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:47.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:47.817 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:47.817+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:47.858 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 4] out_osds: [3, 5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:47.858 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:47.859 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2023-01-02T18:18:47.859 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:18:47.859 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:18:47.859 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2023-01-02T18:18:47.910 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:47.918 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:47.919+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:47.931 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:47.965 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:47.970 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:47.970 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:47.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:47.986 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:47.988 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:47.989 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:48.006 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:48.006 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-01-02T18:18:48.007 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:48.019 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:48.019+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:48.119 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:48.119+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:48.121 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:48.121 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:48.132 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:48.220 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:48.221+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:48.271 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:48.272 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:48.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:48.326 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:48.327+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:48.417 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:48.417 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:48.421 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:48.421+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:48.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:48.522 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:48.523+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:48.609 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:48.609 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:48.620 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:48.623 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:48.623+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:48.690 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:18:48.747 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:48.748+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:48.802 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:48.802 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:48.814 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:48.825 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:48.825+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:48.843 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.843 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.844 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.844 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.844 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.844 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.844 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.845 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.845 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.845 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.845 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.845 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.846 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.846 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.846 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.846 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:48.846 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.847 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.847 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:48.847 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.847 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.847 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.848 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.848 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.848 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.848 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.849 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.849 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.849 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.849 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.849 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.850 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.850 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.850 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.850 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.850 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.850 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.851 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.851 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.851 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.851 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.851 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.852 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.852 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.852 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.852 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.852 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.853 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.853 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.853 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:48.853 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.853 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.854 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:48.854 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.854 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.854 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.854 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.855 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.855 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.855 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.855 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.855 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.856 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.856 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.856 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.856 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.856 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.857 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.857 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.857 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.857 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.857 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.858 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.858 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.858 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.858 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.858 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.858 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.859 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.859 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.859 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.859 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.859 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.860 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:48.860 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.860 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.860 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:48.860 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.860 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.861 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.861 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.861 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.861 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.861 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.862 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.862 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.862 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.862 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.862 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.863 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.863 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.863 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.863 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.863 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.864 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.864 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.864 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.864 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.864 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.865 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.865 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:48.865 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:48.865 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:48.865 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:48.866 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:48.866 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.866 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.866 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:48.866 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:48.867 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:48.867 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:48.867 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:48.867 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:48.867 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:48.868 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestIOWithIOHint (3489 ms) 2023-01-02T18:18:48.868 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestDataPoolIO 2023-01-02T18:18:48.926 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:48.927+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:48.994 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:49.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:49.047 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:49.047+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:49.128 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:49.127+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:49.136 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:49.136 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:49.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:49.229 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:49.229+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:49.305 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:49.305 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:49.314 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:49.330 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:49.331+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:49.431 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:49.430+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:49.479 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:49.480 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:49.489 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:49.532 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:49.531+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:49.633 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:49.633+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:49.656 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:49.656 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:49.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:49.690 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:18:49.744 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:49.745+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:49.831 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:49.831 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:49.835 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:49.834+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:49.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:49.936 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:49.937+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:50.002 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:50.006 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:50.006 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:50.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:50.059 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:50.059+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:50.138 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:50.137+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:50.141 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:50.141 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:50.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:50.153 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:50.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:50.187 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:50.204 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:50.222 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:50.239 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:50.240+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:50.240 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:50.257 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:50.275 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:50.276 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:50.277 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:50.278 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:50.321 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:50.321 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:50.322 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:50.322 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:50.327 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:50.339 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:50.340+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:50.440 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:50.441+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:50.455 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:50.455 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:18:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.148971643, 2023-01-02T18:18:50.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:18:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:50.457 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:18:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:18:50.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:18:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:18:50.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:18:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:18:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:18:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:18:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:18:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:18:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:18:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:18:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:18:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:18:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:18:50.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:18:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:18:50.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:18:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:18:50.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:18:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:18:50.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:18:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:18:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:18:50.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:18:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:18:50.472 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:18:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.143843422, 2023-01-02T18:18:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:18:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.475 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:18:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:50.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:50.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:18:50.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:18:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:18:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:18:50.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:18:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:18:50.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:18:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:18:50.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:18:50.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:18:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:18:50.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:18:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:18:50.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:18:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:18:50.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:18:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:18:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:18:50.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:18:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:18:50.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:18:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:18:50.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:18:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:18:50.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:18:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:18:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.491 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:18:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.853778929000001, 2023-01-02T18:18:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:18:50.492 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.493 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:18:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:18:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:18:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:18:50.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:18:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:18:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:18:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:18:50.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:18:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:18:50.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:18:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:50.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:18:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:18:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:18:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:18:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:18:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:18:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:50.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:18:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:18:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:18:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:18:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:18:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:18:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:18:50.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:18:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:18:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:18:50.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.510 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:18:50.510 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:50.510 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.855053585999997, 2023-01-02T18:18:50.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:18:50.510 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.511 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.511 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.511 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.511 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.512 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:18:50.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.512 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:50.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:50.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:50.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:18:50.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:18:50.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:18:50.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:18:50.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:18:50.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:18:50.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:18:50.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:18:50.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:18:50.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:18:50.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:50.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:18:50.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:18:50.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:18:50.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:18:50.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:18:50.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:18:50.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:50.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:18:50.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:18:50.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:18:50.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:18:50.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:18:50.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:18:50.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:18:50.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:18:50.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:18:50.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:18:50.526 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.527 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.527 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.527 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:18:50.527 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:50.528 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.830691822000006, 2023-01-02T18:18:50.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:18:50.528 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.528 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.528 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.528 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.529 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.529 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:18:50.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.529 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:50.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:50.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:50.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:18:50.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:18:50.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:18:50.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:18:50.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:18:50.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:18:50.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:18:50.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:18:50.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:18:50.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:18:50.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:18:50.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:18:50.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:50.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:18:50.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:18:50.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:18:50.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:18:50.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:18:50.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:18:50.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:18:50.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:18:50.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:18:50.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:18:50.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.543 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.544 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:50.544 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:50.544 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 76.125097154000002, 2023-01-02T18:18:50.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:18:50.544 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.544 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.545 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.545 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.545 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.545 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:18:50.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.546 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:50.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:50.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:50.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:18:50.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:18:50.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:18:50.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:18:50.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:18:50.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:18:50.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:18:50.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:18:50.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:18:50.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:18:50.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:18:50.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:18:50.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:50.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:18:50.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:18:50.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:18:50.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:18:50.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:18:50.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:18:50.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:18:50.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:18:50.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:18:50.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:18:50.558 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.559 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.559 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.560 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3321 11.1 11:81555d77:::rbd_object_map.12a2d6b452e6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:50.560 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:50.560 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.117392085999995, 2023-01-02T18:18:50.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002, 2023-01-02T18:18:50.560 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.561 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.561 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.561 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3321 2023-01-02T18:18:50.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.562 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:50.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:50.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:50.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336122+0000", 2023-01-02T18:18:50.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000004e-06 2023-01-02T18:18:50.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336130+0000", 2023-01-02T18:18:50.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4102e-05 2023-01-02T18:18:50.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336144+0000", 2023-01-02T18:18:50.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8210000000000004e-06 2023-01-02T18:18:50.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336151+0000", 2023-01-02T18:18:50.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6598999999999998e-05 2023-01-02T18:18:50.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336208+0000", 2023-01-02T18:18:50.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8439999999999998e-06 2023-01-02T18:18:50.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:50.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336216+0000", 2023-01-02T18:18:50.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028909740000000001 2023-01-02T18:18:50.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339107+0000", 2023-01-02T18:18:50.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1304999999999994e-05 2023-01-02T18:18:50.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339198+0000", 2023-01-02T18:18:50.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030390899999999999 2023-01-02T18:18:50.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:50.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339502+0000", 2023-01-02T18:18:50.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00165285 2023-01-02T18:18:50.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341155+0000", 2023-01-02T18:18:50.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00047942200000000002 2023-01-02T18:18:50.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341634+0000", 2023-01-02T18:18:50.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1620999999999998e-05 2023-01-02T18:18:50.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341696+0000", 2023-01-02T18:18:50.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0988999999999997e-05 2023-01-02T18:18:50.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341737+0000", 2023-01-02T18:18:50.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002 2023-01-02T18:18:50.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.576 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.577 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3327 11.9 e106/102 11:90094091:::rbd_data.12a2d6b452e6.0000000000000000:head v 106'2, mlcod=0'0)", 2023-01-02T18:18:50.577 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:40.350682+0000", 2023-01-02T18:18:50.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.102833680000003, 2023-01-02T18:18:50.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051016009999999999, 2023-01-02T18:18:50.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.579 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.350682+0000", 2023-01-02T18:18:50.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.350682+0000", 2023-01-02T18:18:50.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:50.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.350681+0000", 2023-01-02T18:18:50.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00096689599999999997 2023-01-02T18:18:50.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351648+0000", 2023-01-02T18:18:50.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3237999999999999e-05 2023-01-02T18:18:50.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351661+0000", 2023-01-02T18:18:50.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2079999999999997e-06 2023-01-02T18:18:50.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351667+0000", 2023-01-02T18:18:50.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5334000000000002e-05 2023-01-02T18:18:50.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351723+0000", 2023-01-02T18:18:50.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4102999999999999e-05 2023-01-02T18:18:50.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.351747+0000", 2023-01-02T18:18:50.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039982309999999997 2023-01-02T18:18:50.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.355745+0000", 2023-01-02T18:18:50.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8974999999999999e-05 2023-01-02T18:18:50.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:40.355784+0000", 2023-01-02T18:18:50.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051016009999999999 2023-01-02T18:18:50.589 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.589 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.589 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.590 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:18:50.590 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:50.590 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.072689337, 2023-01-02T18:18:50.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:18:50.590 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.591 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.591 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.591 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.591 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.591 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:18:50.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.592 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:50.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:50.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:18:50.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:18:50.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:18:50.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:18:50.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:18:50.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:18:50.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:18:50.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:18:50.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:18:50.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:18:50.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:18:50.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:18:50.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:18:50.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:50.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:18:50.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:18:50.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:18:50.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:18:50.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:18:50.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:18:50.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:18:50.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:18:50.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:18:50.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:18:50.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.605 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.605 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.606 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:18:50.606 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:50.606 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.042359820999998, 2023-01-02T18:18:50.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:18:50.607 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.607 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.607 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.607 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.608 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.608 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:18:50.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.608 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:50.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:50.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:18:50.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:18:50.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:18:50.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:18:50.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:18:50.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:18:50.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:18:50.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:18:50.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:18:50.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:18:50.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:18:50.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:18:50.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:18:50.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:50.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:18:50.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:18:50.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:18:50.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:18:50.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:18:50.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:18:50.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:18:50.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:18:50.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:18:50.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:18:50.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.622 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.622 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.623 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3341 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e112)", 2023-01-02T18:18:50.623 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:50.623 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.033576556, 2023-01-02T18:18:50.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051817290000000004, 2023-01-02T18:18:50.624 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.624 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.624 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.625 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.625 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.625 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3341 2023-01-02T18:18:50.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.626 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:50.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:50.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:50.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419937+0000", 2023-01-02T18:18:50.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6713000000000001e-05 2023-01-02T18:18:50.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419953+0000", 2023-01-02T18:18:50.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2670000000000001e-05 2023-01-02T18:18:50.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419976+0000", 2023-01-02T18:18:50.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4169999999999998e-06 2023-01-02T18:18:50.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419985+0000", 2023-01-02T18:18:50.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012351199999999999 2023-01-02T18:18:50.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420109+0000", 2023-01-02T18:18:50.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5488999999999995e-05 2023-01-02T18:18:50.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420184+0000", 2023-01-02T18:18:50.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035263699999999999 2023-01-02T18:18:50.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:50.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420537+0000", 2023-01-02T18:18:50.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038774510000000001 2023-01-02T18:18:50.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.424414+0000", 2023-01-02T18:18:50.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063741700000000004 2023-01-02T18:18:50.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425052+0000", 2023-01-02T18:18:50.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5787999999999997e-05 2023-01-02T18:18:50.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425088+0000", 2023-01-02T18:18:50.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3402999999999999e-05 2023-01-02T18:18:50.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425121+0000", 2023-01-02T18:18:50.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051817290000000004 2023-01-02T18:18:50.640 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.640 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.641 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.641 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:50.642 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:50.642 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 54.941913155999998, 2023-01-02T18:18:50.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:18:50.642 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.642 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.643 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.643 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:18:50.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.644 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:50.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:50.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:50.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:18:50.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:18:50.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:18:50.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:18:50.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:18:50.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:18:50.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:18:50.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:18:50.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:18:50.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:18:50.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:18:50.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:18:50.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:50.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:18:50.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:18:50.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:18:50.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:18:50.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:18:50.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:18:50.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:18:50.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:18:50.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:18:50.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:18:50.657 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.657 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.658 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.658 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:18:50.658 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:50.659 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.586375910000001, 2023-01-02T18:18:50.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:18:50.659 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.659 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.659 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.659 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.660 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.660 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:18:50.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.660 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:50.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:50.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:50.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:18:50.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:18:50.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:18:50.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:18:50.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:18:50.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:18:50.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:18:50.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:18:50.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:18:50.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:18:50.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:50.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:18:50.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:18:50.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:18:50.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:18:50.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:18:50.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:18:50.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:50.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:18:50.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:18:50.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:18:50.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:18:50.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:18:50.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:18:50.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:18:50.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:18:50.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:18:50.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:18:50.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.675 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.676 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:18:50.677 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:50.677 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 36.575471266999998, 2023-01-02T18:18:50.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:18:50.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:50.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.678 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:18:50.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.678 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:50.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:50.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:50.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:18:50.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:18:50.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:18:50.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:18:50.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:18:50.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:18:50.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:18:50.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:18:50.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:18:50.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:18:50.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:50.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:18:50.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:18:50.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:18:50.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:18:50.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:18:50.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:18:50.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:18:50.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:18:50.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:18:50.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:18:50.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:18:50.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:18:50.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:18:50.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.691 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.692 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:18:50.692 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:50.692 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 31.549528427999999, 2023-01-02T18:18:50.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:18:50.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.693 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.694 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:18:50.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.695 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:50.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:50.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:50.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:18:50.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:18:50.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:18:50.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:18:50.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:18:50.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:18:50.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:18:50.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:18:50.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:18:50.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:18:50.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:50.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:18:50.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:18:50.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:18:50.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:18:50.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:18:50.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:18:50.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:50.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:18:50.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:18:50.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:18:50.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:18:50.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:18:50.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:18:50.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:18:50.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:18:50.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:18:50.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:18:50.709 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.709 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.709 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.710 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:18:50.710 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:50.710 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.774751312999999, 2023-01-02T18:18:50.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:18:50.711 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.711 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:50.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.712 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:18:50.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.712 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:50.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:50.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:50.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:18:50.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:18:50.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:18:50.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:18:50.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:18:50.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:18:50.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:18:50.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:18:50.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:18:50.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:18:50.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:50.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:18:50.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:18:50.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:18:50.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:18:50.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:18:50.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:18:50.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:18:50.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:18:50.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.723 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.724 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:18:50.724 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:50.724 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.730246279999999, 2023-01-02T18:18:50.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:18:50.725 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.725 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.725 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.725 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.725 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.726 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:18:50.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.726 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:50.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:50.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:50.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:18:50.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:18:50.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:18:50.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:18:50.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:18:50.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:18:50.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:18:50.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:18:50.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:18:50.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:18:50.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:18:50.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:18:50.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:50.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:18:50.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:18:50.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:18:50.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:18:50.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:18:50.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:18:50.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:18:50.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:18:50.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:18:50.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:18:50.738 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.738 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.739 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.739 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:18:50.739 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:50.739 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.5292630240000005, 2023-01-02T18:18:50.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:18:50.740 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.740 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.740 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.741 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.741 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.741 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:18:50.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.741 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:50.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:50.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:50.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:18:50.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:18:50.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:18:50.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:18:50.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:18:50.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:18:50.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:18:50.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:18:50.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:18:50.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:18:50.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:18:50.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:18:50.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:50.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:18:50.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:18:50.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:18:50.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:18:50.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:18:50.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:18:50.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:18:50.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:18:50.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:18:50.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:18:50.754 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.754 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.755 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.755 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:18:50.755 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:50.756 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.3280103210000007, 2023-01-02T18:18:50.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:18:50.756 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.756 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:50.756 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.756 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.757 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.757 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:18:50.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.757 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:50.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:50.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:50.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:18:50.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:18:50.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:18:50.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:18:50.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:18:50.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:18:50.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:18:50.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:18:50.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:18:50.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:18:50.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:18:50.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:18:50.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:50.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:18:50.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:18:50.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:50.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:18:50.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:18:50.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:50.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:18:50.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:18:50.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:50.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:18:50.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:18:50.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:18:50.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:18:50.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.771 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35555 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [read 45056~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e149)", 2023-01-02T18:18:50.771 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:50.771 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.0561838560000005, 2023-01-02T18:18:50.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997, 2023-01-02T18:18:50.772 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:50.772 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:50.772 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:50.772 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:50.773 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:50.773 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35555 2023-01-02T18:18:50.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.773 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:50.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:50.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:50.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:50.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:50.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:50.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:50.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:50.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:50.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5999999999999998e-06 2023-01-02T18:18:50.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:50.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397335+0000", 2023-01-02T18:18:50.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0539999999999997e-06 2023-01-02T18:18:50.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:50.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397342+0000", 2023-01-02T18:18:50.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2090000000000001e-06 2023-01-02T18:18:50.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:50.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397345+0000", 2023-01-02T18:18:50.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5210000000000002e-05 2023-01-02T18:18:50.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:50.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397401+0000", 2023-01-02T18:18:50.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8177999999999996e-05 2023-01-02T18:18:50.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:50.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397479+0000", 2023-01-02T18:18:50.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052113059999999998 2023-01-02T18:18:50.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:50.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:50.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:50.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.402690+0000", 2023-01-02T18:18:50.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997 2023-01-02T18:18:50.782 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.782 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.782 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.782 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:50.783 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:50.783 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:50.784 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:50.785 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:50.785+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:50.785 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:50.885 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:50.884+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:50.911 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:50.911 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:50.912 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:50.912 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:50.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:50.986 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:50.986+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:51.086 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:51.087 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:51.087 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:51.088 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:51.088+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:51.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:51.187 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:51.187+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:51.223 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:51.223 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:51.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:51.224 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:51.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.224 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:53 3.f 3:f5b90545:::rbd_header.12a279b662cb:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:51.224 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:51.224 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 131.714793646, 2023-01-02T18:18:51.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038254109999999999, 2023-01-02T18:18:51.225 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.225 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.225 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.225 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.226 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.226 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 53 2023-01-02T18:18:51.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.226 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:51.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507239+0000", 2023-01-02T18:18:51.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:51.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507237+0000", 2023-01-02T18:18:51.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4399999999999999e-06 2023-01-02T18:18:51.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507245+0000", 2023-01-02T18:18:51.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2310000000000002e-06 2023-01-02T18:18:51.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507254+0000", 2023-01-02T18:18:51.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.49e-06 2023-01-02T18:18:51.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507262+0000", 2023-01-02T18:18:51.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3300000000000001e-05 2023-01-02T18:18:51.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507316+0000", 2023-01-02T18:18:51.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2240000000000003e-06 2023-01-02T18:18:51.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.507321+0000", 2023-01-02T18:18:51.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0019239249999999999 2023-01-02T18:18:51.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509245+0000", 2023-01-02T18:18:51.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133907 2023-01-02T18:18:51.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509379+0000", 2023-01-02T18:18:51.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000258886 2023-01-02T18:18:51.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:51.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.509638+0000", 2023-01-02T18:18:51.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001055587 2023-01-02T18:18:51.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510693+0000", 2023-01-02T18:18:51.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256445 2023-01-02T18:18:51.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.510950+0000", 2023-01-02T18:18:51.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7262000000000002e-05 2023-01-02T18:18:51.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511007+0000", 2023-01-02T18:18:51.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7481000000000001e-05 2023-01-02T18:18:51.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511064+0000", 2023-01-02T18:18:51.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038254109999999999 2023-01-02T18:18:51.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.241 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.242 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:18:51.242 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:51.242 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 123.903982369, 2023-01-02T18:18:51.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:18:51.242 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.243 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:51.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:51.243 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:18:51.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.244 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:51.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:51.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:51.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:18:51.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:18:51.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:18:51.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:18:51.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:18:51.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:18:51.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:18:51.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:18:51.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:18:51.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:18:51.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:51.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:18:51.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:18:51.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:18:51.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:18:51.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:18:51.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:18:51.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:51.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:18:51.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:18:51.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:18:51.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:18:51.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:18:51.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:18:51.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:18:51.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:18:51.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:18:51.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:18:51.258 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.259 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.259 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:18:51.260 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:51.260 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 118.88889891300001, 2023-01-02T18:18:51.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:18:51.260 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.260 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.260 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.261 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:18:51.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.261 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:51.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:51.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:51.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:18:51.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:18:51.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:18:51.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:18:51.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:18:51.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:18:51.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:18:51.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:18:51.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:18:51.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:18:51.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:18:51.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:18:51.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:18:51.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:18:51.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:18:51.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:18:51.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:51.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:18:51.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:18:51.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:18:51.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:18:51.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:18:51.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:18:51.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:18:51.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:18:51.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:18:51.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:18:51.276 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.276 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.276 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.277 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:18:51.277 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:51.277 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.904201336, 2023-01-02T18:18:51.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:18:51.278 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.278 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.278 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.278 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.278 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.279 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:18:51.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.279 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:51.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:51.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:51.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:18:51.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:18:51.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:18:51.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:18:51.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:18:51.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:18:51.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:18:51.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:18:51.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:18:51.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:18:51.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:18:51.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:18:51.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:18:51.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:18:51.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:18:51.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:18:51.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:51.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:18:51.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:18:51.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:18:51.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:18:51.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:18:51.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:18:51.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:18:51.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:18:51.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:18:51.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:18:51.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.294 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.295 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:51.295 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:51.295 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.906176645000002, 2023-01-02T18:18:51.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:18:51.295 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.296 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.296 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:18:51.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.297 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:51.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:51.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:51.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:18:51.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:18:51.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:18:51.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:18:51.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:18:51.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:18:51.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:18:51.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:18:51.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:18:51.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:18:51.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:18:51.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:18:51.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:18:51.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:18:51.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:18:51.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:18:51.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:51.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:18:51.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:18:51.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:18:51.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:18:51.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:18:51.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:18:51.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:18:51.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:18:51.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:18:51.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:18:51.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.312 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.313 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:51.313 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:51.313 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.905118191, 2023-01-02T18:18:51.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:18:51.314 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.314 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.314 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.314 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:51.314 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:51.315 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:18:51.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.315 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:51.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:51.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:51.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:18:51.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:18:51.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:18:51.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:18:51.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:18:51.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:18:51.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:18:51.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:18:51.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:18:51.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:18:51.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:18:51.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:18:51.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:18:51.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:18:51.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:18:51.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:18:51.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:51.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:18:51.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:18:51.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:18:51.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:18:51.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:18:51.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:18:51.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:18:51.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:18:51.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:18:51.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:18:51.329 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.329 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.330 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:18:51.330 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:51.331 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.899753544000006, 2023-01-02T18:18:51.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:18:51.331 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.331 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.331 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.331 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:51.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:51.332 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:18:51.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.332 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:51.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:51.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:51.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:18:51.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:18:51.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:18:51.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:18:51.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:18:51.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:18:51.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:18:51.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:18:51.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:18:51.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:18:51.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:18:51.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:18:51.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:18:51.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:18:51.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:18:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:18:51.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:18:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:18:51.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:18:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:18:51.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:18:51.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:18:51.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:18:51.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:18:51.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:18:51.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:18:51.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.347 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.348 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2191 3.13 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:18:51.348 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:51.348 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.881914929999994, 2023-01-02T18:18:51.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996, 2023-01-02T18:18:51.349 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.349 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.349 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.349 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:51.349 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:51.350 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2191 2023-01-02T18:18:51.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.350 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:51.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:51.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:51.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340115+0000", 2023-01-02T18:18:51.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2921999999999999e-05 2023-01-02T18:18:51.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340128+0000", 2023-01-02T18:18:51.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9213000000000001e-05 2023-01-02T18:18:51.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340147+0000", 2023-01-02T18:18:51.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0695e-05 2023-01-02T18:18:51.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340158+0000", 2023-01-02T18:18:51.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1227000000000001e-05 2023-01-02T18:18:51.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340229+0000", 2023-01-02T18:18:51.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7239999999999992e-06 2023-01-02T18:18:51.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340237+0000", 2023-01-02T18:18:51.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001423248 2023-01-02T18:18:51.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341660+0000", 2023-01-02T18:18:51.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158319 2023-01-02T18:18:51.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341818+0000", 2023-01-02T18:18:51.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019205099999999999 2023-01-02T18:18:51.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:51.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.342011+0000", 2023-01-02T18:18:51.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001641558 2023-01-02T18:18:51.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.343652+0000", 2023-01-02T18:18:51.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001445895 2023-01-02T18:18:51.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345098+0000", 2023-01-02T18:18:51.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4589000000000003e-05 2023-01-02T18:18:51.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345143+0000", 2023-01-02T18:18:51.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9351000000000001e-05 2023-01-02T18:18:51.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345172+0000", 2023-01-02T18:18:51.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996 2023-01-02T18:18:51.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.365 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.366 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:51.366 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:51.366 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.859422043999999, 2023-01-02T18:18:51.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:18:51.366 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.367 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.367 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.367 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:51.367 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:51.367 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:18:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:51.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:51.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:18:51.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:18:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:18:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:18:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:18:51.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:18:51.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:18:51.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:18:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:18:51.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:18:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:18:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:18:51.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:18:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:18:51.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:18:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:18:51.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:18:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:18:51.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:18:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:18:51.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:18:51.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:18:51.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:18:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:18:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:18:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:18:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.382 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:51.383 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 84.854851793999998, 2023-01-02T18:18:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:18:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.384 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:51.385 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:51.385 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:18:51.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.385 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:18:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:18:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:18:51.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:18:51.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:18:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:18:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:18:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:18:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:18:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:18:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:18:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:18:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:18:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:18:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:18:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:18:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:51.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:18:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:18:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:18:51.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:18:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:18:51.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:18:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:18:51.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:18:51.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:18:51.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:18:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:18:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 83.842019777999994, 2023-01-02T18:18:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:18:51.401 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:51.402 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:18:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:51.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:51.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:51.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:18:51.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:18:51.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:18:51.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:18:51.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:18:51.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:51.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:18:51.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:18:51.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:18:51.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:18:51.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:18:51.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:18:51.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:18:51.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:18:51.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:18:51.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:18:51.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:51.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:18:51.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:18:51.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:18:51.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:18:51.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:18:51.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:18:51.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:18:51.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:18:51.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:18:51.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:18:51.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.420 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.420 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.421 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:18:51.421 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:51.421 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.893286278999994, 2023-01-02T18:18:51.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:18:51.422 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.422 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:51.423 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:51.423 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:18:51.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.423 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:51.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:51.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:51.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:18:51.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:18:51.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:18:51.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:18:51.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:18:51.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:18:51.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:18:51.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:18:51.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:18:51.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:18:51.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:51.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:18:51.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:18:51.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:18:51.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:18:51.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:18:51.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:18:51.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:51.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:18:51.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:18:51.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:18:51.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:18:51.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:18:51.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:18:51.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:18:51.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:18:51.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:18:51.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:18:51.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.438 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.438 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:51.439 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:51.439 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.893443224999999, 2023-01-02T18:18:51.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:18:51.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.439 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.440 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:18:51.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.441 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:51.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:51.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:51.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:18:51.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:18:51.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:18:51.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:18:51.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:18:51.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:18:51.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:18:51.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:18:51.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:18:51.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:18:51.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:18:51.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:18:51.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:51.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:18:51.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:18:51.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:18:51.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:18:51.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:18:51.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:18:51.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:18:51.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:18:51.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:18:51.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:18:51.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.453 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.454 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.454 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3381 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch unwatch cookie 140114584663936] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:51.454 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:51.455 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.744749720000002, 2023-01-02T18:18:51.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047545959999999998, 2023-01-02T18:18:51.455 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.455 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.455 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.455 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.456 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.456 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3381 2023-01-02T18:18:51.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.456 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:51.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:51.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:51.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477282+0000", 2023-01-02T18:18:51.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0690000000000003e-06 2023-01-02T18:18:51.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477286+0000", 2023-01-02T18:18:51.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.61e-06 2023-01-02T18:18:51.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477294+0000", 2023-01-02T18:18:51.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.19e-06 2023-01-02T18:18:51.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477297+0000", 2023-01-02T18:18:51.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016576899999999999 2023-01-02T18:18:51.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477463+0000", 2023-01-02T18:18:51.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4697999999999996e-05 2023-01-02T18:18:51.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477527+0000", 2023-01-02T18:18:51.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012896699999999999 2023-01-02T18:18:51.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:51.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477656+0000", 2023-01-02T18:18:51.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092177700000000003 2023-01-02T18:18:51.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.478578+0000", 2023-01-02T18:18:51.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033212659999999998 2023-01-02T18:18:51.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.481899+0000", 2023-01-02T18:18:51.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8207999999999997e-05 2023-01-02T18:18:51.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.481938+0000", 2023-01-02T18:18:51.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9822999999999996e-05 2023-01-02T18:18:51.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482037+0000", 2023-01-02T18:18:51.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047545959999999998 2023-01-02T18:18:51.468 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.468 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.469 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.469 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3382 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+full_try e117)", 2023-01-02T18:18:51.469 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:51.470 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.744514852000002, 2023-01-02T18:18:51.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046394139999999997, 2023-01-02T18:18:51.470 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.470 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:51.470 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.470 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.471 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.471 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3382 2023-01-02T18:18:51.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.471 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:51.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:51.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:51.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477516+0000", 2023-01-02T18:18:51.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0870000000000001e-06 2023-01-02T18:18:51.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477523+0000", 2023-01-02T18:18:51.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7181999999999999e-05 2023-01-02T18:18:51.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477541+0000", 2023-01-02T18:18:51.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.276e-05 2023-01-02T18:18:51.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477553+0000", 2023-01-02T18:18:51.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000346912 2023-01-02T18:18:51.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477900+0000", 2023-01-02T18:18:51.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7819999999999996e-05 2023-01-02T18:18:51.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:51.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477988+0000", 2023-01-02T18:18:51.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762630000000001 2023-01-02T18:18:51.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482064+0000", 2023-01-02T18:18:51.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0998000000000003e-05 2023-01-02T18:18:51.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482105+0000", 2023-01-02T18:18:51.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1690999999999997e-05 2023-01-02T18:18:51.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482157+0000", 2023-01-02T18:18:51.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046394139999999997 2023-01-02T18:18:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3409 11.3 e117/102 11:c4c92e5a:::rbd_trash:head v 117'10, mlcod=117'8)", 2023-01-02T18:18:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.715789897000001, 2023-01-02T18:18:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042507309999999998, 2023-01-02T18:18:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.483 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:51.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506243+0000", 2023-01-02T18:18:51.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:51.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506242+0000", 2023-01-02T18:18:51.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3999999999999998e-06 2023-01-02T18:18:51.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506251+0000", 2023-01-02T18:18:51.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1779e-05 2023-01-02T18:18:51.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506263+0000", 2023-01-02T18:18:51.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2020000000000003e-06 2023-01-02T18:18:51.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506268+0000", 2023-01-02T18:18:51.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6593e-05 2023-01-02T18:18:51.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506305+0000", 2023-01-02T18:18:51.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2292e-05 2023-01-02T18:18:51.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.506317+0000", 2023-01-02T18:18:51.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004147548 2023-01-02T18:18:51.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.510465+0000", 2023-01-02T18:18:51.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8863000000000001e-05 2023-01-02T18:18:51.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.510493+0000", 2023-01-02T18:18:51.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042507309999999998 2023-01-02T18:18:51.493 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.493 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.493 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.494 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3486 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:18:51.494 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:51.494 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.409633221999997, 2023-01-02T18:18:51.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004, 2023-01-02T18:18:51.495 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.495 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.495 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.495 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.495 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3486 2023-01-02T18:18:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812397+0000", 2023-01-02T18:18:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0736e-05 2023-01-02T18:18:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812408+0000", 2023-01-02T18:18:51.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8725000000000001e-05 2023-01-02T18:18:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812427+0000", 2023-01-02T18:18:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6719999999999993e-06 2023-01-02T18:18:51.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812435+0000", 2023-01-02T18:18:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8585000000000003e-05 2023-01-02T18:18:51.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812484+0000", 2023-01-02T18:18:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014839399999999999 2023-01-02T18:18:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812632+0000", 2023-01-02T18:18:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00048733700000000001 2023-01-02T18:18:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.813120+0000", 2023-01-02T18:18:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031693730000000001 2023-01-02T18:18:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.816289+0000", 2023-01-02T18:18:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00079880000000000001 2023-01-02T18:18:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817088+0000", 2023-01-02T18:18:51.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9833000000000001e-05 2023-01-02T18:18:51.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817148+0000", 2023-01-02T18:18:51.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2119000000000001e-05 2023-01-02T18:18:51.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817190+0000", 2023-01-02T18:18:51.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004 2023-01-02T18:18:51.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.508 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.509 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3487 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:18:51.509 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:51.509 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 47.404474426, 2023-01-02T18:18:51.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045799999999999999, 2023-01-02T18:18:51.509 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.510 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.510 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.510 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.510 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.510 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3487 2023-01-02T18:18:51.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.511 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:51.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:51.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:51.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817555+0000", 2023-01-02T18:18:51.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3555e-05 2023-01-02T18:18:51.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817568+0000", 2023-01-02T18:18:51.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8287e-05 2023-01-02T18:18:51.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817587+0000", 2023-01-02T18:18:51.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6570000000000003e-06 2023-01-02T18:18:51.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817595+0000", 2023-01-02T18:18:51.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3665000000000002e-05 2023-01-02T18:18:51.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817649+0000", 2023-01-02T18:18:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2825999999999996e-05 2023-01-02T18:18:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817732+0000", 2023-01-02T18:18:51.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042540399999999999 2023-01-02T18:18:51.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:51.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.818157+0000", 2023-01-02T18:18:51.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033449220000000002 2023-01-02T18:18:51.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.821502+0000", 2023-01-02T18:18:51.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052594299999999996 2023-01-02T18:18:51.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822028+0000", 2023-01-02T18:18:51.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2504999999999999e-05 2023-01-02T18:18:51.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822091+0000", 2023-01-02T18:18:51.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7435999999999998e-05 2023-01-02T18:18:51.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822138+0000", 2023-01-02T18:18:51.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045799999999999999 2023-01-02T18:18:51.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.523 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.523 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.524 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3488 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e126)", 2023-01-02T18:18:51.524 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:51.524 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.399555628999998, 2023-01-02T18:18:51.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004, 2023-01-02T18:18:51.525 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.525 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.525 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.526 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3488 2023-01-02T18:18:51.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.526 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:51.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:51.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:51.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822474+0000", 2023-01-02T18:18:51.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8097999999999999e-05 2023-01-02T18:18:51.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822492+0000", 2023-01-02T18:18:51.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4201000000000001e-05 2023-01-02T18:18:51.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822516+0000", 2023-01-02T18:18:51.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1077000000000001e-05 2023-01-02T18:18:51.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822527+0000", 2023-01-02T18:18:51.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0508999999999998e-05 2023-01-02T18:18:51.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822608+0000", 2023-01-02T18:18:51.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1670999999999999e-05 2023-01-02T18:18:51.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822679+0000", 2023-01-02T18:18:51.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030685400000000001 2023-01-02T18:18:51.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:51.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822986+0000", 2023-01-02T18:18:51.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002756896 2023-01-02T18:18:51.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.825743+0000", 2023-01-02T18:18:51.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014320229999999999 2023-01-02T18:18:51.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827175+0000", 2023-01-02T18:18:51.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6622999999999998e-05 2023-01-02T18:18:51.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827212+0000", 2023-01-02T18:18:51.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3500000000000001e-05 2023-01-02T18:18:51.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827245+0000", 2023-01-02T18:18:51.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004 2023-01-02T18:18:51.538 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.539 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.539 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.539 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:51.539 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:51.540 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.350404001000001, 2023-01-02T18:18:51.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:18:51.540 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:51.540 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:51.540 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:51.541 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:51.541 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:51.541 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:18:51.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.541 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:51.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:51.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:51.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:51.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:51.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:51.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:51.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:51.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:18:51.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:18:51.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:51.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:18:51.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:18:51.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:51.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:18:51.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:18:51.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:51.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:18:51.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:18:51.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:51.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:18:51.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:18:51.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:51.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:18:51.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:18:51.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:51.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:18:51.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:18:51.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:51.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:18:51.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:18:51.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:51.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:18:51.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:18:51.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:51.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:18:51.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:18:51.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:51.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:51.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:51.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:18:51.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:18:51.553 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.554 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.554 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.554 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:51.554 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:51.554 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:51.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:51.557 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:51.556+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:51.656 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:51.657+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:51.702 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:51.702 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:51.703 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:51.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:18:51.713 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:51.797 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:51.798+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:51.858 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:51.858+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:51.881 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:51.882 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:51.882 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:18:51.882 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:18:51.882 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:51.892 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:51.958 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:51.958+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:52.059 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:52.060+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:52.061 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:52.061 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:18:52.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:18:52.062 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:18:52.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.062 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2319 3.1 3:83da4b60:::rbd_object_map.11d54907a3eb.0000000000000014:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:52.062 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:52.062 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 85.686139901999994, 2023-01-02T18:18:52.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001, 2023-01-02T18:18:52.063 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.063 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.063 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.063 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:18:52.064 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:52.064 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2319 2023-01-02T18:18:52.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.064 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:52.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:18:52.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:52.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374312+0000", 2023-01-02T18:18:52.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2023-01-02T18:18:52.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374323+0000", 2023-01-02T18:18:52.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8349e-05 2023-01-02T18:18:52.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374341+0000", 2023-01-02T18:18:52.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9909999999999997e-06 2023-01-02T18:18:52.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374351+0000", 2023-01-02T18:18:52.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.617e-05 2023-01-02T18:18:52.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374398+0000", 2023-01-02T18:18:52.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:18:52.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:52.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374403+0000", 2023-01-02T18:18:52.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001918765 2023-01-02T18:18:52.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376322+0000", 2023-01-02T18:18:52.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015418100000000001 2023-01-02T18:18:52.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376476+0000", 2023-01-02T18:18:52.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016648999999999999 2023-01-02T18:18:52.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:52.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376642+0000", 2023-01-02T18:18:52.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001972976 2023-01-02T18:18:52.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.378615+0000", 2023-01-02T18:18:52.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020004570000000002 2023-01-02T18:18:52.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380616+0000", 2023-01-02T18:18:52.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3064000000000005e-05 2023-01-02T18:18:52.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380679+0000", 2023-01-02T18:18:52.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9119000000000002e-05 2023-01-02T18:18:52.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380728+0000", 2023-01-02T18:18:52.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001 2023-01-02T18:18:52.078 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.078 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.079 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.079 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3507 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:52.079 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:52.079 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 35.166714053, 2023-01-02T18:18:52.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002, 2023-01-02T18:18:52.080 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.080 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.080 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.080 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.081 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.081 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3507 2023-01-02T18:18:52.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.081 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:52.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:18:52.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:52.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893738+0000", 2023-01-02T18:18:52.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4447000000000001e-05 2023-01-02T18:18:52.084 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.084 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893752+0000", 2023-01-02T18:18:52.085 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8085999999999999e-05 2023-01-02T18:18:52.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.085 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.085 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893770+0000", 2023-01-02T18:18:52.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5949999999999999e-06 2023-01-02T18:18:52.086 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.086 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.086 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.086 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893779+0000", 2023-01-02T18:18:52.087 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4619000000000001e-05 2023-01-02T18:18:52.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.087 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.087 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893824+0000", 2023-01-02T18:18:52.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0294000000000002e-05 2023-01-02T18:18:52.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893894+0000", 2023-01-02T18:18:52.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034635200000000002 2023-01-02T18:18:52.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:52.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.894240+0000", 2023-01-02T18:18:52.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024283040000000001 2023-01-02T18:18:52.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.896669+0000", 2023-01-02T18:18:52.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018365300000000001 2023-01-02T18:18:52.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898505+0000", 2023-01-02T18:18:52.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2230000000000001e-05 2023-01-02T18:18:52.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898537+0000", 2023-01-02T18:18:52.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6251e-05 2023-01-02T18:18:52.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898564+0000", 2023-01-02T18:18:52.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002 2023-01-02T18:18:52.093 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.094 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.094 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.094 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3508 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:18:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 34.161610496000002, 2023-01-02T18:18:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001, 2023-01-02T18:18:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.095 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3508 2023-01-02T18:18:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.096 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:18:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898841+0000", 2023-01-02T18:18:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:18:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898867+0000", 2023-01-02T18:18:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323999999999999e-05 2023-01-02T18:18:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898890+0000", 2023-01-02T18:18:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8820000000000007e-06 2023-01-02T18:18:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898899+0000", 2023-01-02T18:18:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1070999999999999e-05 2023-01-02T18:18:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.102 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898950+0000", 2023-01-02T18:18:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2550000000000002e-05 2023-01-02T18:18:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.103 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899022+0000", 2023-01-02T18:18:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317836 2023-01-02T18:18:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:52.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899340+0000", 2023-01-02T18:18:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002728931 2023-01-02T18:18:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.902069+0000", 2023-01-02T18:18:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014209419999999999 2023-01-02T18:18:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903490+0000", 2023-01-02T18:18:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3368000000000003e-05 2023-01-02T18:18:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903523+0000", 2023-01-02T18:18:52.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5165999999999999e-05 2023-01-02T18:18:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903549+0000", 2023-01-02T18:18:52.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001 2023-01-02T18:18:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.109 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16198 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1536~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.163588188999999, 2023-01-02T18:18:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003, 2023-01-02T18:18:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.110 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16198 2023-01-02T18:18:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.111 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:18:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896865+0000", 2023-01-02T18:18:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6900000000000001e-06 2023-01-02T18:18:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.114 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896868+0000", 2023-01-02T18:18:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:18:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896874+0000", 2023-01-02T18:18:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.447e-06 2023-01-02T18:18:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896876+0000", 2023-01-02T18:18:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001873179 2023-01-02T18:18:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898750+0000", 2023-01-02T18:18:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7626000000000005e-05 2023-01-02T18:18:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898827+0000", 2023-01-02T18:18:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012927899999999999 2023-01-02T18:18:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.119 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898957+0000", 2023-01-02T18:18:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023139749999999998 2023-01-02T18:18:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.120 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901271+0000", 2023-01-02T18:18:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4455000000000005e-05 2023-01-02T18:18:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.121 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901335+0000", 2023-01-02T18:18:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7706999999999994e-05 2023-01-02T18:18:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.122 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901403+0000", 2023-01-02T18:18:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3409999999999999e-05 2023-01-02T18:18:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901446+0000", 2023-01-02T18:18:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003 2023-01-02T18:18:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16199 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2048~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.163575100999999, 2023-01-02T18:18:52.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004, 2023-01-02T18:18:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.126 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16199 2023-01-02T18:18:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:18:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.69e-06 2023-01-02T18:18:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896883+0000", 2023-01-02T18:18:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2909999999999999e-06 2023-01-02T18:18:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896887+0000", 2023-01-02T18:18:52.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.238e-06 2023-01-02T18:18:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896889+0000", 2023-01-02T18:18:52.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002707919 2023-01-02T18:18:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899597+0000", 2023-01-02T18:18:52.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2546000000000002e-05 2023-01-02T18:18:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899639+0000", 2023-01-02T18:18:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4080999999999996e-05 2023-01-02T18:18:52.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899733+0000", 2023-01-02T18:18:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001771826 2023-01-02T18:18:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.135 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901505+0000", 2023-01-02T18:18:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6619999999999994e-06 2023-01-02T18:18:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901514+0000", 2023-01-02T18:18:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0059999999999998e-05 2023-01-02T18:18:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.137 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901564+0000", 2023-01-02T18:18:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1318e-05 2023-01-02T18:18:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.138 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901605+0000", 2023-01-02T18:18:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004 2023-01-02T18:18:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16200 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2560~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.163562914, 2023-01-02T18:18:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998, 2023-01-02T18:18:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.140 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16200 2023-01-02T18:18:52.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.142 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:52.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:52.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:18:52.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0820000000000001e-06 2023-01-02T18:18:52.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896893+0000", 2023-01-02T18:18:52.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8679999999999999e-06 2023-01-02T18:18:52.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.146 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896896+0000", 2023-01-02T18:18:52.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1390000000000002e-06 2023-01-02T18:18:52.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896898+0000", 2023-01-02T18:18:52.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032553590000000002 2023-01-02T18:18:52.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.148 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900153+0000", 2023-01-02T18:18:52.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8237000000000003e-05 2023-01-02T18:18:52.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900232+0000", 2023-01-02T18:18:52.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018062300000000001 2023-01-02T18:18:52.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900412+0000", 2023-01-02T18:18:52.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012047169999999999 2023-01-02T18:18:52.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901617+0000", 2023-01-02T18:18:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042531099999999999 2023-01-02T18:18:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902042+0000", 2023-01-02T18:18:52.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1499000000000003e-05 2023-01-02T18:18:52.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.153 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.153 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902094+0000", 2023-01-02T18:18:52.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9249000000000003e-05 2023-01-02T18:18:52.153 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.153 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.154 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.154 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902133+0000", 2023-01-02T18:18:52.154 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998 2023-01-02T18:18:52.154 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.154 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.155 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.155 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.155 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.155 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16201 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:52.155 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:52.156 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.16355403, 2023-01-02T18:18:52.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004, 2023-01-02T18:18:52.156 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.156 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.156 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.156 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.157 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.157 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16201 2023-01-02T18:18:52.157 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.157 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.157 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.158 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.158 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:52.158 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.159 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:52.159 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:18:52.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4200000000000001e-06 2023-01-02T18:18:52.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.160 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896902+0000", 2023-01-02T18:18:52.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8849999999999999e-06 2023-01-02T18:18:52.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896905+0000", 2023-01-02T18:18:52.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2500000000000001e-06 2023-01-02T18:18:52.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896907+0000", 2023-01-02T18:18:52.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038386549999999998 2023-01-02T18:18:52.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900746+0000", 2023-01-02T18:18:52.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8287000000000004e-05 2023-01-02T18:18:52.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900834+0000", 2023-01-02T18:18:52.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016278899999999999 2023-01-02T18:18:52.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900997+0000", 2023-01-02T18:18:52.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011903720000000001 2023-01-02T18:18:52.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902187+0000", 2023-01-02T18:18:52.166 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634200000000004 2023-01-02T18:18:52.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902704+0000", 2023-01-02T18:18:52.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.957e-05 2023-01-02T18:18:52.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902733+0000", 2023-01-02T18:18:52.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4341e-05 2023-01-02T18:18:52.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.169 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902758+0000", 2023-01-02T18:18:52.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004 2023-01-02T18:18:52.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.169 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.170 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16202 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:52.170 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:52.170 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.163544612999999, 2023-01-02T18:18:52.170 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001, 2023-01-02T18:18:52.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.171 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.171 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.171 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.171 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16202 2023-01-02T18:18:52.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.172 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.172 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.172 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:52.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.173 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:52.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:18:52.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.092e-06 2023-01-02T18:18:52.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896911+0000", 2023-01-02T18:18:52.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1019999999999999e-06 2023-01-02T18:18:52.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896915+0000", 2023-01-02T18:18:52.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7930000000000002e-06 2023-01-02T18:18:52.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896918+0000", 2023-01-02T18:18:52.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047231770000000003 2023-01-02T18:18:52.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901641+0000", 2023-01-02T18:18:52.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2209000000000002e-05 2023-01-02T18:18:52.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901684+0000", 2023-01-02T18:18:52.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104726 2023-01-02T18:18:52.179 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901788+0000", 2023-01-02T18:18:52.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015539740000000001 2023-01-02T18:18:52.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903342+0000", 2023-01-02T18:18:52.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1817999999999998e-05 2023-01-02T18:18:52.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903394+0000", 2023-01-02T18:18:52.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8734999999999998e-05 2023-01-02T18:18:52.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903423+0000", 2023-01-02T18:18:52.183 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9155000000000001e-05 2023-01-02T18:18:52.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903452+0000", 2023-01-02T18:18:52.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001 2023-01-02T18:18:52.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.184 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.184 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.185 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16203 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:52.185 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:52.185 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.163533519000001, 2023-01-02T18:18:52.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998, 2023-01-02T18:18:52.185 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.186 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.186 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.186 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.186 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.186 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16203 2023-01-02T18:18:52.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.187 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:52.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.188 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.188 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:18:52.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.189 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.189 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.189 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896920+0000", 2023-01-02T18:18:52.189 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1600000000000001e-06 2023-01-02T18:18:52.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.190 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.190 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.190 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896922+0000", 2023-01-02T18:18:52.190 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5219999999999999e-06 2023-01-02T18:18:52.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.191 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.191 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.191 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896926+0000", 2023-01-02T18:18:52.191 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9470000000000002e-06 2023-01-02T18:18:52.191 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.192 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.192 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.192 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896928+0000", 2023-01-02T18:18:52.192 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052862669999999999 2023-01-02T18:18:52.192 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.193 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.193 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.193 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902214+0000", 2023-01-02T18:18:52.193 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3084999999999994e-05 2023-01-02T18:18:52.193 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.194 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.194 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902307+0000", 2023-01-02T18:18:52.194 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013711100000000001 2023-01-02T18:18:52.194 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.194 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.195 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.195 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902444+0000", 2023-01-02T18:18:52.195 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090387900000000001 2023-01-02T18:18:52.195 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.195 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.196 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903348+0000", 2023-01-02T18:18:52.196 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015428300000000001 2023-01-02T18:18:52.196 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.196 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.196 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.197 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903503+0000", 2023-01-02T18:18:52.197 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7078999999999999e-05 2023-01-02T18:18:52.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.197 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.198 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903530+0000", 2023-01-02T18:18:52.198 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9266000000000002e-05 2023-01-02T18:18:52.198 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.198 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.198 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.199 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903549+0000", 2023-01-02T18:18:52.199 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998 2023-01-02T18:18:52.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.199 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.199 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.199 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.200 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.200 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16204 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:52.200 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:52.200 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.163524070000001, 2023-01-02T18:18:52.200 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996, 2023-01-02T18:18:52.201 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.201 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.201 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.202 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16204 2023-01-02T18:18:52.202 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.202 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.202 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.202 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:52.203 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.203 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.203 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.203 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.203 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:52.204 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.204 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.204 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.204 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.204 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:18:52.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1679999999999997e-06 2023-01-02T18:18:52.205 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.205 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.205 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.205 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896934+0000", 2023-01-02T18:18:52.205 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.039e-06 2023-01-02T18:18:52.206 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.206 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.206 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.206 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896937+0000", 2023-01-02T18:18:52.206 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0389999999999999e-06 2023-01-02T18:18:52.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.207 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.207 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.207 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896939+0000", 2023-01-02T18:18:52.207 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058543179999999998 2023-01-02T18:18:52.207 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.208 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.208 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.208 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902793+0000", 2023-01-02T18:18:52.208 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5451999999999996e-05 2023-01-02T18:18:52.208 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.209 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.209 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902859+0000", 2023-01-02T18:18:52.209 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5087999999999996e-05 2023-01-02T18:18:52.209 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.209 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.210 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.210 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902944+0000", 2023-01-02T18:18:52.210 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086757900000000005 2023-01-02T18:18:52.210 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.210 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.211 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903811+0000", 2023-01-02T18:18:52.211 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9238000000000002e-05 2023-01-02T18:18:52.211 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.211 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.211 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.212 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903901+0000", 2023-01-02T18:18:52.212 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0630000000000001e-05 2023-01-02T18:18:52.212 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.212 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.212 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.213 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903951+0000", 2023-01-02T18:18:52.213 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6187999999999998e-05 2023-01-02T18:18:52.213 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.213 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.213 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.214 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904007+0000", 2023-01-02T18:18:52.214 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996 2023-01-02T18:18:52.214 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.214 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.214 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.214 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.215 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.215 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16205 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 0~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e140)", 2023-01-02T18:18:52.215 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:52.215 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 24.160781051000001, 2023-01-02T18:18:52.215 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868, 2023-01-02T18:18:52.216 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.216 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:52.216 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.216 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.216 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.217 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16205 2023-01-02T18:18:52.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.217 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.217 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.217 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:52.218 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.218 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.218 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.218 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.218 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:18:52.219 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:52.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.219 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.219 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.219 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899672+0000", 2023-01-02T18:18:52.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2650000000000004e-06 2023-01-02T18:18:52.220 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.220 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.220 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.220 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899677+0000", 2023-01-02T18:18:52.220 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1850000000000004e-06 2023-01-02T18:18:52.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.221 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.221 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.221 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899686+0000", 2023-01-02T18:18:52.221 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4259999999999996e-06 2023-01-02T18:18:52.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.222 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.222 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899690+0000", 2023-01-02T18:18:52.222 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576512 2023-01-02T18:18:52.223 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.223 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.223 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.223 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903266+0000", 2023-01-02T18:18:52.223 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5141000000000005e-05 2023-01-02T18:18:52.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.224 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.224 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:52.224 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903332+0000", 2023-01-02T18:18:52.224 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070156899999999998 2023-01-02T18:18:52.224 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.225 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.225 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.225 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904033+0000", 2023-01-02T18:18:52.225 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0550000000000003e-05 2023-01-02T18:18:52.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.226 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.226 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.226 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904074+0000", 2023-01-02T18:18:52.226 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7970000000000001e-05 2023-01-02T18:18:52.226 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.227 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.227 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.227 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904142+0000", 2023-01-02T18:18:52.227 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868 2023-01-02T18:18:52.227 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.227 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.228 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.228 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.228 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28602 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 146432~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e143)", 2023-01-02T18:18:52.228 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:52.229 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.122796648000001, 2023-01-02T18:18:52.229 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996, 2023-01-02T18:18:52.229 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.229 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:52.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.229 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.230 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.230 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28602 2023-01-02T18:18:52.230 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.230 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.230 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.231 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.231 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:52.231 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.231 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.231 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.232 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:18:52.232 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:52.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.232 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.232 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.233 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937656+0000", 2023-01-02T18:18:52.233 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3520000000000003e-06 2023-01-02T18:18:52.233 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.233 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.233 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.234 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937663+0000", 2023-01-02T18:18:52.234 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4744e-05 2023-01-02T18:18:52.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.234 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.234 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937677+0000", 2023-01-02T18:18:52.235 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5119999999999997e-06 2023-01-02T18:18:52.235 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.235 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.235 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.235 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937684+0000", 2023-01-02T18:18:52.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2098999999999997e-05 2023-01-02T18:18:52.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.236 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.236 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.236 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937736+0000", 2023-01-02T18:18:52.236 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:18:52.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.237 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:52.237 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937745+0000", 2023-01-02T18:18:52.237 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073198109999999999 2023-01-02T18:18:52.238 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.238 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.238 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.238 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945065+0000", 2023-01-02T18:18:52.238 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1624000000000002e-05 2023-01-02T18:18:52.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.239 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.239 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.239 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945156+0000", 2023-01-02T18:18:52.239 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123879 2023-01-02T18:18:52.240 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.240 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.240 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.240 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945280+0000", 2023-01-02T18:18:52.240 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996 2023-01-02T18:18:52.240 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.241 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.241 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.241 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.241 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.241 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28808 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [assert-version v64,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:18:52.242 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:52.242 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 21.047618368999998, 2023-01-02T18:18:52.242 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002, 2023-01-02T18:18:52.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.242 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.242 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.243 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.243 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28808 2023-01-02T18:18:52.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.243 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.244 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.244 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:52.244 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.244 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.245 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.245 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:18:52.245 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:52.245 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.246 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.246 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012835+0000", 2023-01-02T18:18:52.246 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0229999999999998e-06 2023-01-02T18:18:52.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.247 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012841+0000", 2023-01-02T18:18:52.247 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1938e-05 2023-01-02T18:18:52.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.247 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.248 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012853+0000", 2023-01-02T18:18:52.248 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5520000000000004e-06 2023-01-02T18:18:52.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.248 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.249 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012858+0000", 2023-01-02T18:18:52.249 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9961999999999999e-05 2023-01-02T18:18:52.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.249 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012888+0000", 2023-01-02T18:18:52.250 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2904e-05 2023-01-02T18:18:52.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.250 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.250 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012941+0000", 2023-01-02T18:18:52.251 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016403699999999999 2023-01-02T18:18:52.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.251 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.251 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.251 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013105+0000", 2023-01-02T18:18:52.252 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074456399999999997 2023-01-02T18:18:52.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.252 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.252 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013850+0000", 2023-01-02T18:18:52.253 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027539999999999999 2023-01-02T18:18:52.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.253 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.253 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016604+0000", 2023-01-02T18:18:52.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4141999999999999e-05 2023-01-02T18:18:52.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.254 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.254 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016638+0000", 2023-01-02T18:18:52.254 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7827000000000002e-05 2023-01-02T18:18:52.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.255 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.255 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016676+0000", 2023-01-02T18:18:52.255 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002 2023-01-02T18:18:52.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.256 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.256 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41666 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:52.257 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:18:52.257 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.6829596579999997, 2023-01-02T18:18:52.257 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043435039999999998, 2023-01-02T18:18:52.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.257 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.258 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.258 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.258 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.258 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41666 2023-01-02T18:18:52.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.259 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.259 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.259 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.259 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:18:52.259 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.260 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.260 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:18:52.260 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.261 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.261 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:18:52.261 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7869999999999999e-06 2023-01-02T18:18:52.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.262 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.262 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377498+0000", 2023-01-02T18:18:52.262 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7349999999999999e-06 2023-01-02T18:18:52.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.263 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.263 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377505+0000", 2023-01-02T18:18:52.263 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9289999999999997e-06 2023-01-02T18:18:52.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.264 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.264 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377509+0000", 2023-01-02T18:18:52.264 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028717389999999999 2023-01-02T18:18:52.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.265 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.265 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380381+0000", 2023-01-02T18:18:52.265 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2969999999999997e-05 2023-01-02T18:18:52.265 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.266 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.266 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380424+0000", 2023-01-02T18:18:52.266 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107729 2023-01-02T18:18:52.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:52.267 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380532+0000", 2023-01-02T18:18:52.267 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001230039 2023-01-02T18:18:52.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.267 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381762+0000", 2023-01-02T18:18:52.268 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0010000000000007e-06 2023-01-02T18:18:52.268 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.268 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.268 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.268 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381771+0000", 2023-01-02T18:18:52.269 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6591999999999997e-05 2023-01-02T18:18:52.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.269 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.269 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.269 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381818+0000", 2023-01-02T18:18:52.270 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0386000000000001e-05 2023-01-02T18:18:52.270 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.270 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.270 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.270 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381838+0000", 2023-01-02T18:18:52.271 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043435039999999998 2023-01-02T18:18:52.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.271 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.271 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.271 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.271 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.272 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41667 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:52.272 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:18:52.272 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.6829399890000003, 2023-01-02T18:18:52.272 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048409819999999998, 2023-01-02T18:18:52.272 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.273 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.273 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.273 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.273 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.273 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41667 2023-01-02T18:18:52.274 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.274 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.274 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.274 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.274 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:18:52.275 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.275 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.275 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.275 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.275 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:18:52.276 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.276 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.276 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.276 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.276 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:18:52.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2910000000000001e-06 2023-01-02T18:18:52.277 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.277 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.277 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.277 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377518+0000", 2023-01-02T18:18:52.277 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9619999999999996e-06 2023-01-02T18:18:52.278 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.278 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.278 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.278 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377525+0000", 2023-01-02T18:18:52.278 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0780000000000001e-06 2023-01-02T18:18:52.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.279 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.279 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.279 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377531+0000", 2023-01-02T18:18:52.279 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032340340000000002 2023-01-02T18:18:52.279 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.280 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.280 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.280 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380765+0000", 2023-01-02T18:18:52.280 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1267999999999999e-05 2023-01-02T18:18:52.280 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.281 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.281 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.281 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380806+0000", 2023-01-02T18:18:52.281 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.975e-05 2023-01-02T18:18:52.281 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.282 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:52.282 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380886+0000", 2023-01-02T18:18:52.282 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098581100000000007 2023-01-02T18:18:52.282 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.282 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.283 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.283 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381872+0000", 2023-01-02T18:18:52.283 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042798899999999998 2023-01-02T18:18:52.283 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.283 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.284 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382300+0000", 2023-01-02T18:18:52.284 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2042000000000003e-05 2023-01-02T18:18:52.284 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.284 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.284 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.285 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382332+0000", 2023-01-02T18:18:52.285 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3221999999999999e-05 2023-01-02T18:18:52.285 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.285 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.285 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.286 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382355+0000", 2023-01-02T18:18:52.286 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048409819999999998 2023-01-02T18:18:52.286 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.286 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.286 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.287 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.287 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.287 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41668 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:52.287 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:18:52.287 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.6829183939999997, 2023-01-02T18:18:52.287 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010315690000000001, 2023-01-02T18:18:52.288 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.288 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.288 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.289 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41668 2023-01-02T18:18:52.289 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.289 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.289 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.289 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:18:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.290 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:18:52.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.291 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.291 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.291 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.291 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377535+0000", 2023-01-02T18:18:52.291 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7050000000000001e-06 2023-01-02T18:18:52.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.292 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.292 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.292 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377539+0000", 2023-01-02T18:18:52.292 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:18:52.292 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.293 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.293 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.293 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377548+0000", 2023-01-02T18:18:52.293 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5299999999999998e-06 2023-01-02T18:18:52.293 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.294 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.294 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.294 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377552+0000", 2023-01-02T18:18:52.294 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037753740000000002 2023-01-02T18:18:52.294 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.295 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.295 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381328+0000", 2023-01-02T18:18:52.295 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7478000000000002e-05 2023-01-02T18:18:52.295 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.295 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.296 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.296 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381375+0000", 2023-01-02T18:18:52.296 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103408 2023-01-02T18:18:52.296 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.296 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.297 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:52.297 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381478+0000", 2023-01-02T18:18:52.297 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088558899999999999 2023-01-02T18:18:52.297 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.297 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.298 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382364+0000", 2023-01-02T18:18:52.298 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053292160000000003 2023-01-02T18:18:52.298 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.298 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.298 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.299 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387693+0000", 2023-01-02T18:18:52.299 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2136e-05 2023-01-02T18:18:52.299 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.299 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.299 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387785+0000", 2023-01-02T18:18:52.300 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5914000000000006e-05 2023-01-02T18:18:52.300 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.300 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.300 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.300 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387851+0000", 2023-01-02T18:18:52.301 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010315690000000001 2023-01-02T18:18:52.301 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.301 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.301 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.301 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.301 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.302 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41669 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:52.302 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:18:52.302 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.6828973940000003, 2023-01-02T18:18:52.302 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010395639, 2023-01-02T18:18:52.302 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.303 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.303 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.303 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.303 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.303 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41669 2023-01-02T18:18:52.303 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.304 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.304 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.304 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.304 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:18:52.304 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.305 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.305 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.305 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.305 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:18:52.305 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.306 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.306 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.306 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377556+0000", 2023-01-02T18:18:52.306 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1570000000000003e-06 2023-01-02T18:18:52.306 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.307 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.307 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.307 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377563+0000", 2023-01-02T18:18:52.307 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1639999999999998e-06 2023-01-02T18:18:52.307 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.308 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.308 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.308 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377570+0000", 2023-01-02T18:18:52.308 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0329999999999999e-06 2023-01-02T18:18:52.308 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.309 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.309 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.309 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377575+0000", 2023-01-02T18:18:52.309 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043243480000000004 2023-01-02T18:18:52.309 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.310 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.310 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381899+0000", 2023-01-02T18:18:52.310 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7437e-05 2023-01-02T18:18:52.310 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.310 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.311 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.311 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381946+0000", 2023-01-02T18:18:52.311 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5799999999999998e-05 2023-01-02T18:18:52.311 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.311 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382042+0000", 2023-01-02T18:18:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054838499999999997 2023-01-02T18:18:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.312 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382591+0000", 2023-01-02T18:18:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053095540000000002 2023-01-02T18:18:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.313 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387900+0000", 2023-01-02T18:18:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5627e-05 2023-01-02T18:18:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.314 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387926+0000", 2023-01-02T18:18:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6576000000000001e-05 2023-01-02T18:18:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387952+0000", 2023-01-02T18:18:52.315 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010395639 2023-01-02T18:18:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.316 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41670 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [cmpext 0~512,write 0~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:18:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:18:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.681002909, 2023-01-02T18:18:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0096660940000000001, 2023-01-02T18:18:52.317 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41670 2023-01-02T18:18:52.318 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:18:52.319 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.320 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.320 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.320 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:18:52.320 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:18:52.320 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.321 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.321 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.321 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379450+0000", 2023-01-02T18:18:52.321 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1359999999999996e-06 2023-01-02T18:18:52.321 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.322 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.322 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379455+0000", 2023-01-02T18:18:52.322 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1508999999999999e-05 2023-01-02T18:18:52.322 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.322 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.323 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.323 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379467+0000", 2023-01-02T18:18:52.323 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0369999999999997e-06 2023-01-02T18:18:52.323 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.323 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.324 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379474+0000", 2023-01-02T18:18:52.324 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029082439999999999 2023-01-02T18:18:52.324 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.324 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.324 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382382+0000", 2023-01-02T18:18:52.325 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5390999999999998e-05 2023-01-02T18:18:52.325 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.325 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.325 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:52.325 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382448+0000", 2023-01-02T18:18:52.326 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055373549999999999 2023-01-02T18:18:52.326 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.326 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.326 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.326 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387985+0000", 2023-01-02T18:18:52.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2169999999999998e-05 2023-01-02T18:18:52.327 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.327 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.327 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.327 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388027+0000", 2023-01-02T18:18:52.327 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013321900000000001 2023-01-02T18:18:52.328 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.328 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.328 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:52.328 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388160+0000", 2023-01-02T18:18:52.328 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050349900000000003 2023-01-02T18:18:52.329 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.329 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.329 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.329 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388664+0000", 2023-01-02T18:18:52.329 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040003400000000001 2023-01-02T18:18:52.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.330 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.330 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.330 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389064+0000", 2023-01-02T18:18:52.330 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2549999999999998e-05 2023-01-02T18:18:52.330 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.331 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.331 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.331 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389096+0000", 2023-01-02T18:18:52.331 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0778999999999999e-05 2023-01-02T18:18:52.331 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.332 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.332 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.332 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389117+0000", 2023-01-02T18:18:52.332 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0096660940000000001 2023-01-02T18:18:52.332 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.332 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.333 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.333 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.333 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.333 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:42207 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [read 44548~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e150)", 2023-01-02T18:18:52.333 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:18:52.334 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 6.5209219149999997, 2023-01-02T18:18:52.334 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024391863999999999, 2023-01-02T18:18:52.334 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.334 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:18:52.334 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.334 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.335 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.335 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 42207 2023-01-02T18:18:52.335 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.335 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.335 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.335 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.336 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:18:52.336 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.336 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.336 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.336 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.337 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:18:52.337 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:52.337 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.337 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.337 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539531+0000", 2023-01-02T18:18:52.338 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.822e-06 2023-01-02T18:18:52.338 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.338 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.338 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.338 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539535+0000", 2023-01-02T18:18:52.339 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2060000000000004e-06 2023-01-02T18:18:52.339 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.339 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.339 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.339 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539541+0000", 2023-01-02T18:18:52.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0029999999999999e-06 2023-01-02T18:18:52.340 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.340 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.340 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.340 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539544+0000", 2023-01-02T18:18:52.340 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5829e-05 2023-01-02T18:18:52.341 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.341 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.341 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.341 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539570+0000", 2023-01-02T18:18:52.341 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5000999999999999e-05 2023-01-02T18:18:52.342 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.342 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.342 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.342 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539605+0000", 2023-01-02T18:18:52.342 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024318678999999999 2023-01-02T18:18:52.343 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.343 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.343 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.343 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.563924+0000", 2023-01-02T18:18:52.343 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024391863999999999 2023-01-02T18:18:52.343 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.344 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.344 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.344 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.344 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.344 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:54299 14.1a 14:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e154)", 2023-01-02T18:18:52.345 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:18:52.345 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 0.37575148000000003, 2023-01-02T18:18:52.345 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063022640000000001, 2023-01-02T18:18:52.345 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:18:52.345 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:52.346 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:18:52.346 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:18:52.346 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:52.346 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 54299 2023-01-02T18:18:52.346 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.346 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:18:52.347 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.347 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:18:52.347 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:18:52.347 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:18:52.347 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.348 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:18:52.348 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:18:52.348 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:52.348 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.348 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.349 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:18:52.349 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684700+0000", 2023-01-02T18:18:52.349 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4088e-05 2023-01-02T18:18:52.349 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.349 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.350 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:18:52.350 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684714+0000", 2023-01-02T18:18:52.350 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6232e-05 2023-01-02T18:18:52.350 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.350 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:18:52.351 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684730+0000", 2023-01-02T18:18:52.351 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5450000000000003e-06 2023-01-02T18:18:52.351 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.351 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.351 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:18:52.352 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684739+0000", 2023-01-02T18:18:52.352 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8902e-05 2023-01-02T18:18:52.352 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.352 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.352 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684788+0000", 2023-01-02T18:18:52.353 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2610000000000001e-06 2023-01-02T18:18:52.353 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.353 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.353 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:18:52.353 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684793+0000", 2023-01-02T18:18:52.354 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001184554 2023-01-02T18:18:52.354 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.354 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.354 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:18:52.354 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.685978+0000", 2023-01-02T18:18:52.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013823899999999999 2023-01-02T18:18:52.355 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.355 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.355 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:18:52.355 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.686116+0000", 2023-01-02T18:18:52.355 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003439442 2023-01-02T18:18:52.356 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.356 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.356 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:52.356 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.689555+0000", 2023-01-02T18:18:52.356 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000894128 2023-01-02T18:18:52.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.357 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.357 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:18:52.357 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690450+0000", 2023-01-02T18:18:52.357 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00049250100000000001 2023-01-02T18:18:52.357 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.358 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.358 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:52.358 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690942+0000", 2023-01-02T18:18:52.358 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7042000000000002e-05 2023-01-02T18:18:52.358 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.359 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.359 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:18:52.359 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690979+0000", 2023-01-02T18:18:52.359 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5789999999999999e-05 2023-01-02T18:18:52.359 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:52.360 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:52.360 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:18:52.360 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.691005+0000", 2023-01-02T18:18:52.360 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063022640000000001 2023-01-02T18:18:52.360 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.360 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.361 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.361 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:52.361 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:52.361 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:52.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:52.363 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:52.363+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:52.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:52.464 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:52.464+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:52.534 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:52.535 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:52.535 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:52.545 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:52.547 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:52.565 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:52.564+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:52.566 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:52.584 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:52.602 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:52.620 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:52.639 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:52.657 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:52.665 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:52.665+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:52.672 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:52.672 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:52.676 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:52.677 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:52.677 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:52.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:52.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:52.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:52.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:52.678 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:52.679 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:52.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:52.698 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:18:52.757 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.757 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.758 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.758 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.758 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.758 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.758 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.758 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.759 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.759 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.759 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.759 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.759 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.760 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.760 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.760 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.760 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.760 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.761 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.761 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.761 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.761 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.761 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.761 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.762 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.762 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.762 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.762 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.762 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.763 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.763 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.763 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.763 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.763 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.763 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.764 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.764 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.764 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.764 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.764 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.764 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.765 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.765 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.765 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.765 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.765 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.766 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.766 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.766 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.766 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.766 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.766 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.767 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.767 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.767 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.767 INFO:tasks.workunit.client.0.smithi007.stdout:discard: 512~512 = 512 2023-01-02T18:18:52.767 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.768 INFO:tasks.workunit.client.0.smithi007.stdout:aio discard: 1536~512 = 0 2023-01-02T18:18:52.768 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.768 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.768 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.768 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.769 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.769 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.769 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.769 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestDataPoolIO (3914 ms) 2023-01-02T18:18:52.769 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestScatterGatherIO 2023-01-02T18:18:52.770 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:52.771 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:52.770+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:52.797 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestScatterGatherIO (40 ms) 2023-01-02T18:18:52.797 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestEmptyDiscard 2023-01-02T18:18:52.798 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:52.823 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.823 INFO:tasks.workunit.client.0.smithi007.stdout:aio discard: 0~1048576 = 0 2023-01-02T18:18:52.823 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.824 INFO:tasks.workunit.client.0.smithi007.stdout:aio discard: 0~4194304 = 0 2023-01-02T18:18:52.824 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.824 INFO:tasks.workunit.client.0.smithi007.stdout:aio discard: 3145728~1048576 = 0 2023-01-02T18:18:52.824 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestEmptyDiscard (26 ms) 2023-01-02T18:18:52.824 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestFUA 2023-01-02T18:18:52.825 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:52.834 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:52.834 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:52.846 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:52.889 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:52.890+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:52.971 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.971 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.971 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.972 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.972 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.972 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.972 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.972 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.973 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.973 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:52.973 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.973 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.973 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.974 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.974 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.974 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.974 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.974 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.974 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.975 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.975 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.975 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.975 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.975 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.976 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.976 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.976 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.976 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.976 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.976 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.977 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.977 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.977 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.977 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.977 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.978 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.978 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.978 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.978 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.978 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.978 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.979 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.980 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.980 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.980 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.980 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.980 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.981 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.981 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:52.981 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:52.981 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:52.981 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestFUA (148 ms) 2023-01-02T18:18:52.981 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestIOPP 2023-01-02T18:18:52.982 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:52.983 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:52.984+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:52.983 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:52.983 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:52.993 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.993 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.993 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.994 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.994 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:52.994 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.994 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.994 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.995 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.995 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.995 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.995 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.995 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.995 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.996 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.996 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.996 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.996 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.996 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.997 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.997 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.997 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.997 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.997 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:52.997 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:52.998 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:52.998 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:52.998 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:52.999 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:53.020 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 4] out_osds: [3, 5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:53.020 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:53.020 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2023-01-02T18:18:53.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-01-02T18:18:53.022 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:53.022 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:53.022 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:53.023 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:53.023 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:53.023 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:53.023 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:53.023 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:53.023 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:53.024 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:53.024 INFO:tasks.workunit.client.0.smithi007.stdout:start compare and write 2023-01-02T18:18:53.024 INFO:tasks.workunit.client.0.smithi007.stdout:compare and wrote: 512 2023-01-02T18:18:53.024 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.024 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:53.025 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:53.025 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:53.026 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:53.026 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.026 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:53.026 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:53.027 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:53.027 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:53.027 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.028 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:53.028 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:53.030 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:53.030 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:53.030 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.030 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:53.030 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:53.031 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:53.031 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:53.032 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.032 INFO:tasks.workunit.client.0.smithi007.stdout:started aio compare and write 2023-01-02T18:18:53.032 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:53.033 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:53.033 INFO:tasks.workunit.client.0.smithi007.stdout:finished aio compare and write 2023-01-02T18:18:53.034 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:53.034 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:53.034 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:53.034 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:53.034 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:53.035 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.035 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:53.035 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:53.035 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:53.035 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:53.035 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.036 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:53.036 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:53.037 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:53.037 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:53.037 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.037 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:53.037 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:53.038 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:53.038 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:53.038 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.038 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:53.038 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:53.039 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:53.039 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:53.039 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:53.039 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:53.039 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:53.039 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:53.040 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:53.040 INFO:tasks.workunit.client.0.smithi007.stdout:discard: 512~512 2023-01-02T18:18:53.040 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:53.083 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:53.084+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:53.159 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:53.160 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:53.173 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:53.214 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:53.215+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:53.285 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:53.285+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:53.341 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:53.342 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:53.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:53.373 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-01-02T18:18:53.373 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:53.373 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 155, 2023-01-02T18:18:53.373 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "4e320929-c4bb-4ea9-9e1c-d8479b7e40b1", 2023-01-02T18:18:53.374 INFO:teuthology.orchestra.run.smithi007.stdout: "created": "2023-01-02T18:15:29.542145+0000", 2023-01-02T18:18:53.374 INFO:teuthology.orchestra.run.smithi007.stdout: "modified": "2023-01-02T18:18:52.682360+0000", 2023-01-02T18:18:53.374 INFO:teuthology.orchestra.run.smithi007.stdout: "last_up_change": "2023-01-02T18:15:38.537792+0000", 2023-01-02T18:18:53.374 INFO:teuthology.orchestra.run.smithi007.stdout: "last_in_change": "2023-01-02T18:18:37.336495+0000", 2023-01-02T18:18:53.374 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-01-02T18:18:53.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_num": 5801984, 2023-01-02T18:18:53.375 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_set": [ 2023-01-02T18:18:53.375 INFO:teuthology.orchestra.run.smithi007.stdout: "noscrub", 2023-01-02T18:18:53.375 INFO:teuthology.orchestra.run.smithi007.stdout: "pglog_hardlimit", 2023-01-02T18:18:53.375 INFO:teuthology.orchestra.run.smithi007.stdout: "purged_snapdirs", 2023-01-02T18:18:53.376 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_deletes", 2023-01-02T18:18:53.376 INFO:teuthology.orchestra.run.smithi007.stdout: "sortbitwise" 2023-01-02T18:18:53.376 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:53.376 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_version": 4, 2023-01-02T18:18:53.376 INFO:teuthology.orchestra.run.smithi007.stdout: "full_ratio": 0.94999998807907104, 2023-01-02T18:18:53.377 INFO:teuthology.orchestra.run.smithi007.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-01-02T18:18:53.377 INFO:teuthology.orchestra.run.smithi007.stdout: "nearfull_ratio": 0.85000002384185791, 2023-01-02T18:18:53.377 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_snapshot": "", 2023-01-02T18:18:53.377 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_max": 14, 2023-01-02T18:18:53.378 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd": 8, 2023-01-02T18:18:53.378 INFO:teuthology.orchestra.run.smithi007.stdout: "require_min_compat_client": "luminous", 2023-01-02T18:18:53.378 INFO:teuthology.orchestra.run.smithi007.stdout: "min_compat_client": "luminous", 2023-01-02T18:18:53.378 INFO:teuthology.orchestra.run.smithi007.stdout: "require_osd_release": "pacific", 2023-01-02T18:18:53.378 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": [ 2023-01-02T18:18:53.379 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 1, 2023-01-02T18:18:53.379 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "device_health_metrics", 2023-01-02T18:18:53.379 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:38.598445+0000", 2023-01-02T18:18:53.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:18:53.379 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:18:53.380 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.380 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.380 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.380 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.380 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.381 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.381 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.381 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.381 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.381 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.382 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 1, 2023-01-02T18:18:53.382 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 1, 2023-01-02T18:18:53.382 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 1, 2023-01-02T18:18:53.382 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 1, 2023-01-02T18:18:53.382 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 1, 2023-01-02T18:18:53.383 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.383 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.383 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.383 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.383 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.383 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.384 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.384 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.384 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "16", 2023-01-02T18:18:53.384 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.384 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.385 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.385 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.385 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.385 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:18:53.385 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:18:53.386 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.386 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.386 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.386 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.386 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.387 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.387 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.387 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.387 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.387 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.388 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.388 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.388 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.388 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.388 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.389 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.389 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.389 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.389 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.389 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.390 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.390 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.390 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.390 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.390 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.391 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.391 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.391 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.391 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.391 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.392 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.392 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-01-02T18:18:53.392 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_max": 32, 2023-01-02T18:18:53.392 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 1 2023-01-02T18:18:53.392 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.393 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.393 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_devicehealth": {} 2023-01-02T18:18:53.393 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.393 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.393 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.394 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 2, 2023-01-02T18:18:53.394 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "rbd", 2023-01-02T18:18:53.394 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:15:40.853543+0000", 2023-01-02T18:18:53.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:18:53.394 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:18:53.395 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.395 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.395 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.395 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.395 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.395 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.396 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.396 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.396 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.396 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.396 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 8, 2023-01-02T18:18:53.397 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 8, 2023-01-02T18:18:53.397 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 8, 2023-01-02T18:18:53.397 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 8, 2023-01-02T18:18:53.397 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 8, 2023-01-02T18:18:53.397 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.398 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.398 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.398 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.398 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.398 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.399 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.399 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.399 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "18", 2023-01-02T18:18:53.399 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.399 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.400 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.400 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.400 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.400 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:18:53.401 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:18:53.401 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.401 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.401 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.401 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.402 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.402 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.402 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.402 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.402 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.403 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.403 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.403 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.403 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.403 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.404 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.404 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.404 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.404 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.404 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.405 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.405 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.405 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.405 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.405 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.406 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.406 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.406 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.406 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.406 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.407 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.407 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.407 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.407 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd": {} 2023-01-02T18:18:53.407 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.408 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.408 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.408 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-01-02T18:18:53.408 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-1", 2023-01-02T18:18:53.408 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:36.229953+0000", 2023-01-02T18:18:53.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.409 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.409 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.409 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.409 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.410 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.410 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.410 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.410 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.410 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.410 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.411 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.411 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.411 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.411 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.411 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.412 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.412 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.412 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.412 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.412 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.413 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.413 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.413 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.413 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.413 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "97", 2023-01-02T18:18:53.414 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.414 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.414 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.414 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.414 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.415 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 23, 2023-01-02T18:18:53.415 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 97, 2023-01-02T18:18:53.415 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.415 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.415 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.415 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.416 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.416 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.416 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.416 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.417 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.417 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.417 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.417 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.418 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.418 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.418 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.418 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.418 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.418 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.419 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.419 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.419 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.419 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.419 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.420 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.420 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.420 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.420 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.420 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.421 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.421 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.421 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.421 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.421 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.422 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.422 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.422 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.422 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 4, 2023-01-02T18:18:53.422 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-2", 2023-01-02T18:18:53.423 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:39.906131+0000", 2023-01-02T18:18:53.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.423 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.423 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.423 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.424 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.424 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.424 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.424 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.424 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.425 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.425 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.425 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.425 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.425 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.426 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.426 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.426 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.426 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.426 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.427 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "51", 2023-01-02T18:18:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.428 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 51, 2023-01-02T18:18:53.429 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.432 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.432 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.432 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.433 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.434 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.435 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.436 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.437 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.438 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 5, 2023-01-02T18:18:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-3", 2023-01-02T18:18:53.439 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:44.455124+0000", 2023-01-02T18:18:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.440 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.441 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.442 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.443 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "56", 2023-01-02T18:18:53.444 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 56, 2023-01-02T18:18:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.446 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.447 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.448 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.449 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.450 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.451 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.452 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 6, 2023-01-02T18:18:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-4", 2023-01-02T18:18:53.453 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:49.454047+0000", 2023-01-02T18:18:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.454 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.455 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.456 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.457 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "60", 2023-01-02T18:18:53.458 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.459 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 60, 2023-01-02T18:18:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.460 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.461 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.462 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.463 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.464 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.465 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.466 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 7, 2023-01-02T18:18:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-5", 2023-01-02T18:18:53.467 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:53.843144+0000", 2023-01-02T18:18:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.468 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.469 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.470 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.471 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.472 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "64", 2023-01-02T18:18:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.473 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 64, 2023-01-02T18:18:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.474 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.475 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.476 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.477 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.478 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.479 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.480 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 8, 2023-01-02T18:18:53.481 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-6", 2023-01-02T18:18:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:16:57.794651+0000", 2023-01-02T18:18:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.482 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.483 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.484 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.485 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.486 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "72", 2023-01-02T18:18:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.487 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 7, 2023-01-02T18:18:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 72, 2023-01-02T18:18:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.488 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.489 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.490 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.491 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.492 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.493 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.494 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 9, 2023-01-02T18:18:53.495 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-7", 2023-01-02T18:18:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:05.454247+0000", 2023-01-02T18:18:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.496 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.497 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.498 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.499 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.500 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "76", 2023-01-02T18:18:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.501 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 76, 2023-01-02T18:18:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.502 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.503 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.504 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.505 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.506 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.507 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.508 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.509 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 10, 2023-01-02T18:18:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-8", 2023-01-02T18:18:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:30.404991+0000", 2023-01-02T18:18:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.510 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.511 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.512 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.513 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.514 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "101", 2023-01-02T18:18:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.515 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 9, 2023-01-02T18:18:53.516 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 101, 2023-01-02T18:18:53.517 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.517 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.517 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.517 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.517 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.518 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.519 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.520 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.521 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.521 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.521 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.521 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.522 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.523 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.524 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.524 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.524 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 11, 2023-01-02T18:18:53.524 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-9", 2023-01-02T18:18:53.524 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:34.668757+0000", 2023-01-02T18:18:53.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.525 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.525 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.525 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.525 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.526 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.526 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.526 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.526 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.526 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.527 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.528 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.529 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "126", 2023-01-02T18:18:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.530 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 105, 2023-01-02T18:18:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 10485760, 2023-01-02T18:18:53.531 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.532 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.533 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.534 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.535 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.536 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.537 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 12, 2023-01-02T18:18:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-10", 2023-01-02T18:18:53.538 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:55.603366+0000", 2023-01-02T18:18:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-01-02T18:18:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-01-02T18:18:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.539 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.540 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.541 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.542 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.543 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "120", 2023-01-02T18:18:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.544 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-01-02T18:18:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-01-02T18:18:53.545 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.546 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.547 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.548 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.549 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.550 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.551 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.552 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 13, 2023-01-02T18:18:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-11", 2023-01-02T18:18:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:17:56.778124+0000", 2023-01-02T18:18:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.554 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.555 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.556 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.557 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.558 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "142", 2023-01-02T18:18:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.559 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 123, 2023-01-02T18:18:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.560 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 10485760, 2023-01-02T18:18:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.561 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.562 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.563 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.564 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.565 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.566 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 14, 2023-01-02T18:18:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "test-librbd-smithi007-118686-12", 2023-01-02T18:18:53.567 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-01-02T18:18:48.898825+0000", 2023-01-02T18:18:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 8193, 2023-01-02T18:18:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2023-01-02T18:18:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-01-02T18:18:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-01-02T18:18:53.568 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-01-02T18:18:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-01-02T18:18:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-01-02T18:18:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-01-02T18:18:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-01-02T18:18:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-01-02T18:18:53.569 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-01-02T18:18:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-01-02T18:18:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-01-02T18:18:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-01-02T18:18:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-01-02T18:18:53.570 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-01-02T18:18:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-01-02T18:18:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-01-02T18:18:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-01-02T18:18:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-01-02T18:18:53.571 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-01-02T18:18:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-01-02T18:18:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-01-02T18:18:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-01-02T18:18:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.572 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "155", 2023-01-02T18:18:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-01-02T18:18:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-01-02T18:18:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-01-02T18:18:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-01-02T18:18:53.573 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-01-02T18:18:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 3, 2023-01-02T18:18:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 155, 2023-01-02T18:18:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-01-02T18:18:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-01-02T18:18:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-01-02T18:18:53.574 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-01-02T18:18:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-01-02T18:18:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-01-02T18:18:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-01-02T18:18:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-01-02T18:18:53.575 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-01-02T18:18:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-01-02T18:18:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-01-02T18:18:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-01-02T18:18:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-01-02T18:18:53.576 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-01-02T18:18:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-01-02T18:18:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-01-02T18:18:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-01-02T18:18:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-01-02T18:18:53.577 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-01-02T18:18:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-01-02T18:18:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-01-02T18:18:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-01-02T18:18:53.578 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-01-02T18:18:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-01-02T18:18:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-01-02T18:18:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-01-02T18:18:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-01-02T18:18:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-01-02T18:18:53.579 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-01-02T18:18:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-01-02T18:18:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-01-02T18:18:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-01-02T18:18:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: "rados": {} 2023-01-02T18:18:53.580 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:18:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:18:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "69e18813-bd8e-4b22-9c40-d702ff3a5efd", 2023-01-02T18:18:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.6576995849609375, 2023-01-02T18:18:53.582 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 152, 2023-01-02T18:18:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:53.583 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6808", 2023-01-02T18:18:53.584 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6809", 2023-01-02T18:18:53.585 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:53.586 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6810", 2023-01-02T18:18:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:53.587 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6811", 2023-01-02T18:18:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:53.588 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.589 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6814", 2023-01-02T18:18:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.590 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6815", 2023-01-02T18:18:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.591 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.592 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6812", 2023-01-02T18:18:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.593 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6813", 2023-01-02T18:18:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107063 2023-01-02T18:18:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.594 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6809/107063", 2023-01-02T18:18:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6811/107063", 2023-01-02T18:18:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6815/107063", 2023-01-02T18:18:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6813/107063", 2023-01-02T18:18:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:53.595 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:18:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "aa04dec6-4607-4f2a-85a3-a6278832fef3", 2023-01-02T18:18:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:53.597 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.3902130126953125, 2023-01-02T18:18:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 152, 2023-01-02T18:18:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:53.598 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.599 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6824", 2023-01-02T18:18:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.600 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6825", 2023-01-02T18:18:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.601 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6826", 2023-01-02T18:18:53.602 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6827", 2023-01-02T18:18:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:53.603 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.604 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6830", 2023-01-02T18:18:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.605 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6831", 2023-01-02T18:18:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.606 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.607 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6828", 2023-01-02T18:18:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.608 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6829", 2023-01-02T18:18:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107066 2023-01-02T18:18:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.609 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6825/107066", 2023-01-02T18:18:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6827/107066", 2023-01-02T18:18:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6831/107066", 2023-01-02T18:18:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6829/107066", 2023-01-02T18:18:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:53.610 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.611 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:18:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "c98a28fb-d910-4601-a229-d4318259ab9b", 2023-01-02T18:18:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.14453125, 2023-01-02T18:18:53.612 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 152, 2023-01-02T18:18:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:53.613 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.614 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6816", 2023-01-02T18:18:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.615 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6817", 2023-01-02T18:18:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.616 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6818", 2023-01-02T18:18:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:53.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6819", 2023-01-02T18:18:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:53.618 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6822", 2023-01-02T18:18:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6823", 2023-01-02T18:18:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.621 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.622 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6820", 2023-01-02T18:18:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.623 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6821", 2023-01-02T18:18:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107065 2023-01-02T18:18:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.624 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6817/107065", 2023-01-02T18:18:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6819/107065", 2023-01-02T18:18:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6823/107065", 2023-01-02T18:18:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6821/107065", 2023-01-02T18:18:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:53.625 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:18:53.626 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "3c5d48f4-5384-4563-8acb-11d866b85ef4", 2023-01-02T18:18:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 0, 2023-01-02T18:18:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 0, 2023-01-02T18:18:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:18:53.627 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 128, 2023-01-02T18:18:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:53.628 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.629 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6800", 2023-01-02T18:18:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.630 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6801", 2023-01-02T18:18:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:53.631 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6802", 2023-01-02T18:18:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:53.632 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6803", 2023-01-02T18:18:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:53.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.634 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6806", 2023-01-02T18:18:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.635 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6807", 2023-01-02T18:18:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.637 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6804", 2023-01-02T18:18:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.638 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.7:6805", 2023-01-02T18:18:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 107064 2023-01-02T18:18:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.7:6801/107064", 2023-01-02T18:18:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.7:6803/107064", 2023-01-02T18:18:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.7:6807/107064", 2023-01-02T18:18:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.7:6805/107064", 2023-01-02T18:18:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:53.640 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:18:53.641 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "2476d495-4979-4679-a7e9-12652c270092", 2023-01-02T18:18:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 0.35540771484375, 2023-01-02T18:18:53.642 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 152, 2023-01-02T18:18:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:53.643 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6800", 2023-01-02T18:18:53.644 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.645 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6801", 2023-01-02T18:18:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:53.646 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6802", 2023-01-02T18:18:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:53.647 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6803", 2023-01-02T18:18:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:53.648 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6806", 2023-01-02T18:18:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6807", 2023-01-02T18:18:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.652 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6804", 2023-01-02T18:18:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.653 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6805", 2023-01-02T18:18:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106900 2023-01-02T18:18:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.654 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6801/106900", 2023-01-02T18:18:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6803/106900", 2023-01-02T18:18:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6807/106900", 2023-01-02T18:18:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6805/106900", 2023-01-02T18:18:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:53.655 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.656 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:18:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "38d57e5e-b6c1-445f-b181-23fb518698f9", 2023-01-02T18:18:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 0, 2023-01-02T18:18:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 0, 2023-01-02T18:18:53.657 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:18:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 132, 2023-01-02T18:18:53.658 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.659 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6816", 2023-01-02T18:18:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.660 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6817", 2023-01-02T18:18:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.661 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6818", 2023-01-02T18:18:53.662 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6819", 2023-01-02T18:18:53.663 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:53.664 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6822", 2023-01-02T18:18:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:53.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6823", 2023-01-02T18:18:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.666 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.667 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6820", 2023-01-02T18:18:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.668 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6821", 2023-01-02T18:18:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106930 2023-01-02T18:18:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6817/106930", 2023-01-02T18:18:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6819/106930", 2023-01-02T18:18:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6823/106930", 2023-01-02T18:18:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6821/106930", 2023-01-02T18:18:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:53.670 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.671 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:18:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "6c78f25a-2a65-47fe-b101-e47c00a5b2f6", 2023-01-02T18:18:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:18:53.672 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 152, 2023-01-02T18:18:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.674 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6808", 2023-01-02T18:18:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6809", 2023-01-02T18:18:53.675 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:53.676 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6810", 2023-01-02T18:18:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:53.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6811", 2023-01-02T18:18:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.678 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.679 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6814", 2023-01-02T18:18:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.680 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6815", 2023-01-02T18:18:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6812", 2023-01-02T18:18:53.682 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6813", 2023-01-02T18:18:53.683 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106901 2023-01-02T18:18:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6809/106901", 2023-01-02T18:18:53.684 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6811/106901", 2023-01-02T18:18:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6815/106901", 2023-01-02T18:18:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6813/106901", 2023-01-02T18:18:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:53.685 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:18:53.686 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "b094706d-7145-4865-ae95-e5cd7e40d23b", 2023-01-02T18:18:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-01-02T18:18:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-01-02T18:18:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-01-02T18:18:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-01-02T18:18:53.687 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-01-02T18:18:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-01-02T18:18:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 13, 2023-01-02T18:18:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 152, 2023-01-02T18:18:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-01-02T18:18:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-01-02T18:18:53.688 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-01-02T18:18:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6824", 2023-01-02T18:18:53.689 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6825", 2023-01-02T18:18:53.690 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-01-02T18:18:53.691 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6826", 2023-01-02T18:18:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:53.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6827", 2023-01-02T18:18:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:53.693 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-01-02T18:18:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.694 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6830", 2023-01-02T18:18:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.695 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6831", 2023-01-02T18:18:53.696 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:53.696 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.696 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.696 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-01-02T18:18:53.697 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-01-02T18:18:53.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.697 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-01-02T18:18:53.697 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6828", 2023-01-02T18:18:53.697 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:53.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.698 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-01-02T18:18:53.698 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.57:6829", 2023-01-02T18:18:53.698 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 106931 2023-01-02T18:18:53.698 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.699 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.699 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.699 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.57:6825/106931", 2023-01-02T18:18:53.699 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.57:6827/106931", 2023-01-02T18:18:53.699 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.57:6831/106931", 2023-01-02T18:18:53.700 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.57:6829/106931", 2023-01-02T18:18:53.700 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-01-02T18:18:53.700 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-01-02T18:18:53.700 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-01-02T18:18:53.700 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.701 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.701 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:53.701 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_xinfo": [ 2023-01-02T18:18:53.701 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.701 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-01-02T18:18:53.702 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:53.702 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:53.702 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:53.702 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:53.702 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:53.703 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.290083+0000", 2023-01-02T18:18:53.703 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:53.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.703 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-01-02T18:18:53.703 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:53.704 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:53.704 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:53.704 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:53.704 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:53.704 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.303022+0000", 2023-01-02T18:18:53.705 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:53.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.705 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-01-02T18:18:53.705 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:53.706 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:53.706 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:53.706 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:53.706 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:53.706 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.292245+0000", 2023-01-02T18:18:53.707 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:53.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.707 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 3, 2023-01-02T18:18:53.707 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:53.708 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:53.708 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:53.708 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:53.708 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 65536, 2023-01-02T18:18:53.708 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.210530+0000", 2023-01-02T18:18:53.709 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:53.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.709 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 4, 2023-01-02T18:18:53.709 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:53.710 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:53.710 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:53.710 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:53.710 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:53.710 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.282212+0000", 2023-01-02T18:18:53.710 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:53.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.711 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 5, 2023-01-02T18:18:53.711 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:53.711 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:53.712 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:53.712 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:53.712 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 65536, 2023-01-02T18:18:53.712 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.237376+0000", 2023-01-02T18:18:53.712 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:53.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.713 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 6, 2023-01-02T18:18:53.713 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:53.713 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:53.714 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:53.714 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:53.714 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:53.714 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.239974+0000", 2023-01-02T18:18:53.714 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:53.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.715 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 7, 2023-01-02T18:18:53.715 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-01-02T18:18:53.715 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-01-02T18:18:53.715 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-01-02T18:18:53.716 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138314316775423, 2023-01-02T18:18:53.716 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-01-02T18:18:53.716 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-01-02T18:15:37.276340+0000", 2023-01-02T18:18:53.716 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-01-02T18:18:53.716 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.717 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:53.717 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap": [ 2023-01-02T18:18:53.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.717 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "2.0", 2023-01-02T18:18:53.717 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:18:53.718 INFO:teuthology.orchestra.run.smithi007.stdout: 2, 2023-01-02T18:18:53.718 INFO:teuthology.orchestra.run.smithi007.stdout: 3 2023-01-02T18:18:53.718 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.719 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "3.14", 2023-01-02T18:18:53.719 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-01-02T18:18:53.719 INFO:teuthology.orchestra.run.smithi007.stdout: 2, 2023-01-02T18:18:53.719 INFO:teuthology.orchestra.run.smithi007.stdout: 0 2023-01-02T18:18:53.719 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_items": [ 2023-01-02T18:18:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "3.19", 2023-01-02T18:18:53.720 INFO:teuthology.orchestra.run.smithi007.stdout: "mappings": [ 2023-01-02T18:18:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: "from": 4, 2023-01-02T18:18:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: "to": 6 2023-01-02T18:18:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.721 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.722 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "4.1b", 2023-01-02T18:18:53.722 INFO:teuthology.orchestra.run.smithi007.stdout: "mappings": [ 2023-01-02T18:18:53.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.723 INFO:teuthology.orchestra.run.smithi007.stdout: "from": 1, 2023-01-02T18:18:53.723 INFO:teuthology.orchestra.run.smithi007.stdout: "to": 2 2023-01-02T18:18:53.723 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.723 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.723 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.723 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.724 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "9.1e", 2023-01-02T18:18:53.724 INFO:teuthology.orchestra.run.smithi007.stdout: "mappings": [ 2023-01-02T18:18:53.724 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.724 INFO:teuthology.orchestra.run.smithi007.stdout: "from": 7, 2023-01-02T18:18:53.724 INFO:teuthology.orchestra.run.smithi007.stdout: "to": 2 2023-01-02T18:18:53.725 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.725 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.725 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.725 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "9.1f", 2023-01-02T18:18:53.726 INFO:teuthology.orchestra.run.smithi007.stdout: "mappings": [ 2023-01-02T18:18:53.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.726 INFO:teuthology.orchestra.run.smithi007.stdout: "from": 7, 2023-01-02T18:18:53.726 INFO:teuthology.orchestra.run.smithi007.stdout: "to": 2 2023-01-02T18:18:53.726 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.726 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.727 INFO:teuthology.orchestra.run.smithi007.stdout: "pgid": "11.1c", 2023-01-02T18:18:53.727 INFO:teuthology.orchestra.run.smithi007.stdout: "mappings": [ 2023-01-02T18:18:53.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.727 INFO:teuthology.orchestra.run.smithi007.stdout: "from": 7, 2023-01-02T18:18:53.728 INFO:teuthology.orchestra.run.smithi007.stdout: "to": 4 2023-01-02T18:18:53.728 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.728 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.728 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.728 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:53.728 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_temp": [], 2023-01-02T18:18:53.729 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_temp": [], 2023-01-02T18:18:53.729 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklist": {}, 2023-01-02T18:18:53.729 INFO:teuthology.orchestra.run.smithi007.stdout: "range_blocklist": {}, 2023-01-02T18:18:53.729 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profiles": { 2023-01-02T18:18:53.729 INFO:teuthology.orchestra.run.smithi007.stdout: "default": { 2023-01-02T18:18:53.730 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-failure-domain": "osd", 2023-01-02T18:18:53.730 INFO:teuthology.orchestra.run.smithi007.stdout: "k": "2", 2023-01-02T18:18:53.730 INFO:teuthology.orchestra.run.smithi007.stdout: "m": "1", 2023-01-02T18:18:53.730 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin": "jerasure", 2023-01-02T18:18:53.730 INFO:teuthology.orchestra.run.smithi007.stdout: "ruleset-failure-domain": "osd", 2023-01-02T18:18:53.731 INFO:teuthology.orchestra.run.smithi007.stdout: "technique": "reed_sol_van" 2023-01-02T18:18:53.731 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:18:53.731 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps_queue": [ 2023-01-02T18:18:53.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.732 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 14, 2023-01-02T18:18:53.732 INFO:teuthology.orchestra.run.smithi007.stdout: "snaps": [ 2023-01-02T18:18:53.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.732 INFO:teuthology.orchestra.run.smithi007.stdout: "begin": 2, 2023-01-02T18:18:53.732 INFO:teuthology.orchestra.run.smithi007.stdout: "length": 1 2023-01-02T18:18:53.732 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.733 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.733 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.733 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:53.733 INFO:teuthology.orchestra.run.smithi007.stdout: "new_removed_snaps": [ 2023-01-02T18:18:53.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.734 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 14, 2023-01-02T18:18:53.734 INFO:teuthology.orchestra.run.smithi007.stdout: "snaps": [ 2023-01-02T18:18:53.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:18:53.734 INFO:teuthology.orchestra.run.smithi007.stdout: "begin": 2, 2023-01-02T18:18:53.734 INFO:teuthology.orchestra.run.smithi007.stdout: "length": 1 2023-01-02T18:18:53.735 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.735 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:18:53.735 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.735 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-01-02T18:18:53.735 INFO:teuthology.orchestra.run.smithi007.stdout: "new_purged_snaps": [], 2023-01-02T18:18:53.735 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_node_flags": {}, 2023-01-02T18:18:53.736 INFO:teuthology.orchestra.run.smithi007.stdout: "device_class_flags": {}, 2023-01-02T18:18:53.736 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode": { 2023-01-02T18:18:53.736 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_enabled": false, 2023-01-02T18:18:53.736 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_bucket_count": 0, 2023-01-02T18:18:53.736 INFO:teuthology.orchestra.run.smithi007.stdout: "degraded_stretch_mode": 0, 2023-01-02T18:18:53.736 INFO:teuthology.orchestra.run.smithi007.stdout: "recovering_stretch_mode": 0, 2023-01-02T18:18:53.737 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_bucket": 0 2023-01-02T18:18:53.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:18:53.737 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:53.740 INFO:tasks.thrashosds.thrasher:j is {'epoch': 155, 'fsid': '4e320929-c4bb-4ea9-9e1c-d8479b7e40b1', 'created': '2023-01-02T18:15:29.542145+0000', 'modified': '2023-01-02T18:18:52.682360+0000', 'last_up_change': '2023-01-02T18:15:38.537792+0000', 'last_in_change': '2023-01-02T18:18:37.336495+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 14, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'pacific', 'pools': [{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2023-01-02T18:15:38.598445+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-01-02T18:15:40.853543+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'test-librbd-smithi007-118686-1', 'create_time': '2023-01-02T18:16:36.229953+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 23, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 4, 'pool_name': 'test-librbd-smithi007-118686-2', 'create_time': '2023-01-02T18:16:39.906131+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 51, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 5, 'pool_name': 'test-librbd-smithi007-118686-3', 'create_time': '2023-01-02T18:16:44.455124+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 56, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 6, 'pool_name': 'test-librbd-smithi007-118686-4', 'create_time': '2023-01-02T18:16:49.454047+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 60, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 7, 'pool_name': 'test-librbd-smithi007-118686-5', 'create_time': '2023-01-02T18:16:53.843144+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 64, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 8, 'pool_name': 'test-librbd-smithi007-118686-6', 'create_time': '2023-01-02T18:16:57.794651+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 7, 'snap_epoch': 72, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 9, 'pool_name': 'test-librbd-smithi007-118686-7', 'create_time': '2023-01-02T18:17:05.454247+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 10, 'pool_name': 'test-librbd-smithi007-118686-8', 'create_time': '2023-01-02T18:17:30.404991+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 9, 'snap_epoch': 101, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 11, 'pool_name': 'test-librbd-smithi007-118686-9', 'create_time': '2023-01-02T18:17:34.668757+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '126', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 105, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 10485760, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 12, 'pool_name': 'test-librbd-smithi007-118686-10', 'create_time': '2023-01-02T18:17:55.603366+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 13, 'pool_name': 'test-librbd-smithi007-118686-11', 'create_time': '2023-01-02T18:17:56.778124+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '142', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 123, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 10485760, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}, {'pool': 14, 'pool_name': 'test-librbd-smithi007-118686-12', 'create_time': '2023-01-02T18:18:48.898825+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 155, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}}], 'osds': [{'osd': 0, 'uuid': '69e18813-bd8e-4b22-9c40-d702ff3a5efd', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.6576995849609375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 152, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6808', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6809', 'nonce': 107063}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6810', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6811', 'nonce': 107063}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6814', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6815', 'nonce': 107063}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6812', 'nonce': 107063}, {'type': 'v1', 'addr': '172.21.15.7:6813', 'nonce': 107063}]}, 'public_addr': '172.21.15.7:6809/107063', 'cluster_addr': '172.21.15.7:6811/107063', 'heartbeat_back_addr': '172.21.15.7:6815/107063', 'heartbeat_front_addr': '172.21.15.7:6813/107063', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa04dec6-4607-4f2a-85a3-a6278832fef3', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3902130126953125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 152, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6824', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6825', 'nonce': 107066}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6826', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6827', 'nonce': 107066}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6830', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6831', 'nonce': 107066}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6828', 'nonce': 107066}, {'type': 'v1', 'addr': '172.21.15.7:6829', 'nonce': 107066}]}, 'public_addr': '172.21.15.7:6825/107066', 'cluster_addr': '172.21.15.7:6827/107066', 'heartbeat_back_addr': '172.21.15.7:6831/107066', 'heartbeat_front_addr': '172.21.15.7:6829/107066', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'c98a28fb-d910-4601-a229-d4318259ab9b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.14453125, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 152, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6816', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6817', 'nonce': 107065}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6818', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6819', 'nonce': 107065}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6822', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6823', 'nonce': 107065}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6820', 'nonce': 107065}, {'type': 'v1', 'addr': '172.21.15.7:6821', 'nonce': 107065}]}, 'public_addr': '172.21.15.7:6817/107065', 'cluster_addr': '172.21.15.7:6819/107065', 'heartbeat_back_addr': '172.21.15.7:6823/107065', 'heartbeat_front_addr': '172.21.15.7:6821/107065', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '3c5d48f4-5384-4563-8acb-11d866b85ef4', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 128, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6800', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6801', 'nonce': 107064}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6802', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6803', 'nonce': 107064}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6806', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6807', 'nonce': 107064}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6804', 'nonce': 107064}, {'type': 'v1', 'addr': '172.21.15.7:6805', 'nonce': 107064}]}, 'public_addr': '172.21.15.7:6801/107064', 'cluster_addr': '172.21.15.7:6803/107064', 'heartbeat_back_addr': '172.21.15.7:6807/107064', 'heartbeat_front_addr': '172.21.15.7:6805/107064', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '2476d495-4979-4679-a7e9-12652c270092', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.35540771484375, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 152, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6800', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6801', 'nonce': 106900}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6802', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6803', 'nonce': 106900}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6806', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6807', 'nonce': 106900}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6804', 'nonce': 106900}, {'type': 'v1', 'addr': '172.21.15.57:6805', 'nonce': 106900}]}, 'public_addr': '172.21.15.57:6801/106900', 'cluster_addr': '172.21.15.57:6803/106900', 'heartbeat_back_addr': '172.21.15.57:6807/106900', 'heartbeat_front_addr': '172.21.15.57:6805/106900', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '38d57e5e-b6c1-445f-b181-23fb518698f9', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6816', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6817', 'nonce': 106930}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6818', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6819', 'nonce': 106930}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6822', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6823', 'nonce': 106930}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6820', 'nonce': 106930}, {'type': 'v1', 'addr': '172.21.15.57:6821', 'nonce': 106930}]}, 'public_addr': '172.21.15.57:6817/106930', 'cluster_addr': '172.21.15.57:6819/106930', 'heartbeat_back_addr': '172.21.15.57:6823/106930', 'heartbeat_front_addr': '172.21.15.57:6821/106930', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '6c78f25a-2a65-47fe-b101-e47c00a5b2f6', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 152, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6808', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6809', 'nonce': 106901}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6810', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6811', 'nonce': 106901}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6814', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6815', 'nonce': 106901}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6812', 'nonce': 106901}, {'type': 'v1', 'addr': '172.21.15.57:6813', 'nonce': 106901}]}, 'public_addr': '172.21.15.57:6809/106901', 'cluster_addr': '172.21.15.57:6811/106901', 'heartbeat_back_addr': '172.21.15.57:6815/106901', 'heartbeat_front_addr': '172.21.15.57:6813/106901', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'b094706d-7145-4865-ae95-e5cd7e40d23b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 152, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6824', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6825', 'nonce': 106931}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6826', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6827', 'nonce': 106931}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6830', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6831', 'nonce': 106931}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6828', 'nonce': 106931}, {'type': 'v1', 'addr': '172.21.15.57:6829', 'nonce': 106931}]}, 'public_addr': '172.21.15.57:6825/106931', 'cluster_addr': '172.21.15.57:6827/106931', 'heartbeat_back_addr': '172.21.15.57:6831/106931', 'heartbeat_front_addr': '172.21.15.57:6829/106931', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.290083+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.303022+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.292245+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.210530+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.282212+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 65536, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.237376+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.239974+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138314316775423, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-01-02T18:15:37.276340+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [2, 3]}, {'pgid': '3.14', 'osds': [2, 0]}], 'pg_upmap_items': [{'pgid': '3.19', 'mappings': [{'from': 4, 'to': 6}]}, {'pgid': '4.1b', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '9.1e', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '9.1f', 'mappings': [{'from': 7, 'to': 2}]}, {'pgid': '11.1c', 'mappings': [{'from': 7, 'to': 4}]}], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'ruleset-failure-domain': 'osd', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 14, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_removed_snaps': [{'pool': 14, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-01-02T18:18:53.740 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.19 2023-01-02T18:18:53.740 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.19 2023-01-02T18:18:53.741 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:53.738+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:53.840 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:53.841+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:53.876 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:53.877 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:53.887 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:53.941 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:53.941+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:54.041 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:54.041+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:54.061 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:54.062 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:54.072 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:54.142 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:54.143+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:54.166 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:54.166 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:54.166 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:54.167 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:54.167 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:54.167 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:54.167 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.167 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.168 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:54.168 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.168 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.168 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:54.168 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.169 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.169 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:54.169 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.169 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.169 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.170 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.170 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:54.170 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.170 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.170 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:54.171 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.171 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.171 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:54.171 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.171 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.171 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:54.172 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.172 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.172 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.172 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.172 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:54.172 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.173 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.173 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:54.173 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.173 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.174 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:54.174 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.174 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.174 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:54.174 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.175 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.175 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.175 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.175 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:54.175 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.176 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.176 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:54.176 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.176 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.176 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:54.177 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.177 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.177 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:54.177 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.177 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.178 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.178 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.178 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:54.178 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.178 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.179 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:54.179 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.179 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.179 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:54.179 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.179 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.180 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:54.180 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.180 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.180 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.181 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.181 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.182 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.182 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.182 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.183 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.183 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.183 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.184 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.184 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.184 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.185 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.185 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.185 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.186 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.186 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.186 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.186 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.187 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.187 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.188 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.188 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.188 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.188 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.188 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.189 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.189 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.189 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.189 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.189 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.190 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.190 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.190 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.190 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.190 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.191 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.191 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.191 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.208 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:54.209 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:54.209 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.209 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.210 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.210 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.210 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.210 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.211 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:54.233 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.234 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.234 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.234 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.235 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.235 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.235 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.265 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:54.264+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:54.271 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.271 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.271 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.271 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.271 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.272 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.272 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.299 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.299 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.299 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.299 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.300 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.300 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.300 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.300 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.300 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.301 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.301 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.301 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.301 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.345 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:54.346+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:54.354 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:54.354 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:54.360 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.360 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.360 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.360 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.361 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.361 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.361 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.365 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:54.411 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.411 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.412 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.412 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.412 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.412 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.412 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.448 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:54.449+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:54.473 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.473 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.474 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.474 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.474 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.474 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.474 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.539 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:54.540 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:54.540 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.541 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.541 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.541 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.541 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.541 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.542 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.542 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.542 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.542 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.542 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.543 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.543 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.546 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:54.547+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:54.551 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:54.647 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:54.648+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:54.648 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.648 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.648 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.648 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.648 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.649 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.649 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.695 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:54.696 INFO:teuthology.orchestra.run.smithi007.stderr:clear 3.19 pg_upmap_items mapping 2023-01-02T18:18:54.711 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:18:54.725 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:54.725 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:54.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:54.740 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.740 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.740 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.741 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.741 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.741 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.741 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.779 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:54.780+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:54.838 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.839 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.839 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.839 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.840 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.840 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.840 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.844 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:54.848 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:54.849+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:54.864 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:54.873 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:54.874 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:54.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:54.885 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:54.909 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:54.920 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:54.921 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:54.921 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:54.921 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:54.922 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.922 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.922 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.923 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.923 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.924 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:54.924 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:54.925 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:54.925 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:54.928 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:54.945 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:54.963 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:54.969 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:54.970+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:54.981 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:54.982 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:54.983 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:54.983 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:54.983 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:54.984 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:54.984 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:54.984 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:54.985 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:55.032 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.033 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:55.033 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:55.034 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:55.034 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.034 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:55.035 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:55.050 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:55.051+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:55.065 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:55.066 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:55.066 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:55.066 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:55.067 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:55.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:18:55.122 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.122 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:55.122 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:55.123 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:55.123 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.123 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:55.123 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:55.152 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:55.153+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:55.247 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.247 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:55.247 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:55.247 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:55.247 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.248 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:55.248 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:55.252 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:55.253+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:55.257 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:55.258 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:55.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:55.258 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:55.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.258 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2 3.17 3:ece625d0:::rbd_id.image1:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:18:55.259 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:18:55.259 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 137.83981021899999, 2023-01-02T18:18:55.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001, 2023-01-02T18:18:55.259 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.259 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:18:55.260 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.260 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.260 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.260 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2 2023-01-02T18:18:55.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.261 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:18:55.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:18:55.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:55.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416794+0000", 2023-01-02T18:18:55.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1639e-05 2023-01-02T18:18:55.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416806+0000", 2023-01-02T18:18:55.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7169999999999997e-06 2023-01-02T18:18:55.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416814+0000", 2023-01-02T18:18:55.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0390000000000004e-06 2023-01-02T18:18:55.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416819+0000", 2023-01-02T18:18:55.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4200000000000003e-05 2023-01-02T18:18:55.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416873+0000", 2023-01-02T18:18:55.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5050000000000004e-06 2023-01-02T18:18:55.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:55.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416880+0000", 2023-01-02T18:18:55.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003595263 2023-01-02T18:18:55.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420475+0000", 2023-01-02T18:18:55.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5440000000000004e-06 2023-01-02T18:18:55.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:55.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420482+0000", 2023-01-02T18:18:55.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014728149999999999 2023-01-02T18:18:55.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.421955+0000", 2023-01-02T18:18:55.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5858000000000004e-05 2023-01-02T18:18:55.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.422040+0000", 2023-01-02T18:18:55.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001 2023-01-02T18:18:55.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.272 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.273 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:55.273 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:18:55.273 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 135.83102357999999, 2023-01-02T18:18:55.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997, 2023-01-02T18:18:55.274 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.274 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.274 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.274 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.274 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.275 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9 2023-01-02T18:18:55.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.275 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:18:55.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:18:55.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:55.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425580+0000", 2023-01-02T18:18:55.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1592e-05 2023-01-02T18:18:55.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425592+0000", 2023-01-02T18:18:55.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727e-05 2023-01-02T18:18:55.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425607+0000", 2023-01-02T18:18:55.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.204e-06 2023-01-02T18:18:55.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425615+0000", 2023-01-02T18:18:55.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3989000000000002e-05 2023-01-02T18:18:55.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425659+0000", 2023-01-02T18:18:55.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105519 2023-01-02T18:18:55.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425764+0000", 2023-01-02T18:18:55.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019538499999999999 2023-01-02T18:18:55.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:55.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425959+0000", 2023-01-02T18:18:55.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045306399999999998 2023-01-02T18:18:55.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430490+0000", 2023-01-02T18:18:55.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6642000000000003e-05 2023-01-02T18:18:55.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430557+0000", 2023-01-02T18:18:55.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4468999999999997e-05 2023-01-02T18:18:55.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430601+0000", 2023-01-02T18:18:55.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.025e-05 2023-01-02T18:18:55.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430631+0000", 2023-01-02T18:18:55.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997 2023-01-02T18:18:55.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.288 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:10 3.17 3:ece625d0:::rbd_id.image1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:55.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:18:55.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 135.82579656300001, 2023-01-02T18:18:55.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982, 2023-01-02T18:18:55.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.289 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.289 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.290 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10 2023-01-02T18:18:55.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.290 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:18:55.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:18:55.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:55.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430808+0000", 2023-01-02T18:18:55.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2579999999999998e-06 2023-01-02T18:18:55.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430815+0000", 2023-01-02T18:18:55.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:18:55.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430828+0000", 2023-01-02T18:18:55.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8730000000000004e-06 2023-01-02T18:18:55.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430834+0000", 2023-01-02T18:18:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6267000000000003e-05 2023-01-02T18:18:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430880+0000", 2023-01-02T18:18:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7486999999999997e-05 2023-01-02T18:18:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430978+0000", 2023-01-02T18:18:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156785 2023-01-02T18:18:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:55.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.431135+0000", 2023-01-02T18:18:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089828900000000003 2023-01-02T18:18:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432033+0000", 2023-01-02T18:18:55.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057836200000000002 2023-01-02T18:18:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432611+0000", 2023-01-02T18:18:55.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2023-01-02T18:18:55.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432649+0000", 2023-01-02T18:18:55.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4532e-05 2023-01-02T18:18:55.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432693+0000", 2023-01-02T18:18:55.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982 2023-01-02T18:18:55.302 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.303 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.303 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.303 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:14 3.17 3:ece625d0:::rbd_id.image1:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:18:55.303 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:18:55.304 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 135.81428141699999, 2023-01-02T18:18:55.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305, 2023-01-02T18:18:55.304 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.304 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:55.304 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.304 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.305 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.305 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 14 2023-01-02T18:18:55.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.305 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:18:55.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:18:55.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:55.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442323+0000", 2023-01-02T18:18:55.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0670000000000003e-06 2023-01-02T18:18:55.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442330+0000", 2023-01-02T18:18:55.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2111e-05 2023-01-02T18:18:55.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442342+0000", 2023-01-02T18:18:55.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5030000000000002e-06 2023-01-02T18:18:55.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442349+0000", 2023-01-02T18:18:55.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4279999999999997e-05 2023-01-02T18:18:55.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442383+0000", 2023-01-02T18:18:55.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2152999999999999e-05 2023-01-02T18:18:55.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442445+0000", 2023-01-02T18:18:55.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020234039999999999 2023-01-02T18:18:55.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.444469+0000", 2023-01-02T18:18:55.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305 2023-01-02T18:18:55.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.313 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.314 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:30 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:55.314 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:18:55.314 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 135.800282619, 2023-01-02T18:18:55.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702, 2023-01-02T18:18:55.315 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.315 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.315 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.315 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.315 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.316 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 30 2023-01-02T18:18:55.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.316 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:18:55.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:18:55.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:55.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456322+0000", 2023-01-02T18:18:55.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.267e-06 2023-01-02T18:18:55.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456329+0000", 2023-01-02T18:18:55.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4963999999999999e-05 2023-01-02T18:18:55.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456344+0000", 2023-01-02T18:18:55.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6860000000000006e-06 2023-01-02T18:18:55.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456352+0000", 2023-01-02T18:18:55.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1700000000000003e-05 2023-01-02T18:18:55.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456403+0000", 2023-01-02T18:18:55.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1058999999999997e-05 2023-01-02T18:18:55.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456494+0000", 2023-01-02T18:18:55.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026174 2023-01-02T18:18:55.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:55.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456756+0000", 2023-01-02T18:18:55.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057697200000000003 2023-01-02T18:18:55.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457333+0000", 2023-01-02T18:18:55.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00050206299999999997 2023-01-02T18:18:55.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457835+0000", 2023-01-02T18:18:55.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7630000000000002e-05 2023-01-02T18:18:55.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457893+0000", 2023-01-02T18:18:55.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7191000000000003e-05 2023-01-02T18:18:55.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457940+0000", 2023-01-02T18:18:55.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702 2023-01-02T18:18:55.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.328 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.328 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.329 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:31 3.1c 3:3d3f3250:::rbd_id.image2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:18:55.329 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:18:55.329 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 135.79852821200001, 2023-01-02T18:18:55.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002, 2023-01-02T18:18:55.330 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.330 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.330 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.331 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 31 2023-01-02T18:18:55.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.331 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:18:55.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:18:55.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:55.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:18:55.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:18:55.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458084+0000", 2023-01-02T18:18:55.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3246e-05 2023-01-02T18:18:55.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458097+0000", 2023-01-02T18:18:55.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6010000000000002e-06 2023-01-02T18:18:55.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458103+0000", 2023-01-02T18:18:55.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2332000000000001e-05 2023-01-02T18:18:55.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458135+0000", 2023-01-02T18:18:55.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8839999999999996e-05 2023-01-02T18:18:55.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458234+0000", 2023-01-02T18:18:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000148947 2023-01-02T18:18:55.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:55.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458383+0000", 2023-01-02T18:18:55.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001891876 2023-01-02T18:18:55.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460275+0000", 2023-01-02T18:18:55.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029464600000000002 2023-01-02T18:18:55.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460569+0000", 2023-01-02T18:18:55.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6334e-05 2023-01-02T18:18:55.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460626+0000", 2023-01-02T18:18:55.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7567e-05 2023-01-02T18:18:55.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460673+0000", 2023-01-02T18:18:55.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002 2023-01-02T18:18:55.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.343 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.344 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35 3.1c 3:3d3f3250:::rbd_id.image2:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:18:55.344 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:18:55.344 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 135.78954242200001, 2023-01-02T18:18:55.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134, 2023-01-02T18:18:55.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.345 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:55.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35 2023-01-02T18:18:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:18:55.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:18:55.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:55.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:18:55.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2440000000000004e-06 2023-01-02T18:18:55.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467067+0000", 2023-01-02T18:18:55.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1679999999999993e-06 2023-01-02T18:18:55.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467076+0000", 2023-01-02T18:18:55.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2880000000000003e-06 2023-01-02T18:18:55.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467080+0000", 2023-01-02T18:18:55.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3101e-05 2023-01-02T18:18:55.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467123+0000", 2023-01-02T18:18:55.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8630999999999999e-05 2023-01-02T18:18:55.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467212+0000", 2023-01-02T18:18:55.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020884290000000002 2023-01-02T18:18:55.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.469300+0000", 2023-01-02T18:18:55.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134 2023-01-02T18:18:55.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.354 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.354 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.355 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2821 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:55.355 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:18:55.355 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.921666615000007, 2023-01-02T18:18:55.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999, 2023-01-02T18:18:55.356 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.356 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.356 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.356 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2821 2023-01-02T18:18:55.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.357 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:18:55.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:18:55.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:55.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334937+0000", 2023-01-02T18:18:55.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:18:55.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334946+0000", 2023-01-02T18:18:55.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2023-01-02T18:18:55.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334961+0000", 2023-01-02T18:18:55.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:18:55.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334968+0000", 2023-01-02T18:18:55.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8257000000000001e-05 2023-01-02T18:18:55.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335027+0000", 2023-01-02T18:18:55.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104551 2023-01-02T18:18:55.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335131+0000", 2023-01-02T18:18:55.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024432700000000002 2023-01-02T18:18:55.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:55.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335376+0000", 2023-01-02T18:18:55.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00087122800000000004 2023-01-02T18:18:55.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.336247+0000", 2023-01-02T18:18:55.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001616592 2023-01-02T18:18:55.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337863+0000", 2023-01-02T18:18:55.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6448e-05 2023-01-02T18:18:55.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337910+0000", 2023-01-02T18:18:55.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4098999999999999e-05 2023-01-02T18:18:55.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337954+0000", 2023-01-02T18:18:55.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999 2023-01-02T18:18:55.368 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.369 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.369 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.369 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:2823 10.15 e101/98 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:18:55.369 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:18:55.370 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.916583044999996, 2023-01-02T18:18:55.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999, 2023-01-02T18:18:55.370 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.370 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.370 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:18:55.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:18:55.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:55.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340022+0000", 2023-01-02T18:18:55.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6679999999999998e-06 2023-01-02T18:18:55.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340028+0000", 2023-01-02T18:18:55.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9619999999999999e-06 2023-01-02T18:18:55.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340037+0000", 2023-01-02T18:18:55.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9020000000000002e-06 2023-01-02T18:18:55.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340044+0000", 2023-01-02T18:18:55.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121297 2023-01-02T18:18:55.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340165+0000", 2023-01-02T18:18:55.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7771e-05 2023-01-02T18:18:55.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340183+0000", 2023-01-02T18:18:55.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022034379999999998 2023-01-02T18:18:55.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342386+0000", 2023-01-02T18:18:55.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3992000000000002e-05 2023-01-02T18:18:55.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342430+0000", 2023-01-02T18:18:55.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999 2023-01-02T18:18:55.380 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.380 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.380 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.380 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2915 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:55.381 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:18:55.381 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.84132486, 2023-01-02T18:18:55.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001, 2023-01-02T18:18:55.381 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.381 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.382 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.382 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2915 2023-01-02T18:18:55.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.382 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:18:55.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:18:55.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:55.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415280+0000", 2023-01-02T18:18:55.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0479999999999998e-06 2023-01-02T18:18:55.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415285+0000", 2023-01-02T18:18:55.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2146e-05 2023-01-02T18:18:55.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415297+0000", 2023-01-02T18:18:55.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6869999999999994e-06 2023-01-02T18:18:55.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415305+0000", 2023-01-02T18:18:55.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7336999999999999e-05 2023-01-02T18:18:55.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415332+0000", 2023-01-02T18:18:55.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0314e-05 2023-01-02T18:18:55.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415382+0000", 2023-01-02T18:18:55.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2730000000000003e-05 2023-01-02T18:18:55.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:55.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415455+0000", 2023-01-02T18:18:55.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052884199999999996 2023-01-02T18:18:55.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415984+0000", 2023-01-02T18:18:55.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016222630000000001 2023-01-02T18:18:55.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417606+0000", 2023-01-02T18:18:55.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0604e-05 2023-01-02T18:18:55.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417637+0000", 2023-01-02T18:18:55.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.366e-05 2023-01-02T18:18:55.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417660+0000", 2023-01-02T18:18:55.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001 2023-01-02T18:18:55.394 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.394 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.395 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2916 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:55.395 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:18:55.395 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.838723393999999, 2023-01-02T18:18:55.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999, 2023-01-02T18:18:55.396 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.396 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:55.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2916 2023-01-02T18:18:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:18:55.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:18:55.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:55.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417881+0000", 2023-01-02T18:18:55.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7620000000000003e-06 2023-01-02T18:18:55.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417886+0000", 2023-01-02T18:18:55.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1369000000000001e-05 2023-01-02T18:18:55.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417897+0000", 2023-01-02T18:18:55.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6840000000000004e-06 2023-01-02T18:18:55.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417902+0000", 2023-01-02T18:18:55.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0825000000000003e-05 2023-01-02T18:18:55.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417943+0000", 2023-01-02T18:18:55.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4980000000000003e-05 2023-01-02T18:18:55.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.418028+0000", 2023-01-02T18:18:55.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014752299999999999 2023-01-02T18:18:55.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.419503+0000", 2023-01-02T18:18:55.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999 2023-01-02T18:18:55.405 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.406 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.406 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.406 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e41)", 2023-01-02T18:18:55.407 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:18:55.407 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.704433555999998, 2023-01-02T18:18:55.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312, 2023-01-02T18:18:55.407 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.407 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:18:55.407 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.408 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:18:55.408 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:18:55.408 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:18:55.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.408 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:18:55.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:18:55.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:55.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552171+0000", 2023-01-02T18:18:55.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3999999999999997e-06 2023-01-02T18:18:55.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552177+0000", 2023-01-02T18:18:55.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1396999999999999e-05 2023-01-02T18:18:55.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552189+0000", 2023-01-02T18:18:55.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9620000000000001e-06 2023-01-02T18:18:55.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552194+0000", 2023-01-02T18:18:55.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060382329999999996 2023-01-02T18:18:55.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558232+0000", 2023-01-02T18:18:55.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3328e-05 2023-01-02T18:18:55.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558245+0000", 2023-01-02T18:18:55.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312 2023-01-02T18:18:55.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.416 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.416 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.416 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected e101)", 2023-01-02T18:18:55.417 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:18:55.417 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.701670385, 2023-01-02T18:18:55.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999, 2023-01-02T18:18:55.417 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.417 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:18:55.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.418 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:18:55.418 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:18:55.418 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:18:55.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.418 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:18:55.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:18:55.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:55.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554934+0000", 2023-01-02T18:18:55.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5679999999999999e-06 2023-01-02T18:18:55.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554940+0000", 2023-01-02T18:18:55.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866999999999999e-05 2023-01-02T18:18:55.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554951+0000", 2023-01-02T18:18:55.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9819999999999999e-06 2023-01-02T18:18:55.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554956+0000", 2023-01-02T18:18:55.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003315634 2023-01-02T18:18:55.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558271+0000", 2023-01-02T18:18:55.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3561999999999997e-05 2023-01-02T18:18:55.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558355+0000", 2023-01-02T18:18:55.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999 2023-01-02T18:18:55.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.426 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.427 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3195 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e102)", 2023-01-02T18:18:55.427 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:18:55.427 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 78.803563815999993, 2023-01-02T18:18:55.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001, 2023-01-02T18:18:55.428 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.428 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.428 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3195 2023-01-02T18:18:55.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.429 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:18:55.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:18:55.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:55.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453040+0000", 2023-01-02T18:18:55.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0059999999999992e-06 2023-01-02T18:18:55.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453048+0000", 2023-01-02T18:18:55.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4034e-05 2023-01-02T18:18:55.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453062+0000", 2023-01-02T18:18:55.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:18:55.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453070+0000", 2023-01-02T18:18:55.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6203e-05 2023-01-02T18:18:55.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453166+0000", 2023-01-02T18:18:55.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012608000000000001 2023-01-02T18:18:55.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453292+0000", 2023-01-02T18:18:55.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019149799999999999 2023-01-02T18:18:55.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:55.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453484+0000", 2023-01-02T18:18:55.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074549399999999997 2023-01-02T18:18:55.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454229+0000", 2023-01-02T18:18:55.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038527599999999999 2023-01-02T18:18:55.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454614+0000", 2023-01-02T18:18:55.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0699000000000003e-05 2023-01-02T18:18:55.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454675+0000", 2023-01-02T18:18:55.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8510000000000001e-05 2023-01-02T18:18:55.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454724+0000", 2023-01-02T18:18:55.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001 2023-01-02T18:18:55.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.441 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.441 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.442 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3316 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+full_try e106)", 2023-01-02T18:18:55.442 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:18:55.442 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.934297495999999, 2023-01-02T18:18:55.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002, 2023-01-02T18:18:55.443 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.443 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:55.443 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.443 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.443 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.443 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3316 2023-01-02T18:18:55.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.444 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:18:55.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:18:55.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:55.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322306+0000", 2023-01-02T18:18:55.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0338e-05 2023-01-02T18:18:55.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322316+0000", 2023-01-02T18:18:55.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5367999999999999e-05 2023-01-02T18:18:55.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322332+0000", 2023-01-02T18:18:55.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0642000000000001e-05 2023-01-02T18:18:55.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322342+0000", 2023-01-02T18:18:55.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0119999999999999e-05 2023-01-02T18:18:55.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322412+0000", 2023-01-02T18:18:55.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0169999999999996e-06 2023-01-02T18:18:55.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:55.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322420+0000", 2023-01-02T18:18:55.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048005519999999996 2023-01-02T18:18:55.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327221+0000", 2023-01-02T18:18:55.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8480000000000007e-05 2023-01-02T18:18:55.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327310+0000", 2023-01-02T18:18:55.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141008 2023-01-02T18:18:55.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327451+0000", 2023-01-02T18:18:55.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002 2023-01-02T18:18:55.456 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.456 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.456 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.457 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3318 11.5 e106/102 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head v 106'2, mlcod=0'0)", 2023-01-02T18:18:55.457 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:18:55.457 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.927520620999999, 2023-01-02T18:18:55.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978, 2023-01-02T18:18:55.457 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.458 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.458 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:18:55.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:18:55.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:55.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329084+0000", 2023-01-02T18:18:55.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9700000000000002e-06 2023-01-02T18:18:55.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329091+0000", 2023-01-02T18:18:55.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0783e-05 2023-01-02T18:18:55.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329102+0000", 2023-01-02T18:18:55.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5800000000000003e-06 2023-01-02T18:18:55.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329110+0000", 2023-01-02T18:18:55.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102808 2023-01-02T18:18:55.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329213+0000", 2023-01-02T18:18:55.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1041999999999999e-05 2023-01-02T18:18:55.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329234+0000", 2023-01-02T18:18:55.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040932829999999996 2023-01-02T18:18:55.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333327+0000", 2023-01-02T18:18:55.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7880000000000002e-05 2023-01-02T18:18:55.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333375+0000", 2023-01-02T18:18:55.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978 2023-01-02T18:18:55.467 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.467 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.467 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.468 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPull(7.1e e112/111 cost 1049576)", 2023-01-02T18:18:55.468 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:18:55.468 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.598427834000006, 2023-01-02T18:18:55.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012, 2023-01-02T18:18:55.468 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.469 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:18:55.469 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:18:55.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:18:55.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:55.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658177+0000", 2023-01-02T18:18:55.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7961e-05 2023-01-02T18:18:55.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658195+0000", 2023-01-02T18:18:55.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7309e-05 2023-01-02T18:18:55.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658212+0000", 2023-01-02T18:18:55.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2859999999999999e-06 2023-01-02T18:18:55.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658220+0000", 2023-01-02T18:18:55.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1268999999999998e-05 2023-01-02T18:18:55.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658292+0000", 2023-01-02T18:18:55.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039592480000000003 2023-01-02T18:18:55.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.662251+0000", 2023-01-02T18:18:55.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012 2023-01-02T18:18:55.476 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.476 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.477 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3454 12.1a e121/118 12:5cea7035:::rbd_info:head v 121'1, mlcod=0'0)", 2023-01-02T18:18:55.477 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:18:55.478 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 56.524833059999999, 2023-01-02T18:18:55.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001, 2023-01-02T18:18:55.478 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.478 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.478 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:18:55.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:18:55.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:55.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731772+0000", 2023-01-02T18:18:55.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1409999999999999e-06 2023-01-02T18:18:55.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731779+0000", 2023-01-02T18:18:55.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6167999999999998e-05 2023-01-02T18:18:55.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731795+0000", 2023-01-02T18:18:55.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2630000000000003e-06 2023-01-02T18:18:55.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731804+0000", 2023-01-02T18:18:55.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018042000000000001 2023-01-02T18:18:55.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731984+0000", 2023-01-02T18:18:55.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1704000000000001e-05 2023-01-02T18:18:55.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.732006+0000", 2023-01-02T18:18:55.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076487370000000001 2023-01-02T18:18:55.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739655+0000", 2023-01-02T18:18:55.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5726999999999999e-05 2023-01-02T18:18:55.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739690+0000", 2023-01-02T18:18:55.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001 2023-01-02T18:18:55.488 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.488 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.489 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(7.14 133/132 [PushOp(7:2d7624f7:::rbd_id.image26:head, version: 64'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(7:2d7624f7:::rbd_id.image26:head@64'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:18:55.489 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:18:55.490 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 40.850921028000002, 2023-01-02T18:18:55.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998, 2023-01-02T18:18:55.490 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.490 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:55.490 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:18:55.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:18:55.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:55.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405684+0000", 2023-01-02T18:18:55.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2345e-05 2023-01-02T18:18:55.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405697+0000", 2023-01-02T18:18:55.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4418e-05 2023-01-02T18:18:55.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405711+0000", 2023-01-02T18:18:55.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0879999999999999e-05 2023-01-02T18:18:55.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405722+0000", 2023-01-02T18:18:55.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133447 2023-01-02T18:18:55.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405855+0000", 2023-01-02T18:18:55.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5799999999999992e-06 2023-01-02T18:18:55.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405864+0000", 2023-01-02T18:18:55.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022636800000000001 2023-01-02T18:18:55.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408128+0000", 2023-01-02T18:18:55.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998 2023-01-02T18:18:55.499 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.499 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.499 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.500 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:28825 3.16 3:6aa41c7b:::rbd_header.12a211eeb54d:head [watch watch cookie 140114583906128] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:18:55.500 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:18:55.500 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.22979441, 2023-01-02T18:18:55.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737, 2023-01-02T18:18:55.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.500 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.501 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.501 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.501 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.501 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28825 2023-01-02T18:18:55.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.502 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:18:55.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:18:55.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:55.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:18:55.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0239999999999999e-06 2023-01-02T18:18:55.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026815+0000", 2023-01-02T18:18:55.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9989999999999997e-06 2023-01-02T18:18:55.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026824+0000", 2023-01-02T18:18:55.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1080000000000003e-06 2023-01-02T18:18:55.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026828+0000", 2023-01-02T18:18:55.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1114000000000001e-05 2023-01-02T18:18:55.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026859+0000", 2023-01-02T18:18:55.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1344999999999997e-05 2023-01-02T18:18:55.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026910+0000", 2023-01-02T18:18:55.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104691 2023-01-02T18:18:55.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:55.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027015+0000", 2023-01-02T18:18:55.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00059966399999999997 2023-01-02T18:18:55.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027615+0000", 2023-01-02T18:18:55.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018614879999999999 2023-01-02T18:18:55.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029476+0000", 2023-01-02T18:18:55.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1659999999999998e-05 2023-01-02T18:18:55.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029508+0000", 2023-01-02T18:18:55.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6330999999999997e-05 2023-01-02T18:18:55.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029594+0000", 2023-01-02T18:18:55.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737 2023-01-02T18:18:55.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.514 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.514 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.515 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:55.516 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.516 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:55.516 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:55.516 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:55.516 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.516 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:55.517 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:55.517 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.517 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:55.517 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:55.517 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestIOPP (2388 ms) 2023-01-02T18:18:55.518 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestIOPPWithIOHint 2023-01-02T18:18:55.518 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:55.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:18:55.520 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:55.517+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:55.617 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:55.618+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:55.648 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:55.648 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:55.649 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:55.658 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:18:55.700 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:18:55.736 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:55.736 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:55.737 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:55.737 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:55.737 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 512 2023-01-02T18:18:55.737 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.737 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:55.738 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:55.738 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:55.737+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:55.739 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.739 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:55.739 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.739 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:55.740 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:55.740 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.740 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:55.740 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.740 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:55.741 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:55.741 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.741 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:55.742 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.742 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:55.742 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:55.743 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.743 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:55.743 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.743 INFO:tasks.workunit.client.0.smithi007.stdout:started write 2023-01-02T18:18:55.744 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:55.745 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:55.745 INFO:tasks.workunit.client.0.smithi007.stdout:finished write 2023-01-02T18:18:55.745 INFO:tasks.workunit.client.0.smithi007.stdout:read: 512 2023-01-02T18:18:55.745 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.746 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:55.746 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:55.746 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:55.746 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:55.746 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.747 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:55.747 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:55.747 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:55.747 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:55.747 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.748 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:55.748 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:55.748 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:55.748 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:55.748 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.748 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:55.749 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:55.749 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:55.749 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:55.749 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:55.749 INFO:tasks.workunit.client.0.smithi007.stdout:started read 2023-01-02T18:18:55.750 INFO:tasks.workunit.client.0.smithi007.stdout:read completion cb called! 2023-01-02T18:18:55.799 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:55.799 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:55.799 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:55.799 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:55.800 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:55.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:18:55.819 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:55.820+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:55.920 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:55.921+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:55.946 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:55.946 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:55.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:55.947 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:55.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.947 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:18:55.947 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:55.948 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.640405058, 2023-01-02T18:18:55.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:18:55.948 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.948 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.948 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.948 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:55.949 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:55.949 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:18:55.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.949 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:55.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:18:55.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:55.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:18:55.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:18:55.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:18:55.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:18:55.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:18:55.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:18:55.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:18:55.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:18:55.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:18:55.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:18:55.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:55.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:18:55.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:18:55.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:18:55.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:18:55.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:18:55.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:18:55.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:55.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:18:55.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:18:55.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:18:55.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:18:55.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:18:55.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:18:55.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:18:55.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:18:55.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:18:55.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:18:55.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.964 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.964 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.965 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:18:55.965 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:55.965 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.63527683700001, 2023-01-02T18:18:55.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:18:55.966 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.966 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.966 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.966 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.967 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.967 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:18:55.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.967 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:55.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:18:55.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:55.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:18:55.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:18:55.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:18:55.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:18:55.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:18:55.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:18:55.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:18:55.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:18:55.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:18:55.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:18:55.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:55.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:18:55.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:18:55.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:18:55.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:18:55.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:18:55.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:18:55.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:55.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:18:55.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:18:55.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:18:55.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:18:55.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:18:55.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:18:55.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:18:55.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:18:55.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:18:55.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:18:55.981 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.982 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.982 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.982 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:18:55.983 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:55.983 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.345212344, 2023-01-02T18:18:55.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:18:55.983 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:55.983 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:55.983 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:55.984 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:55.984 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:55.984 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:18:55.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.984 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:55.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:55.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:55.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:55.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:55.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:18:55.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:55.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:55.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:18:55.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:18:55.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:55.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:18:55.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:18:55.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:55.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:18:55.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:18:55.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:55.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:18:55.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:18:55.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:18:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:18:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:55.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:18:55.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:18:55.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:55.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:18:55.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:18:55.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:55.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:18:55.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:18:55.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:55.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:18:55.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:18:55.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:55.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:18:55.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:18:55.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:55.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:18:55.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:18:55.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:55.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:18:55.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:18:55.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:55.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:55.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:18:55.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:18:55.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.999 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:55.999 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:55.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:55.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.000 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:18:56.000 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:56.000 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.346487001, 2023-01-02T18:18:56.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:18:56.000 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.001 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.001 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.001 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.001 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.001 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:18:56.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.002 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:56.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:18:56.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:56.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:18:56.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:18:56.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:18:56.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:18:56.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:18:56.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:18:56.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:18:56.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:18:56.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:18:56.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:18:56.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:18:56.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:18:56.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:18:56.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:18:56.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:18:56.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:18:56.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:56.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:18:56.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:18:56.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:18:56.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:18:56.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:18:56.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:18:56.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:18:56.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:18:56.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:18:56.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:18:56.016 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.016 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.016 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.017 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:18:56.017 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:56.017 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.32212523699999, 2023-01-02T18:18:56.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:18:56.018 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.018 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.018 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.018 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.019 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.019 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:18:56.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.019 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:56.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:18:56.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:56.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:18:56.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:18:56.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:18:56.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:18:56.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:18:56.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:18:56.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:18:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:18:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:18:56.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:18:56.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:18:56.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:18:56.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:56.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:18:56.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:18:56.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:18:56.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:18:56.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:18:56.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:18:56.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:18:56.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:18:56.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:18:56.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:18:56.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.032 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.032 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.033 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:18:56.033 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:56.033 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.616530569000005, 2023-01-02T18:18:56.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:18:56.034 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.034 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.034 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.034 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.034 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.035 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:18:56.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.035 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:56.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:18:56.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:56.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:18:56.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:18:56.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:18:56.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:18:56.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:18:56.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:18:56.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:18:56.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:18:56.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:18:56.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:18:56.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:18:56.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:18:56.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:56.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:18:56.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:18:56.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:18:56.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:18:56.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:18:56.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:18:56.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:18:56.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:18:56.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:18:56.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:18:56.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.048 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.048 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.049 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3321 11.1 11:81555d77:::rbd_object_map.12a2d6b452e6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:56.049 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:56.049 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 76.608825500999998, 2023-01-02T18:18:56.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002, 2023-01-02T18:18:56.050 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.050 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.050 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.050 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.050 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.051 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3321 2023-01-02T18:18:56.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.051 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:56.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:18:56.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:56.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336122+0000", 2023-01-02T18:18:56.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000004e-06 2023-01-02T18:18:56.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336130+0000", 2023-01-02T18:18:56.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4102e-05 2023-01-02T18:18:56.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336144+0000", 2023-01-02T18:18:56.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8210000000000004e-06 2023-01-02T18:18:56.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336151+0000", 2023-01-02T18:18:56.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6598999999999998e-05 2023-01-02T18:18:56.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336208+0000", 2023-01-02T18:18:56.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8439999999999998e-06 2023-01-02T18:18:56.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336216+0000", 2023-01-02T18:18:56.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028909740000000001 2023-01-02T18:18:56.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339107+0000", 2023-01-02T18:18:56.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1304999999999994e-05 2023-01-02T18:18:56.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339198+0000", 2023-01-02T18:18:56.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030390899999999999 2023-01-02T18:18:56.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:56.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339502+0000", 2023-01-02T18:18:56.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00165285 2023-01-02T18:18:56.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341155+0000", 2023-01-02T18:18:56.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00047942200000000002 2023-01-02T18:18:56.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341634+0000", 2023-01-02T18:18:56.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1620999999999998e-05 2023-01-02T18:18:56.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341696+0000", 2023-01-02T18:18:56.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0988999999999997e-05 2023-01-02T18:18:56.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341737+0000", 2023-01-02T18:18:56.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002 2023-01-02T18:18:56.066 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.066 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.066 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.067 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:18:56.067 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:56.067 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.564122752000003, 2023-01-02T18:18:56.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:18:56.068 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.068 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.068 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.068 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.068 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.069 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:18:56.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.069 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:56.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:18:56.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:18:56.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:18:56.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:18:56.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:18:56.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:18:56.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:18:56.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:18:56.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:18:56.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:18:56.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:18:56.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:18:56.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:18:56.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:18:56.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:56.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:18:56.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:18:56.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:18:56.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:18:56.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:18:56.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:18:56.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:18:56.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:18:56.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:18:56.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:18:56.081 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.082 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.082 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.082 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:18:56.083 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:56.083 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.533793235999994, 2023-01-02T18:18:56.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:18:56.083 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.083 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.084 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.084 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.084 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.084 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:18:56.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.085 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:56.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:18:56.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:18:56.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:18:56.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:18:56.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:18:56.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:18:56.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:18:56.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:18:56.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:18:56.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:18:56.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:18:56.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:18:56.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:18:56.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:18:56.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:56.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:18:56.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:18:56.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:18:56.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:18:56.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:18:56.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:18:56.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:18:56.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:18:56.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:18:56.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:18:56.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.097 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3341 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e112)", 2023-01-02T18:18:56.098 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.525009971000003, 2023-01-02T18:18:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051817290000000004, 2023-01-02T18:18:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.099 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3341 2023-01-02T18:18:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:18:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:56.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419937+0000", 2023-01-02T18:18:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6713000000000001e-05 2023-01-02T18:18:56.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419953+0000", 2023-01-02T18:18:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2670000000000001e-05 2023-01-02T18:18:56.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419976+0000", 2023-01-02T18:18:56.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4169999999999998e-06 2023-01-02T18:18:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419985+0000", 2023-01-02T18:18:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012351199999999999 2023-01-02T18:18:56.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420109+0000", 2023-01-02T18:18:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5488999999999995e-05 2023-01-02T18:18:56.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420184+0000", 2023-01-02T18:18:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035263699999999999 2023-01-02T18:18:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420537+0000", 2023-01-02T18:18:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038774510000000001 2023-01-02T18:18:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.424414+0000", 2023-01-02T18:18:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063741700000000004 2023-01-02T18:18:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425052+0000", 2023-01-02T18:18:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5787999999999997e-05 2023-01-02T18:18:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425088+0000", 2023-01-02T18:18:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3402999999999999e-05 2023-01-02T18:18:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425121+0000", 2023-01-02T18:18:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051817290000000004 2023-01-02T18:18:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.433346571000001, 2023-01-02T18:18:56.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:18:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:18:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:18:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:18:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:18:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:18:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:18:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:18:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:18:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:18:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:18:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:18:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:18:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:18:56.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:18:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:18:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:18:56.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:18:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:18:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:18:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:18:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:18:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:18:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:18:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:18:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:18:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.129 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:18:56.130 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 43.077809324999997, 2023-01-02T18:18:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:18:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.131 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:18:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.132 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:18:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:18:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:18:56.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:18:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:18:56.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:18:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:18:56.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:18:56.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:18:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:18:56.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:18:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:18:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:18:56.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:18:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:18:56.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:18:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:18:56.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:18:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:18:56.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:18:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:18:56.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:18:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:18:56.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:18:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:18:56.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:18:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:18:56.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.148 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:18:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.066904682000001, 2023-01-02T18:18:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:18:56.149 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.150 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:18:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:56.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:18:56.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:18:56.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:18:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:18:56.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:18:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:18:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:18:56.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:18:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:18:56.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:18:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:18:56.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:18:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:18:56.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:18:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:18:56.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:18:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:18:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:18:56.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:18:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:18:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:18:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:18:56.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:18:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:18:56.163 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:18:56.164 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.040961842999998, 2023-01-02T18:18:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:18:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.165 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:18:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.166 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:18:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:56.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:18:56.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:18:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:18:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:18:56.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:18:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:18:56.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:18:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:18:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:18:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:18:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:18:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:18:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:18:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:18:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:18:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:18:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:18:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:18:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:18:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:18:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:18:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:18:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:18:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:18:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:18:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:18:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:18:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 34.266184727999999, 2023-01-02T18:18:56.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:18:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:18:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:18:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:18:56.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:18:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:18:56.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:18:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:18:56.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:18:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:18:56.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:18:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:18:56.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:18:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:18:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:18:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:18:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:18:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:18:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:18:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:18:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:18:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:18:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.221679694999999, 2023-01-02T18:18:56.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:18:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:18:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:18:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:18:56.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:18:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:18:56.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:18:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:18:56.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:18:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:18:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:18:56.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:18:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:18:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:18:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:18:56.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:18:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:18:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:18:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:18:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:18:56.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:18:56.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:18:56.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:18:56.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:18:56.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:18:56.210 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.210 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.210 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.211 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:18:56.211 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:56.211 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.020696439, 2023-01-02T18:18:56.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:18:56.212 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.212 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.212 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.212 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.213 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.213 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:18:56.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.213 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:56.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:18:56.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:56.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:18:56.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:18:56.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:18:56.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:18:56.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:18:56.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:18:56.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:18:56.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:18:56.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:18:56.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:18:56.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:18:56.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:18:56.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:56.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:18:56.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:18:56.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:18:56.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:18:56.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:18:56.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:18:56.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:18:56.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:18:56.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:18:56.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:18:56.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.226 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.226 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.226 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:18:56.227 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:56.227 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.819443736, 2023-01-02T18:18:56.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:18:56.227 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.227 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.228 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.228 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:18:56.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.228 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:56.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:18:56.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:56.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:18:56.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:18:56.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:18:56.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:18:56.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:18:56.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:18:56.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:18:56.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:18:56.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:18:56.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:18:56.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:18:56.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:18:56.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:56.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:18:56.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:18:56.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:18:56.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:18:56.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:18:56.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:18:56.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:18:56.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:18:56.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:18:56.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:18:56.241 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.241 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.242 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.242 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35555 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [read 45056~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e149)", 2023-01-02T18:18:56.242 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:56.243 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.547617271, 2023-01-02T18:18:56.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997, 2023-01-02T18:18:56.243 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.243 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:56.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.244 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35555 2023-01-02T18:18:56.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.244 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:56.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:56.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:56.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:18:56.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5999999999999998e-06 2023-01-02T18:18:56.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397335+0000", 2023-01-02T18:18:56.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0539999999999997e-06 2023-01-02T18:18:56.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397342+0000", 2023-01-02T18:18:56.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2090000000000001e-06 2023-01-02T18:18:56.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397345+0000", 2023-01-02T18:18:56.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5210000000000002e-05 2023-01-02T18:18:56.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397401+0000", 2023-01-02T18:18:56.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8177999999999996e-05 2023-01-02T18:18:56.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397479+0000", 2023-01-02T18:18:56.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052113059999999998 2023-01-02T18:18:56.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.402690+0000", 2023-01-02T18:18:56.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997 2023-01-02T18:18:56.253 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.253 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.253 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.254 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:10838 3.d e156/147 3:b21fdca0:::rbd_id.image57:head v 156'10, mlcod=137'8)", 2023-01-02T18:18:56.254 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:18:56.255 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.57818815000000001, 2023-01-02T18:18:56.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489, 2023-01-02T18:18:56.255 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.255 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.256 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:18:56.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:18:56.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:18:56.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:18:56.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8000000000000001e-06 2023-01-02T18:18:56.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366767+0000", 2023-01-02T18:18:56.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0953e-05 2023-01-02T18:18:56.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366778+0000", 2023-01-02T18:18:56.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8860000000000003e-06 2023-01-02T18:18:56.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366783+0000", 2023-01-02T18:18:56.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3716e-05 2023-01-02T18:18:56.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366827+0000", 2023-01-02T18:18:56.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3964999999999998e-05 2023-01-02T18:18:56.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366851+0000", 2023-01-02T18:18:56.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054574560000000003 2023-01-02T18:18:56.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372308+0000", 2023-01-02T18:18:56.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2353e-05 2023-01-02T18:18:56.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372341+0000", 2023-01-02T18:18:56.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489 2023-01-02T18:18:56.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.266 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.266 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.267 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.267 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:56.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:18:56.269 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:56.269+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:56.369 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:56.369+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:56.438 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:56.438 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:56.438 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:56.438 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:56.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:18:56.470 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:56.469+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:56.571 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:56.571+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:56.627 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:56.627 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:56.628 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:56.628 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:56.628 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:56.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:18:56.681 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:56.682+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:56.773 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:56.774+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:56.793 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:56.793 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:18:56.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:18:56.794 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:18:56.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.794 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:18:56.794 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:56.795 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 129.47455585399999, 2023-01-02T18:18:56.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:18:56.795 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.795 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.795 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.796 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:56.796 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:56.796 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:18:56.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.796 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:56.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:18:56.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:56.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:18:56.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:18:56.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:18:56.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:18:56.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:18:56.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:18:56.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:18:56.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:18:56.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:18:56.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:18:56.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:18:56.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:18:56.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:18:56.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:18:56.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:18:56.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:18:56.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:18:56.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:56.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:18:56.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:18:56.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:18:56.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:18:56.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:18:56.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:18:56.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:18:56.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:18:56.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:18:56.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:18:56.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.811 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.811 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.811 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:18:56.811 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:56.812 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.459472398, 2023-01-02T18:18:56.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:18:56.812 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.812 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.812 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.813 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.813 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.813 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:18:56.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.813 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:56.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:18:56.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:56.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:18:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:18:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:18:56.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:18:56.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:18:56.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:18:56.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:18:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:18:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:18:56.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:18:56.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:18:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:18:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:18:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:18:56.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:18:56.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:18:56.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:18:56.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:18:56.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:18:56.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:18:56.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:18:56.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:18:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:18:56.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:18:56.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:18:56.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:18:56.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:18:56.827 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.827 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:18:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:56.828 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 115.474774821, 2023-01-02T18:18:56.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:18:56.829 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.829 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.829 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.829 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.830 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.830 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:18:56.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.830 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:56.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:18:56.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:56.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:18:56.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:18:56.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:18:56.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:18:56.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:18:56.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:18:56.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:18:56.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:18:56.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:18:56.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:18:56.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:18:56.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:18:56.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:18:56.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:18:56.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:18:56.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:18:56.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:56.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:18:56.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:18:56.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:18:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:18:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:18:56.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:18:56.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:18:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:18:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:18:56.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:18:56.844 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.844 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.844 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.845 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:18:56.845 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:56.845 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.47675013, 2023-01-02T18:18:56.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:18:56.846 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.846 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.846 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.846 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.846 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:18:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:56.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:18:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:18:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:18:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:18:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:18:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:18:56.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:18:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:18:56.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:18:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:18:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:18:56.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:18:56.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:18:56.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:18:56.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:18:56.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:18:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:18:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:18:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:18:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:18:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:18:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:18:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:18:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:18:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:18:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:18:56.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:18:56.861 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.861 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.861 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:18:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.475691676, 2023-01-02T18:18:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:18:56.862 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:56.863 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:18:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:56.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:18:56.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:18:56.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:18:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:18:56.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:18:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:18:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:18:56.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:18:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:18:56.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:18:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:18:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:18:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:18:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:18:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:18:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:18:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:18:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:18:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:18:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:18:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:18:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:18:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:18:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:18:56.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:18:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:18:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:18:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:18:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.470327029000003, 2023-01-02T18:18:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:18:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.879 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:18:56.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:18:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:56.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:18:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:18:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:18:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:18:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:18:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:18:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:18:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:18:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:18:56.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:18:56.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:18:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:18:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:18:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:18:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:18:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:18:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:18:56.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:18:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:18:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:18:56.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:18:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:18:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:18:56.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:18:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:18:56.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:18:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:18:56.894 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.895 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2191 3.13 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:18:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.452488415000005, 2023-01-02T18:18:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996, 2023-01-02T18:18:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.896 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2191 2023-01-02T18:18:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.897 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:18:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340115+0000", 2023-01-02T18:18:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2921999999999999e-05 2023-01-02T18:18:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340128+0000", 2023-01-02T18:18:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9213000000000001e-05 2023-01-02T18:18:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340147+0000", 2023-01-02T18:18:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0695e-05 2023-01-02T18:18:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340158+0000", 2023-01-02T18:18:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1227000000000001e-05 2023-01-02T18:18:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340229+0000", 2023-01-02T18:18:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7239999999999992e-06 2023-01-02T18:18:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340237+0000", 2023-01-02T18:18:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001423248 2023-01-02T18:18:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341660+0000", 2023-01-02T18:18:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158319 2023-01-02T18:18:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341818+0000", 2023-01-02T18:18:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019205099999999999 2023-01-02T18:18:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.342011+0000", 2023-01-02T18:18:56.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001641558 2023-01-02T18:18:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.343652+0000", 2023-01-02T18:18:56.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001445895 2023-01-02T18:18:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345098+0000", 2023-01-02T18:18:56.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4589000000000003e-05 2023-01-02T18:18:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345143+0000", 2023-01-02T18:18:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9351000000000001e-05 2023-01-02T18:18:56.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345172+0000", 2023-01-02T18:18:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996 2023-01-02T18:18:56.911 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:18:56.912 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.429995528999996, 2023-01-02T18:18:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:18:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.913 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:18:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.914 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:18:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:18:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:18:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:18:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:18:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:18:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:18:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:18:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:18:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:18:56.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:18:56.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:18:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:18:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:18:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:18:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:18:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:18:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:18:56.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:18:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:18:56.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:18:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:18:56.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:18:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:18:56.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:18:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:18:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:18:56.928 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:18:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.425425278999995, 2023-01-02T18:18:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:18:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.930 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:18:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.931 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:18:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.936 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:18:56.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:18:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:18:56.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:18:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:18:56.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:18:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:18:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:18:56.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:18:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:18:56.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:18:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:18:56.945 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:18:56.946 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.412593263000005, 2023-01-02T18:18:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:18:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.947 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:18:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.948 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:18:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:18:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:18:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:18:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:18:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:18:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:18:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:18:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:18:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:18:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:18:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:18:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:18:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:18:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:18:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:18:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:18:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:18:56.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:18:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:18:56.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:18:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:18:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:18:56.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:18:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:18:56.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:18:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:18:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.962 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:18:56.963 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.463859764000006, 2023-01-02T18:18:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:18:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.964 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:18:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:18:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:18:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:18:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:18:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:18:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:18:56.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:18:56.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:18:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:18:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:18:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:18:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:56.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:18:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:18:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:18:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:18:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:18:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:18:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:18:56.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:18:56.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:18:56.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:18:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:18:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:18:56.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:18:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:18:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:18:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:18:56.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:18:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.981 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:18:56.981 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:56.981 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 77.464016709999996, 2023-01-02T18:18:56.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:18:56.981 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.982 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.982 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:18:56.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:56.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:18:56.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:18:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:18:56.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:18:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:18:56.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:18:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:18:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:18:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:18:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:18:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:18:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:18:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:18:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:18:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:18:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:18:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:18:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:56.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:18:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:18:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:56.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:18:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:18:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:56.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:18:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:18:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:56.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3381 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch unwatch cookie 140114584663936] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:18:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.315323204999999, 2023-01-02T18:18:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047545959999999998, 2023-01-02T18:18:56.996 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:56.997 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3381 2023-01-02T18:18:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:56.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477283+0000", 2023-01-02T18:18:56.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477282+0000", 2023-01-02T18:18:57.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0690000000000003e-06 2023-01-02T18:18:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477286+0000", 2023-01-02T18:18:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.61e-06 2023-01-02T18:18:57.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477294+0000", 2023-01-02T18:18:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.19e-06 2023-01-02T18:18:57.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477297+0000", 2023-01-02T18:18:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016576899999999999 2023-01-02T18:18:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477463+0000", 2023-01-02T18:18:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4697999999999996e-05 2023-01-02T18:18:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477527+0000", 2023-01-02T18:18:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012896699999999999 2023-01-02T18:18:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:18:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477656+0000", 2023-01-02T18:18:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092177700000000003 2023-01-02T18:18:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.478578+0000", 2023-01-02T18:18:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033212659999999998 2023-01-02T18:18:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.481899+0000", 2023-01-02T18:18:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8207999999999997e-05 2023-01-02T18:18:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:57.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.481938+0000", 2023-01-02T18:18:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9822999999999996e-05 2023-01-02T18:18:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:57.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482037+0000", 2023-01-02T18:18:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047545959999999998 2023-01-02T18:18:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3382 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [notify-ack] snapc 0=[] ondisk+read+known_if_redirected+full_try e117)", 2023-01-02T18:18:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.315088336999999, 2023-01-02T18:18:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046394139999999997, 2023-01-02T18:18:57.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3382 2023-01-02T18:18:57.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:57.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:57.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477518+0000", 2023-01-02T18:18:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:18:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:57.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477516+0000", 2023-01-02T18:18:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0870000000000001e-06 2023-01-02T18:18:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477523+0000", 2023-01-02T18:18:57.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7181999999999999e-05 2023-01-02T18:18:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477541+0000", 2023-01-02T18:18:57.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.276e-05 2023-01-02T18:18:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477553+0000", 2023-01-02T18:18:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000346912 2023-01-02T18:18:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477900+0000", 2023-01-02T18:18:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7819999999999996e-05 2023-01-02T18:18:57.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for rw locks", 2023-01-02T18:18:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.477988+0000", 2023-01-02T18:18:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762630000000001 2023-01-02T18:18:57.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482064+0000", 2023-01-02T18:18:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0998000000000003e-05 2023-01-02T18:18:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482105+0000", 2023-01-02T18:18:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1690999999999997e-05 2023-01-02T18:18:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.482157+0000", 2023-01-02T18:18:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0046394139999999997 2023-01-02T18:18:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.023 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3486 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:18:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:57.024 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.980206707000001, 2023-01-02T18:18:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004, 2023-01-02T18:18:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:57.025 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3486 2023-01-02T18:18:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:18:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:18:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:57.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812397+0000", 2023-01-02T18:18:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0736e-05 2023-01-02T18:18:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:57.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812408+0000", 2023-01-02T18:18:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8725000000000001e-05 2023-01-02T18:18:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812427+0000", 2023-01-02T18:18:57.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6719999999999993e-06 2023-01-02T18:18:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812435+0000", 2023-01-02T18:18:57.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8585000000000003e-05 2023-01-02T18:18:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812484+0000", 2023-01-02T18:18:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014839399999999999 2023-01-02T18:18:57.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812632+0000", 2023-01-02T18:18:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00048733700000000001 2023-01-02T18:18:57.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.813120+0000", 2023-01-02T18:18:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031693730000000001 2023-01-02T18:18:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.816289+0000", 2023-01-02T18:18:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00079880000000000001 2023-01-02T18:18:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817088+0000", 2023-01-02T18:18:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9833000000000001e-05 2023-01-02T18:18:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817148+0000", 2023-01-02T18:18:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2119000000000001e-05 2023-01-02T18:18:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817190+0000", 2023-01-02T18:18:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004 2023-01-02T18:18:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.038 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3487 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:18:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:57.039 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.975047910999997, 2023-01-02T18:18:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045799999999999999, 2023-01-02T18:18:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3487 2023-01-02T18:18:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:57.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817558+0000", 2023-01-02T18:18:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:18:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817555+0000", 2023-01-02T18:18:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3555e-05 2023-01-02T18:18:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:57.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817568+0000", 2023-01-02T18:18:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8287e-05 2023-01-02T18:18:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:57.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817587+0000", 2023-01-02T18:18:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6570000000000003e-06 2023-01-02T18:18:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:57.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817595+0000", 2023-01-02T18:18:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3665000000000002e-05 2023-01-02T18:18:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817649+0000", 2023-01-02T18:18:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2825999999999996e-05 2023-01-02T18:18:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:57.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.817732+0000", 2023-01-02T18:18:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042540399999999999 2023-01-02T18:18:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:57.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.818157+0000", 2023-01-02T18:18:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033449220000000002 2023-01-02T18:18:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.821502+0000", 2023-01-02T18:18:57.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052594299999999996 2023-01-02T18:18:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822028+0000", 2023-01-02T18:18:57.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2504999999999999e-05 2023-01-02T18:18:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822091+0000", 2023-01-02T18:18:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7435999999999998e-05 2023-01-02T18:18:57.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:03.822138+0000", 2023-01-02T18:18:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045799999999999999 2023-01-02T18:18:57.053 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3488 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e126)", 2023-01-02T18:18:57.054 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.970129114000002, 2023-01-02T18:18:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004, 2023-01-02T18:18:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:57.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3488 2023-01-02T18:18:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.056 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:18:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822474+0000", 2023-01-02T18:18:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8097999999999999e-05 2023-01-02T18:18:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822492+0000", 2023-01-02T18:18:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4201000000000001e-05 2023-01-02T18:18:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822516+0000", 2023-01-02T18:18:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1077000000000001e-05 2023-01-02T18:18:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822527+0000", 2023-01-02T18:18:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0508999999999998e-05 2023-01-02T18:18:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822608+0000", 2023-01-02T18:18:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1670999999999999e-05 2023-01-02T18:18:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:57.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822679+0000", 2023-01-02T18:18:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030685400000000001 2023-01-02T18:18:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:18:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822986+0000", 2023-01-02T18:18:57.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002756896 2023-01-02T18:18:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.825743+0000", 2023-01-02T18:18:57.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014320229999999999 2023-01-02T18:18:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827175+0000", 2023-01-02T18:18:57.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6622999999999998e-05 2023-01-02T18:18:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827212+0000", 2023-01-02T18:18:57.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3500000000000001e-05 2023-01-02T18:18:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827245+0000", 2023-01-02T18:18:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004 2023-01-02T18:18:57.068 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.069 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:18:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.920977486000002, 2023-01-02T18:18:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:18:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:57.070 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:18:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:18:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:18:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.071 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:57.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:18:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:18:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:18:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:18:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:18:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:18:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:18:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:18:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:18:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:18:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:18:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:18:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:57.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:18:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:18:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:18:57.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:18:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:18:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:18:57.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:18:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:18:57.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:18:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:18:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:18:57.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:18:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:18:57.083 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:18:57.084 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:18:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.426370744, 2023-01-02T18:18:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:18:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:18:57.085 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:18:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.086 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:18:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:18:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:18:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:18:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:18:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:57.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:18:57.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:18:57.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:57.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:18:57.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:18:57.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:57.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:18:57.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:18:57.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:18:57.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:18:57.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:57.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:18:57.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:18:57.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:18:57.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:18:57.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:18:57.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:18:57.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:18:57.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:18:57.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:18:57.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:18:57.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:18:57.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:18:57.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:18:57.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:18:57.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:57.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:18:57.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:18:57.098 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10841 3.d 3:b21fdca0:::rbd_id.image57:head [stat] snapc 0=[] ondisk+read+known_if_redirected e157)", 2023-01-02T18:18:57.099 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:18:57.100 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.0811658959999999, 2023-01-02T18:18:57.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048345949999999997, 2023-01-02T18:18:57.100 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:18:57.100 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:18:57.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:18:57.101 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:18:57.101 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:18:57.101 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10841 2023-01-02T18:18:57.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.101 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:18:57.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:18:57.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:18:57.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:18:57.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:18:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:18:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:18:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:18:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711438+0000", 2023-01-02T18:18:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3810000000000005e-06 2023-01-02T18:18:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:18:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711448+0000", 2023-01-02T18:18:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7039000000000001e-05 2023-01-02T18:18:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:18:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711465+0000", 2023-01-02T18:18:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2190000000000001e-06 2023-01-02T18:18:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:18:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711471+0000", 2023-01-02T18:18:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6118999999999997e-05 2023-01-02T18:18:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711517+0000", 2023-01-02T18:18:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2149999999999998e-06 2023-01-02T18:18:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:18:57.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711523+0000", 2023-01-02T18:18:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045723059999999999 2023-01-02T18:18:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:18:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716096+0000", 2023-01-02T18:18:57.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6606000000000004e-05 2023-01-02T18:18:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:18:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716182+0000", 2023-01-02T18:18:57.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2539000000000003e-05 2023-01-02T18:18:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:18:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:18:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:18:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716275+0000", 2023-01-02T18:18:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048345949999999997 2023-01-02T18:18:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:18:57.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:18:57.112 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:57.113 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:18:57.115 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:57.114+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:57.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:18:57.116 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 512 2023-01-02T18:18:57.117 INFO:tasks.workunit.client.0.smithi007.stdout:finished read 2023-01-02T18:18:57.117 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:57.117 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.117 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.117 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 0 2023-01-02T18:18:57.118 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.118 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.118 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:57.118 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.118 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.119 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 16384 2023-01-02T18:18:57.119 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.119 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.119 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.119 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.120 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:57.120 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.120 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.120 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 49152 2023-01-02T18:18:57.121 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.121 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.121 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:57.121 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.121 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.122 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 65536 2023-01-02T18:18:57.122 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.122 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.122 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.122 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.123 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:57.123 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.123 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.123 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 98304 2023-01-02T18:18:57.123 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.124 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.124 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:57.124 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.124 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.124 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 114688 2023-01-02T18:18:57.124 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.125 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.125 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.125 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.125 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:57.125 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.126 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.126 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 147456 2023-01-02T18:18:57.126 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.126 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.126 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:57.127 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.127 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.127 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 163840 2023-01-02T18:18:57.127 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.127 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.128 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.128 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.128 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:57.128 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.128 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.129 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 196608 2023-01-02T18:18:57.129 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.129 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.129 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:57.129 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.130 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.130 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 212992 2023-01-02T18:18:57.130 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.130 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.130 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.131 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.131 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.131 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.131 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.131 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.131 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.132 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.132 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.132 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.132 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.132 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.133 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.133 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.133 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.133 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.133 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.133 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.134 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.134 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.134 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.134 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.134 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.135 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.135 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.135 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.135 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.135 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.136 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.136 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.136 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.136 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.136 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.136 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.137 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.137 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.137 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.137 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.137 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.138 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.138 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.138 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.138 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.138 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.139 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.139 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.139 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.139 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.139 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.139 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.140 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.140 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.140 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.140 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.140 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.141 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.141 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.141 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.141 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.141 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.142 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.142 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.142 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.142 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.142 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.143 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.143 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.143 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.143 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.143 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.143 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.144 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.144 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.144 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.144 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.144 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.145 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.145 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.145 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.145 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.148 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.148 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.148 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.149 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.149 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.149 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.149 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.202 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.202 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.203 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.203 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.203 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.203 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.203 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.214 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:57.214+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:57.249 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.249 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.249 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.249 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.250 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.250 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.250 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.250 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.250 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.251 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.251 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.251 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.251 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.278 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:18:57.279 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:18:57.279 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:18:57.279 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:18:57.289 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:18:57.292 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:57.312 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:57.315 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:57.315+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:57.328 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.328 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.328 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.329 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.329 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.329 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.329 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.331 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:57.349 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:57.368 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:57.387 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:57.392 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.392 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.392 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.392 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.393 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.393 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.393 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.407 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:57.416 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:57.416+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:57.423 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:57.423 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:57.424 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:18:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:18:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:18:57.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:18:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:18:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:18:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:18:57.427 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:18:57.435 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:18:57.474 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.474 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.474 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.475 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.475 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.475 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.475 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.517 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:57.518+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:57.546 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.546 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.546 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.546 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.547 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.547 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.547 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.547 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.547 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.548 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:57.548 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.548 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.548 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.599 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:57.599 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:57.609 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:18:57.653 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:57.653+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:57.673 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.673 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.674 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.674 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.674 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.675 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.675 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.714 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:18:57.719 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:57.719+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:57.742 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:57.742 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:57.753 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:18:57.773 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.774 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.774 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.774 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.774 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.775 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.775 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.820 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:57.820+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:57.905 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:57.905 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:57.906 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:57.906 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:57.906 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:57.906 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:57.906 INFO:tasks.workunit.client.0.smithi007.stdout:write completion cb called! 2023-01-02T18:18:57.909 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:57.909 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:57.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:18:57.960 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:18:57.960+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:18:58.003 INFO:tasks.workunit.client.0.smithi007.stdout:return value is: 0 2023-01-02T18:18:58.004 INFO:tasks.workunit.client.0.smithi007.stdout:finished writesame 2023-01-02T18:18:58.004 INFO:tasks.workunit.client.0.smithi007.stdout:to verify the data 2023-01-02T18:18:58.004 INFO:tasks.workunit.client.0.smithi007.stdout:verified 2023-01-02T18:18:58.004 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:58.005 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:58.005 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:58.005 INFO:tasks.workunit.client.0.smithi007.stdout:created completion 2023-01-02T18:18:58.005 INFO:tasks.workunit.client.0.smithi007.stdout:started writesame 2023-01-02T18:18:58.005 INFO:tasks.workunit.client.0.smithi007.stdout:expected fail, finished writesame 2023-01-02T18:18:58.005 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestIOPPWithIOHint (2645 ms) 2023-01-02T18:18:58.006 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestIOToSnapshot 2023-01-02T18:18:58.006 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:18:58.021 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:58.021+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:58.090 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:58.090 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:58.100 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:18:58.122 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:58.122+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:58.223 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:58.223+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:58.266 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:58.267 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:58.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:18:58.324 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:58.324+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:58.424 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:58.425+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:58.441 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:58.441 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:58.451 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:18:58.525 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:58.525+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:58.577 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:58.577 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:58.587 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:18:58.626 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:58.627+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:58.710 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:18:58.726 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:18:58.726+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:18:58.765 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:58.766 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:58.776 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:18:58.828 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:18:58.828+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:18:58.929 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:58.929+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:58.941 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:58.942 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:58.951 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:18:59.030 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:18:59.030+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:18:59.117 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:59.118 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:59.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:18:59.130 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:59.130+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:59.231 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:59.231+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:59.267 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:59.268 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:59.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:18:59.331 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:59.331+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:59.358 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 0 2023-01-02T18:18:59.358 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 0 2023-01-02T18:18:59.358 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 1 2023-01-02T18:18:59.358 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:18:59.359 INFO:tasks.workunit.client.0.smithi007.stdout:snap: orig 2023-01-02T18:18:59.359 INFO:tasks.workunit.client.0.smithi007.stdout:found orig with size 2097152 2023-01-02T18:18:59.359 INFO:tasks.workunit.client.0.smithi007.stdout:read: 80 2023-01-02T18:18:59.359 INFO:tasks.workunit.client.0.smithi007.stdout:write test data! 2023-01-02T18:18:59.359 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 80 2023-01-02T18:18:59.360 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 2 2023-01-02T18:18:59.360 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:18:59.360 INFO:tasks.workunit.client.0.smithi007.stdout:snap: orig 2023-01-02T18:18:59.360 INFO:tasks.workunit.client.0.smithi007.stdout:snap: written 2023-01-02T18:18:59.360 INFO:tasks.workunit.client.0.smithi007.stdout:found orig with size 2097152 2023-01-02T18:18:59.361 INFO:tasks.workunit.client.0.smithi007.stdout:found written with size 2097152 2023-01-02T18:18:59.361 INFO:tasks.workunit.client.0.smithi007.stdout:read: 80 2023-01-02T18:18:59.361 INFO:tasks.workunit.client.0.smithi007.stdout:read: 80 2023-01-02T18:18:59.361 INFO:tasks.workunit.client.0.smithi007.stdout:read: 80 2023-01-02T18:18:59.361 INFO:tasks.workunit.client.0.smithi007.stdout:write to snapshot returned -30 2023-01-02T18:18:59.361 INFO:tasks.workunit.client.0.smithi007.stdout:Read-only file system 2023-01-02T18:18:59.383 INFO:tasks.workunit.client.0.smithi007.stdout:read: 80 2023-01-02T18:18:59.384 INFO:tasks.workunit.client.0.smithi007.stdout:read: 80 2023-01-02T18:18:59.384 INFO:tasks.workunit.client.0.smithi007.stdout:wrote: 80 2023-01-02T18:18:59.384 INFO:tasks.workunit.client.0.smithi007.stdout:opening testimg@orig 2023-01-02T18:18:59.385 INFO:tasks.workunit.client.0.smithi007.stdout:read: 80 2023-01-02T18:18:59.385 INFO:tasks.workunit.client.0.smithi007.stdout:write to snapshot returned -30 2023-01-02T18:18:59.385 INFO:tasks.workunit.client.0.smithi007.stdout:Read-only file system 2023-01-02T18:18:59.434 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:59.433+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:59.439 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:18:59.457 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:59.457 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:59.467 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:18:59.555 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:18:59.555+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:18:59.584 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:18:59.600 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:18:59.617 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:18:59.634 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:18:59.636 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:18:59.636 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:18:59.637 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:59.636+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:59.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:18:59.652 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:18:59.670 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:18:59.687 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:18:59.705 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:18:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:18:59.706 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:18:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:18:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:18:59.707 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:18:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:18:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:18:59.708 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:18:59.708 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 4] out_osds: [3, 5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:18:59.709 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:18:59.709 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2023-01-02T18:18:59.709 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:18:59.709 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:18:59.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2023-01-02T18:18:59.738 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:18:59.739+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:18:59.818 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:59.819 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:59.819 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:18:59.819 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:59.830 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:18:59.838 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:18:59.837+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:18:59.865 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:59.866 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "filestore_inject_stall = '3' (not observed, change may require restart) " 2023-01-02T18:18:59.866 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:59.939 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:18:59.938+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:18:59.960 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:18:59.960 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:18:59.961 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:18:59.961 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:18:59.962 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:18:59.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:19:00.039 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:00.039+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:00.099 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:00.100 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:00.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:00.100 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:00.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.101 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2 3.17 3:ece625d0:::rbd_id.image1:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:19:00.101 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:00.101 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 142.68186611300001, 2023-01-02T18:19:00.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001, 2023-01-02T18:19:00.102 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.102 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:00.102 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.102 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.103 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.103 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2 2023-01-02T18:19:00.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.103 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:00.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:00.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:00.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416794+0000", 2023-01-02T18:19:00.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1639e-05 2023-01-02T18:19:00.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416806+0000", 2023-01-02T18:19:00.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7169999999999997e-06 2023-01-02T18:19:00.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416814+0000", 2023-01-02T18:19:00.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0390000000000004e-06 2023-01-02T18:19:00.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416819+0000", 2023-01-02T18:19:00.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4200000000000003e-05 2023-01-02T18:19:00.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416873+0000", 2023-01-02T18:19:00.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5050000000000004e-06 2023-01-02T18:19:00.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:00.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416880+0000", 2023-01-02T18:19:00.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003595263 2023-01-02T18:19:00.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420475+0000", 2023-01-02T18:19:00.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5440000000000004e-06 2023-01-02T18:19:00.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:00.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420482+0000", 2023-01-02T18:19:00.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014728149999999999 2023-01-02T18:19:00.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.421955+0000", 2023-01-02T18:19:00.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5858000000000004e-05 2023-01-02T18:19:00.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.422040+0000", 2023-01-02T18:19:00.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001 2023-01-02T18:19:00.114 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.115 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.115 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.115 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:00.116 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:00.116 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 140.67307947399999, 2023-01-02T18:19:00.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997, 2023-01-02T18:19:00.116 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.116 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.116 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.117 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.117 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.117 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9 2023-01-02T18:19:00.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.117 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:00.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:00.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:00.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425580+0000", 2023-01-02T18:19:00.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1592e-05 2023-01-02T18:19:00.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425592+0000", 2023-01-02T18:19:00.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727e-05 2023-01-02T18:19:00.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425607+0000", 2023-01-02T18:19:00.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.204e-06 2023-01-02T18:19:00.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425615+0000", 2023-01-02T18:19:00.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3989000000000002e-05 2023-01-02T18:19:00.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425659+0000", 2023-01-02T18:19:00.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105519 2023-01-02T18:19:00.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425764+0000", 2023-01-02T18:19:00.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019538499999999999 2023-01-02T18:19:00.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:00.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425959+0000", 2023-01-02T18:19:00.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045306399999999998 2023-01-02T18:19:00.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430490+0000", 2023-01-02T18:19:00.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6642000000000003e-05 2023-01-02T18:19:00.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430557+0000", 2023-01-02T18:19:00.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4468999999999997e-05 2023-01-02T18:19:00.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430601+0000", 2023-01-02T18:19:00.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.025e-05 2023-01-02T18:19:00.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430631+0000", 2023-01-02T18:19:00.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997 2023-01-02T18:19:00.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.130 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:10 3.17 3:ece625d0:::rbd_id.image1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:00.131 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:00.131 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 140.66785245700001, 2023-01-02T18:19:00.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982, 2023-01-02T18:19:00.131 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.131 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.132 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.132 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10 2023-01-02T18:19:00.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.133 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:00.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:00.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:00.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430808+0000", 2023-01-02T18:19:00.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2579999999999998e-06 2023-01-02T18:19:00.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430815+0000", 2023-01-02T18:19:00.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:00.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430828+0000", 2023-01-02T18:19:00.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8730000000000004e-06 2023-01-02T18:19:00.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430834+0000", 2023-01-02T18:19:00.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6267000000000003e-05 2023-01-02T18:19:00.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430880+0000", 2023-01-02T18:19:00.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7486999999999997e-05 2023-01-02T18:19:00.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430978+0000", 2023-01-02T18:19:00.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156785 2023-01-02T18:19:00.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:00.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.431135+0000", 2023-01-02T18:19:00.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089828900000000003 2023-01-02T18:19:00.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432033+0000", 2023-01-02T18:19:00.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057836200000000002 2023-01-02T18:19:00.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432611+0000", 2023-01-02T18:19:00.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2023-01-02T18:19:00.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432649+0000", 2023-01-02T18:19:00.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4532e-05 2023-01-02T18:19:00.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432693+0000", 2023-01-02T18:19:00.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982 2023-01-02T18:19:00.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.145 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.146 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:14 3.17 3:ece625d0:::rbd_id.image1:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:00.146 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:00.146 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 140.65633731099999, 2023-01-02T18:19:00.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305, 2023-01-02T18:19:00.146 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.147 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:00.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.147 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 14 2023-01-02T18:19:00.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.148 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:00.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:00.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:00.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442323+0000", 2023-01-02T18:19:00.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0670000000000003e-06 2023-01-02T18:19:00.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442330+0000", 2023-01-02T18:19:00.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2111e-05 2023-01-02T18:19:00.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442342+0000", 2023-01-02T18:19:00.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5030000000000002e-06 2023-01-02T18:19:00.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442349+0000", 2023-01-02T18:19:00.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4279999999999997e-05 2023-01-02T18:19:00.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442383+0000", 2023-01-02T18:19:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2152999999999999e-05 2023-01-02T18:19:00.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442445+0000", 2023-01-02T18:19:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020234039999999999 2023-01-02T18:19:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.444469+0000", 2023-01-02T18:19:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305 2023-01-02T18:19:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.156 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:30 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:00.157 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 140.642338513, 2023-01-02T18:19:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702, 2023-01-02T18:19:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.158 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 30 2023-01-02T18:19:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456322+0000", 2023-01-02T18:19:00.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.267e-06 2023-01-02T18:19:00.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456329+0000", 2023-01-02T18:19:00.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4963999999999999e-05 2023-01-02T18:19:00.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456344+0000", 2023-01-02T18:19:00.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6860000000000006e-06 2023-01-02T18:19:00.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456352+0000", 2023-01-02T18:19:00.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1700000000000003e-05 2023-01-02T18:19:00.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456403+0000", 2023-01-02T18:19:00.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1058999999999997e-05 2023-01-02T18:19:00.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456494+0000", 2023-01-02T18:19:00.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026174 2023-01-02T18:19:00.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:00.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456756+0000", 2023-01-02T18:19:00.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057697200000000003 2023-01-02T18:19:00.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457333+0000", 2023-01-02T18:19:00.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00050206299999999997 2023-01-02T18:19:00.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457835+0000", 2023-01-02T18:19:00.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7630000000000002e-05 2023-01-02T18:19:00.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457893+0000", 2023-01-02T18:19:00.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7191000000000003e-05 2023-01-02T18:19:00.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457940+0000", 2023-01-02T18:19:00.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702 2023-01-02T18:19:00.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.171 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.172 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:31 3.1c 3:3d3f3250:::rbd_id.image2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:00.172 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:00.173 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 140.64058410600001, 2023-01-02T18:19:00.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002, 2023-01-02T18:19:00.173 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.173 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.173 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.173 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 31 2023-01-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:00.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:00.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:00.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:19:00.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458084+0000", 2023-01-02T18:19:00.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3246e-05 2023-01-02T18:19:00.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458097+0000", 2023-01-02T18:19:00.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6010000000000002e-06 2023-01-02T18:19:00.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458103+0000", 2023-01-02T18:19:00.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2332000000000001e-05 2023-01-02T18:19:00.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458135+0000", 2023-01-02T18:19:00.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8839999999999996e-05 2023-01-02T18:19:00.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458234+0000", 2023-01-02T18:19:00.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000148947 2023-01-02T18:19:00.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:00.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458383+0000", 2023-01-02T18:19:00.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001891876 2023-01-02T18:19:00.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460275+0000", 2023-01-02T18:19:00.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029464600000000002 2023-01-02T18:19:00.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460569+0000", 2023-01-02T18:19:00.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6334e-05 2023-01-02T18:19:00.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460626+0000", 2023-01-02T18:19:00.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7567e-05 2023-01-02T18:19:00.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460673+0000", 2023-01-02T18:19:00.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002 2023-01-02T18:19:00.186 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.187 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.187 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.187 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35 3.1c 3:3d3f3250:::rbd_id.image2:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:00.188 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:00.188 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 140.63159831600001, 2023-01-02T18:19:00.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134, 2023-01-02T18:19:00.188 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.188 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:00.188 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.189 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.189 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.189 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35 2023-01-02T18:19:00.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.189 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:00.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:00.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:00.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:00.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2440000000000004e-06 2023-01-02T18:19:00.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467067+0000", 2023-01-02T18:19:00.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1679999999999993e-06 2023-01-02T18:19:00.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467076+0000", 2023-01-02T18:19:00.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2880000000000003e-06 2023-01-02T18:19:00.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467080+0000", 2023-01-02T18:19:00.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3101e-05 2023-01-02T18:19:00.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467123+0000", 2023-01-02T18:19:00.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8630999999999999e-05 2023-01-02T18:19:00.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467212+0000", 2023-01-02T18:19:00.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020884290000000002 2023-01-02T18:19:00.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.469300+0000", 2023-01-02T18:19:00.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134 2023-01-02T18:19:00.198 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.198 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.198 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.199 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2821 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:00.199 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:00.199 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.763722509000004, 2023-01-02T18:19:00.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999, 2023-01-02T18:19:00.199 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.200 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.200 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.200 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.200 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.200 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2821 2023-01-02T18:19:00.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.201 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:00.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:00.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:00.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334937+0000", 2023-01-02T18:19:00.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:19:00.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334946+0000", 2023-01-02T18:19:00.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2023-01-02T18:19:00.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334961+0000", 2023-01-02T18:19:00.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:00.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334968+0000", 2023-01-02T18:19:00.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8257000000000001e-05 2023-01-02T18:19:00.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335027+0000", 2023-01-02T18:19:00.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104551 2023-01-02T18:19:00.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335131+0000", 2023-01-02T18:19:00.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024432700000000002 2023-01-02T18:19:00.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:00.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335376+0000", 2023-01-02T18:19:00.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00087122800000000004 2023-01-02T18:19:00.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.336247+0000", 2023-01-02T18:19:00.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001616592 2023-01-02T18:19:00.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337863+0000", 2023-01-02T18:19:00.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6448e-05 2023-01-02T18:19:00.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337910+0000", 2023-01-02T18:19:00.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4098999999999999e-05 2023-01-02T18:19:00.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337954+0000", 2023-01-02T18:19:00.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999 2023-01-02T18:19:00.213 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.213 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.214 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.214 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:2823 10.15 e101/98 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:19:00.214 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:00.215 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.758638938999994, 2023-01-02T18:19:00.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999, 2023-01-02T18:19:00.215 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.215 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.215 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:00.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:00.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:00.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340022+0000", 2023-01-02T18:19:00.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6679999999999998e-06 2023-01-02T18:19:00.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340028+0000", 2023-01-02T18:19:00.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9619999999999999e-06 2023-01-02T18:19:00.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340037+0000", 2023-01-02T18:19:00.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9020000000000002e-06 2023-01-02T18:19:00.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340044+0000", 2023-01-02T18:19:00.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121297 2023-01-02T18:19:00.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340165+0000", 2023-01-02T18:19:00.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7771e-05 2023-01-02T18:19:00.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340183+0000", 2023-01-02T18:19:00.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022034379999999998 2023-01-02T18:19:00.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342386+0000", 2023-01-02T18:19:00.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3992000000000002e-05 2023-01-02T18:19:00.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342430+0000", 2023-01-02T18:19:00.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999 2023-01-02T18:19:00.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.225 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.226 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2915 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:00.226 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:00.226 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.683380753999998, 2023-01-02T18:19:00.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001, 2023-01-02T18:19:00.227 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.227 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.227 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2915 2023-01-02T18:19:00.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.228 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:00.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:00.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:00.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415280+0000", 2023-01-02T18:19:00.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0479999999999998e-06 2023-01-02T18:19:00.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415285+0000", 2023-01-02T18:19:00.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2146e-05 2023-01-02T18:19:00.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415297+0000", 2023-01-02T18:19:00.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6869999999999994e-06 2023-01-02T18:19:00.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415305+0000", 2023-01-02T18:19:00.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7336999999999999e-05 2023-01-02T18:19:00.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415332+0000", 2023-01-02T18:19:00.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0314e-05 2023-01-02T18:19:00.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415382+0000", 2023-01-02T18:19:00.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2730000000000003e-05 2023-01-02T18:19:00.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:00.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415455+0000", 2023-01-02T18:19:00.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052884199999999996 2023-01-02T18:19:00.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415984+0000", 2023-01-02T18:19:00.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016222630000000001 2023-01-02T18:19:00.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417606+0000", 2023-01-02T18:19:00.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0604e-05 2023-01-02T18:19:00.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417637+0000", 2023-01-02T18:19:00.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.366e-05 2023-01-02T18:19:00.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417660+0000", 2023-01-02T18:19:00.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001 2023-01-02T18:19:00.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.240 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.241 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2916 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:00.241 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:00.242 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.680779287999997, 2023-01-02T18:19:00.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999, 2023-01-02T18:19:00.242 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.242 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:00.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.243 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2916 2023-01-02T18:19:00.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.243 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:00.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:00.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:00.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417881+0000", 2023-01-02T18:19:00.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7620000000000003e-06 2023-01-02T18:19:00.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417886+0000", 2023-01-02T18:19:00.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1369000000000001e-05 2023-01-02T18:19:00.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417897+0000", 2023-01-02T18:19:00.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6840000000000004e-06 2023-01-02T18:19:00.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417902+0000", 2023-01-02T18:19:00.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0825000000000003e-05 2023-01-02T18:19:00.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417943+0000", 2023-01-02T18:19:00.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4980000000000003e-05 2023-01-02T18:19:00.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.418028+0000", 2023-01-02T18:19:00.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014752299999999999 2023-01-02T18:19:00.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.419503+0000", 2023-01-02T18:19:00.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999 2023-01-02T18:19:00.252 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.252 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.252 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.253 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e41)", 2023-01-02T18:19:00.253 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:00.253 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.546489449999996, 2023-01-02T18:19:00.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312, 2023-01-02T18:19:00.253 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.254 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:00.254 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.254 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:00.254 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:00.254 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:00.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.255 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:00.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:00.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:00.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552171+0000", 2023-01-02T18:19:00.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3999999999999997e-06 2023-01-02T18:19:00.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552177+0000", 2023-01-02T18:19:00.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1396999999999999e-05 2023-01-02T18:19:00.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552189+0000", 2023-01-02T18:19:00.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9620000000000001e-06 2023-01-02T18:19:00.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552194+0000", 2023-01-02T18:19:00.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060382329999999996 2023-01-02T18:19:00.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558232+0000", 2023-01-02T18:19:00.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3328e-05 2023-01-02T18:19:00.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558245+0000", 2023-01-02T18:19:00.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312 2023-01-02T18:19:00.262 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.262 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.263 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.263 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected e101)", 2023-01-02T18:19:00.263 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:00.264 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.543726278999998, 2023-01-02T18:19:00.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999, 2023-01-02T18:19:00.264 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.264 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:00.264 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.264 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:00.265 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:00.265 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:00.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.265 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:00.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:00.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:00.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554934+0000", 2023-01-02T18:19:00.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5679999999999999e-06 2023-01-02T18:19:00.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554940+0000", 2023-01-02T18:19:00.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866999999999999e-05 2023-01-02T18:19:00.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554951+0000", 2023-01-02T18:19:00.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9819999999999999e-06 2023-01-02T18:19:00.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554956+0000", 2023-01-02T18:19:00.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003315634 2023-01-02T18:19:00.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558271+0000", 2023-01-02T18:19:00.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3561999999999997e-05 2023-01-02T18:19:00.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558355+0000", 2023-01-02T18:19:00.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999 2023-01-02T18:19:00.273 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.273 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.273 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.274 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3195 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e102)", 2023-01-02T18:19:00.274 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:00.274 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 83.645619710000005, 2023-01-02T18:19:00.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001, 2023-01-02T18:19:00.275 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.275 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.275 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.275 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3195 2023-01-02T18:19:00.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.276 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453040+0000", 2023-01-02T18:19:00.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0059999999999992e-06 2023-01-02T18:19:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453048+0000", 2023-01-02T18:19:00.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4034e-05 2023-01-02T18:19:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453062+0000", 2023-01-02T18:19:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:00.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453070+0000", 2023-01-02T18:19:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6203e-05 2023-01-02T18:19:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453166+0000", 2023-01-02T18:19:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012608000000000001 2023-01-02T18:19:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453292+0000", 2023-01-02T18:19:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019149799999999999 2023-01-02T18:19:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453484+0000", 2023-01-02T18:19:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074549399999999997 2023-01-02T18:19:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454229+0000", 2023-01-02T18:19:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038527599999999999 2023-01-02T18:19:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454614+0000", 2023-01-02T18:19:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0699000000000003e-05 2023-01-02T18:19:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454675+0000", 2023-01-02T18:19:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8510000000000001e-05 2023-01-02T18:19:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454724+0000", 2023-01-02T18:19:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001 2023-01-02T18:19:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3316 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+full_try e106)", 2023-01-02T18:19:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:00.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.776353389999997, 2023-01-02T18:19:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002, 2023-01-02T18:19:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3316 2023-01-02T18:19:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322306+0000", 2023-01-02T18:19:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0338e-05 2023-01-02T18:19:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322316+0000", 2023-01-02T18:19:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5367999999999999e-05 2023-01-02T18:19:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322332+0000", 2023-01-02T18:19:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0642000000000001e-05 2023-01-02T18:19:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322342+0000", 2023-01-02T18:19:00.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0119999999999999e-05 2023-01-02T18:19:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322412+0000", 2023-01-02T18:19:00.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0169999999999996e-06 2023-01-02T18:19:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322420+0000", 2023-01-02T18:19:00.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048005519999999996 2023-01-02T18:19:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327221+0000", 2023-01-02T18:19:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8480000000000007e-05 2023-01-02T18:19:00.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327310+0000", 2023-01-02T18:19:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141008 2023-01-02T18:19:00.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327451+0000", 2023-01-02T18:19:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002 2023-01-02T18:19:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.301 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3318 11.5 e106/102 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head v 106'2, mlcod=0'0)", 2023-01-02T18:19:00.302 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.769576514999997, 2023-01-02T18:19:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978, 2023-01-02T18:19:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329084+0000", 2023-01-02T18:19:00.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9700000000000002e-06 2023-01-02T18:19:00.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329091+0000", 2023-01-02T18:19:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0783e-05 2023-01-02T18:19:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329102+0000", 2023-01-02T18:19:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5800000000000003e-06 2023-01-02T18:19:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329110+0000", 2023-01-02T18:19:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102808 2023-01-02T18:19:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329213+0000", 2023-01-02T18:19:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1041999999999999e-05 2023-01-02T18:19:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329234+0000", 2023-01-02T18:19:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040932829999999996 2023-01-02T18:19:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333327+0000", 2023-01-02T18:19:00.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7880000000000002e-05 2023-01-02T18:19:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333375+0000", 2023-01-02T18:19:00.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978 2023-01-02T18:19:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPull(7.1e e112/111 cost 1049576)", 2023-01-02T18:19:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.440483728000004, 2023-01-02T18:19:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012, 2023-01-02T18:19:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.314 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:00.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:00.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658177+0000", 2023-01-02T18:19:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7961e-05 2023-01-02T18:19:00.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658195+0000", 2023-01-02T18:19:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7309e-05 2023-01-02T18:19:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658212+0000", 2023-01-02T18:19:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2859999999999999e-06 2023-01-02T18:19:00.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658220+0000", 2023-01-02T18:19:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1268999999999998e-05 2023-01-02T18:19:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658292+0000", 2023-01-02T18:19:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039592480000000003 2023-01-02T18:19:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.662251+0000", 2023-01-02T18:19:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012 2023-01-02T18:19:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.322 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3454 12.1a e121/118 12:5cea7035:::rbd_info:head v 121'1, mlcod=0'0)", 2023-01-02T18:19:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:00.323 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.366888953999997, 2023-01-02T18:19:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001, 2023-01-02T18:19:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731772+0000", 2023-01-02T18:19:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1409999999999999e-06 2023-01-02T18:19:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731779+0000", 2023-01-02T18:19:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6167999999999998e-05 2023-01-02T18:19:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731795+0000", 2023-01-02T18:19:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2630000000000003e-06 2023-01-02T18:19:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731804+0000", 2023-01-02T18:19:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018042000000000001 2023-01-02T18:19:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731984+0000", 2023-01-02T18:19:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1704000000000001e-05 2023-01-02T18:19:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.732006+0000", 2023-01-02T18:19:00.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076487370000000001 2023-01-02T18:19:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739655+0000", 2023-01-02T18:19:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5726999999999999e-05 2023-01-02T18:19:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739690+0000", 2023-01-02T18:19:00.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001 2023-01-02T18:19:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(7.14 133/132 [PushOp(7:2d7624f7:::rbd_id.image26:head, version: 64'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(7:2d7624f7:::rbd_id.image26:head@64'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:19:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 45.692976922, 2023-01-02T18:19:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998, 2023-01-02T18:19:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:00.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405684+0000", 2023-01-02T18:19:00.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2345e-05 2023-01-02T18:19:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405697+0000", 2023-01-02T18:19:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4418e-05 2023-01-02T18:19:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405711+0000", 2023-01-02T18:19:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0879999999999999e-05 2023-01-02T18:19:00.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405722+0000", 2023-01-02T18:19:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133447 2023-01-02T18:19:00.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405855+0000", 2023-01-02T18:19:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5799999999999992e-06 2023-01-02T18:19:00.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405864+0000", 2023-01-02T18:19:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022636800000000001 2023-01-02T18:19:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408128+0000", 2023-01-02T18:19:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998 2023-01-02T18:19:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.344 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:28825 3.16 3:6aa41c7b:::rbd_header.12a211eeb54d:head [watch watch cookie 140114583906128] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:00.345 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.071850304000002, 2023-01-02T18:19:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737, 2023-01-02T18:19:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.346 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28825 2023-01-02T18:19:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0239999999999999e-06 2023-01-02T18:19:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026815+0000", 2023-01-02T18:19:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9989999999999997e-06 2023-01-02T18:19:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026824+0000", 2023-01-02T18:19:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1080000000000003e-06 2023-01-02T18:19:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026828+0000", 2023-01-02T18:19:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1114000000000001e-05 2023-01-02T18:19:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026859+0000", 2023-01-02T18:19:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1344999999999997e-05 2023-01-02T18:19:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026910+0000", 2023-01-02T18:19:00.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104691 2023-01-02T18:19:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027015+0000", 2023-01-02T18:19:00.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00059966399999999997 2023-01-02T18:19:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027615+0000", 2023-01-02T18:19:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018614879999999999 2023-01-02T18:19:00.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029476+0000", 2023-01-02T18:19:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1659999999999998e-05 2023-01-02T18:19:00.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029508+0000", 2023-01-02T18:19:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6330999999999997e-05 2023-01-02T18:19:00.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029594+0000", 2023-01-02T18:19:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737 2023-01-02T18:19:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.359 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.360 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.360 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:00.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:19:00.362 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:00.361+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:00.463 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:00.463+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:00.531 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:00.531 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:00.531 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:00.541 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:19:00.563 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:00.563+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:00.664 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:00.664+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:00.666 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:00.666 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:00.666 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:00.666 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:00.667 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:00.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:19:00.727 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:19:00.765 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:00.765+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:00.803 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:00.804 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:00.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:00.804 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:00.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.804 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:19:00.805 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:00.805 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.497858069, 2023-01-02T18:19:00.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:19:00.805 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.805 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.806 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.806 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:00.806 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:00.806 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:19:00.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.807 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:00.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:00.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:00.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:19:00.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:19:00.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:19:00.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:19:00.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:19:00.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:19:00.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:19:00.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:19:00.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:19:00.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:19:00.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:00.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:19:00.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:19:00.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:19:00.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:19:00.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:19:00.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:19:00.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:00.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:19:00.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:19:00.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:19:00.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:19:00.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:19:00.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:19:00.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:19:00.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:19:00.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:19:00.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:19:00.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.821 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.822 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:00.822 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:00.822 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.492729848, 2023-01-02T18:19:00.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:19:00.823 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.823 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.823 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.823 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.823 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.823 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:19:00.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.824 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:00.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:00.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:00.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:19:00.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:19:00.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:19:00.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:19:00.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:19:00.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:19:00.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:19:00.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:19:00.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:19:00.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:19:00.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:00.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:19:00.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:19:00.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:19:00.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:19:00.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:19:00.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:19:00.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:00.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:19:00.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:19:00.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:19:00.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:19:00.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:19:00.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:19:00.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:19:00.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:19:00.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:19:00.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:19:00.838 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.838 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.838 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.839 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:19:00.839 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:00.839 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.20266535499999, 2023-01-02T18:19:00.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:19:00.839 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.839 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.840 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.840 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.840 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.840 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:19:00.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.841 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:00.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:00.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:00.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:19:00.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:19:00.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:19:00.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:19:00.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:19:00.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:19:00.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:19:00.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:19:00.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:19:00.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:19:00.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:00.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:19:00.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:19:00.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:19:00.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:19:00.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:19:00.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:19:00.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:00.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:19:00.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:19:00.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:19:00.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:19:00.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:19:00.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:19:00.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:19:00.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:19:00.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:19:00.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:19:00.855 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.855 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.855 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.856 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:00.856 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:00.856 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.203940012, 2023-01-02T18:19:00.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:19:00.856 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.857 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.857 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.857 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.857 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.857 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:19:00.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.858 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:00.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:00.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:00.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:19:00.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:19:00.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:19:00.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:19:00.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:19:00.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:19:00.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:19:00.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:19:00.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:19:00.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:19:00.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:00.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:19:00.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:19:00.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:19:00.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:19:00.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:19:00.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:19:00.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:00.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:19:00.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:19:00.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:19:00.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:19:00.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:19:00.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:19:00.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:19:00.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:19:00.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:19:00.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:19:00.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.872 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.873 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:00.873 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:00.873 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.179578248, 2023-01-02T18:19:00.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:19:00.874 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.874 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.874 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.874 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.875 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.875 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:19:00.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.875 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:00.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:00.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:00.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:19:00.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:19:00.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:19:00.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:19:00.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:19:00.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:19:00.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:19:00.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:19:00.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:19:00.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:19:00.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:19:00.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:19:00.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:00.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:19:00.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:19:00.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:19:00.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:19:00.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:19:00.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:19:00.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:19:00.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:19:00.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:19:00.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:19:00.888 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.888 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.888 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.889 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:00.889 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:00.889 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.473983579999995, 2023-01-02T18:19:00.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:19:00.889 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.889 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:19:00.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:00.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:00.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:00.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:19:00.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:19:00.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:19:00.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:19:00.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:19:00.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:19:00.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:19:00.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:19:00.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:19:00.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:19:00.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:19:00.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:19:00.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:00.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:19:00.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:19:00.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:19:00.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:19:00.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:19:00.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:19:00.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:19:00.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:19:00.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:19:00.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:19:00.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.903 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.904 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.904 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3321 11.1 11:81555d77:::rbd_object_map.12a2d6b452e6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:00.904 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:00.905 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.466278512000002, 2023-01-02T18:19:00.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002, 2023-01-02T18:19:00.905 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.905 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.905 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.906 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.906 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.906 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3321 2023-01-02T18:19:00.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.906 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:00.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:00.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:00.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336122+0000", 2023-01-02T18:19:00.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000004e-06 2023-01-02T18:19:00.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336130+0000", 2023-01-02T18:19:00.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4102e-05 2023-01-02T18:19:00.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336144+0000", 2023-01-02T18:19:00.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8210000000000004e-06 2023-01-02T18:19:00.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336151+0000", 2023-01-02T18:19:00.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6598999999999998e-05 2023-01-02T18:19:00.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336208+0000", 2023-01-02T18:19:00.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8439999999999998e-06 2023-01-02T18:19:00.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:00.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336216+0000", 2023-01-02T18:19:00.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028909740000000001 2023-01-02T18:19:00.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339107+0000", 2023-01-02T18:19:00.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1304999999999994e-05 2023-01-02T18:19:00.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339198+0000", 2023-01-02T18:19:00.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030390899999999999 2023-01-02T18:19:00.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:00.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339502+0000", 2023-01-02T18:19:00.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00165285 2023-01-02T18:19:00.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341155+0000", 2023-01-02T18:19:00.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00047942200000000002 2023-01-02T18:19:00.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341634+0000", 2023-01-02T18:19:00.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1620999999999998e-05 2023-01-02T18:19:00.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341696+0000", 2023-01-02T18:19:00.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0988999999999997e-05 2023-01-02T18:19:00.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341737+0000", 2023-01-02T18:19:00.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002 2023-01-02T18:19:00.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.921 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.922 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:19:00.922 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:00.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 76.421575763000007, 2023-01-02T18:19:00.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:19:00.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.923 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.923 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:19:00.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.924 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:00.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:00.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:00.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:19:00.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:19:00.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:19:00.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:19:00.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:19:00.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:19:00.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:19:00.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:19:00.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:19:00.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:19:00.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:19:00.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:19:00.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:00.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:19:00.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:19:00.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:19:00.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:19:00.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:19:00.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:19:00.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:19:00.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:19:00.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:19:00.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:19:00.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.936 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.937 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:19:00.937 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:00.937 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.391246246999998, 2023-01-02T18:19:00.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:19:00.937 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.938 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.938 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.938 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.938 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.938 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:19:00.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.939 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:00.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:00.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:00.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:19:00.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:19:00.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:19:00.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:19:00.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:19:00.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:19:00.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:19:00.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:19:00.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:19:00.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:19:00.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:19:00.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:19:00.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:00.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:19:00.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:19:00.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:19:00.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:19:00.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:19:00.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:19:00.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:19:00.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:19:00.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:19:00.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:19:00.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.951 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3341 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e112)", 2023-01-02T18:19:00.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:19:00.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.382462982000007, 2023-01-02T18:19:00.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051817290000000004, 2023-01-02T18:19:00.952 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.952 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.953 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3341 2023-01-02T18:19:00.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.954 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.954 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:19:00.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419939+0000", 2023-01-02T18:19:00.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:00.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419937+0000", 2023-01-02T18:19:00.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6713000000000001e-05 2023-01-02T18:19:00.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419953+0000", 2023-01-02T18:19:00.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2670000000000001e-05 2023-01-02T18:19:00.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419976+0000", 2023-01-02T18:19:00.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4169999999999998e-06 2023-01-02T18:19:00.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.419985+0000", 2023-01-02T18:19:00.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012351199999999999 2023-01-02T18:19:00.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420109+0000", 2023-01-02T18:19:00.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5488999999999995e-05 2023-01-02T18:19:00.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420184+0000", 2023-01-02T18:19:00.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00035263699999999999 2023-01-02T18:19:00.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:00.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.420537+0000", 2023-01-02T18:19:00.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038774510000000001 2023-01-02T18:19:00.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.424414+0000", 2023-01-02T18:19:00.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00063741700000000004 2023-01-02T18:19:00.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425052+0000", 2023-01-02T18:19:00.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5787999999999997e-05 2023-01-02T18:19:00.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425088+0000", 2023-01-02T18:19:00.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3402999999999999e-05 2023-01-02T18:19:00.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:50.425121+0000", 2023-01-02T18:19:00.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051817290000000004 2023-01-02T18:19:00.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.966 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.966 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:19:00.967 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:00.967 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.290799582000005, 2023-01-02T18:19:00.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:19:00.967 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.967 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.968 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:19:00.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.969 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:00.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:00.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:00.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:19:00.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:19:00.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:19:00.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:19:00.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:19:00.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:19:00.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:19:00.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:19:00.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:19:00.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:19:00.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:19:00.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:19:00.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:00.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:19:00.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:19:00.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:19:00.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:19:00.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:19:00.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:19:00.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:19:00.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:19:00.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:19:00.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:19:00.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.980 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.980 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.981 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:19:00.981 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:00.981 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 47.935262336000001, 2023-01-02T18:19:00.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:19:00.982 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.982 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:00.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:00.982 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:00.982 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:19:00.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.983 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:00.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:00.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:00.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:00.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:00.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:00.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:00.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:00.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:19:00.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:19:00.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:00.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:19:00.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:19:00.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:00.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:19:00.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:19:00.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:00.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:19:00.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:19:00.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:19:00.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:19:00.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:00.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:19:00.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:19:00.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:00.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:19:00.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:19:00.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:00.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:19:00.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:19:00.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:00.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:19:00.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:19:00.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:00.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:19:00.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:19:00.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:00.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:19:00.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:19:00.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:00.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:19:00.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:19:00.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:00.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:19:00.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:19:00.997 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.997 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:00.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:00.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:00.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:00.998 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:19:00.998 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:00.998 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.924357692999997, 2023-01-02T18:19:00.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:19:00.999 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:00.999 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:00.999 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:00.999 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.000 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:19:01.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.000 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:01.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:19:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:19:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:19:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:19:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:19:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:19:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:19:01.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:19:01.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:19:01.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:19:01.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:01.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:19:01.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:19:01.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:19:01.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:19:01.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:19:01.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:19:01.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:19:01.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:19:01.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:19:01.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:19:01.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:19:01.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:19:01.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:19:01.012 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.012 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.013 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:19:01.013 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:01.014 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 41.898414854000002, 2023-01-02T18:19:01.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:19:01.014 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.014 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.014 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.015 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:19:01.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.015 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:19:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:19:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:19:01.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:19:01.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:19:01.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:19:01.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:19:01.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:19:01.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:19:01.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:19:01.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:19:01.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:19:01.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:19:01.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:19:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:19:01.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:19:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:19:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:19:01.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:19:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:19:01.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:19:01.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:19:01.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:19:01.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:19:01.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:19:01.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:19:01.029 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.029 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.030 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.030 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:19:01.030 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:01.031 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 39.123637739000003, 2023-01-02T18:19:01.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:19:01.031 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.031 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:01.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.032 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.032 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.032 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:19:01.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.032 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:01.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:01.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:01.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:19:01.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:19:01.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:19:01.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:19:01.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:19:01.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:19:01.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:19:01.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:19:01.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:19:01.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:19:01.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:19:01.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:19:01.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:19:01.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:19:01.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:19:01.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:19:01.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:19:01.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:19:01.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.042 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.043 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:19:01.043 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:01.044 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.079132706000003, 2023-01-02T18:19:01.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:19:01.044 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.044 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.045 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.045 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:19:01.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.045 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:01.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:01.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:01.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:19:01.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:19:01.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:19:01.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:19:01.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:19:01.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:19:01.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:19:01.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:19:01.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:19:01.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:19:01.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:19:01.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:19:01.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:01.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:19:01.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:19:01.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:19:01.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:19:01.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:19:01.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:19:01.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:19:01.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:19:01.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:19:01.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:19:01.057 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.057 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.058 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:01.058 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:01.059 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.878149449999999, 2023-01-02T18:19:01.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:19:01.059 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.059 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.059 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.060 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.060 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:19:01.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.060 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:01.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:01.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:01.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:19:01.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:19:01.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:19:01.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:19:01.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:19:01.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:19:01.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:19:01.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:19:01.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:19:01.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:19:01.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:19:01.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:19:01.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:01.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:19:01.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:19:01.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:19:01.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:19:01.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:19:01.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:19:01.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:19:01.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:19:01.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:19:01.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:19:01.071 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.072 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.072 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.072 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:01.072 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:01.073 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.676896747000001, 2023-01-02T18:19:01.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:19:01.073 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.073 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.073 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.074 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.074 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.074 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:19:01.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.074 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:01.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:01.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:01.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:19:01.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:19:01.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:19:01.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:19:01.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:19:01.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:19:01.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:19:01.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:19:01.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:19:01.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:19:01.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:19:01.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:19:01.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:01.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:19:01.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:19:01.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:19:01.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:19:01.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:19:01.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:19:01.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:19:01.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:19:01.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:19:01.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:19:01.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.086 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.086 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.086 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35555 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [read 45056~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e149)", 2023-01-02T18:19:01.087 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:01.087 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.405070282000001, 2023-01-02T18:19:01.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997, 2023-01-02T18:19:01.087 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.087 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:01.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.088 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.088 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35555 2023-01-02T18:19:01.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.088 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:01.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:01.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:01.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:01.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5999999999999998e-06 2023-01-02T18:19:01.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397335+0000", 2023-01-02T18:19:01.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0539999999999997e-06 2023-01-02T18:19:01.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397342+0000", 2023-01-02T18:19:01.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2090000000000001e-06 2023-01-02T18:19:01.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397345+0000", 2023-01-02T18:19:01.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5210000000000002e-05 2023-01-02T18:19:01.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397401+0000", 2023-01-02T18:19:01.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8177999999999996e-05 2023-01-02T18:19:01.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397479+0000", 2023-01-02T18:19:01.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052113059999999998 2023-01-02T18:19:01.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.402690+0000", 2023-01-02T18:19:01.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997 2023-01-02T18:19:01.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.097 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.098 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:10838 3.d e156/147 3:b21fdca0:::rbd_id.image57:head v 156'10, mlcod=137'8)", 2023-01-02T18:19:01.098 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:01.098 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.4356411610000004, 2023-01-02T18:19:01.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489, 2023-01-02T18:19:01.098 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.099 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.099 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:01.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:01.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:01.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:01.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8000000000000001e-06 2023-01-02T18:19:01.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366767+0000", 2023-01-02T18:19:01.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0953e-05 2023-01-02T18:19:01.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366778+0000", 2023-01-02T18:19:01.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8860000000000003e-06 2023-01-02T18:19:01.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366783+0000", 2023-01-02T18:19:01.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3716e-05 2023-01-02T18:19:01.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366827+0000", 2023-01-02T18:19:01.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3964999999999998e-05 2023-01-02T18:19:01.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366851+0000", 2023-01-02T18:19:01.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054574560000000003 2023-01-02T18:19:01.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372308+0000", 2023-01-02T18:19:01.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2353e-05 2023-01-02T18:19:01.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372341+0000", 2023-01-02T18:19:01.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489 2023-01-02T18:19:01.107 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.108 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.108 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.108 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.108 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.108 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:01.110 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:19:01.110 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:01.110+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:01.211 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:01.211+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:01.277 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:01.278 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:01.278 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:01.287 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:19:01.311 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:01.312+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:01.346 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:19:01.365 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 2 2023-01-02T18:19:01.366 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:19:01.366 INFO:tasks.workunit.client.0.smithi007.stdout:snap: orig 2023-01-02T18:19:01.366 INFO:tasks.workunit.client.0.smithi007.stdout:snap: written 2023-01-02T18:19:01.366 INFO:tasks.workunit.client.0.smithi007.stdout:found orig with size 2097152 2023-01-02T18:19:01.367 INFO:tasks.workunit.client.0.smithi007.stdout:found written with size 2097152 2023-01-02T18:19:01.367 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 1 2023-01-02T18:19:01.367 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:19:01.367 INFO:tasks.workunit.client.0.smithi007.stdout:snap: orig 2023-01-02T18:19:01.367 INFO:tasks.workunit.client.0.smithi007.stdout:found orig with size 2097152 2023-01-02T18:19:01.367 INFO:tasks.workunit.client.0.smithi007.stdout:num snaps is: 0 2023-01-02T18:19:01.368 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 0 2023-01-02T18:19:01.368 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestIOToSnapshot (3362 ms) 2023-01-02T18:19:01.368 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestSnapshotDeletedIo 2023-01-02T18:19:01.368 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:19:01.413 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:01.412+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:01.462 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:01.462 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:01.462 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:01.462 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:01.462 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:01.471 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:19:01.515 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:01.516+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:01.600 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:01.600 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:01.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:01.600 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:01.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.601 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:19:01.601 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:01.601 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 134.280558434, 2023-01-02T18:19:01.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:19:01.602 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.602 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.602 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.602 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.602 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.603 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:19:01.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.603 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:01.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:01.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:01.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:19:01.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:19:01.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:19:01.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:19:01.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:19:01.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:19:01.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:19:01.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:19:01.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:19:01.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:01.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:01.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:19:01.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:19:01.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:19:01.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:19:01.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:19:01.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:19:01.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:01.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:19:01.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:19:01.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:19:01.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:19:01.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:19:01.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:19:01.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:19:01.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:19:01.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:19:01.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:19:01.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.618 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.618 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.619 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:19:01.619 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:01.619 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 129.26547497799999, 2023-01-02T18:19:01.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:19:01.620 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.620 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.620 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.621 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:19:01.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.621 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:01.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:01.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:01.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:19:01.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:19:01.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:19:01.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:19:01.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:19:01.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:19:01.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:19:01.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:19:01.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:19:01.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:19:01.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:19:01.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:19:01.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:19:01.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:19:01.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:19:01.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:19:01.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:01.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:19:01.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:19:01.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:19:01.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:19:01.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:19:01.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:19:01.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:19:01.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:19:01.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:19:01.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:19:01.635 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.636 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.636 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.636 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:01.637 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:01.637 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.28077740099999, 2023-01-02T18:19:01.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:19:01.637 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.637 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.638 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.638 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.638 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.638 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:19:01.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.639 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:01.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:01.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:01.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:19:01.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:19:01.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:19:01.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:19:01.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:19:01.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:19:01.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:19:01.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:19:01.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:19:01.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:19:01.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:19:01.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:19:01.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:19:01.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:19:01.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:19:01.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:19:01.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:01.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:19:01.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:19:01.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:19:01.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:19:01.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:19:01.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:19:01.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:19:01.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:19:01.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:19:01.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:19:01.653 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.653 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.654 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.654 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:19:01.654 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:01.655 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.28275271, 2023-01-02T18:19:01.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:19:01.655 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.655 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.655 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.656 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.656 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:19:01.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.656 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:01.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:01.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:01.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:19:01.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:19:01.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:19:01.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:19:01.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:19:01.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:19:01.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:19:01.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:19:01.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:19:01.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:19:01.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:19:01.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:19:01.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:19:01.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:19:01.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:19:01.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:19:01.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:01.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:19:01.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:19:01.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:19:01.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:19:01.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:19:01.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:19:01.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:19:01.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:19:01.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:19:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:19:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:19:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.28169425599999, 2023-01-02T18:19:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:19:01.672 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.673 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:19:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:01.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:01.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:19:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:19:01.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:19:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:19:01.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:19:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:19:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:19:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:19:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:19:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:19:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:19:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:19:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:19:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:19:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:19:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:19:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:01.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:19:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:19:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:19:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:19:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:19:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:19:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:19:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:19:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:19:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:19:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:19:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.276329609, 2023-01-02T18:19:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:19:01.689 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.690 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:19:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:01.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:01.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:19:01.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:19:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:19:01.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:19:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:19:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:19:01.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:19:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:19:01.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:19:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:19:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:19:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:19:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:19:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:19:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:19:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:19:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:01.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:19:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:19:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:19:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:19:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:19:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:19:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:19:01.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:19:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:19:01.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:19:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2191 3.13 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:19:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.258490995, 2023-01-02T18:19:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996, 2023-01-02T18:19:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.706 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2191 2023-01-02T18:19:01.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:01.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340115+0000", 2023-01-02T18:19:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2921999999999999e-05 2023-01-02T18:19:01.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340128+0000", 2023-01-02T18:19:01.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9213000000000001e-05 2023-01-02T18:19:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340147+0000", 2023-01-02T18:19:01.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0695e-05 2023-01-02T18:19:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340158+0000", 2023-01-02T18:19:01.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1227000000000001e-05 2023-01-02T18:19:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340229+0000", 2023-01-02T18:19:01.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7239999999999992e-06 2023-01-02T18:19:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340237+0000", 2023-01-02T18:19:01.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001423248 2023-01-02T18:19:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341660+0000", 2023-01-02T18:19:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158319 2023-01-02T18:19:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341818+0000", 2023-01-02T18:19:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019205099999999999 2023-01-02T18:19:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:01.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.342011+0000", 2023-01-02T18:19:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001641558 2023-01-02T18:19:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.343652+0000", 2023-01-02T18:19:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001445895 2023-01-02T18:19:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345098+0000", 2023-01-02T18:19:01.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4589000000000003e-05 2023-01-02T18:19:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345143+0000", 2023-01-02T18:19:01.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9351000000000001e-05 2023-01-02T18:19:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345172+0000", 2023-01-02T18:19:01.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996 2023-01-02T18:19:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:19:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.235998108999993, 2023-01-02T18:19:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:19:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.725 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:19:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:19:01.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:19:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:19:01.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:19:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:19:01.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:19:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:19:01.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:19:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:19:01.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:19:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:19:01.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:19:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:19:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:19:01.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:19:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:19:01.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:19:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:19:01.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:19:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:19:01.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:19:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:19:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:19:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:19:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:19:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:19:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.231427858999993, 2023-01-02T18:19:01.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:19:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.742 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:19:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:19:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:19:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:19:01.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:19:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:19:01.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:19:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:19:01.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:19:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:19:01.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:19:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:19:01.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:19:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:19:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:19:01.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:19:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:19:01.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:19:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:19:01.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:19:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:19:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:19:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:19:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:19:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:19:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:19:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:19:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.757 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:19:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:01.758 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 94.218595843000003, 2023-01-02T18:19:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:19:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.759 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:19:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:19:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:19:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:19:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:19:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:19:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:19:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:19:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:19:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:19:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:19:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:19:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:19:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:19:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:19:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:19:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:19:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:19:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:19:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:19:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:19:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:19:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:19:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:19:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:19:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:19:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:19:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:19:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.269862344000003, 2023-01-02T18:19:01.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:19:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.777 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:19:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:19:01.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:19:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:19:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:19:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:19:01.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:19:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:19:01.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:19:01.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:19:01.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:19:01.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:19:01.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:19:01.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:19:01.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:19:01.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:19:01.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:19:01.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:01.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:19:01.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:19:01.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:19:01.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:19:01.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:19:01.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:19:01.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:19:01.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:19:01.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:19:01.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:19:01.792 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.793 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.793 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.793 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:01.794 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:01.794 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 82.270019289999993, 2023-01-02T18:19:01.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:19:01.794 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.794 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.794 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.795 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.795 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.795 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:19:01.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.795 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:01.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:01.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:01.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:19:01.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:19:01.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:19:01.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:19:01.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:19:01.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:19:01.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:19:01.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:19:01.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:19:01.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:19:01.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:19:01.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:19:01.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:19:01.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:19:01.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:19:01.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:19:01.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:19:01.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:19:01.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:19:01.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:19:01.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:19:01.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:19:01.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:19:01.808 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.808 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.809 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.809 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3486 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e125)", 2023-01-02T18:19:01.809 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:19:01.810 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.786209286999998, 2023-01-02T18:19:01.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004, 2023-01-02T18:19:01.810 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.810 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.810 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.811 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3486 2023-01-02T18:19:01.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.811 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:19:01.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812399+0000", 2023-01-02T18:19:01.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:01.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812397+0000", 2023-01-02T18:19:01.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0736e-05 2023-01-02T18:19:01.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812408+0000", 2023-01-02T18:19:01.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8725000000000001e-05 2023-01-02T18:19:01.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812427+0000", 2023-01-02T18:19:01.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6719999999999993e-06 2023-01-02T18:19:01.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812435+0000", 2023-01-02T18:19:01.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8585000000000003e-05 2023-01-02T18:19:01.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812484+0000", 2023-01-02T18:19:01.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014839399999999999 2023-01-02T18:19:01.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.812632+0000", 2023-01-02T18:19:01.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00048733700000000001 2023-01-02T18:19:01.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:01.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.813120+0000", 2023-01-02T18:19:01.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031693730000000001 2023-01-02T18:19:01.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.816289+0000", 2023-01-02T18:19:01.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00079880000000000001 2023-01-02T18:19:01.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817088+0000", 2023-01-02T18:19:01.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9833000000000001e-05 2023-01-02T18:19:01.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817148+0000", 2023-01-02T18:19:01.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2119000000000001e-05 2023-01-02T18:19:01.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:02.817190+0000", 2023-01-02T18:19:01.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047903700000000004 2023-01-02T18:19:01.824 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.824 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.825 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.825 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3488 13.18 13:1f74662e:::rbd_data.12.12a21d7fc3ba.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e126)", 2023-01-02T18:19:01.825 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:19:01.825 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 56.776131694, 2023-01-02T18:19:01.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004, 2023-01-02T18:19:01.826 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.826 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.826 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.826 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.827 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.827 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3488 2023-01-02T18:19:01.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.827 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:19:01.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822477+0000", 2023-01-02T18:19:01.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:01.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822474+0000", 2023-01-02T18:19:01.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8097999999999999e-05 2023-01-02T18:19:01.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822492+0000", 2023-01-02T18:19:01.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4201000000000001e-05 2023-01-02T18:19:01.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822516+0000", 2023-01-02T18:19:01.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1077000000000001e-05 2023-01-02T18:19:01.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822527+0000", 2023-01-02T18:19:01.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0508999999999998e-05 2023-01-02T18:19:01.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822608+0000", 2023-01-02T18:19:01.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1670999999999999e-05 2023-01-02T18:19:01.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822679+0000", 2023-01-02T18:19:01.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030685400000000001 2023-01-02T18:19:01.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:01.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.822986+0000", 2023-01-02T18:19:01.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002756896 2023-01-02T18:19:01.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.825743+0000", 2023-01-02T18:19:01.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014320229999999999 2023-01-02T18:19:01.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827175+0000", 2023-01-02T18:19:01.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6622999999999998e-05 2023-01-02T18:19:01.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827212+0000", 2023-01-02T18:19:01.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3500000000000001e-05 2023-01-02T18:19:01.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:04.827245+0000", 2023-01-02T18:19:01.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047683710000000004 2023-01-02T18:19:01.840 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.840 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.840 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.841 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:01.841 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:01.841 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.726980066000003, 2023-01-02T18:19:01.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:19:01.841 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.842 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.842 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.842 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.842 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.842 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:19:01.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.843 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:01.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:01.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:01.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:19:01.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:19:01.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:19:01.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:19:01.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:19:01.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:19:01.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:19:01.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:19:01.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:19:01.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:19:01.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:19:01.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:19:01.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:01.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:19:01.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:19:01.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:19:01.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:19:01.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:19:01.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:19:01.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:19:01.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:19:01.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:19:01.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:19:01.856 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.856 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.856 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.857 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:01.857 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:01.857 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.2323733240000001, 2023-01-02T18:19:01.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:19:01.858 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.858 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.858 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.858 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.859 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.859 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:19:01.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.859 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:01.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:01.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:01.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:19:01.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:19:01.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:19:01.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:19:01.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:19:01.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:19:01.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:19:01.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:19:01.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:19:01.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:19:01.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:19:01.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:19:01.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:01.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:19:01.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:19:01.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:19:01.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:19:01.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:19:01.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:19:01.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:19:01.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:19:01.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:19:01.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:19:01.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.872 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.873 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10841 3.d 3:b21fdca0:::rbd_id.image57:head [stat] snapc 0=[] ondisk+read+known_if_redirected e157)", 2023-01-02T18:19:01.873 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:01.873 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.8871684760000003, 2023-01-02T18:19:01.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048345949999999997, 2023-01-02T18:19:01.874 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.874 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:01.874 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.874 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:01.874 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:01.875 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10841 2023-01-02T18:19:01.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.875 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:01.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:01.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:01.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711438+0000", 2023-01-02T18:19:01.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3810000000000005e-06 2023-01-02T18:19:01.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711448+0000", 2023-01-02T18:19:01.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7039000000000001e-05 2023-01-02T18:19:01.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711465+0000", 2023-01-02T18:19:01.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2190000000000001e-06 2023-01-02T18:19:01.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711471+0000", 2023-01-02T18:19:01.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6118999999999997e-05 2023-01-02T18:19:01.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711517+0000", 2023-01-02T18:19:01.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2149999999999998e-06 2023-01-02T18:19:01.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711523+0000", 2023-01-02T18:19:01.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045723059999999999 2023-01-02T18:19:01.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716096+0000", 2023-01-02T18:19:01.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6606000000000004e-05 2023-01-02T18:19:01.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716182+0000", 2023-01-02T18:19:01.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2539000000000003e-05 2023-01-02T18:19:01.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716275+0000", 2023-01-02T18:19:01.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048345949999999997 2023-01-02T18:19:01.886 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.886 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.886 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.887 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54769 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e160)", 2023-01-02T18:19:01.887 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:01.887 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.2586786240000001, 2023-01-02T18:19:01.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999, 2023-01-02T18:19:01.887 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.887 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.888 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54769 2023-01-02T18:19:01.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.888 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:01.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:01.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:01.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339928+0000", 2023-01-02T18:19:01.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0937e-05 2023-01-02T18:19:01.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339939+0000", 2023-01-02T18:19:01.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8923000000000002e-05 2023-01-02T18:19:01.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339958+0000", 2023-01-02T18:19:01.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4999999999999999e-06 2023-01-02T18:19:01.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339966+0000", 2023-01-02T18:19:01.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1886999999999999e-05 2023-01-02T18:19:01.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340028+0000", 2023-01-02T18:19:01.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9189999999999999e-06 2023-01-02T18:19:01.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340036+0000", 2023-01-02T18:19:01.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012331458999999999 2023-01-02T18:19:01.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352367+0000", 2023-01-02T18:19:01.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5671000000000001e-05 2023-01-02T18:19:01.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352443+0000", 2023-01-02T18:19:01.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028359799999999998 2023-01-02T18:19:01.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:01.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352727+0000", 2023-01-02T18:19:01.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089580699999999998 2023-01-02T18:19:01.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353622+0000", 2023-01-02T18:19:01.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163995 2023-01-02T18:19:01.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353786+0000", 2023-01-02T18:19:01.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7710000000000002e-05 2023-01-02T18:19:01.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353834+0000", 2023-01-02T18:19:01.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3380999999999999e-05 2023-01-02T18:19:01.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353857+0000", 2023-01-02T18:19:01.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999 2023-01-02T18:19:01.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.903 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.903 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.904 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54785 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:01.904 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:01.904 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.25501089300000002, 2023-01-02T18:19:01.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348, 2023-01-02T18:19:01.905 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.905 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.905 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.905 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.906 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.906 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54785 2023-01-02T18:19:01.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.906 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:01.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:01.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:01.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343595+0000", 2023-01-02T18:19:01.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2480000000000002e-06 2023-01-02T18:19:01.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343605+0000", 2023-01-02T18:19:01.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6588000000000001e-05 2023-01-02T18:19:01.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343621+0000", 2023-01-02T18:19:01.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2490000000000004e-06 2023-01-02T18:19:01.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343629+0000", 2023-01-02T18:19:01.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3723000000000001e-05 2023-01-02T18:19:01.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343672+0000", 2023-01-02T18:19:01.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.04e-06 2023-01-02T18:19:01.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:01.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343677+0000", 2023-01-02T18:19:01.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054799280000000002 2023-01-02T18:19:01.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349157+0000", 2023-01-02T18:19:01.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010108299999999999 2023-01-02T18:19:01.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349258+0000", 2023-01-02T18:19:01.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000406179 2023-01-02T18:19:01.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:01.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349665+0000", 2023-01-02T18:19:01.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051027499999999996 2023-01-02T18:19:01.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354767+0000", 2023-01-02T18:19:01.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000482819 2023-01-02T18:19:01.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355250+0000", 2023-01-02T18:19:01.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7871999999999998e-05 2023-01-02T18:19:01.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355298+0000", 2023-01-02T18:19:01.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6105e-05 2023-01-02T18:19:01.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355344+0000", 2023-01-02T18:19:01.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348 2023-01-02T18:19:01.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.921 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.922 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54793 3.12 3:48f2e415:::rbd_object_map.12a21a1bf873:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:01.922 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:01.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.23926924499999999, 2023-01-02T18:19:01.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048462100000000001, 2023-01-02T18:19:01.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:01.923 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:01.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:01.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:01.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:01.923 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54793 2023-01-02T18:19:01.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.924 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:01.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:01.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:01.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:01.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:01.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:01.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:01.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:01.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359338+0000", 2023-01-02T18:19:01.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5590000000000002e-06 2023-01-02T18:19:01.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:01.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359345+0000", 2023-01-02T18:19:01.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4041e-05 2023-01-02T18:19:01.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:01.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359359+0000", 2023-01-02T18:19:01.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8009999999999998e-06 2023-01-02T18:19:01.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:01.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359366+0000", 2023-01-02T18:19:01.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7101000000000002e-05 2023-01-02T18:19:01.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:01.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359413+0000", 2023-01-02T18:19:01.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0733e-05 2023-01-02T18:19:01.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:01.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359504+0000", 2023-01-02T18:19:01.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018615799999999999 2023-01-02T18:19:01.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:01.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359690+0000", 2023-01-02T18:19:01.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000870461 2023-01-02T18:19:01.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:01.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.360560+0000", 2023-01-02T18:19:01.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035062750000000001 2023-01-02T18:19:01.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:01.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364066+0000", 2023-01-02T18:19:01.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7508000000000005e-05 2023-01-02T18:19:01.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:01.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364134+0000", 2023-01-02T18:19:01.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1615e-05 2023-01-02T18:19:01.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:01.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:01.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:01.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364186+0000", 2023-01-02T18:19:01.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048462100000000001 2023-01-02T18:19:01.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.936 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:01.936 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:01.937 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:01.937 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:19:01.939 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:01.938+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:01.939 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:19:02.039 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:02.039+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:02.084 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:02.085 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:02.085 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:19:02.085 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:02.095 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:19:02.098 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:02.117 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:02.135 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:02.139 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:02.139+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:02.152 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:02.171 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:02.189 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:02.208 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:02.223 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:02.223 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:02.226 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:02.227 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:19:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:19:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:19:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:19:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:19:02.228 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:19:02.229 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:19:02.229 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:19:02.234 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:19:02.282 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:02.280+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:02.340 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:02.341+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:02.413 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:02.414 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:02.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:19:02.441 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:02.441+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:02.542 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:02.542+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:02.553 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:02.553 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:02.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:19:02.643 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:02.644+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:02.688 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:02.688 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:02.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:19:02.743 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:02.744+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:02.823 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:02.824 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:02.833 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:19:02.877 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:02.877+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:02.945 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:02.944+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:02.959 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:02.960 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:02.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:19:03.045 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:03.046+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:03.136 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:03.136 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:03.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:19:03.147 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:03.146+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:03.247 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:03.247+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:03.311 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:03.312 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:03.321 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:19:03.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:19:03.362 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:03.362+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:03.372 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestSnapshotDeletedIo (2006 ms) 2023-01-02T18:19:03.372 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestClone 2023-01-02T18:19:03.372 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:19:03.449 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:03.449+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:03.514 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:03.514 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:03.524 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:19:03.565 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:03.565+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:03.650 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:03.651+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:03.719 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:03.719 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:03.729 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:19:03.751 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:03.752+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:03.852 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:03.852+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:03.853 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:03.854 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:03.864 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:19:03.953 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:03.953+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:03.990 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:03.990 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:04.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:19:04.085 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:04.085+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:04.155 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:04.155+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:04.165 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:04.166 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:04.176 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:19:04.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:19:04.285 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:04.285+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:04.341 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:04.341 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:04.351 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:19:04.362 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:19:04.394 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:04.395+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:04.396 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:04.417 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:04.437 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:04.456 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:04.457 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:04.457+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:04.474 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:04.493 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:04.499 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:04.499 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:04.499 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:04.499 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:04.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:19:04.512 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:04.531 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:04.533 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:19:04.533 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:19:04.533 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:19:04.533 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:19:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:19:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:19:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:19:04.534 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:19:04.594 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:04.595+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:04.658 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:04.659+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:04.679 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:04.680 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:04.680 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:04.680 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:04.680 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:04.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:19:04.776 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:04.776+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:04.858 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:04.859 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:04.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:04.859 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:04.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.859 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2 3.17 3:ece625d0:::rbd_id.image1:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:19:04.860 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:04.860 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 147.44038067, 2023-01-02T18:19:04.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001, 2023-01-02T18:19:04.860 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.860 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:04.861 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:04.861 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:04.861 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:04.861 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2 2023-01-02T18:19:04.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.862 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:04.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:04.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:04.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416794+0000", 2023-01-02T18:19:04.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1639e-05 2023-01-02T18:19:04.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416806+0000", 2023-01-02T18:19:04.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7169999999999997e-06 2023-01-02T18:19:04.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:04.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416814+0000", 2023-01-02T18:19:04.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0390000000000004e-06 2023-01-02T18:19:04.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:04.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416819+0000", 2023-01-02T18:19:04.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4200000000000003e-05 2023-01-02T18:19:04.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416873+0000", 2023-01-02T18:19:04.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5050000000000004e-06 2023-01-02T18:19:04.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:04.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416880+0000", 2023-01-02T18:19:04.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003595263 2023-01-02T18:19:04.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420475+0000", 2023-01-02T18:19:04.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5440000000000004e-06 2023-01-02T18:19:04.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:04.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420482+0000", 2023-01-02T18:19:04.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014728149999999999 2023-01-02T18:19:04.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.421955+0000", 2023-01-02T18:19:04.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5858000000000004e-05 2023-01-02T18:19:04.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:04.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.422040+0000", 2023-01-02T18:19:04.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001 2023-01-02T18:19:04.877 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.878 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:04.878 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.878 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:04.879 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:04.879 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 145.431594031, 2023-01-02T18:19:04.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997, 2023-01-02T18:19:04.879 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.879 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:04.880 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:04.880 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:04.880 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:04.880 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9 2023-01-02T18:19:04.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.881 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:04.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:04.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:04.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425580+0000", 2023-01-02T18:19:04.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1592e-05 2023-01-02T18:19:04.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425592+0000", 2023-01-02T18:19:04.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727e-05 2023-01-02T18:19:04.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:04.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425607+0000", 2023-01-02T18:19:04.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.204e-06 2023-01-02T18:19:04.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:04.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425615+0000", 2023-01-02T18:19:04.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3989000000000002e-05 2023-01-02T18:19:04.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425659+0000", 2023-01-02T18:19:04.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105519 2023-01-02T18:19:04.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:04.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425764+0000", 2023-01-02T18:19:04.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019538499999999999 2023-01-02T18:19:04.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:04.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425959+0000", 2023-01-02T18:19:04.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045306399999999998 2023-01-02T18:19:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430490+0000", 2023-01-02T18:19:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6642000000000003e-05 2023-01-02T18:19:04.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:04.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430557+0000", 2023-01-02T18:19:04.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4468999999999997e-05 2023-01-02T18:19:04.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:04.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430601+0000", 2023-01-02T18:19:04.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.025e-05 2023-01-02T18:19:04.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:04.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430631+0000", 2023-01-02T18:19:04.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997 2023-01-02T18:19:04.895 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.895 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:04.895 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.896 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:10 3.17 3:ece625d0:::rbd_id.image1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:04.896 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:04.896 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 145.42636701399999, 2023-01-02T18:19:04.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982, 2023-01-02T18:19:04.897 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.897 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:04.897 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:04.897 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:04.897 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:04.898 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10 2023-01-02T18:19:04.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.898 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:04.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:04.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:04.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430808+0000", 2023-01-02T18:19:04.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2579999999999998e-06 2023-01-02T18:19:04.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430815+0000", 2023-01-02T18:19:04.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:04.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:04.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430828+0000", 2023-01-02T18:19:04.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8730000000000004e-06 2023-01-02T18:19:04.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:04.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430834+0000", 2023-01-02T18:19:04.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6267000000000003e-05 2023-01-02T18:19:04.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430880+0000", 2023-01-02T18:19:04.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7486999999999997e-05 2023-01-02T18:19:04.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:04.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430978+0000", 2023-01-02T18:19:04.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156785 2023-01-02T18:19:04.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.431135+0000", 2023-01-02T18:19:04.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089828900000000003 2023-01-02T18:19:04.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:04.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432033+0000", 2023-01-02T18:19:04.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057836200000000002 2023-01-02T18:19:04.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:04.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432611+0000", 2023-01-02T18:19:04.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2023-01-02T18:19:04.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:04.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432649+0000", 2023-01-02T18:19:04.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4532e-05 2023-01-02T18:19:04.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:04.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432693+0000", 2023-01-02T18:19:04.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982 2023-01-02T18:19:04.914 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.914 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:04.914 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.915 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:14 3.17 3:ece625d0:::rbd_id.image1:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:04.916 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:04.916 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 145.414851868, 2023-01-02T18:19:04.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305, 2023-01-02T18:19:04.917 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.917 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:04.917 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:04.918 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:04.918 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:04.918 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 14 2023-01-02T18:19:04.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.919 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:04.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:04.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:04.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442323+0000", 2023-01-02T18:19:04.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0670000000000003e-06 2023-01-02T18:19:04.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442330+0000", 2023-01-02T18:19:04.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2111e-05 2023-01-02T18:19:04.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:04.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442342+0000", 2023-01-02T18:19:04.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5030000000000002e-06 2023-01-02T18:19:04.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:04.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442349+0000", 2023-01-02T18:19:04.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4279999999999997e-05 2023-01-02T18:19:04.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442383+0000", 2023-01-02T18:19:04.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2152999999999999e-05 2023-01-02T18:19:04.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:04.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442445+0000", 2023-01-02T18:19:04.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020234039999999999 2023-01-02T18:19:04.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:04.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.444469+0000", 2023-01-02T18:19:04.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305 2023-01-02T18:19:04.929 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.929 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:04.930 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.931 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:30 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:04.931 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:04.932 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 145.40085307000001, 2023-01-02T18:19:04.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702, 2023-01-02T18:19:04.932 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.933 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:04.933 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:04.933 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:04.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:04.934 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 30 2023-01-02T18:19:04.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.934 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:04.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:04.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:04.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456322+0000", 2023-01-02T18:19:04.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.267e-06 2023-01-02T18:19:04.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456329+0000", 2023-01-02T18:19:04.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4963999999999999e-05 2023-01-02T18:19:04.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:04.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456344+0000", 2023-01-02T18:19:04.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6860000000000006e-06 2023-01-02T18:19:04.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:04.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456352+0000", 2023-01-02T18:19:04.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1700000000000003e-05 2023-01-02T18:19:04.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456403+0000", 2023-01-02T18:19:04.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1058999999999997e-05 2023-01-02T18:19:04.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:04.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456494+0000", 2023-01-02T18:19:04.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026174 2023-01-02T18:19:04.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:04.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456756+0000", 2023-01-02T18:19:04.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057697200000000003 2023-01-02T18:19:04.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:04.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457333+0000", 2023-01-02T18:19:04.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00050206299999999997 2023-01-02T18:19:04.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:04.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457835+0000", 2023-01-02T18:19:04.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7630000000000002e-05 2023-01-02T18:19:04.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:04.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457893+0000", 2023-01-02T18:19:04.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7191000000000003e-05 2023-01-02T18:19:04.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:04.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457940+0000", 2023-01-02T18:19:04.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702 2023-01-02T18:19:04.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.948 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:04.948 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.949 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:31 3.1c 3:3d3f3250:::rbd_id.image2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:04.949 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:04.949 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 145.39909866299999, 2023-01-02T18:19:04.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002, 2023-01-02T18:19:04.950 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.950 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:04.950 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:04.950 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:04.951 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:04.951 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 31 2023-01-02T18:19:04.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.951 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:04.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:04.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:04.953 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.953 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.953 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:04.954 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:19:04.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458084+0000", 2023-01-02T18:19:04.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3246e-05 2023-01-02T18:19:04.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:04.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458097+0000", 2023-01-02T18:19:04.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6010000000000002e-06 2023-01-02T18:19:04.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:04.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458103+0000", 2023-01-02T18:19:04.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2332000000000001e-05 2023-01-02T18:19:04.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458135+0000", 2023-01-02T18:19:04.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8839999999999996e-05 2023-01-02T18:19:04.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:04.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458234+0000", 2023-01-02T18:19:04.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000148947 2023-01-02T18:19:04.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:04.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458383+0000", 2023-01-02T18:19:04.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001891876 2023-01-02T18:19:04.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:04.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460275+0000", 2023-01-02T18:19:04.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029464600000000002 2023-01-02T18:19:04.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:04.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460569+0000", 2023-01-02T18:19:04.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6334e-05 2023-01-02T18:19:04.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:04.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460626+0000", 2023-01-02T18:19:04.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7567e-05 2023-01-02T18:19:04.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:04.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460673+0000", 2023-01-02T18:19:04.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002 2023-01-02T18:19:04.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.967 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:04.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.968 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35 3.1c 3:3d3f3250:::rbd_id.image2:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:04.968 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:04.968 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 145.39011287299999, 2023-01-02T18:19:04.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134, 2023-01-02T18:19:04.969 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.969 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:04.969 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:04.969 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:04.969 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:04.969 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35 2023-01-02T18:19:04.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.970 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:04.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:04.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:04.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:04.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2440000000000004e-06 2023-01-02T18:19:04.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467067+0000", 2023-01-02T18:19:04.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1679999999999993e-06 2023-01-02T18:19:04.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:04.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467076+0000", 2023-01-02T18:19:04.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2880000000000003e-06 2023-01-02T18:19:04.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:04.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467080+0000", 2023-01-02T18:19:04.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3101e-05 2023-01-02T18:19:04.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467123+0000", 2023-01-02T18:19:04.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8630999999999999e-05 2023-01-02T18:19:04.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:04.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467212+0000", 2023-01-02T18:19:04.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020884290000000002 2023-01-02T18:19:04.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:04.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.469300+0000", 2023-01-02T18:19:04.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134 2023-01-02T18:19:04.978 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.979 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:04.979 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.979 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2821 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:04.980 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:04.980 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.522237066000002, 2023-01-02T18:19:04.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999, 2023-01-02T18:19:04.980 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.980 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:04.980 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:04.981 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:04.981 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:04.981 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2821 2023-01-02T18:19:04.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.981 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:04.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:04.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:04.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334937+0000", 2023-01-02T18:19:04.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:19:04.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334946+0000", 2023-01-02T18:19:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2023-01-02T18:19:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:04.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334961+0000", 2023-01-02T18:19:04.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:04.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:04.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334968+0000", 2023-01-02T18:19:04.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8257000000000001e-05 2023-01-02T18:19:04.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:04.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335027+0000", 2023-01-02T18:19:04.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104551 2023-01-02T18:19:04.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:04.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335131+0000", 2023-01-02T18:19:04.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024432700000000002 2023-01-02T18:19:04.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:04.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335376+0000", 2023-01-02T18:19:04.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00087122800000000004 2023-01-02T18:19:04.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:04.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.336247+0000", 2023-01-02T18:19:04.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001616592 2023-01-02T18:19:04.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:04.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337863+0000", 2023-01-02T18:19:04.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6448e-05 2023-01-02T18:19:04.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:04.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337910+0000", 2023-01-02T18:19:04.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4098999999999999e-05 2023-01-02T18:19:04.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:04.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337954+0000", 2023-01-02T18:19:04.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999 2023-01-02T18:19:04.993 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.994 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:04.994 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:04.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.994 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:2823 10.15 e101/98 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:19:04.995 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:04.995 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.517153496000006, 2023-01-02T18:19:04.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999, 2023-01-02T18:19:04.995 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:04.995 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:04.995 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:04.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:04.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:04.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:04.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:04.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:04.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:04.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:04.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340022+0000", 2023-01-02T18:19:04.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6679999999999998e-06 2023-01-02T18:19:04.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:04.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:04.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340028+0000", 2023-01-02T18:19:04.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9619999999999999e-06 2023-01-02T18:19:04.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:04.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340037+0000", 2023-01-02T18:19:05.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9020000000000002e-06 2023-01-02T18:19:05.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340044+0000", 2023-01-02T18:19:05.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121297 2023-01-02T18:19:05.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340165+0000", 2023-01-02T18:19:05.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7771e-05 2023-01-02T18:19:05.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340183+0000", 2023-01-02T18:19:05.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022034379999999998 2023-01-02T18:19:05.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342386+0000", 2023-01-02T18:19:05.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3992000000000002e-05 2023-01-02T18:19:05.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342430+0000", 2023-01-02T18:19:05.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999 2023-01-02T18:19:05.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.005 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.005 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.006 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2915 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:05.006 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:05.006 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.441895310999996, 2023-01-02T18:19:05.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001, 2023-01-02T18:19:05.006 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.007 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.007 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.007 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.007 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.007 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2915 2023-01-02T18:19:05.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.008 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:05.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:05.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415280+0000", 2023-01-02T18:19:05.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0479999999999998e-06 2023-01-02T18:19:05.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415285+0000", 2023-01-02T18:19:05.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2146e-05 2023-01-02T18:19:05.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415297+0000", 2023-01-02T18:19:05.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6869999999999994e-06 2023-01-02T18:19:05.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415305+0000", 2023-01-02T18:19:05.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7336999999999999e-05 2023-01-02T18:19:05.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415332+0000", 2023-01-02T18:19:05.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0314e-05 2023-01-02T18:19:05.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415382+0000", 2023-01-02T18:19:05.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2730000000000003e-05 2023-01-02T18:19:05.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:05.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415455+0000", 2023-01-02T18:19:05.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052884199999999996 2023-01-02T18:19:05.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415984+0000", 2023-01-02T18:19:05.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016222630000000001 2023-01-02T18:19:05.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417606+0000", 2023-01-02T18:19:05.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0604e-05 2023-01-02T18:19:05.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417637+0000", 2023-01-02T18:19:05.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.366e-05 2023-01-02T18:19:05.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417660+0000", 2023-01-02T18:19:05.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001 2023-01-02T18:19:05.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.020 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.021 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2916 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:05.021 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:05.021 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.439293844999995, 2023-01-02T18:19:05.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999, 2023-01-02T18:19:05.021 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.021 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:05.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.022 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2916 2023-01-02T18:19:05.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.023 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:05.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:05.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417881+0000", 2023-01-02T18:19:05.025 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 4] out_osds: [3, 5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:19:05.026 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:19:05.026 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2023-01-02T18:19:05.026 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2023-01-02T18:19:05.026 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2023-01-02T18:19:05.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2023-01-02T18:19:05.028 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:05.026+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:05.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7620000000000003e-06 2023-01-02T18:19:05.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417886+0000", 2023-01-02T18:19:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1369000000000001e-05 2023-01-02T18:19:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417897+0000", 2023-01-02T18:19:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6840000000000004e-06 2023-01-02T18:19:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417902+0000", 2023-01-02T18:19:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0825000000000003e-05 2023-01-02T18:19:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417943+0000", 2023-01-02T18:19:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4980000000000003e-05 2023-01-02T18:19:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.418028+0000", 2023-01-02T18:19:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014752299999999999 2023-01-02T18:19:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.419503+0000", 2023-01-02T18:19:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999 2023-01-02T18:19:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e41)", 2023-01-02T18:19:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.305004006999994, 2023-01-02T18:19:05.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312, 2023-01-02T18:19:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:05.037 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552171+0000", 2023-01-02T18:19:05.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3999999999999997e-06 2023-01-02T18:19:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552177+0000", 2023-01-02T18:19:05.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1396999999999999e-05 2023-01-02T18:19:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552189+0000", 2023-01-02T18:19:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9620000000000001e-06 2023-01-02T18:19:05.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552194+0000", 2023-01-02T18:19:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060382329999999996 2023-01-02T18:19:05.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558232+0000", 2023-01-02T18:19:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3328e-05 2023-01-02T18:19:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558245+0000", 2023-01-02T18:19:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312 2023-01-02T18:19:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.045 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected e101)", 2023-01-02T18:19:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:05.046 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.302240835999996, 2023-01-02T18:19:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999, 2023-01-02T18:19:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.047 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554934+0000", 2023-01-02T18:19:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5679999999999999e-06 2023-01-02T18:19:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554940+0000", 2023-01-02T18:19:05.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866999999999999e-05 2023-01-02T18:19:05.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554951+0000", 2023-01-02T18:19:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9819999999999999e-06 2023-01-02T18:19:05.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554956+0000", 2023-01-02T18:19:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003315634 2023-01-02T18:19:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558271+0000", 2023-01-02T18:19:05.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3561999999999997e-05 2023-01-02T18:19:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558355+0000", 2023-01-02T18:19:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999 2023-01-02T18:19:05.058 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.059 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3195 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e102)", 2023-01-02T18:19:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 88.404134267000003, 2023-01-02T18:19:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001, 2023-01-02T18:19:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.060 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3195 2023-01-02T18:19:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.061 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:05.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453040+0000", 2023-01-02T18:19:05.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0059999999999992e-06 2023-01-02T18:19:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453048+0000", 2023-01-02T18:19:05.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4034e-05 2023-01-02T18:19:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453062+0000", 2023-01-02T18:19:05.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453070+0000", 2023-01-02T18:19:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6203e-05 2023-01-02T18:19:05.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453166+0000", 2023-01-02T18:19:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012608000000000001 2023-01-02T18:19:05.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453292+0000", 2023-01-02T18:19:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019149799999999999 2023-01-02T18:19:05.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453484+0000", 2023-01-02T18:19:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074549399999999997 2023-01-02T18:19:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454229+0000", 2023-01-02T18:19:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038527599999999999 2023-01-02T18:19:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454614+0000", 2023-01-02T18:19:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0699000000000003e-05 2023-01-02T18:19:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454675+0000", 2023-01-02T18:19:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8510000000000001e-05 2023-01-02T18:19:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454724+0000", 2023-01-02T18:19:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001 2023-01-02T18:19:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3316 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+full_try e106)", 2023-01-02T18:19:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.534867946999995, 2023-01-02T18:19:05.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002, 2023-01-02T18:19:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.077 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3316 2023-01-02T18:19:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322306+0000", 2023-01-02T18:19:05.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0338e-05 2023-01-02T18:19:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322316+0000", 2023-01-02T18:19:05.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5367999999999999e-05 2023-01-02T18:19:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322332+0000", 2023-01-02T18:19:05.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0642000000000001e-05 2023-01-02T18:19:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322342+0000", 2023-01-02T18:19:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0119999999999999e-05 2023-01-02T18:19:05.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322412+0000", 2023-01-02T18:19:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0169999999999996e-06 2023-01-02T18:19:05.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322420+0000", 2023-01-02T18:19:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048005519999999996 2023-01-02T18:19:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327221+0000", 2023-01-02T18:19:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8480000000000007e-05 2023-01-02T18:19:05.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327310+0000", 2023-01-02T18:19:05.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141008 2023-01-02T18:19:05.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327451+0000", 2023-01-02T18:19:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002 2023-01-02T18:19:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.089 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3318 11.5 e106/102 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head v 106'2, mlcod=0'0)", 2023-01-02T18:19:05.090 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.528091071999995, 2023-01-02T18:19:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978, 2023-01-02T18:19:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.091 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329084+0000", 2023-01-02T18:19:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9700000000000002e-06 2023-01-02T18:19:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329091+0000", 2023-01-02T18:19:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0783e-05 2023-01-02T18:19:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329102+0000", 2023-01-02T18:19:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5800000000000003e-06 2023-01-02T18:19:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329110+0000", 2023-01-02T18:19:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102808 2023-01-02T18:19:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329213+0000", 2023-01-02T18:19:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1041999999999999e-05 2023-01-02T18:19:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329234+0000", 2023-01-02T18:19:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040932829999999996 2023-01-02T18:19:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333327+0000", 2023-01-02T18:19:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7880000000000002e-05 2023-01-02T18:19:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333375+0000", 2023-01-02T18:19:05.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978 2023-01-02T18:19:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPull(7.1e e112/111 cost 1049576)", 2023-01-02T18:19:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 76.198998285000002, 2023-01-02T18:19:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012, 2023-01-02T18:19:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.102 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658177+0000", 2023-01-02T18:19:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7961e-05 2023-01-02T18:19:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658195+0000", 2023-01-02T18:19:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7309e-05 2023-01-02T18:19:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658212+0000", 2023-01-02T18:19:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2859999999999999e-06 2023-01-02T18:19:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658220+0000", 2023-01-02T18:19:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1268999999999998e-05 2023-01-02T18:19:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658292+0000", 2023-01-02T18:19:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039592480000000003 2023-01-02T18:19:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.662251+0000", 2023-01-02T18:19:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012 2023-01-02T18:19:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3454 12.1a e121/118 12:5cea7035:::rbd_info:head v 121'1, mlcod=0'0)", 2023-01-02T18:19:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.125403511000002, 2023-01-02T18:19:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001, 2023-01-02T18:19:05.111 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:05.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:05.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731772+0000", 2023-01-02T18:19:05.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1409999999999999e-06 2023-01-02T18:19:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731779+0000", 2023-01-02T18:19:05.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6167999999999998e-05 2023-01-02T18:19:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731795+0000", 2023-01-02T18:19:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2630000000000003e-06 2023-01-02T18:19:05.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731804+0000", 2023-01-02T18:19:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018042000000000001 2023-01-02T18:19:05.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731984+0000", 2023-01-02T18:19:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1704000000000001e-05 2023-01-02T18:19:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.732006+0000", 2023-01-02T18:19:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076487370000000001 2023-01-02T18:19:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739655+0000", 2023-01-02T18:19:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5726999999999999e-05 2023-01-02T18:19:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739690+0000", 2023-01-02T18:19:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001 2023-01-02T18:19:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.121 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(7.14 133/132 [PushOp(7:2d7624f7:::rbd_id.image26:head, version: 64'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(7:2d7624f7:::rbd_id.image26:head@64'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:19:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 50.451491478999998, 2023-01-02T18:19:05.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998, 2023-01-02T18:19:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405684+0000", 2023-01-02T18:19:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2345e-05 2023-01-02T18:19:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405697+0000", 2023-01-02T18:19:05.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4418e-05 2023-01-02T18:19:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405711+0000", 2023-01-02T18:19:05.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0879999999999999e-05 2023-01-02T18:19:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405722+0000", 2023-01-02T18:19:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133447 2023-01-02T18:19:05.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405855+0000", 2023-01-02T18:19:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5799999999999992e-06 2023-01-02T18:19:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405864+0000", 2023-01-02T18:19:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022636800000000001 2023-01-02T18:19:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408128+0000", 2023-01-02T18:19:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998 2023-01-02T18:19:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.131 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:28825 3.16 3:6aa41c7b:::rbd_header.12a211eeb54d:head [watch watch cookie 140114583906128] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.830364861, 2023-01-02T18:19:05.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737, 2023-01-02T18:19:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.133 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28825 2023-01-02T18:19:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0239999999999999e-06 2023-01-02T18:19:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026815+0000", 2023-01-02T18:19:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9989999999999997e-06 2023-01-02T18:19:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026824+0000", 2023-01-02T18:19:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1080000000000003e-06 2023-01-02T18:19:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026828+0000", 2023-01-02T18:19:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1114000000000001e-05 2023-01-02T18:19:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026859+0000", 2023-01-02T18:19:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1344999999999997e-05 2023-01-02T18:19:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026910+0000", 2023-01-02T18:19:05.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104691 2023-01-02T18:19:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027015+0000", 2023-01-02T18:19:05.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00059966399999999997 2023-01-02T18:19:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027615+0000", 2023-01-02T18:19:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018614879999999999 2023-01-02T18:19:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029476+0000", 2023-01-02T18:19:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1659999999999998e-05 2023-01-02T18:19:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029508+0000", 2023-01-02T18:19:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6330999999999997e-05 2023-01-02T18:19:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029594+0000", 2023-01-02T18:19:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737 2023-01-02T18:19:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.147 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.148 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.148 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:05.148 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:19:05.150 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:05.150+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:05.251 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:05.252+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:05.276 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:05.277 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "" 2023-01-02T18:19:05.277 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:05.278 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:05.278 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:05.279 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:05.279 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:05.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:19:05.352 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:05.352+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:05.381 INFO:tasks.workunit.client.0.smithi007.stdout:made parent image "parent" 2023-01-02T18:19:05.382 INFO:tasks.workunit.client.0.smithi007.stdout:parent has no parent info 2023-01-02T18:19:05.382 INFO:tasks.workunit.client.0.smithi007.stdout:made snapshot "parent@parent_snap" 2023-01-02T18:19:05.382 INFO:tasks.workunit.client.0.smithi007.stdout:can't unprotect an unprotected snap 2023-01-02T18:19:05.382 INFO:tasks.workunit.client.0.smithi007.stdout:can't protect a protected snap 2023-01-02T18:19:05.383 INFO:tasks.workunit.client.0.smithi007.stdout:made and opened clone "child" 2023-01-02T18:19:05.383 INFO:tasks.workunit.client.0.smithi007.stdout:read: 8 2023-01-02T18:19:05.383 INFO:tasks.workunit.client.0.smithi007.stdout:read: 8 2023-01-02T18:19:05.383 INFO:tasks.workunit.client.0.smithi007.stdout:read: 8 2023-01-02T18:19:05.383 INFO:tasks.workunit.client.0.smithi007.stdout:sizes and overlaps are good between parent and child 2023-01-02T18:19:05.383 INFO:tasks.workunit.client.0.smithi007.stdout:child image successfully cloned all image-meta pairs 2023-01-02T18:19:05.384 INFO:tasks.workunit.client.0.smithi007.stdout:sized down clone, changed overlap 2023-01-02T18:19:05.384 INFO:tasks.workunit.client.0.smithi007.stdout:parent info: size 4194304 obj_size 4194304 parent_pool 18446744073709551615 2023-01-02T18:19:05.384 INFO:tasks.workunit.client.0.smithi007.stdout:sized up clone, changed size but not overlap or parent's size 2023-01-02T18:19:05.384 INFO:tasks.workunit.client.0.smithi007.stdout:can't remove parent while child still exists 2023-01-02T18:19:05.384 INFO:tasks.workunit.client.0.smithi007.stdout:can't remove parent while still protected 2023-01-02T18:19:05.385 INFO:tasks.workunit.client.0.smithi007.stdout:removed parent snap after unprotecting 2023-01-02T18:19:05.385 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestClone (2010 ms) 2023-01-02T18:19:05.385 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.TestClone2 2023-01-02T18:19:05.385 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:19:05.453 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:05.453+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:05.468 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:05.468 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:05.469 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:05.469 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:05.479 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:19:05.555 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:05.554+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:05.655 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:05.656+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:05.663 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.664 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:19:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 129.35805096799999, 2023-01-02T18:19:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:19:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.665 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:19:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.666 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:05.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:19:05.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:19:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:19:05.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:19:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:19:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:19:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:19:05.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:19:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:19:05.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:19:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:19:05.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:19:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:19:05.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:19:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:19:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:19:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:19:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:19:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:19:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:19:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:19:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:19:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:19:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:19:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:19:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:19:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.683 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:05.683 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:05.683 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.35292274699999, 2023-01-02T18:19:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:19:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.684 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:19:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:19:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:19:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:19:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:19:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:19:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:19:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:19:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:19:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:19:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:19:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:19:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:19:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:19:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:19:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:19:05.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:19:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:19:05.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:19:05.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:19:05.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:19:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:19:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:19:05.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:19:05.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:19:05.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:19:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:19:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.700 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.701 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:19:05.702 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:05.702 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 115.06285825400001, 2023-01-02T18:19:05.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:19:05.703 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.703 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:19:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:19:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:19:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:19:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:19:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:19:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:19:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:19:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:19:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:19:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:19:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:19:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:19:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:19:05.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:19:05.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:19:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:19:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:19:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:19:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:19:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:19:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:19:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:19:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:19:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:19:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:19:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:19:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.719 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:05.720 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.064132911, 2023-01-02T18:19:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:19:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.721 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:19:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.722 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:19:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:19:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:19:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:19:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:19:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:19:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:19:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:19:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:19:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:19:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:19:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:19:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:19:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:19:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:19:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:19:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:05.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:19:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:19:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:19:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:19:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:19:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:19:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:19:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:19:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:19:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:19:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.737 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:05.738 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.039771147, 2023-01-02T18:19:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:19:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:19:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:19:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:19:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:19:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:19:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:19:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:19:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:19:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:19:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:19:05.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:19:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:19:05.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:19:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:19:05.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:19:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:19:05.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:19:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:19:05.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:19:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:19:05.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:19:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:19:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:19:05.752 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.753 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.334176479000007, 2023-01-02T18:19:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:19:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.754 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:19:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.755 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:05.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:19:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:19:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:19:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:19:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:19:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:19:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:19:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:19:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:19:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:19:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:19:05.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:19:05.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:05.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:19:05.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:19:05.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:19:05.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:19:05.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:19:05.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:19:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:19:05.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:19:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:19:05.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:19:05.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.770 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.770 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3321 11.1 11:81555d77:::rbd_object_map.12a2d6b452e6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.326471411, 2023-01-02T18:19:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002, 2023-01-02T18:19:05.771 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.772 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3321 2023-01-02T18:19:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336122+0000", 2023-01-02T18:19:05.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000004e-06 2023-01-02T18:19:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336130+0000", 2023-01-02T18:19:05.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4102e-05 2023-01-02T18:19:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336144+0000", 2023-01-02T18:19:05.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8210000000000004e-06 2023-01-02T18:19:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336151+0000", 2023-01-02T18:19:05.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6598999999999998e-05 2023-01-02T18:19:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336208+0000", 2023-01-02T18:19:05.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8439999999999998e-06 2023-01-02T18:19:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336216+0000", 2023-01-02T18:19:05.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028909740000000001 2023-01-02T18:19:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339107+0000", 2023-01-02T18:19:05.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1304999999999994e-05 2023-01-02T18:19:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339198+0000", 2023-01-02T18:19:05.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030390899999999999 2023-01-02T18:19:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339502+0000", 2023-01-02T18:19:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00165285 2023-01-02T18:19:05.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341155+0000", 2023-01-02T18:19:05.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00047942200000000002 2023-01-02T18:19:05.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341634+0000", 2023-01-02T18:19:05.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1620999999999998e-05 2023-01-02T18:19:05.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341696+0000", 2023-01-02T18:19:05.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0988999999999997e-05 2023-01-02T18:19:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341737+0000", 2023-01-02T18:19:05.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002 2023-01-02T18:19:05.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.788 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.789 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:19:05.790 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:05.790 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.281768662000005, 2023-01-02T18:19:05.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:19:05.791 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.791 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.791 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.791 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:19:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:05.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:05.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:19:05.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:19:05.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:19:05.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:19:05.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:19:05.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:19:05.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:19:05.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:19:05.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:19:05.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:19:05.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:19:05.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:19:05.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:05.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:19:05.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:19:05.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:19:05.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:19:05.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:19:05.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:19:05.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:19:05.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:19:05.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:19:05.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:19:05.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.805 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.805 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.806 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:19:05.806 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:05.806 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 76.251439145999996, 2023-01-02T18:19:05.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:19:05.807 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.807 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.807 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.807 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.807 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.808 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:19:05.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.808 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:05.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:05.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:05.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:19:05.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:19:05.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:19:05.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:19:05.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:19:05.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:19:05.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:19:05.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:19:05.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:19:05.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:19:05.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:19:05.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:19:05.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:05.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:19:05.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:19:05.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:19:05.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:19:05.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:19:05.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:19:05.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:19:05.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:19:05.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:19:05.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:19:05.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.822 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.823 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.823 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:19:05.823 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:05.824 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.150992481000003, 2023-01-02T18:19:05.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:19:05.824 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.824 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.825 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.825 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.825 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:19:05.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.825 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:05.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:05.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:19:05.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:19:05.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:19:05.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:19:05.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:19:05.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:19:05.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:19:05.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:19:05.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:19:05.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:19:05.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:19:05.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:19:05.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:05.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:19:05.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:19:05.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:19:05.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:19:05.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:19:05.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:19:05.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:19:05.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:19:05.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:19:05.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:19:05.840 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.840 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.840 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.840 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:19:05.841 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:05.841 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.795455234999999, 2023-01-02T18:19:05.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:19:05.841 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.841 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.842 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.842 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.842 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.842 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:19:05.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.842 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:05.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:05.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:05.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:19:05.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:19:05.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:19:05.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:19:05.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:19:05.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:19:05.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:19:05.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:19:05.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:19:05.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:19:05.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:19:05.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:19:05.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:19:05.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:19:05.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:19:05.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:19:05.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:05.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:19:05.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:19:05.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:19:05.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:19:05.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:19:05.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:19:05.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:19:05.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:19:05.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:19:05.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:19:05.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.859 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.859 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.860 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:19:05.860 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:05.860 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.784550592000002, 2023-01-02T18:19:05.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:19:05.860 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.861 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:05.861 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.861 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.861 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.861 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:19:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:05.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:19:05.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:19:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:19:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:19:05.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:19:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:19:05.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:19:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:19:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:19:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:19:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:19:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:19:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:19:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:19:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:19:05.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:19:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:19:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:19:05.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:19:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:19:05.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:19:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:19:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:19:05.873 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.874 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:19:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 46.758607753, 2023-01-02T18:19:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:19:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.875 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:19:05.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:05.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:05.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:19:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:19:05.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:19:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:19:05.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:19:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:19:05.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:19:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:19:05.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:19:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:19:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:19:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:19:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:19:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:19:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:19:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:19:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:19:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:19:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:19:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:19:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:19:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:19:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:19:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:19:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:19:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:19:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.891 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:19:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 43.983830638000001, 2023-01-02T18:19:05.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:19:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.893 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:19:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:19:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:19:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:19:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:19:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:19:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:19:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:19:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:19:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:19:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:19:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:19:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:19:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:19:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:19:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:19:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:19:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:19:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:19:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.905 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:19:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 42.939325605000001, 2023-01-02T18:19:05.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:19:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.907 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:19:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:19:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:19:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:19:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:19:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:19:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:19:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:19:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:19:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:19:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:19:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:19:05.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:19:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:19:05.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:19:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:19:05.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:19:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:19:05.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:19:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:19:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:19:05.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:19:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:19:05.920 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.921 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.738342349, 2023-01-02T18:19:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:19:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.922 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:19:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.923 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:05.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:19:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:19:05.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:19:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:19:05.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:19:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:19:05.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:19:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:19:05.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:19:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:19:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:19:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:19:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:19:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:19:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:19:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:19:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:19:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:19:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:19:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:19:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:19:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:19:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.936 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:05.937 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.537089645999998, 2023-01-02T18:19:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:19:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.938 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:19:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:19:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:19:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:19:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:19:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:19:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:19:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:19:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:19:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:19:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:19:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:19:05.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:19:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:19:05.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:19:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:19:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:19:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:19:05.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:19:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:19:05.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:19:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:19:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:19:05.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35555 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [read 45056~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e149)", 2023-01-02T18:19:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.265263181000002, 2023-01-02T18:19:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997, 2023-01-02T18:19:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.953 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35555 2023-01-02T18:19:05.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:05.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5999999999999998e-06 2023-01-02T18:19:05.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397335+0000", 2023-01-02T18:19:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0539999999999997e-06 2023-01-02T18:19:05.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397342+0000", 2023-01-02T18:19:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2090000000000001e-06 2023-01-02T18:19:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397345+0000", 2023-01-02T18:19:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5210000000000002e-05 2023-01-02T18:19:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397401+0000", 2023-01-02T18:19:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8177999999999996e-05 2023-01-02T18:19:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397479+0000", 2023-01-02T18:19:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052113059999999998 2023-01-02T18:19:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.402690+0000", 2023-01-02T18:19:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997 2023-01-02T18:19:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.963 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:10838 3.d e156/147 3:b21fdca0:::rbd_id.image57:head v 156'10, mlcod=137'8)", 2023-01-02T18:19:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:05.964 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.295834060000001, 2023-01-02T18:19:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489, 2023-01-02T18:19:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:05.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8000000000000001e-06 2023-01-02T18:19:05.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366767+0000", 2023-01-02T18:19:05.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0953e-05 2023-01-02T18:19:05.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366778+0000", 2023-01-02T18:19:05.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8860000000000003e-06 2023-01-02T18:19:05.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366783+0000", 2023-01-02T18:19:05.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3716e-05 2023-01-02T18:19:05.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366827+0000", 2023-01-02T18:19:05.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3964999999999998e-05 2023-01-02T18:19:05.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366851+0000", 2023-01-02T18:19:05.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054574560000000003 2023-01-02T18:19:05.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372308+0000", 2023-01-02T18:19:05.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2353e-05 2023-01-02T18:19:05.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372341+0000", 2023-01-02T18:19:05.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489 2023-01-02T18:19:05.977 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.977 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.977 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.978 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54804 3.17 3:ec8e444a:::rbd_header.12a28f082913:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:05.978 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:05.978 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.2887694170000001, 2023-01-02T18:19:05.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001, 2023-01-02T18:19:05.979 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:05.979 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:05.979 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:05.979 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:05.979 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:05.980 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54804 2023-01-02T18:19:05.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.980 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:05.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:05.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:05.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:05.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:05.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:05.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:05.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:05.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373824+0000", 2023-01-02T18:19:05.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9380000000000004e-06 2023-01-02T18:19:05.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:05.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373834+0000", 2023-01-02T18:19:05.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6818999999999999e-05 2023-01-02T18:19:05.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:05.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373851+0000", 2023-01-02T18:19:05.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.481e-06 2023-01-02T18:19:05.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:05.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373858+0000", 2023-01-02T18:19:05.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2268999999999998e-05 2023-01-02T18:19:05.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373900+0000", 2023-01-02T18:19:05.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1660000000000002e-06 2023-01-02T18:19:05.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:05.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373906+0000", 2023-01-02T18:19:05.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060814570000000002 2023-01-02T18:19:05.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:05.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.379987+0000", 2023-01-02T18:19:05.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015394200000000001 2023-01-02T18:19:05.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:05.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380141+0000", 2023-01-02T18:19:05.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026425999999999999 2023-01-02T18:19:05.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:05.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380405+0000", 2023-01-02T18:19:05.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00098840499999999993 2023-01-02T18:19:05.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:05.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381394+0000", 2023-01-02T18:19:05.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1028e-05 2023-01-02T18:19:05.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:05.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381405+0000", 2023-01-02T18:19:05.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9657999999999997e-05 2023-01-02T18:19:05.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:05.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381464+0000", 2023-01-02T18:19:05.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1522e-05 2023-01-02T18:19:05.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:05.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:05.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:05.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381506+0000", 2023-01-02T18:19:05.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001 2023-01-02T18:19:05.996 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.996 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.996 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.996 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:05.996 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:05.997 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:05.998 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:19:05.999 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:05.998+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:06.099 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:06.099+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:06.168 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:06.169 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:06.169 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:06.169 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:06.178 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:19:06.222 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:06.223+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:06.302 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:06.302+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:06.303 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:06.303 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:06.304 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:06.304 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:06.304 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:06.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:19:06.374 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:19:06.403 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:06.404+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:06.496 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:06.496 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:06.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:06.497 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:06.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.497 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:19:06.497 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:06.498 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 139.17717304199999, 2023-01-02T18:19:06.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:19:06.498 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.498 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.498 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.499 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.499 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:19:06.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.499 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:06.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:06.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:06.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:19:06.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:19:06.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:19:06.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:19:06.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:19:06.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:19:06.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:19:06.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:19:06.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:19:06.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:06.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:06.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:19:06.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:19:06.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:19:06.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:19:06.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:19:06.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:19:06.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:06.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:19:06.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:19:06.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:19:06.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:19:06.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:19:06.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:19:06.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:19:06.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:19:06.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:19:06.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:19:06.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.514 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.514 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:19:06.515 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:06.515 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 134.16208958600001, 2023-01-02T18:19:06.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:19:06.515 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.515 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.516 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:19:06.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.517 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:06.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:06.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:06.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:19:06.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:19:06.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:19:06.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:19:06.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:19:06.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:19:06.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:19:06.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:19:06.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:19:06.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:19:06.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:19:06.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:19:06.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:19:06.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:19:06.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:19:06.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:19:06.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:06.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:19:06.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:19:06.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:19:06.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:19:06.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:19:06.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:19:06.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:19:06.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:19:06.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:19:06.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:19:06.531 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.531 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.531 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.532 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:06.532 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:06.532 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.177392009, 2023-01-02T18:19:06.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:19:06.532 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.533 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.533 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.533 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:19:06.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.534 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:06.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:06.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:06.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:19:06.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:19:06.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:19:06.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:19:06.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:19:06.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:19:06.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:19:06.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:19:06.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:19:06.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:19:06.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:19:06.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:19:06.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:19:06.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:19:06.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:19:06.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:19:06.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:06.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:19:06.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:19:06.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:19:06.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:19:06.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:19:06.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:19:06.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:19:06.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:19:06.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:19:06.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:19:06.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.548 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.548 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.549 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:19:06.549 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:06.549 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.179367318, 2023-01-02T18:19:06.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:19:06.550 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.550 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.550 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.551 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:19:06.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.551 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:06.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:06.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:06.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:19:06.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:19:06.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:19:06.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:19:06.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:19:06.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:19:06.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:19:06.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:19:06.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:19:06.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:19:06.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:19:06.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:19:06.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:19:06.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:19:06.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:19:06.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:19:06.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:06.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:19:06.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:19:06.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:19:06.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:19:06.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:19:06.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:19:06.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:19:06.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:19:06.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:19:06.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:19:06.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.565 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.566 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:19:06.566 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:06.566 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.178308864, 2023-01-02T18:19:06.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:19:06.567 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.568 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:19:06.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.568 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:06.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:06.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:06.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:19:06.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:19:06.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:19:06.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:19:06.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:19:06.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:19:06.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:19:06.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:19:06.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:19:06.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:19:06.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:19:06.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:19:06.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:19:06.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:19:06.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:19:06.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:19:06.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:06.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:19:06.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:19:06.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:19:06.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:19:06.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:19:06.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:19:06.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:19:06.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:19:06.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:19:06.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:19:06.582 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.582 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.582 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.583 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:19:06.583 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:06.583 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.17294421699999, 2023-01-02T18:19:06.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:19:06.584 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.584 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.584 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.585 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:19:06.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.585 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:06.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:06.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:06.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:19:06.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:19:06.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:19:06.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:19:06.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:19:06.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:19:06.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:19:06.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:19:06.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:19:06.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:19:06.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:19:06.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:19:06.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:19:06.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:19:06.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:19:06.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:19:06.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:06.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:19:06.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:19:06.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:19:06.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:19:06.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:19:06.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:19:06.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.598 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:19:06.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:19:06.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:19:06.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:19:06.599 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.599 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.600 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.600 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2191 3.13 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:19:06.600 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:06.600 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.155105603, 2023-01-02T18:19:06.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996, 2023-01-02T18:19:06.601 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.601 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.601 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.601 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.602 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.602 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2191 2023-01-02T18:19:06.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.602 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:06.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:06.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:06.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340115+0000", 2023-01-02T18:19:06.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2921999999999999e-05 2023-01-02T18:19:06.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340128+0000", 2023-01-02T18:19:06.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9213000000000001e-05 2023-01-02T18:19:06.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340147+0000", 2023-01-02T18:19:06.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0695e-05 2023-01-02T18:19:06.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340158+0000", 2023-01-02T18:19:06.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1227000000000001e-05 2023-01-02T18:19:06.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340229+0000", 2023-01-02T18:19:06.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7239999999999992e-06 2023-01-02T18:19:06.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340237+0000", 2023-01-02T18:19:06.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001423248 2023-01-02T18:19:06.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341660+0000", 2023-01-02T18:19:06.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158319 2023-01-02T18:19:06.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341818+0000", 2023-01-02T18:19:06.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019205099999999999 2023-01-02T18:19:06.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:06.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.342011+0000", 2023-01-02T18:19:06.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001641558 2023-01-02T18:19:06.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.343652+0000", 2023-01-02T18:19:06.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001445895 2023-01-02T18:19:06.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345098+0000", 2023-01-02T18:19:06.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4589000000000003e-05 2023-01-02T18:19:06.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.615 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.615 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345143+0000", 2023-01-02T18:19:06.615 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9351000000000001e-05 2023-01-02T18:19:06.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345172+0000", 2023-01-02T18:19:06.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996 2023-01-02T18:19:06.616 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.617 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.617 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.617 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:19:06.618 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:06.618 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.132612717, 2023-01-02T18:19:06.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:19:06.618 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.618 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.618 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.619 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.619 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.619 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:19:06.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.619 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:06.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:06.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:06.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:19:06.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:19:06.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:19:06.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:19:06.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:19:06.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:19:06.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:19:06.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:19:06.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:19:06.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:19:06.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:19:06.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:19:06.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:19:06.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:19:06.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:19:06.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:19:06.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:06.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:19:06.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:19:06.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:19:06.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:19:06.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:19:06.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:19:06.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:19:06.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:19:06.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:19:06.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:19:06.633 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.634 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.634 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:06.635 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:06.635 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.128042467, 2023-01-02T18:19:06.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:19:06.635 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.635 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.636 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:19:06.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.636 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:06.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:06.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:06.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:19:06.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:19:06.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:19:06.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:19:06.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:19:06.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:19:06.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:19:06.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:19:06.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:19:06.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:19:06.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:19:06.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:19:06.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:19:06.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:19:06.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:19:06.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:19:06.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:06.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:19:06.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:19:06.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:19:06.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:19:06.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:19:06.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:19:06.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:19:06.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:19:06.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:19:06.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:19:06.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.651 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.651 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.652 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:19:06.652 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:06.652 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.115210450999996, 2023-01-02T18:19:06.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:19:06.652 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.653 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.653 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.653 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.653 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.653 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:19:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:06.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:19:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:19:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:19:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:19:06.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:19:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:19:06.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:19:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:19:06.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:19:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:19:06.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:19:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:19:06.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:19:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:19:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:19:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:19:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:19:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:19:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:19:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:19:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:19:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:19:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:19:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:19:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:19:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:19:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:19:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.166476951999996, 2023-01-02T18:19:06.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:19:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.670 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:19:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:19:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:19:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:19:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:19:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:19:06.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:19:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:19:06.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:19:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:19:06.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:19:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:19:06.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:19:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:19:06.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:19:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:19:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:19:06.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:19:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:19:06.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:19:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:19:06.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:19:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:19:06.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:19:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:19:06.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:19:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:19:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.685 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.686 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.686 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:06.686 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:06.687 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 87.166633898000001, 2023-01-02T18:19:06.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:19:06.687 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.687 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.687 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.688 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.688 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.688 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:19:06.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.688 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:06.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:06.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:06.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:19:06.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:19:06.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:19:06.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:19:06.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:19:06.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:19:06.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:19:06.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:19:06.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:19:06.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:19:06.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:19:06.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:19:06.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:19:06.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:19:06.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:19:06.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:19:06.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:19:06.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:19:06.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:19:06.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:19:06.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:19:06.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:19:06.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:19:06.700 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.701 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.701 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.701 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:06.702 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:06.702 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.623594674000003, 2023-01-02T18:19:06.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:19:06.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.702 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.703 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:19:06.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.703 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:06.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:06.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:06.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:19:06.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:19:06.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:19:06.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:19:06.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:19:06.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:19:06.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:19:06.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:19:06.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:19:06.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:19:06.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:19:06.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:19:06.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:06.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:19:06.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:19:06.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:19:06.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:19:06.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:19:06.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:19:06.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:19:06.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:19:06.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:19:06.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:19:06.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.716 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.716 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.717 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:06.717 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:06.717 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.128987931999999, 2023-01-02T18:19:06.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:19:06.718 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.718 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.718 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.718 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.718 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.719 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:19:06.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.719 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:06.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:19:06.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:19:06.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:19:06.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:19:06.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:19:06.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:19:06.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:19:06.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:19:06.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:19:06.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:19:06.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:19:06.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:19:06.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:06.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:19:06.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:19:06.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:19:06.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:19:06.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:19:06.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:19:06.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:19:06.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:19:06.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:19:06.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:19:06.731 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.731 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.731 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.732 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10841 3.d 3:b21fdca0:::rbd_id.image57:head [stat] snapc 0=[] ondisk+read+known_if_redirected e157)", 2023-01-02T18:19:06.732 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:06.732 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.783783084, 2023-01-02T18:19:06.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048345949999999997, 2023-01-02T18:19:06.733 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.733 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:06.733 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.733 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:06.734 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:06.734 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10841 2023-01-02T18:19:06.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.734 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:06.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:06.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:06.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711438+0000", 2023-01-02T18:19:06.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3810000000000005e-06 2023-01-02T18:19:06.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711448+0000", 2023-01-02T18:19:06.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7039000000000001e-05 2023-01-02T18:19:06.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711465+0000", 2023-01-02T18:19:06.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2190000000000001e-06 2023-01-02T18:19:06.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711471+0000", 2023-01-02T18:19:06.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6118999999999997e-05 2023-01-02T18:19:06.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711517+0000", 2023-01-02T18:19:06.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2149999999999998e-06 2023-01-02T18:19:06.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711523+0000", 2023-01-02T18:19:06.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045723059999999999 2023-01-02T18:19:06.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716096+0000", 2023-01-02T18:19:06.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6606000000000004e-05 2023-01-02T18:19:06.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716182+0000", 2023-01-02T18:19:06.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2539000000000003e-05 2023-01-02T18:19:06.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716275+0000", 2023-01-02T18:19:06.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048345949999999997 2023-01-02T18:19:06.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.744 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.745 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54769 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e160)", 2023-01-02T18:19:06.745 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:06.745 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.155293232, 2023-01-02T18:19:06.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999, 2023-01-02T18:19:06.746 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.746 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.746 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.746 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.747 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.747 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54769 2023-01-02T18:19:06.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.747 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:06.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:06.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:06.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339928+0000", 2023-01-02T18:19:06.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0937e-05 2023-01-02T18:19:06.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339939+0000", 2023-01-02T18:19:06.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8923000000000002e-05 2023-01-02T18:19:06.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339958+0000", 2023-01-02T18:19:06.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4999999999999999e-06 2023-01-02T18:19:06.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339966+0000", 2023-01-02T18:19:06.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1886999999999999e-05 2023-01-02T18:19:06.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340028+0000", 2023-01-02T18:19:06.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9189999999999999e-06 2023-01-02T18:19:06.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340036+0000", 2023-01-02T18:19:06.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012331458999999999 2023-01-02T18:19:06.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352367+0000", 2023-01-02T18:19:06.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5671000000000001e-05 2023-01-02T18:19:06.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352443+0000", 2023-01-02T18:19:06.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028359799999999998 2023-01-02T18:19:06.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:06.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352727+0000", 2023-01-02T18:19:06.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089580699999999998 2023-01-02T18:19:06.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353622+0000", 2023-01-02T18:19:06.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163995 2023-01-02T18:19:06.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353786+0000", 2023-01-02T18:19:06.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7710000000000002e-05 2023-01-02T18:19:06.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353834+0000", 2023-01-02T18:19:06.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3380999999999999e-05 2023-01-02T18:19:06.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353857+0000", 2023-01-02T18:19:06.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999 2023-01-02T18:19:06.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.761 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.762 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.762 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54785 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:06.762 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:06.763 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1516255009999998, 2023-01-02T18:19:06.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348, 2023-01-02T18:19:06.763 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.763 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.763 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.764 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.764 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.764 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54785 2023-01-02T18:19:06.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.764 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:06.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:06.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:06.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343595+0000", 2023-01-02T18:19:06.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2480000000000002e-06 2023-01-02T18:19:06.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343605+0000", 2023-01-02T18:19:06.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6588000000000001e-05 2023-01-02T18:19:06.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343621+0000", 2023-01-02T18:19:06.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2490000000000004e-06 2023-01-02T18:19:06.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343629+0000", 2023-01-02T18:19:06.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3723000000000001e-05 2023-01-02T18:19:06.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343672+0000", 2023-01-02T18:19:06.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.04e-06 2023-01-02T18:19:06.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343677+0000", 2023-01-02T18:19:06.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054799280000000002 2023-01-02T18:19:06.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349157+0000", 2023-01-02T18:19:06.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010108299999999999 2023-01-02T18:19:06.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349258+0000", 2023-01-02T18:19:06.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000406179 2023-01-02T18:19:06.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:06.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349665+0000", 2023-01-02T18:19:06.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051027499999999996 2023-01-02T18:19:06.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354767+0000", 2023-01-02T18:19:06.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000482819 2023-01-02T18:19:06.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355250+0000", 2023-01-02T18:19:06.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7871999999999998e-05 2023-01-02T18:19:06.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355298+0000", 2023-01-02T18:19:06.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6105e-05 2023-01-02T18:19:06.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355344+0000", 2023-01-02T18:19:06.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348 2023-01-02T18:19:06.779 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.779 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.779 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.780 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54793 3.12 3:48f2e415:::rbd_object_map.12a21a1bf873:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:06.780 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:06.780 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1358838530000002, 2023-01-02T18:19:06.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048462100000000001, 2023-01-02T18:19:06.780 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.781 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.781 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.781 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54793 2023-01-02T18:19:06.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.782 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:06.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:06.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:06.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359338+0000", 2023-01-02T18:19:06.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5590000000000002e-06 2023-01-02T18:19:06.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359345+0000", 2023-01-02T18:19:06.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4041e-05 2023-01-02T18:19:06.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359359+0000", 2023-01-02T18:19:06.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8009999999999998e-06 2023-01-02T18:19:06.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359366+0000", 2023-01-02T18:19:06.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7101000000000002e-05 2023-01-02T18:19:06.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359413+0000", 2023-01-02T18:19:06.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0733e-05 2023-01-02T18:19:06.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359504+0000", 2023-01-02T18:19:06.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018615799999999999 2023-01-02T18:19:06.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:06.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359690+0000", 2023-01-02T18:19:06.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000870461 2023-01-02T18:19:06.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.360560+0000", 2023-01-02T18:19:06.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035062750000000001 2023-01-02T18:19:06.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364066+0000", 2023-01-02T18:19:06.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7508000000000005e-05 2023-01-02T18:19:06.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364134+0000", 2023-01-02T18:19:06.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1615e-05 2023-01-02T18:19:06.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364186+0000", 2023-01-02T18:19:06.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048462100000000001 2023-01-02T18:19:06.794 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.794 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.794 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.795 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56246 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:06.795 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:06.795 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.85022437799999995, 2023-01-02T18:19:06.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998, 2023-01-02T18:19:06.796 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.796 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.796 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.796 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.796 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.797 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56246 2023-01-02T18:19:06.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.797 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:06.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:06.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:06.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644998+0000", 2023-01-02T18:19:06.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2189999999999998e-06 2023-01-02T18:19:06.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645002+0000", 2023-01-02T18:19:06.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0909999999999993e-06 2023-01-02T18:19:06.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645010+0000", 2023-01-02T18:19:06.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6880000000000001e-06 2023-01-02T18:19:06.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645014+0000", 2023-01-02T18:19:06.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6795999999999998e-05 2023-01-02T18:19:06.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645051+0000", 2023-01-02T18:19:06.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000001e-05 2023-01-02T18:19:06.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645135+0000", 2023-01-02T18:19:06.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199557 2023-01-02T18:19:06.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:06.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645335+0000", 2023-01-02T18:19:06.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00070655299999999996 2023-01-02T18:19:06.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.646041+0000", 2023-01-02T18:19:06.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047206009999999996 2023-01-02T18:19:06.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650762+0000", 2023-01-02T18:19:06.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5790999999999997e-05 2023-01-02T18:19:06.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650798+0000", 2023-01-02T18:19:06.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4202999999999997e-05 2023-01-02T18:19:06.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650842+0000", 2023-01-02T18:19:06.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998 2023-01-02T18:19:06.809 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.809 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.810 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56449 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", 2023-01-02T18:19:06.810 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:06.811 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 0.12583063799999999, 2023-01-02T18:19:06.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305, 2023-01-02T18:19:06.811 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:06.811 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:06.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:06.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:06.812 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:06.812 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56449 2023-01-02T18:19:06.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.812 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:06.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:06.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:06.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:06.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:06.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:06.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:06.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:06.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369390+0000", 2023-01-02T18:19:06.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1600000000000001e-05 2023-01-02T18:19:06.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:06.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369402+0000", 2023-01-02T18:19:06.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8179999999999999e-05 2023-01-02T18:19:06.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:06.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369420+0000", 2023-01-02T18:19:06.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.951e-06 2023-01-02T18:19:06.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:06.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369427+0000", 2023-01-02T18:19:06.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8652999999999995e-05 2023-01-02T18:19:06.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369496+0000", 2023-01-02T18:19:06.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1131000000000001e-05 2023-01-02T18:19:06.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:06.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369507+0000", 2023-01-02T18:19:06.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010015711 2023-01-02T18:19:06.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:06.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379523+0000", 2023-01-02T18:19:06.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017405799999999999 2023-01-02T18:19:06.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:06.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379697+0000", 2023-01-02T18:19:06.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097878599999999994 2023-01-02T18:19:06.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:06.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.380675+0000", 2023-01-02T18:19:06.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090579699999999996 2023-01-02T18:19:06.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:06.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.381581+0000", 2023-01-02T18:19:06.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062692200000000003 2023-01-02T18:19:06.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:06.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382208+0000", 2023-01-02T18:19:06.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1279000000000003e-05 2023-01-02T18:19:06.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:06.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382239+0000", 2023-01-02T18:19:06.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4488e-05 2023-01-02T18:19:06.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:06.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:06.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:06.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382264+0000", 2023-01-02T18:19:06.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305 2023-01-02T18:19:06.826 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.826 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.826 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.826 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:06.826 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:06.827 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:06.827 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:19:06.828 INFO:tasks.workunit.client.0.smithi007.stdout:made parent image "parent" 2023-01-02T18:19:06.828 INFO:tasks.workunit.client.0.smithi007.stdout:parent has no parent info 2023-01-02T18:19:06.829 INFO:tasks.workunit.client.0.smithi007.stdout:made snapshot "parent@parent_snap" 2023-01-02T18:19:06.829 INFO:tasks.workunit.client.0.smithi007.stdout:made and opened clone "child" 2023-01-02T18:19:06.829 INFO:tasks.workunit.client.0.smithi007.stdout:child image successfully cloned all image-meta pairs 2023-01-02T18:19:06.829 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.TestClone2 (1125 ms) 2023-01-02T18:19:06.829 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.ListChildren 2023-01-02T18:19:06.830 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:06.828+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:06.831 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:19:06.929 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:06.930+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:06.959 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:06.959 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:06.960 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:19:06.960 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:06.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:19:06.973 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:06.990 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:07.009 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:07.026 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:07.030 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:07.030+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:07.044 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:07.061 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:07.079 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:07.096 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:07.096 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:07.096 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:07.098 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:19:07.098 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:19:07.098 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:19:07.098 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:19:07.099 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:19:07.099 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:19:07.099 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:19:07.099 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:19:07.107 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:19:07.152 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:07.151+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:07.231 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:07.232+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:07.274 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:07.274 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:07.284 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:19:07.333 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:07.333+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:07.391 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:19:07.422 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:07.423 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:07.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:19:07.434 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:07.435+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:07.535 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:07.535+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:07.599 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:07.600 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:07.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:19:07.636 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:07.637+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:07.737 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:07.737+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:07.776 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:07.776 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:07.786 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:19:07.838 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:07.838+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:07.939 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:07.939+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:07.952 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:07.952 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:07.962 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:19:08.040 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:08.040+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:08.087 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:08.088 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:08.098 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:19:08.142 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:08.142+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:08.223 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:08.224 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:08.234 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:19:08.241 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:08.242+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:08.342 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:08.342+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:08.417 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:08.417 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:08.427 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:19:08.442 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:08.443+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:08.543 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:08.544+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:08.553 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:08.553 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:08.563 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:19:08.644 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:08.644+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:08.689 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:08.690 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:08.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:19:08.746 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:08.746+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:08.839 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:08.839 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:08.846 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:08.847+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:08.849 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:19:08.947 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:08.947+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:09.014 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:09.015 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:09.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:19:09.048 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:09.048+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:09.110 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:19:09.150 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:09.150 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:09.154 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:09.154+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:09.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:19:09.251 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:09.251+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:09.254 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:09.272 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:09.285 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:09.286 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:09.288 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:09.295 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:19:09.306 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:09.324 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:09.351 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:09.351+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:09.352 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:09.370 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:09.388 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:19:09.389 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:19:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:19:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:19:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:19:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:19:09.390 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:19:09.391 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:19:09.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:19:09.452 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:09.453+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:09.467 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:09.467 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:09.467 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:09.467 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:09.467 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:09.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:19:09.554 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:09.553+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:09.644 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:09.644 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:09.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:09.645 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:09.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.645 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2 3.17 3:ece625d0:::rbd_id.image1:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:19:09.646 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:09.646 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 152.22686514, 2023-01-02T18:19:09.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001, 2023-01-02T18:19:09.646 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.646 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:09.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.647 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.648 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2 2023-01-02T18:19:09.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.648 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:09.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:09.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:09.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416794+0000", 2023-01-02T18:19:09.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1639e-05 2023-01-02T18:19:09.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416806+0000", 2023-01-02T18:19:09.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7169999999999997e-06 2023-01-02T18:19:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416814+0000", 2023-01-02T18:19:09.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0390000000000004e-06 2023-01-02T18:19:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416819+0000", 2023-01-02T18:19:09.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4200000000000003e-05 2023-01-02T18:19:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416873+0000", 2023-01-02T18:19:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5050000000000004e-06 2023-01-02T18:19:09.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:09.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416880+0000", 2023-01-02T18:19:09.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003595263 2023-01-02T18:19:09.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420475+0000", 2023-01-02T18:19:09.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5440000000000004e-06 2023-01-02T18:19:09.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:09.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420482+0000", 2023-01-02T18:19:09.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014728149999999999 2023-01-02T18:19:09.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.421955+0000", 2023-01-02T18:19:09.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5858000000000004e-05 2023-01-02T18:19:09.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.422040+0000", 2023-01-02T18:19:09.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001 2023-01-02T18:19:09.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.664 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.665 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:09.665 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:09.665 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 150.21807850100001, 2023-01-02T18:19:09.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997, 2023-01-02T18:19:09.666 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.666 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.666 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.667 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9 2023-01-02T18:19:09.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.667 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:09.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:09.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:09.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425580+0000", 2023-01-02T18:19:09.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1592e-05 2023-01-02T18:19:09.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425592+0000", 2023-01-02T18:19:09.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727e-05 2023-01-02T18:19:09.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425607+0000", 2023-01-02T18:19:09.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.204e-06 2023-01-02T18:19:09.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425615+0000", 2023-01-02T18:19:09.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3989000000000002e-05 2023-01-02T18:19:09.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425659+0000", 2023-01-02T18:19:09.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105519 2023-01-02T18:19:09.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425764+0000", 2023-01-02T18:19:09.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019538499999999999 2023-01-02T18:19:09.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:09.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425959+0000", 2023-01-02T18:19:09.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045306399999999998 2023-01-02T18:19:09.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:09.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430490+0000", 2023-01-02T18:19:09.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6642000000000003e-05 2023-01-02T18:19:09.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:09.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430557+0000", 2023-01-02T18:19:09.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4468999999999997e-05 2023-01-02T18:19:09.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430601+0000", 2023-01-02T18:19:09.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.025e-05 2023-01-02T18:19:09.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430631+0000", 2023-01-02T18:19:09.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997 2023-01-02T18:19:09.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.683 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.684 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:10 3.17 3:ece625d0:::rbd_id.image1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:09.684 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:09.684 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 150.212851484, 2023-01-02T18:19:09.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982, 2023-01-02T18:19:09.685 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.685 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.685 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.686 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.686 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.686 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10 2023-01-02T18:19:09.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.687 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:09.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:09.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:09.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430808+0000", 2023-01-02T18:19:09.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2579999999999998e-06 2023-01-02T18:19:09.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430815+0000", 2023-01-02T18:19:09.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:09.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430828+0000", 2023-01-02T18:19:09.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8730000000000004e-06 2023-01-02T18:19:09.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430834+0000", 2023-01-02T18:19:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6267000000000003e-05 2023-01-02T18:19:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430880+0000", 2023-01-02T18:19:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7486999999999997e-05 2023-01-02T18:19:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430978+0000", 2023-01-02T18:19:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156785 2023-01-02T18:19:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.431135+0000", 2023-01-02T18:19:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089828900000000003 2023-01-02T18:19:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432033+0000", 2023-01-02T18:19:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057836200000000002 2023-01-02T18:19:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432611+0000", 2023-01-02T18:19:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2023-01-02T18:19:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432649+0000", 2023-01-02T18:19:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4532e-05 2023-01-02T18:19:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432693+0000", 2023-01-02T18:19:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982 2023-01-02T18:19:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.700 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:14 3.17 3:ece625d0:::rbd_id.image1:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:09.701 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 150.201336338, 2023-01-02T18:19:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305, 2023-01-02T18:19:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:09.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 14 2023-01-02T18:19:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.703 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:09.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442323+0000", 2023-01-02T18:19:09.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0670000000000003e-06 2023-01-02T18:19:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442330+0000", 2023-01-02T18:19:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2111e-05 2023-01-02T18:19:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442342+0000", 2023-01-02T18:19:09.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5030000000000002e-06 2023-01-02T18:19:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442349+0000", 2023-01-02T18:19:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4279999999999997e-05 2023-01-02T18:19:09.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442383+0000", 2023-01-02T18:19:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2152999999999999e-05 2023-01-02T18:19:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442445+0000", 2023-01-02T18:19:09.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020234039999999999 2023-01-02T18:19:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.444469+0000", 2023-01-02T18:19:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305 2023-01-02T18:19:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.717 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.719 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:30 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:09.719 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:09.719 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 150.18733753999999, 2023-01-02T18:19:09.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702, 2023-01-02T18:19:09.720 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.720 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.721 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.721 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.721 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.721 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 30 2023-01-02T18:19:09.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.722 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:09.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:09.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:09.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456322+0000", 2023-01-02T18:19:09.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.267e-06 2023-01-02T18:19:09.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456329+0000", 2023-01-02T18:19:09.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4963999999999999e-05 2023-01-02T18:19:09.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456344+0000", 2023-01-02T18:19:09.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6860000000000006e-06 2023-01-02T18:19:09.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456352+0000", 2023-01-02T18:19:09.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1700000000000003e-05 2023-01-02T18:19:09.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456403+0000", 2023-01-02T18:19:09.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1058999999999997e-05 2023-01-02T18:19:09.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456494+0000", 2023-01-02T18:19:09.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026174 2023-01-02T18:19:09.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:09.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456756+0000", 2023-01-02T18:19:09.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057697200000000003 2023-01-02T18:19:09.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:09.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457333+0000", 2023-01-02T18:19:09.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00050206299999999997 2023-01-02T18:19:09.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:09.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457835+0000", 2023-01-02T18:19:09.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7630000000000002e-05 2023-01-02T18:19:09.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457893+0000", 2023-01-02T18:19:09.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7191000000000003e-05 2023-01-02T18:19:09.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457940+0000", 2023-01-02T18:19:09.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702 2023-01-02T18:19:09.735 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.735 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.736 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.736 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:31 3.1c 3:3d3f3250:::rbd_id.image2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:09.736 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:09.737 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 150.18558313299999, 2023-01-02T18:19:09.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002, 2023-01-02T18:19:09.737 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.737 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.738 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.738 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.738 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.738 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 31 2023-01-02T18:19:09.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.739 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:09.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:09.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:09.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:09.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:19:09.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458084+0000", 2023-01-02T18:19:09.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3246e-05 2023-01-02T18:19:09.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458097+0000", 2023-01-02T18:19:09.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6010000000000002e-06 2023-01-02T18:19:09.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458103+0000", 2023-01-02T18:19:09.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2332000000000001e-05 2023-01-02T18:19:09.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458135+0000", 2023-01-02T18:19:09.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8839999999999996e-05 2023-01-02T18:19:09.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458234+0000", 2023-01-02T18:19:09.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000148947 2023-01-02T18:19:09.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:09.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458383+0000", 2023-01-02T18:19:09.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001891876 2023-01-02T18:19:09.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:09.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460275+0000", 2023-01-02T18:19:09.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029464600000000002 2023-01-02T18:19:09.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:09.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460569+0000", 2023-01-02T18:19:09.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6334e-05 2023-01-02T18:19:09.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460626+0000", 2023-01-02T18:19:09.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7567e-05 2023-01-02T18:19:09.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460673+0000", 2023-01-02T18:19:09.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002 2023-01-02T18:19:09.752 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.752 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.752 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.753 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35 3.1c 3:3d3f3250:::rbd_id.image2:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:09.753 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:09.753 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 150.176597343, 2023-01-02T18:19:09.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134, 2023-01-02T18:19:09.754 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.754 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:09.754 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.754 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.755 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.755 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35 2023-01-02T18:19:09.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.755 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:09.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:09.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:09.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:09.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2440000000000004e-06 2023-01-02T18:19:09.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467067+0000", 2023-01-02T18:19:09.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1679999999999993e-06 2023-01-02T18:19:09.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467076+0000", 2023-01-02T18:19:09.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2880000000000003e-06 2023-01-02T18:19:09.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467080+0000", 2023-01-02T18:19:09.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3101e-05 2023-01-02T18:19:09.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467123+0000", 2023-01-02T18:19:09.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8630999999999999e-05 2023-01-02T18:19:09.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467212+0000", 2023-01-02T18:19:09.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020884290000000002 2023-01-02T18:19:09.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.469300+0000", 2023-01-02T18:19:09.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134 2023-01-02T18:19:09.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.765 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.765 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2821 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:09.765 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:09.766 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.308721535999993, 2023-01-02T18:19:09.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999, 2023-01-02T18:19:09.766 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.766 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.766 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.767 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.767 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.767 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2821 2023-01-02T18:19:09.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.767 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:09.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:09.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:09.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334937+0000", 2023-01-02T18:19:09.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:19:09.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334946+0000", 2023-01-02T18:19:09.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2023-01-02T18:19:09.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334961+0000", 2023-01-02T18:19:09.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:09.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334968+0000", 2023-01-02T18:19:09.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8257000000000001e-05 2023-01-02T18:19:09.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335027+0000", 2023-01-02T18:19:09.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104551 2023-01-02T18:19:09.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335131+0000", 2023-01-02T18:19:09.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024432700000000002 2023-01-02T18:19:09.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:09.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335376+0000", 2023-01-02T18:19:09.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00087122800000000004 2023-01-02T18:19:09.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:09.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.336247+0000", 2023-01-02T18:19:09.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001616592 2023-01-02T18:19:09.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:09.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337863+0000", 2023-01-02T18:19:09.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6448e-05 2023-01-02T18:19:09.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337910+0000", 2023-01-02T18:19:09.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4098999999999999e-05 2023-01-02T18:19:09.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337954+0000", 2023-01-02T18:19:09.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999 2023-01-02T18:19:09.780 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.781 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.781 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.781 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:2823 10.15 e101/98 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:19:09.782 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:09.782 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.303637965999997, 2023-01-02T18:19:09.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999, 2023-01-02T18:19:09.782 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.782 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.783 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:09.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:09.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:09.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340022+0000", 2023-01-02T18:19:09.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6679999999999998e-06 2023-01-02T18:19:09.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340028+0000", 2023-01-02T18:19:09.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9619999999999999e-06 2023-01-02T18:19:09.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340037+0000", 2023-01-02T18:19:09.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9020000000000002e-06 2023-01-02T18:19:09.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340044+0000", 2023-01-02T18:19:09.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121297 2023-01-02T18:19:09.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340165+0000", 2023-01-02T18:19:09.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7771e-05 2023-01-02T18:19:09.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340183+0000", 2023-01-02T18:19:09.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022034379999999998 2023-01-02T18:19:09.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342386+0000", 2023-01-02T18:19:09.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3992000000000002e-05 2023-01-02T18:19:09.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342430+0000", 2023-01-02T18:19:09.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999 2023-01-02T18:19:09.792 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.793 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.793 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.794 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2915 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:09.794 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:09.794 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.228379781000001, 2023-01-02T18:19:09.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001, 2023-01-02T18:19:09.794 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.794 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.795 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.795 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.795 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.795 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2915 2023-01-02T18:19:09.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.796 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:09.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:09.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:09.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415280+0000", 2023-01-02T18:19:09.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0479999999999998e-06 2023-01-02T18:19:09.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415285+0000", 2023-01-02T18:19:09.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2146e-05 2023-01-02T18:19:09.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.800 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.800 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415297+0000", 2023-01-02T18:19:09.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6869999999999994e-06 2023-01-02T18:19:09.801 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.801 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.801 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.801 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415305+0000", 2023-01-02T18:19:09.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7336999999999999e-05 2023-01-02T18:19:09.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415332+0000", 2023-01-02T18:19:09.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0314e-05 2023-01-02T18:19:09.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415382+0000", 2023-01-02T18:19:09.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2730000000000003e-05 2023-01-02T18:19:09.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:09.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415455+0000", 2023-01-02T18:19:09.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052884199999999996 2023-01-02T18:19:09.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:09.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415984+0000", 2023-01-02T18:19:09.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016222630000000001 2023-01-02T18:19:09.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:09.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417606+0000", 2023-01-02T18:19:09.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0604e-05 2023-01-02T18:19:09.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417637+0000", 2023-01-02T18:19:09.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.366e-05 2023-01-02T18:19:09.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417660+0000", 2023-01-02T18:19:09.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001 2023-01-02T18:19:09.808 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.809 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.809 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.809 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2916 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:09.810 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:09.810 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.225778314999999, 2023-01-02T18:19:09.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999, 2023-01-02T18:19:09.810 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.810 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:09.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.811 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.811 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2916 2023-01-02T18:19:09.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.811 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:09.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:09.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:09.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417881+0000", 2023-01-02T18:19:09.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7620000000000003e-06 2023-01-02T18:19:09.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417886+0000", 2023-01-02T18:19:09.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1369000000000001e-05 2023-01-02T18:19:09.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417897+0000", 2023-01-02T18:19:09.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6840000000000004e-06 2023-01-02T18:19:09.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417902+0000", 2023-01-02T18:19:09.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0825000000000003e-05 2023-01-02T18:19:09.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417943+0000", 2023-01-02T18:19:09.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4980000000000003e-05 2023-01-02T18:19:09.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.418028+0000", 2023-01-02T18:19:09.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014752299999999999 2023-01-02T18:19:09.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.419503+0000", 2023-01-02T18:19:09.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999 2023-01-02T18:19:09.821 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.822 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.823 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e41)", 2023-01-02T18:19:09.823 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:09.823 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.091488476999999, 2023-01-02T18:19:09.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312, 2023-01-02T18:19:09.823 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.824 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:09.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:09.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:09.824 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:09.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.825 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:09.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:09.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:09.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552171+0000", 2023-01-02T18:19:09.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3999999999999997e-06 2023-01-02T18:19:09.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552177+0000", 2023-01-02T18:19:09.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1396999999999999e-05 2023-01-02T18:19:09.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552189+0000", 2023-01-02T18:19:09.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9620000000000001e-06 2023-01-02T18:19:09.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552194+0000", 2023-01-02T18:19:09.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060382329999999996 2023-01-02T18:19:09.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558232+0000", 2023-01-02T18:19:09.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3328e-05 2023-01-02T18:19:09.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558245+0000", 2023-01-02T18:19:09.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312 2023-01-02T18:19:09.833 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.833 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.833 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.834 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected e101)", 2023-01-02T18:19:09.834 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:09.834 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.088725306000001, 2023-01-02T18:19:09.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999, 2023-01-02T18:19:09.835 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.835 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:09.835 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.835 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:09.835 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:09.836 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:09.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.836 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:09.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:09.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:09.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554934+0000", 2023-01-02T18:19:09.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5679999999999999e-06 2023-01-02T18:19:09.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554940+0000", 2023-01-02T18:19:09.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866999999999999e-05 2023-01-02T18:19:09.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554951+0000", 2023-01-02T18:19:09.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9819999999999999e-06 2023-01-02T18:19:09.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554956+0000", 2023-01-02T18:19:09.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003315634 2023-01-02T18:19:09.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558271+0000", 2023-01-02T18:19:09.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3561999999999997e-05 2023-01-02T18:19:09.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558355+0000", 2023-01-02T18:19:09.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999 2023-01-02T18:19:09.845 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.845 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.845 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.846 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3195 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e102)", 2023-01-02T18:19:09.846 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:09.846 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.190618736999994, 2023-01-02T18:19:09.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001, 2023-01-02T18:19:09.847 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.847 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.847 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.847 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.848 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.848 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3195 2023-01-02T18:19:09.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.848 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:09.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:09.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:09.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453040+0000", 2023-01-02T18:19:09.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0059999999999992e-06 2023-01-02T18:19:09.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453048+0000", 2023-01-02T18:19:09.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4034e-05 2023-01-02T18:19:09.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453062+0000", 2023-01-02T18:19:09.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:09.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453070+0000", 2023-01-02T18:19:09.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6203e-05 2023-01-02T18:19:09.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453166+0000", 2023-01-02T18:19:09.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012608000000000001 2023-01-02T18:19:09.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453292+0000", 2023-01-02T18:19:09.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019149799999999999 2023-01-02T18:19:09.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:09.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453484+0000", 2023-01-02T18:19:09.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074549399999999997 2023-01-02T18:19:09.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:09.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454229+0000", 2023-01-02T18:19:09.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038527599999999999 2023-01-02T18:19:09.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:09.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454614+0000", 2023-01-02T18:19:09.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0699000000000003e-05 2023-01-02T18:19:09.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454675+0000", 2023-01-02T18:19:09.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8510000000000001e-05 2023-01-02T18:19:09.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454724+0000", 2023-01-02T18:19:09.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001 2023-01-02T18:19:09.862 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.862 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.863 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3316 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+full_try e106)", 2023-01-02T18:19:09.863 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:09.864 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.321352417, 2023-01-02T18:19:09.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002, 2023-01-02T18:19:09.864 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.864 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:09.864 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.865 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.865 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.865 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3316 2023-01-02T18:19:09.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.865 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:09.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:09.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:09.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322306+0000", 2023-01-02T18:19:09.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0338e-05 2023-01-02T18:19:09.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322316+0000", 2023-01-02T18:19:09.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5367999999999999e-05 2023-01-02T18:19:09.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322332+0000", 2023-01-02T18:19:09.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0642000000000001e-05 2023-01-02T18:19:09.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322342+0000", 2023-01-02T18:19:09.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0119999999999999e-05 2023-01-02T18:19:09.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322412+0000", 2023-01-02T18:19:09.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0169999999999996e-06 2023-01-02T18:19:09.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:09.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322420+0000", 2023-01-02T18:19:09.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048005519999999996 2023-01-02T18:19:09.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327221+0000", 2023-01-02T18:19:09.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8480000000000007e-05 2023-01-02T18:19:09.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327310+0000", 2023-01-02T18:19:09.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141008 2023-01-02T18:19:09.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327451+0000", 2023-01-02T18:19:09.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002 2023-01-02T18:19:09.882 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.883 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.883 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.884 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3318 11.5 e106/102 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head v 106'2, mlcod=0'0)", 2023-01-02T18:19:09.884 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:09.885 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 90.314575542, 2023-01-02T18:19:09.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978, 2023-01-02T18:19:09.885 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.886 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.886 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:09.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:09.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:09.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329084+0000", 2023-01-02T18:19:09.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9700000000000002e-06 2023-01-02T18:19:09.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329091+0000", 2023-01-02T18:19:09.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0783e-05 2023-01-02T18:19:09.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329102+0000", 2023-01-02T18:19:09.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5800000000000003e-06 2023-01-02T18:19:09.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329110+0000", 2023-01-02T18:19:09.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102808 2023-01-02T18:19:09.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329213+0000", 2023-01-02T18:19:09.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1041999999999999e-05 2023-01-02T18:19:09.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329234+0000", 2023-01-02T18:19:09.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040932829999999996 2023-01-02T18:19:09.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333327+0000", 2023-01-02T18:19:09.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7880000000000002e-05 2023-01-02T18:19:09.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333375+0000", 2023-01-02T18:19:09.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978 2023-01-02T18:19:09.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.897 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.897 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.898 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPull(7.1e e112/111 cost 1049576)", 2023-01-02T18:19:09.898 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:09.898 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 80.985482755000007, 2023-01-02T18:19:09.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012, 2023-01-02T18:19:09.898 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.899 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:09.899 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:09.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:09.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:09.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658177+0000", 2023-01-02T18:19:09.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7961e-05 2023-01-02T18:19:09.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658195+0000", 2023-01-02T18:19:09.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7309e-05 2023-01-02T18:19:09.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658212+0000", 2023-01-02T18:19:09.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2859999999999999e-06 2023-01-02T18:19:09.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658220+0000", 2023-01-02T18:19:09.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1268999999999998e-05 2023-01-02T18:19:09.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658292+0000", 2023-01-02T18:19:09.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039592480000000003 2023-01-02T18:19:09.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.662251+0000", 2023-01-02T18:19:09.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012 2023-01-02T18:19:09.908 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.908 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.908 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.909 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3454 12.1a e121/118 12:5cea7035:::rbd_info:head v 121'1, mlcod=0'0)", 2023-01-02T18:19:09.909 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:09.909 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.911887981000007, 2023-01-02T18:19:09.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001, 2023-01-02T18:19:09.909 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.910 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.910 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:09.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:09.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:09.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731772+0000", 2023-01-02T18:19:09.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1409999999999999e-06 2023-01-02T18:19:09.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731779+0000", 2023-01-02T18:19:09.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6167999999999998e-05 2023-01-02T18:19:09.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731795+0000", 2023-01-02T18:19:09.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2630000000000003e-06 2023-01-02T18:19:09.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731804+0000", 2023-01-02T18:19:09.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018042000000000001 2023-01-02T18:19:09.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731984+0000", 2023-01-02T18:19:09.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1704000000000001e-05 2023-01-02T18:19:09.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.918 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.918 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.732006+0000", 2023-01-02T18:19:09.918 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076487370000000001 2023-01-02T18:19:09.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.919 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.919 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739655+0000", 2023-01-02T18:19:09.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5726999999999999e-05 2023-01-02T18:19:09.919 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.919 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739690+0000", 2023-01-02T18:19:09.920 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001 2023-01-02T18:19:09.920 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.920 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.921 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.921 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(7.14 133/132 [PushOp(7:2d7624f7:::rbd_id.image26:head, version: 64'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(7:2d7624f7:::rbd_id.image26:head@64'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:19:09.921 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:09.922 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 55.237975949000003, 2023-01-02T18:19:09.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998, 2023-01-02T18:19:09.922 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.922 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:09.922 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:09.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:09.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:09.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405684+0000", 2023-01-02T18:19:09.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2345e-05 2023-01-02T18:19:09.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405697+0000", 2023-01-02T18:19:09.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4418e-05 2023-01-02T18:19:09.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405711+0000", 2023-01-02T18:19:09.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0879999999999999e-05 2023-01-02T18:19:09.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405722+0000", 2023-01-02T18:19:09.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133447 2023-01-02T18:19:09.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405855+0000", 2023-01-02T18:19:09.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5799999999999992e-06 2023-01-02T18:19:09.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405864+0000", 2023-01-02T18:19:09.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022636800000000001 2023-01-02T18:19:09.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408128+0000", 2023-01-02T18:19:09.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998 2023-01-02T18:19:09.932 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.932 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.932 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.933 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:28825 3.16 3:6aa41c7b:::rbd_header.12a211eeb54d:head [watch watch cookie 140114583906128] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:09.933 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:09.933 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.616849330999997, 2023-01-02T18:19:09.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737, 2023-01-02T18:19:09.934 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:09.934 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:09.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:09.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:09.934 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:09.935 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28825 2023-01-02T18:19:09.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.935 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:09.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.935 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:09.936 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:09.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:09.936 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.936 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:09.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:09.937 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:09.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:09.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:09.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0239999999999999e-06 2023-01-02T18:19:09.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:09.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026815+0000", 2023-01-02T18:19:09.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9989999999999997e-06 2023-01-02T18:19:09.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:09.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026824+0000", 2023-01-02T18:19:09.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1080000000000003e-06 2023-01-02T18:19:09.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:09.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026828+0000", 2023-01-02T18:19:09.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1114000000000001e-05 2023-01-02T18:19:09.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:09.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026859+0000", 2023-01-02T18:19:09.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1344999999999997e-05 2023-01-02T18:19:09.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:09.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026910+0000", 2023-01-02T18:19:09.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104691 2023-01-02T18:19:09.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:09.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027015+0000", 2023-01-02T18:19:09.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00059966399999999997 2023-01-02T18:19:09.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:09.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027615+0000", 2023-01-02T18:19:09.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018614879999999999 2023-01-02T18:19:09.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:09.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029476+0000", 2023-01-02T18:19:09.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1659999999999998e-05 2023-01-02T18:19:09.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:09.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029508+0000", 2023-01-02T18:19:09.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6330999999999997e-05 2023-01-02T18:19:09.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:09.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:09.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:09.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029594+0000", 2023-01-02T18:19:09.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737 2023-01-02T18:19:09.949 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.949 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.949 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.949 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:09.949 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:09.950 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:09.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:19:09.952 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:09.951+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:10.052 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:10.052+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:10.119 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:10.120 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:10.120 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:10.120 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:10.129 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:19:10.170 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:10.171+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:10.254 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:10.254+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:10.289 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7, 4] out_osds: [3, 5] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:19:10.289 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:19:10.289 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 6, 7, 4] 2023-01-02T18:19:10.290 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2023-01-02T18:19:10.294 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:10.295 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:10.295 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:10.304 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:19:10.351 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:19:10.356 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:19:10.389 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:10.390+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:10.456 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:10.456+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:10.481 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:10.481 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:19:10.482 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 134.17574253199999, 2023-01-02T18:19:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:19:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.483 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:19:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:19:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:19:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:19:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:19:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:19:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:19:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:19:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:19:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:19:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:19:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:19:10.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:19:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:19:10.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:19:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:19:10.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:19:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:19:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:19:10.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:19:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:19:10.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:19:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:19:10.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:19:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:19:10.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:19:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:19:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:10.499 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 129.17061431100001, 2023-01-02T18:19:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:19:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.500 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:19:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:19:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:19:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:19:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:19:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:19:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:19:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:19:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:19:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:19:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:19:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:19:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:19:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:19:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:19:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:19:10.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:19:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:19:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:19:10.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:19:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:19:10.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:19:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:19:10.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:19:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:19:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:19:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:19:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.515 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:19:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:10.516 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.88054981800001, 2023-01-02T18:19:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:19:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:19:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:19:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:19:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:19:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:19:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:19:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:19:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:19:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:19:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:19:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:19:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:19:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:19:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:19:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:19:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:19:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:19:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:19:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:19:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:19:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:19:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:19:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:19:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:19:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:19:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:19:10.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:19:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 118.881824475, 2023-01-02T18:19:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:19:10.534 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:19:10.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:10.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:10.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:19:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:19:10.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:19:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:19:10.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:19:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:19:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:19:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:19:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:19:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:19:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:19:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:19:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:19:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:19:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:19:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:19:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:19:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:19:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:19:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:19:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:19:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:19:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:19:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:19:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:19:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:19:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 118.857462711, 2023-01-02T18:19:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:19:10.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.552 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:19:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:10.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:19:10.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:19:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:19:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:19:10.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:19:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:19:10.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:19:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:19:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:19:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:19:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:19:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:19:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:10.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:19:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:19:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:19:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:19:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:19:10.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:19:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:19:10.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:19:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:19:10.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:19:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.151868042999993, 2023-01-02T18:19:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:19:10.566 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:19:10.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:10.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:10.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:19:10.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:19:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:19:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:19:10.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:19:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:19:10.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:19:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:19:10.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:19:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:19:10.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:19:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:19:10.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:19:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:19:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:19:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:19:10.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:19:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:19:10.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:19:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:19:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:19:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:19:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3321 11.1 11:81555d77:::rbd_object_map.12a2d6b452e6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:10.581 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.144162975, 2023-01-02T18:19:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002, 2023-01-02T18:19:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.582 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3321 2023-01-02T18:19:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336122+0000", 2023-01-02T18:19:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000004e-06 2023-01-02T18:19:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336130+0000", 2023-01-02T18:19:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4102e-05 2023-01-02T18:19:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336144+0000", 2023-01-02T18:19:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8210000000000004e-06 2023-01-02T18:19:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336151+0000", 2023-01-02T18:19:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6598999999999998e-05 2023-01-02T18:19:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336208+0000", 2023-01-02T18:19:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8439999999999998e-06 2023-01-02T18:19:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336216+0000", 2023-01-02T18:19:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028909740000000001 2023-01-02T18:19:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339107+0000", 2023-01-02T18:19:10.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1304999999999994e-05 2023-01-02T18:19:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339198+0000", 2023-01-02T18:19:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030390899999999999 2023-01-02T18:19:10.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339502+0000", 2023-01-02T18:19:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00165285 2023-01-02T18:19:10.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341155+0000", 2023-01-02T18:19:10.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00047942200000000002 2023-01-02T18:19:10.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341634+0000", 2023-01-02T18:19:10.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1620999999999998e-05 2023-01-02T18:19:10.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341696+0000", 2023-01-02T18:19:10.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0988999999999997e-05 2023-01-02T18:19:10.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341737+0000", 2023-01-02T18:19:10.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002 2023-01-02T18:19:10.597 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.597 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.597 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.598 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:19:10.598 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:10.598 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 86.099460226000005, 2023-01-02T18:19:10.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:19:10.599 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.599 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.600 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:19:10.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.600 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:10.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:10.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:10.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:19:10.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:19:10.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:19:10.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:19:10.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:19:10.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:19:10.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:19:10.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:19:10.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:19:10.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:19:10.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:19:10.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:19:10.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:10.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:19:10.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:19:10.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:19:10.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:19:10.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:19:10.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:19:10.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:19:10.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:19:10.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:19:10.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:19:10.612 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.612 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.613 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.613 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:19:10.613 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:10.614 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.069130709999996, 2023-01-02T18:19:10.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:19:10.614 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.614 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.614 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.615 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.615 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:19:10.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.615 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.616 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.616 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:10.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.616 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.617 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.617 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:10.617 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:10.617 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.617 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.618 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:19:10.618 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:19:10.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.618 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:19:10.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:19:10.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:19:10.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:19:10.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:19:10.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:19:10.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.621 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:19:10.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:19:10.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:19:10.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:19:10.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:10.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:19:10.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:19:10.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:19:10.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:19:10.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:19:10.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:19:10.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:19:10.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:19:10.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:19:10.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:19:10.627 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.628 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.628 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.628 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:19:10.629 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:10.629 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 74.968684045000003, 2023-01-02T18:19:10.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:19:10.629 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.629 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.629 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.630 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.630 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.630 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:19:10.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.630 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:10.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.631 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:10.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:10.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:19:10.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:19:10.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.634 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:19:10.634 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:19:10.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.635 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:19:10.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:19:10.635 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.635 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.636 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:19:10.636 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:19:10.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.636 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.637 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:19:10.637 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:19:10.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:19:10.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:19:10.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:10.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:19:10.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:19:10.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:19:10.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:19:10.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:19:10.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:19:10.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:19:10.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:19:10.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:19:10.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:19:10.642 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.643 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.643 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.643 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:19:10.644 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:10.644 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.613146798999999, 2023-01-02T18:19:10.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:19:10.644 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.644 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.645 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.645 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.645 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.645 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:19:10.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.646 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:10.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:10.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:10.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:19:10.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:19:10.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:19:10.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:19:10.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:19:10.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:19:10.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:19:10.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:19:10.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:19:10.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:19:10.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:19:10.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:19:10.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:19:10.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:19:10.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:19:10.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:19:10.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:10.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:19:10.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:19:10.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:19:10.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:19:10.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:19:10.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:19:10.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:19:10.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:19:10.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:19:10.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:19:10.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.660 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.661 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:19:10.661 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:10.661 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 56.602242156000003, 2023-01-02T18:19:10.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:19:10.661 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.662 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:10.662 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.662 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.662 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.662 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:19:10.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.663 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:10.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:10.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:10.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:19:10.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:19:10.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:19:10.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:19:10.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:19:10.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:19:10.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:19:10.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:19:10.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:19:10.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:19:10.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:10.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:19:10.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:19:10.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:19:10.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:19:10.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:19:10.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:19:10.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:19:10.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:19:10.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:19:10.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:19:10.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:19:10.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:19:10.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:19:10.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.675 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.675 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.676 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:19:10.676 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:10.676 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.576299317, 2023-01-02T18:19:10.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:19:10.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.677 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.677 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.678 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:19:10.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.678 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:10.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:10.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:10.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:19:10.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:19:10.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:19:10.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:19:10.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:19:10.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:19:10.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:19:10.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:19:10.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:19:10.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:19:10.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:19:10.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:19:10.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:19:10.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:19:10.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:19:10.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:19:10.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:10.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:19:10.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:19:10.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:19:10.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:19:10.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:19:10.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:19:10.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.691 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:19:10.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:19:10.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:19:10.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:19:10.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.693 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.693 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.693 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:19:10.694 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:10.694 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.801522202000001, 2023-01-02T18:19:10.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:19:10.694 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.694 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:10.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.695 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.695 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.695 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:19:10.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.695 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:10.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:10.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:10.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:19:10.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:19:10.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:19:10.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:19:10.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:19:10.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:19:10.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:19:10.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:19:10.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:19:10.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:19:10.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:19:10.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:19:10.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:19:10.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:19:10.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:19:10.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:19:10.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:19:10.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:19:10.706 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.706 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.706 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.707 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:19:10.707 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:10.707 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 47.757017169000001, 2023-01-02T18:19:10.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:19:10.708 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.708 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.708 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.708 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.708 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.709 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:19:10.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.709 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:10.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:10.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:10.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:19:10.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:19:10.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:19:10.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:19:10.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:19:10.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:19:10.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:19:10.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:19:10.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:19:10.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:19:10.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:19:10.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:19:10.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:10.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:19:10.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:19:10.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:19:10.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:19:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:19:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:19:10.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:19:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:19:10.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:19:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:19:10.721 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.722 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.556033913, 2023-01-02T18:19:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:19:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.723 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:19:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.724 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:10.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:19:10.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:19:10.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:19:10.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:19:10.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:19:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:19:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:19:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:19:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:19:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:19:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:19:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:19:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:19:10.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:19:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:19:10.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:19:10.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:19:10.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:19:10.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:19:10.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:19:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:19:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:19:10.736 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.737 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.737 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.737 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.354781209999999, 2023-01-02T18:19:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:19:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:19:10.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:10.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:10.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:19:10.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:19:10.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:19:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:19:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:19:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:19:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:19:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:19:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:19:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:19:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.746 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:19:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:19:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.747 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:19:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:19:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:19:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:19:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:19:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:19:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:19:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:19:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:19:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:19:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35555 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [read 45056~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e149)", 2023-01-02T18:19:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.082954744999999, 2023-01-02T18:19:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997, 2023-01-02T18:19:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35555 2023-01-02T18:19:10.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:10.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:10.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5999999999999998e-06 2023-01-02T18:19:10.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397335+0000", 2023-01-02T18:19:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0539999999999997e-06 2023-01-02T18:19:10.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397342+0000", 2023-01-02T18:19:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2090000000000001e-06 2023-01-02T18:19:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397345+0000", 2023-01-02T18:19:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5210000000000002e-05 2023-01-02T18:19:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397401+0000", 2023-01-02T18:19:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8177999999999996e-05 2023-01-02T18:19:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397479+0000", 2023-01-02T18:19:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052113059999999998 2023-01-02T18:19:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.402690+0000", 2023-01-02T18:19:10.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997 2023-01-02T18:19:10.763 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.763 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.763 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.764 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:10838 3.d e156/147 3:b21fdca0:::rbd_id.image57:head v 156'10, mlcod=137'8)", 2023-01-02T18:19:10.764 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:10.764 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.113525623999999, 2023-01-02T18:19:10.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489, 2023-01-02T18:19:10.764 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:10.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:10.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8000000000000001e-06 2023-01-02T18:19:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366767+0000", 2023-01-02T18:19:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0953e-05 2023-01-02T18:19:10.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366778+0000", 2023-01-02T18:19:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8860000000000003e-06 2023-01-02T18:19:10.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366783+0000", 2023-01-02T18:19:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3716e-05 2023-01-02T18:19:10.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366827+0000", 2023-01-02T18:19:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3964999999999998e-05 2023-01-02T18:19:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366851+0000", 2023-01-02T18:19:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054574560000000003 2023-01-02T18:19:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372308+0000", 2023-01-02T18:19:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2353e-05 2023-01-02T18:19:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372341+0000", 2023-01-02T18:19:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489 2023-01-02T18:19:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.774 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.775 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54804 3.17 3:ec8e444a:::rbd_header.12a28f082913:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:10.775 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:10.775 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.1064609809999997, 2023-01-02T18:19:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001, 2023-01-02T18:19:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:10.776 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54804 2023-01-02T18:19:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:10.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373824+0000", 2023-01-02T18:19:10.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9380000000000004e-06 2023-01-02T18:19:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373834+0000", 2023-01-02T18:19:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6818999999999999e-05 2023-01-02T18:19:10.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373851+0000", 2023-01-02T18:19:10.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.481e-06 2023-01-02T18:19:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373858+0000", 2023-01-02T18:19:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2268999999999998e-05 2023-01-02T18:19:10.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373900+0000", 2023-01-02T18:19:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1660000000000002e-06 2023-01-02T18:19:10.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373906+0000", 2023-01-02T18:19:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060814570000000002 2023-01-02T18:19:10.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.379987+0000", 2023-01-02T18:19:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015394200000000001 2023-01-02T18:19:10.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380141+0000", 2023-01-02T18:19:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026425999999999999 2023-01-02T18:19:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380405+0000", 2023-01-02T18:19:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00098840499999999993 2023-01-02T18:19:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381394+0000", 2023-01-02T18:19:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1028e-05 2023-01-02T18:19:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381405+0000", 2023-01-02T18:19:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9657999999999997e-05 2023-01-02T18:19:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381464+0000", 2023-01-02T18:19:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1522e-05 2023-01-02T18:19:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:10.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381506+0000", 2023-01-02T18:19:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001 2023-01-02T18:19:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:10.791 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:10.792 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:10.793 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-01-02T18:19:10.623+0000 7fe18f96e700 -1 mon.a@0(leader).osd e170 definitely_dead 0 2023-01-02T18:19:10.793 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:10.793+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:10.794 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:19:10.895 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:10.895+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:10.961 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:10.961 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:10.962 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:10.962 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:10.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:19:10.996 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:10.996+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:11.096 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:11.096 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:11.097 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:11.097 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:11.097 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:11.097 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:11.097+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:11.106 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:19:11.197 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:11.198+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:11.273 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:11.273 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:11.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:11.274 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:11.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.274 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:19:11.274 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:11.275 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 143.95402159, 2023-01-02T18:19:11.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:19:11.275 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.275 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.276 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.276 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.276 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.276 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:19:11.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.277 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:11.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:11.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:11.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:19:11.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:19:11.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:19:11.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:19:11.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:19:11.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:19:11.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:19:11.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:19:11.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:19:11.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:11.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:11.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:19:11.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:19:11.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:19:11.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:19:11.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:19:11.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:19:11.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:11.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:19:11.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:19:11.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:19:11.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:19:11.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:19:11.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:19:11.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:19:11.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:19:11.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:19:11.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:19:11.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.292 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.293 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:19:11.293 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:11.293 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 138.93893813400001, 2023-01-02T18:19:11.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:19:11.294 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.294 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.294 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.294 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.294 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.294 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:19:11.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.295 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:11.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:11.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:11.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:19:11.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:19:11.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:19:11.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:19:11.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:19:11.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:19:11.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:19:11.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:19:11.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:19:11.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:19:11.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:19:11.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:19:11.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:19:11.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:19:11.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:19:11.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:19:11.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:11.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:19:11.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:19:11.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:19:11.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:19:11.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:19:11.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:19:11.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:19:11.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:19:11.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:19:11.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:19:11.309 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.309 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.309 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.310 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:11.310 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:11.310 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 129.95424055699999, 2023-01-02T18:19:11.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:19:11.311 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.311 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.311 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.312 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:19:11.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.312 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:11.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:11.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:11.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:19:11.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:19:11.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:19:11.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:19:11.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:19:11.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:19:11.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:19:11.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:19:11.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:19:11.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:19:11.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:19:11.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:19:11.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:19:11.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:19:11.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:19:11.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:19:11.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:11.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:19:11.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:19:11.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:19:11.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:19:11.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:19:11.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:19:11.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:19:11.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:19:11.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:19:11.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:19:11.326 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.326 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.327 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.327 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:19:11.327 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:11.328 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 115.95621586599999, 2023-01-02T18:19:11.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:19:11.328 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.328 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.328 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.328 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.329 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.329 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:19:11.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.329 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:11.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:11.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:11.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:19:11.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:19:11.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:19:11.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:19:11.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:19:11.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:19:11.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:19:11.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:19:11.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:19:11.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:19:11.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:19:11.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:19:11.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:19:11.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:19:11.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:19:11.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:19:11.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:11.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:19:11.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:19:11.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:19:11.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:19:11.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:19:11.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:19:11.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:19:11.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:19:11.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:19:11.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:19:11.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.344 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.344 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.344 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:19:11.345 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:11.345 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.95515741200001, 2023-01-02T18:19:11.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:19:11.345 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.345 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.345 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.346 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.346 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.346 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:19:11.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.346 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:11.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:11.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:11.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:19:11.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:19:11.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:19:11.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:19:11.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:19:11.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:19:11.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:19:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:19:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:19:11.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:19:11.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:19:11.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:19:11.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:19:11.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:19:11.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:19:11.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:19:11.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:11.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:19:11.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:19:11.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:19:11.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:19:11.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:19:11.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:19:11.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:19:11.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:19:11.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:19:11.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:19:11.361 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.361 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.361 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.362 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:19:11.362 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:11.362 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 113.949792765, 2023-01-02T18:19:11.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:19:11.362 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.363 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.363 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.363 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.363 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.363 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:19:11.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.364 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:11.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:11.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:11.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:19:11.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:19:11.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:19:11.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:19:11.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:19:11.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:19:11.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:19:11.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:19:11.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:19:11.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:19:11.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:19:11.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:19:11.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:19:11.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:19:11.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:19:11.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:19:11.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:11.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:19:11.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:19:11.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:19:11.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:19:11.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:19:11.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:19:11.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:19:11.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:19:11.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:19:11.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:19:11.378 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.378 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.378 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.379 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2191 3.13 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:19:11.379 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:11.379 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.931954151, 2023-01-02T18:19:11.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996, 2023-01-02T18:19:11.380 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.380 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.380 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.380 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.380 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.381 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2191 2023-01-02T18:19:11.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.381 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:11.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:11.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:11.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340115+0000", 2023-01-02T18:19:11.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2921999999999999e-05 2023-01-02T18:19:11.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340128+0000", 2023-01-02T18:19:11.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9213000000000001e-05 2023-01-02T18:19:11.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340147+0000", 2023-01-02T18:19:11.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0695e-05 2023-01-02T18:19:11.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340158+0000", 2023-01-02T18:19:11.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1227000000000001e-05 2023-01-02T18:19:11.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340229+0000", 2023-01-02T18:19:11.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7239999999999992e-06 2023-01-02T18:19:11.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340237+0000", 2023-01-02T18:19:11.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001423248 2023-01-02T18:19:11.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341660+0000", 2023-01-02T18:19:11.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158319 2023-01-02T18:19:11.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341818+0000", 2023-01-02T18:19:11.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019205099999999999 2023-01-02T18:19:11.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:11.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.342011+0000", 2023-01-02T18:19:11.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001641558 2023-01-02T18:19:11.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.343652+0000", 2023-01-02T18:19:11.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001445895 2023-01-02T18:19:11.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345098+0000", 2023-01-02T18:19:11.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4589000000000003e-05 2023-01-02T18:19:11.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345143+0000", 2023-01-02T18:19:11.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9351000000000001e-05 2023-01-02T18:19:11.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345172+0000", 2023-01-02T18:19:11.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996 2023-01-02T18:19:11.395 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.396 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.396 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.396 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:19:11.397 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:11.397 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 108.909461265, 2023-01-02T18:19:11.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:19:11.397 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.397 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.398 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.398 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.398 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.398 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:19:11.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.399 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:11.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:11.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:11.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:19:11.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:19:11.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:19:11.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:19:11.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:19:11.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:19:11.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:19:11.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:19:11.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:19:11.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:19:11.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:19:11.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:19:11.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:19:11.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:19:11.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:19:11.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:19:11.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:11.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:19:11.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:19:11.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:19:11.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:19:11.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:19:11.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:19:11.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:19:11.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:19:11.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:19:11.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:19:11.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.414 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.415 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:11.415 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:11.415 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.904891015, 2023-01-02T18:19:11.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:19:11.416 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.416 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.416 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.416 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.417 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.417 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:19:11.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.417 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:11.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:11.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:11.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:19:11.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:19:11.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:19:11.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:19:11.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:19:11.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:19:11.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:19:11.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:19:11.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:19:11.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:19:11.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:19:11.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:19:11.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:19:11.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:19:11.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:19:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:19:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:19:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:19:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:19:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:19:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:19:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:19:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:19:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:19:11.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:19:11.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:19:11.432 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.432 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.432 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.433 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:19:11.433 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:11.433 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 103.892058999, 2023-01-02T18:19:11.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:19:11.433 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.434 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.434 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:19:11.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.435 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:11.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:11.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:11.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:19:11.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:19:11.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:19:11.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:19:11.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:19:11.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:19:11.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:19:11.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:19:11.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:19:11.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:19:11.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:19:11.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:19:11.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:19:11.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:19:11.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:19:11.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:19:11.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:11.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:19:11.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:19:11.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:19:11.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:19:11.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:19:11.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:19:11.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:19:11.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:19:11.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:19:11.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:19:11.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.449 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.449 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.450 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:19:11.450 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:11.450 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.9433255, 2023-01-02T18:19:11.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:19:11.451 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.451 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.451 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.451 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.452 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.452 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:19:11.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.452 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:11.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:11.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:11.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:19:11.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:19:11.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:19:11.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:19:11.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:19:11.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:19:11.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:19:11.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:19:11.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:19:11.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:19:11.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:19:11.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:19:11.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:19:11.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:19:11.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:19:11.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:19:11.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:11.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:19:11.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:19:11.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:19:11.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:19:11.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:19:11.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:19:11.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:19:11.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:19:11.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:19:11.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:19:11.467 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.467 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.467 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.468 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:11.468 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:11.468 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.943482446000004, 2023-01-02T18:19:11.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:19:11.468 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.469 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.469 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.469 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:19:11.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.470 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:11.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:11.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:11.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:19:11.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:19:11.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:19:11.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:19:11.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:19:11.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:19:11.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:19:11.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:19:11.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:19:11.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:19:11.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:19:11.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:19:11.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:19:11.478 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:19:11.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:19:11.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:19:11.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:19:11.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:19:11.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:19:11.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:19:11.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:19:11.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:19:11.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:19:11.482 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.482 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.482 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.483 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:11.483 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:11.483 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 43.400443222, 2023-01-02T18:19:11.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:19:11.484 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.484 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.484 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.484 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.485 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.485 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:19:11.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.485 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:11.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:11.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:11.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:19:11.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:19:11.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:19:11.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:19:11.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:19:11.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:19:11.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:19:11.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:19:11.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:19:11.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:19:11.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:19:11.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:19:11.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:11.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:19:11.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:19:11.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:19:11.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:19:11.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:19:11.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:19:11.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:19:11.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:19:11.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:19:11.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:19:11.497 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.498 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.90583648, 2023-01-02T18:19:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:19:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.499 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:19:11.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:11.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:19:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:19:11.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:19:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:19:11.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:19:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:19:11.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:19:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:19:11.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:19:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:19:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:19:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:19:11.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:19:11.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:19:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:19:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:19:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:19:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:19:11.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:19:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:19:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:19:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:19:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.514 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10841 3.d 3:b21fdca0:::rbd_id.image57:head [stat] snapc 0=[] ondisk+read+known_if_redirected e157)", 2023-01-02T18:19:11.515 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.560631632, 2023-01-02T18:19:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048345949999999997, 2023-01-02T18:19:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:11.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10841 2023-01-02T18:19:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.517 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711440+0000", 2023-01-02T18:19:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:11.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711438+0000", 2023-01-02T18:19:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3810000000000005e-06 2023-01-02T18:19:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711448+0000", 2023-01-02T18:19:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7039000000000001e-05 2023-01-02T18:19:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711465+0000", 2023-01-02T18:19:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2190000000000001e-06 2023-01-02T18:19:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711471+0000", 2023-01-02T18:19:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6118999999999997e-05 2023-01-02T18:19:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711517+0000", 2023-01-02T18:19:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2149999999999998e-06 2023-01-02T18:19:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.711523+0000", 2023-01-02T18:19:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045723059999999999 2023-01-02T18:19:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716096+0000", 2023-01-02T18:19:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6606000000000004e-05 2023-01-02T18:19:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716182+0000", 2023-01-02T18:19:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2539000000000003e-05 2023-01-02T18:19:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.716275+0000", 2023-01-02T18:19:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048345949999999997 2023-01-02T18:19:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54769 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e160)", 2023-01-02T18:19:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.93214178, 2023-01-02T18:19:11.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999, 2023-01-02T18:19:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54769 2023-01-02T18:19:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339928+0000", 2023-01-02T18:19:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0937e-05 2023-01-02T18:19:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339939+0000", 2023-01-02T18:19:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8923000000000002e-05 2023-01-02T18:19:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339958+0000", 2023-01-02T18:19:11.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4999999999999999e-06 2023-01-02T18:19:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339966+0000", 2023-01-02T18:19:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1886999999999999e-05 2023-01-02T18:19:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340028+0000", 2023-01-02T18:19:11.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9189999999999999e-06 2023-01-02T18:19:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340036+0000", 2023-01-02T18:19:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012331458999999999 2023-01-02T18:19:11.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352367+0000", 2023-01-02T18:19:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5671000000000001e-05 2023-01-02T18:19:11.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352443+0000", 2023-01-02T18:19:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028359799999999998 2023-01-02T18:19:11.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352727+0000", 2023-01-02T18:19:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089580699999999998 2023-01-02T18:19:11.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353622+0000", 2023-01-02T18:19:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163995 2023-01-02T18:19:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353786+0000", 2023-01-02T18:19:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7710000000000002e-05 2023-01-02T18:19:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353834+0000", 2023-01-02T18:19:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3380999999999999e-05 2023-01-02T18:19:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353857+0000", 2023-01-02T18:19:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999 2023-01-02T18:19:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.545 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54785 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:11.546 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.9284740490000001, 2023-01-02T18:19:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348, 2023-01-02T18:19:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.547 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54785 2023-01-02T18:19:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343595+0000", 2023-01-02T18:19:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2480000000000002e-06 2023-01-02T18:19:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343605+0000", 2023-01-02T18:19:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6588000000000001e-05 2023-01-02T18:19:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343621+0000", 2023-01-02T18:19:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2490000000000004e-06 2023-01-02T18:19:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343629+0000", 2023-01-02T18:19:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3723000000000001e-05 2023-01-02T18:19:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343672+0000", 2023-01-02T18:19:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.04e-06 2023-01-02T18:19:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343677+0000", 2023-01-02T18:19:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054799280000000002 2023-01-02T18:19:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349157+0000", 2023-01-02T18:19:11.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010108299999999999 2023-01-02T18:19:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349258+0000", 2023-01-02T18:19:11.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000406179 2023-01-02T18:19:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349665+0000", 2023-01-02T18:19:11.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051027499999999996 2023-01-02T18:19:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354767+0000", 2023-01-02T18:19:11.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000482819 2023-01-02T18:19:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355250+0000", 2023-01-02T18:19:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7871999999999998e-05 2023-01-02T18:19:11.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355298+0000", 2023-01-02T18:19:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6105e-05 2023-01-02T18:19:11.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355344+0000", 2023-01-02T18:19:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348 2023-01-02T18:19:11.562 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.563 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54793 3.12 3:48f2e415:::rbd_object_map.12a21a1bf873:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.9127324009999995, 2023-01-02T18:19:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048462100000000001, 2023-01-02T18:19:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.564 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54793 2023-01-02T18:19:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.565 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359338+0000", 2023-01-02T18:19:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5590000000000002e-06 2023-01-02T18:19:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359345+0000", 2023-01-02T18:19:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4041e-05 2023-01-02T18:19:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359359+0000", 2023-01-02T18:19:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8009999999999998e-06 2023-01-02T18:19:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359366+0000", 2023-01-02T18:19:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7101000000000002e-05 2023-01-02T18:19:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359413+0000", 2023-01-02T18:19:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0733e-05 2023-01-02T18:19:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359504+0000", 2023-01-02T18:19:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018615799999999999 2023-01-02T18:19:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359690+0000", 2023-01-02T18:19:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000870461 2023-01-02T18:19:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.360560+0000", 2023-01-02T18:19:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035062750000000001 2023-01-02T18:19:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364066+0000", 2023-01-02T18:19:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7508000000000005e-05 2023-01-02T18:19:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364134+0000", 2023-01-02T18:19:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1615e-05 2023-01-02T18:19:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364186+0000", 2023-01-02T18:19:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048462100000000001 2023-01-02T18:19:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56246 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:11.580 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.6270729260000003, 2023-01-02T18:19:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998, 2023-01-02T18:19:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.581 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.582 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56246 2023-01-02T18:19:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644998+0000", 2023-01-02T18:19:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2189999999999998e-06 2023-01-02T18:19:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645002+0000", 2023-01-02T18:19:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0909999999999993e-06 2023-01-02T18:19:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645010+0000", 2023-01-02T18:19:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6880000000000001e-06 2023-01-02T18:19:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645014+0000", 2023-01-02T18:19:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6795999999999998e-05 2023-01-02T18:19:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645051+0000", 2023-01-02T18:19:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000001e-05 2023-01-02T18:19:11.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645135+0000", 2023-01-02T18:19:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199557 2023-01-02T18:19:11.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645335+0000", 2023-01-02T18:19:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00070655299999999996 2023-01-02T18:19:11.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.646041+0000", 2023-01-02T18:19:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047206009999999996 2023-01-02T18:19:11.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650762+0000", 2023-01-02T18:19:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5790999999999997e-05 2023-01-02T18:19:11.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650798+0000", 2023-01-02T18:19:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4202999999999997e-05 2023-01-02T18:19:11.595 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650842+0000", 2023-01-02T18:19:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998 2023-01-02T18:19:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.596 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56449 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", 2023-01-02T18:19:11.597 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.9026791860000003, 2023-01-02T18:19:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305, 2023-01-02T18:19:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:11.598 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:11.599 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56449 2023-01-02T18:19:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:11.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:11.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369390+0000", 2023-01-02T18:19:11.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1600000000000001e-05 2023-01-02T18:19:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369402+0000", 2023-01-02T18:19:11.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8179999999999999e-05 2023-01-02T18:19:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369420+0000", 2023-01-02T18:19:11.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.951e-06 2023-01-02T18:19:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369427+0000", 2023-01-02T18:19:11.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8652999999999995e-05 2023-01-02T18:19:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369496+0000", 2023-01-02T18:19:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1131000000000001e-05 2023-01-02T18:19:11.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369507+0000", 2023-01-02T18:19:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010015711 2023-01-02T18:19:11.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379523+0000", 2023-01-02T18:19:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017405799999999999 2023-01-02T18:19:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379697+0000", 2023-01-02T18:19:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097878599999999994 2023-01-02T18:19:11.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.380675+0000", 2023-01-02T18:19:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090579699999999996 2023-01-02T18:19:11.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.381581+0000", 2023-01-02T18:19:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062692200000000003 2023-01-02T18:19:11.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382208+0000", 2023-01-02T18:19:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1279000000000003e-05 2023-01-02T18:19:11.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382239+0000", 2023-01-02T18:19:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4488e-05 2023-01-02T18:19:11.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382264+0000", 2023-01-02T18:19:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305 2023-01-02T18:19:11.614 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:11.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:11.615 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:11.616 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:19:11.618 INFO:teuthology.orchestra.run.smithi007.stderr:marked out osd.4. 2023-01-02T18:19:11.619 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:11.617+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:11.619 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:19:11.718 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:11.718+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:11.801 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:11.802 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:11.802 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:19:11.802 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:11.816 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:19:11.818 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:11.819+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:11.822 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:11.843 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:11.864 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:11.878 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:11.896 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:11.914 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:11.919 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:11.919+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:11.933 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:11.957 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:11.957 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:11.967 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:11.968 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:19:11.968 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:19:11.968 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:19:11.968 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:19:11.969 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:19:11.969 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:19:11.969 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:19:11.969 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:19:11.970 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:19:12.020 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:12.021+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:12.121 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:12.122+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:12.145 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:12.146 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:12.153 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:19:12.222 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:12.222+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:12.279 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:12.280 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:12.290 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:19:12.331 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:12.331+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:12.370 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:19:12.425 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:12.425+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:12.509 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:12.510 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:12.521 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:19:12.525 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:12.526+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:12.626 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:12.627+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:12.690 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:12.690 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:12.700 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:19:12.744 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:12.744+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:12.826 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:12.828 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:12.828+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:12.836 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:19:12.930 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:12.931+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:13.001 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:13.002 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:13.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:19:13.031 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:13.032+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:13.132 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:13.132+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:13.136 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:13.136 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:13.146 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:19:13.233 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:13.233+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:13.312 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:13.312 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:13.322 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:19:13.347 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:19:13.347 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:13.347+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:13.434 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:13.434+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:13.481 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:13.481 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:13.491 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:19:13.575 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:13.575+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:13.636 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:13.636+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:13.657 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:13.657 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:13.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:19:13.737 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:13.737+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:13.802 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:13.803 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:13.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:19:13.856 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:13.857+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:13.937 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:13.937 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:13.939 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:13.939+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:13.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:19:13.980 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:19:14.040 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:14.040+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:14.111 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:14.111 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:14.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:19:14.123 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:14.140 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:14.157 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:14.162 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:14.163+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:14.174 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:14.193 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:14.210 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:14.228 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:14.242 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:14.242+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:14.247 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:19:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:19:14.248 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:19:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:19:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:19:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:19:14.249 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:19:14.250 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:19:14.288 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:14.289 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:14.289 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:14.289 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:14.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:19:14.384 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:14.384+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:14.444 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:14.445+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:14.467 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:14.468 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:14.468 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:14.468 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:14.468 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:14.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:19:14.545 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:14.545+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:14.645 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.646 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2 3.17 3:ece625d0:::rbd_id.image1:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:19:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 157.22812382800001, 2023-01-02T18:19:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001, 2023-01-02T18:19:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.647 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2 2023-01-02T18:19:14.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:14.649 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:14.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416794+0000", 2023-01-02T18:19:14.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1639e-05 2023-01-02T18:19:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416806+0000", 2023-01-02T18:19:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7169999999999997e-06 2023-01-02T18:19:14.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416814+0000", 2023-01-02T18:19:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0390000000000004e-06 2023-01-02T18:19:14.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416819+0000", 2023-01-02T18:19:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4200000000000003e-05 2023-01-02T18:19:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416873+0000", 2023-01-02T18:19:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5050000000000004e-06 2023-01-02T18:19:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416880+0000", 2023-01-02T18:19:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003595263 2023-01-02T18:19:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420475+0000", 2023-01-02T18:19:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5440000000000004e-06 2023-01-02T18:19:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420482+0000", 2023-01-02T18:19:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014728149999999999 2023-01-02T18:19:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.421955+0000", 2023-01-02T18:19:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5858000000000004e-05 2023-01-02T18:19:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.422040+0000", 2023-01-02T18:19:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001 2023-01-02T18:19:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.660 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:14.661 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 155.21933718899999, 2023-01-02T18:19:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997, 2023-01-02T18:19:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.662 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9 2023-01-02T18:19:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425580+0000", 2023-01-02T18:19:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1592e-05 2023-01-02T18:19:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.666 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425592+0000", 2023-01-02T18:19:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727e-05 2023-01-02T18:19:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425607+0000", 2023-01-02T18:19:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.204e-06 2023-01-02T18:19:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.668 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425615+0000", 2023-01-02T18:19:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3989000000000002e-05 2023-01-02T18:19:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425659+0000", 2023-01-02T18:19:14.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105519 2023-01-02T18:19:14.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425764+0000", 2023-01-02T18:19:14.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019538499999999999 2023-01-02T18:19:14.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.671 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:14.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425959+0000", 2023-01-02T18:19:14.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045306399999999998 2023-01-02T18:19:14.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:14.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430490+0000", 2023-01-02T18:19:14.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6642000000000003e-05 2023-01-02T18:19:14.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:14.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430557+0000", 2023-01-02T18:19:14.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4468999999999997e-05 2023-01-02T18:19:14.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430601+0000", 2023-01-02T18:19:14.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.025e-05 2023-01-02T18:19:14.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430631+0000", 2023-01-02T18:19:14.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997 2023-01-02T18:19:14.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.676 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.676 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.676 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:10 3.17 3:ece625d0:::rbd_id.image1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:14.677 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:14.677 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 155.21411017200001, 2023-01-02T18:19:14.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982, 2023-01-02T18:19:14.677 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.678 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.678 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.678 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10 2023-01-02T18:19:14.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.679 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:14.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:14.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:14.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430808+0000", 2023-01-02T18:19:14.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2579999999999998e-06 2023-01-02T18:19:14.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430815+0000", 2023-01-02T18:19:14.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:14.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430828+0000", 2023-01-02T18:19:14.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8730000000000004e-06 2023-01-02T18:19:14.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430834+0000", 2023-01-02T18:19:14.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6267000000000003e-05 2023-01-02T18:19:14.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430880+0000", 2023-01-02T18:19:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7486999999999997e-05 2023-01-02T18:19:14.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430978+0000", 2023-01-02T18:19:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156785 2023-01-02T18:19:14.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.431135+0000", 2023-01-02T18:19:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089828900000000003 2023-01-02T18:19:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432033+0000", 2023-01-02T18:19:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057836200000000002 2023-01-02T18:19:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432611+0000", 2023-01-02T18:19:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2023-01-02T18:19:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432649+0000", 2023-01-02T18:19:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4532e-05 2023-01-02T18:19:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432693+0000", 2023-01-02T18:19:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982 2023-01-02T18:19:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.691 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:14 3.17 3:ece625d0:::rbd_id.image1:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:14.692 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 155.20259502600001, 2023-01-02T18:19:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305, 2023-01-02T18:19:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.693 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 14 2023-01-02T18:19:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442323+0000", 2023-01-02T18:19:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0670000000000003e-06 2023-01-02T18:19:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442330+0000", 2023-01-02T18:19:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2111e-05 2023-01-02T18:19:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442342+0000", 2023-01-02T18:19:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5030000000000002e-06 2023-01-02T18:19:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442349+0000", 2023-01-02T18:19:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4279999999999997e-05 2023-01-02T18:19:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442383+0000", 2023-01-02T18:19:14.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2152999999999999e-05 2023-01-02T18:19:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442445+0000", 2023-01-02T18:19:14.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020234039999999999 2023-01-02T18:19:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.444469+0000", 2023-01-02T18:19:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305 2023-01-02T18:19:14.702 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:30 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 155.18859622799999, 2023-01-02T18:19:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702, 2023-01-02T18:19:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.704 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 30 2023-01-02T18:19:14.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456322+0000", 2023-01-02T18:19:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.267e-06 2023-01-02T18:19:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456329+0000", 2023-01-02T18:19:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4963999999999999e-05 2023-01-02T18:19:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456344+0000", 2023-01-02T18:19:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6860000000000006e-06 2023-01-02T18:19:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456352+0000", 2023-01-02T18:19:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1700000000000003e-05 2023-01-02T18:19:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456403+0000", 2023-01-02T18:19:14.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1058999999999997e-05 2023-01-02T18:19:14.712 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456494+0000", 2023-01-02T18:19:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026174 2023-01-02T18:19:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456756+0000", 2023-01-02T18:19:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057697200000000003 2023-01-02T18:19:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457333+0000", 2023-01-02T18:19:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00050206299999999997 2023-01-02T18:19:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457835+0000", 2023-01-02T18:19:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7630000000000002e-05 2023-01-02T18:19:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457893+0000", 2023-01-02T18:19:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7191000000000003e-05 2023-01-02T18:19:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457940+0000", 2023-01-02T18:19:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702 2023-01-02T18:19:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:31 3.1c 3:3d3f3250:::rbd_id.image2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 155.186841821, 2023-01-02T18:19:14.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002, 2023-01-02T18:19:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.720 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.721 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 31 2023-01-02T18:19:14.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.721 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:14.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:14.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:14.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:14.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:19:14.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458084+0000", 2023-01-02T18:19:14.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3246e-05 2023-01-02T18:19:14.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458097+0000", 2023-01-02T18:19:14.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6010000000000002e-06 2023-01-02T18:19:14.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.726 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458103+0000", 2023-01-02T18:19:14.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2332000000000001e-05 2023-01-02T18:19:14.727 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.727 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.727 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458135+0000", 2023-01-02T18:19:14.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8839999999999996e-05 2023-01-02T18:19:14.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.728 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.728 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458234+0000", 2023-01-02T18:19:14.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000148947 2023-01-02T18:19:14.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:14.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458383+0000", 2023-01-02T18:19:14.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001891876 2023-01-02T18:19:14.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:14.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460275+0000", 2023-01-02T18:19:14.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029464600000000002 2023-01-02T18:19:14.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460569+0000", 2023-01-02T18:19:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6334e-05 2023-01-02T18:19:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460626+0000", 2023-01-02T18:19:14.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7567e-05 2023-01-02T18:19:14.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460673+0000", 2023-01-02T18:19:14.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002 2023-01-02T18:19:14.733 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.734 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.734 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.734 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35 3.1c 3:3d3f3250:::rbd_id.image2:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:14.735 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:14.735 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 155.177856031, 2023-01-02T18:19:14.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134, 2023-01-02T18:19:14.735 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.735 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:14.736 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.736 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.736 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.736 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35 2023-01-02T18:19:14.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.736 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:14.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:14.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:14.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:14.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2440000000000004e-06 2023-01-02T18:19:14.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467067+0000", 2023-01-02T18:19:14.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1679999999999993e-06 2023-01-02T18:19:14.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467076+0000", 2023-01-02T18:19:14.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2880000000000003e-06 2023-01-02T18:19:14.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467080+0000", 2023-01-02T18:19:14.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3101e-05 2023-01-02T18:19:14.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467123+0000", 2023-01-02T18:19:14.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8630999999999999e-05 2023-01-02T18:19:14.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467212+0000", 2023-01-02T18:19:14.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020884290000000002 2023-01-02T18:19:14.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.469300+0000", 2023-01-02T18:19:14.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134 2023-01-02T18:19:14.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.745 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.745 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.745 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.746 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2821 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:14.746 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:14.746 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.309980224, 2023-01-02T18:19:14.746 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999, 2023-01-02T18:19:14.747 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.747 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.747 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.747 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.747 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.748 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2821 2023-01-02T18:19:14.748 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.748 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.748 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.748 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.748 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:14.749 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.749 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:14.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:14.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334937+0000", 2023-01-02T18:19:14.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:19:14.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334946+0000", 2023-01-02T18:19:14.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2023-01-02T18:19:14.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334961+0000", 2023-01-02T18:19:14.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:14.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334968+0000", 2023-01-02T18:19:14.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8257000000000001e-05 2023-01-02T18:19:14.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335027+0000", 2023-01-02T18:19:14.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104551 2023-01-02T18:19:14.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335131+0000", 2023-01-02T18:19:14.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024432700000000002 2023-01-02T18:19:14.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:14.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335376+0000", 2023-01-02T18:19:14.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00087122800000000004 2023-01-02T18:19:14.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.757 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:14.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.336247+0000", 2023-01-02T18:19:14.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001616592 2023-01-02T18:19:14.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:14.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337863+0000", 2023-01-02T18:19:14.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6448e-05 2023-01-02T18:19:14.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337910+0000", 2023-01-02T18:19:14.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4098999999999999e-05 2023-01-02T18:19:14.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337954+0000", 2023-01-02T18:19:14.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999 2023-01-02T18:19:14.760 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.760 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.761 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.761 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:2823 10.15 e101/98 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:19:14.761 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:14.762 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.304896654, 2023-01-02T18:19:14.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999, 2023-01-02T18:19:14.762 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.762 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.762 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:14.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.764 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:14.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:14.764 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.764 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.765 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.765 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340022+0000", 2023-01-02T18:19:14.765 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6679999999999998e-06 2023-01-02T18:19:14.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.766 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.766 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340028+0000", 2023-01-02T18:19:14.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9619999999999999e-06 2023-01-02T18:19:14.766 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.766 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.767 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340037+0000", 2023-01-02T18:19:14.767 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9020000000000002e-06 2023-01-02T18:19:14.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.767 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340044+0000", 2023-01-02T18:19:14.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121297 2023-01-02T18:19:14.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340165+0000", 2023-01-02T18:19:14.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7771e-05 2023-01-02T18:19:14.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340183+0000", 2023-01-02T18:19:14.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022034379999999998 2023-01-02T18:19:14.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342386+0000", 2023-01-02T18:19:14.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3992000000000002e-05 2023-01-02T18:19:14.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342430+0000", 2023-01-02T18:19:14.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999 2023-01-02T18:19:14.772 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.772 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.772 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.773 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.773 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2915 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:14.773 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:14.773 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.22963846899999, 2023-01-02T18:19:14.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001, 2023-01-02T18:19:14.773 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.774 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.774 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.774 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.774 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.774 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2915 2023-01-02T18:19:14.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.775 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:14.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:14.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:14.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.777 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415280+0000", 2023-01-02T18:19:14.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0479999999999998e-06 2023-01-02T18:19:14.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415285+0000", 2023-01-02T18:19:14.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2146e-05 2023-01-02T18:19:14.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415297+0000", 2023-01-02T18:19:14.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6869999999999994e-06 2023-01-02T18:19:14.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415305+0000", 2023-01-02T18:19:14.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7336999999999999e-05 2023-01-02T18:19:14.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415332+0000", 2023-01-02T18:19:14.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0314e-05 2023-01-02T18:19:14.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415382+0000", 2023-01-02T18:19:14.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2730000000000003e-05 2023-01-02T18:19:14.782 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.783 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:14.783 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415455+0000", 2023-01-02T18:19:14.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052884199999999996 2023-01-02T18:19:14.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.784 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.784 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:14.784 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415984+0000", 2023-01-02T18:19:14.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016222630000000001 2023-01-02T18:19:14.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:14.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417606+0000", 2023-01-02T18:19:14.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0604e-05 2023-01-02T18:19:14.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417637+0000", 2023-01-02T18:19:14.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.366e-05 2023-01-02T18:19:14.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417660+0000", 2023-01-02T18:19:14.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001 2023-01-02T18:19:14.787 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.787 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.788 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.788 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2916 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:14.788 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:14.789 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.22703700300001, 2023-01-02T18:19:14.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999, 2023-01-02T18:19:14.789 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.789 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:14.789 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.790 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.790 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.790 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2916 2023-01-02T18:19:14.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.790 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:14.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:14.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:14.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417881+0000", 2023-01-02T18:19:14.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7620000000000003e-06 2023-01-02T18:19:14.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417886+0000", 2023-01-02T18:19:14.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1369000000000001e-05 2023-01-02T18:19:14.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417897+0000", 2023-01-02T18:19:14.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6840000000000004e-06 2023-01-02T18:19:14.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417902+0000", 2023-01-02T18:19:14.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0825000000000003e-05 2023-01-02T18:19:14.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417943+0000", 2023-01-02T18:19:14.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4980000000000003e-05 2023-01-02T18:19:14.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.418028+0000", 2023-01-02T18:19:14.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014752299999999999 2023-01-02T18:19:14.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.419503+0000", 2023-01-02T18:19:14.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999 2023-01-02T18:19:14.799 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.800 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e41)", 2023-01-02T18:19:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.09274716500001, 2023-01-02T18:19:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312, 2023-01-02T18:19:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:14.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.803 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:14.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:14.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:14.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552171+0000", 2023-01-02T18:19:14.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3999999999999997e-06 2023-01-02T18:19:14.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552177+0000", 2023-01-02T18:19:14.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1396999999999999e-05 2023-01-02T18:19:14.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552189+0000", 2023-01-02T18:19:14.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9620000000000001e-06 2023-01-02T18:19:14.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552194+0000", 2023-01-02T18:19:14.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060382329999999996 2023-01-02T18:19:14.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558232+0000", 2023-01-02T18:19:14.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3328e-05 2023-01-02T18:19:14.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558245+0000", 2023-01-02T18:19:14.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312 2023-01-02T18:19:14.810 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.810 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.811 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.811 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected e101)", 2023-01-02T18:19:14.811 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:14.812 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.08998399399999, 2023-01-02T18:19:14.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999, 2023-01-02T18:19:14.812 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.812 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:14.813 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.813 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:14.813 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:14.813 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:14.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.814 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:14.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:14.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:14.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554934+0000", 2023-01-02T18:19:14.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5679999999999999e-06 2023-01-02T18:19:14.816 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.817 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.817 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554940+0000", 2023-01-02T18:19:14.817 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866999999999999e-05 2023-01-02T18:19:14.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554951+0000", 2023-01-02T18:19:14.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9819999999999999e-06 2023-01-02T18:19:14.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554956+0000", 2023-01-02T18:19:14.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003315634 2023-01-02T18:19:14.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558271+0000", 2023-01-02T18:19:14.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3561999999999997e-05 2023-01-02T18:19:14.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558355+0000", 2023-01-02T18:19:14.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999 2023-01-02T18:19:14.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.822 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.822 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3195 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e102)", 2023-01-02T18:19:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 98.191877425000001, 2023-01-02T18:19:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001, 2023-01-02T18:19:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.823 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3195 2023-01-02T18:19:14.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.825 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:14.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:14.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:14.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453040+0000", 2023-01-02T18:19:14.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0059999999999992e-06 2023-01-02T18:19:14.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453048+0000", 2023-01-02T18:19:14.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4034e-05 2023-01-02T18:19:14.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453062+0000", 2023-01-02T18:19:14.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:14.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453070+0000", 2023-01-02T18:19:14.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6203e-05 2023-01-02T18:19:14.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453166+0000", 2023-01-02T18:19:14.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012608000000000001 2023-01-02T18:19:14.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.832 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453292+0000", 2023-01-02T18:19:14.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019149799999999999 2023-01-02T18:19:14.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:14.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453484+0000", 2023-01-02T18:19:14.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074549399999999997 2023-01-02T18:19:14.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:14.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454229+0000", 2023-01-02T18:19:14.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038527599999999999 2023-01-02T18:19:14.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:14.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454614+0000", 2023-01-02T18:19:14.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0699000000000003e-05 2023-01-02T18:19:14.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454675+0000", 2023-01-02T18:19:14.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8510000000000001e-05 2023-01-02T18:19:14.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454724+0000", 2023-01-02T18:19:14.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001 2023-01-02T18:19:14.837 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.837 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.837 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.838 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3316 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+full_try e106)", 2023-01-02T18:19:14.838 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:14.838 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.322611104999993, 2023-01-02T18:19:14.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002, 2023-01-02T18:19:14.839 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.839 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:14.839 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.839 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.840 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.840 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3316 2023-01-02T18:19:14.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.840 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:14.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:14.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:14.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322306+0000", 2023-01-02T18:19:14.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0338e-05 2023-01-02T18:19:14.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322316+0000", 2023-01-02T18:19:14.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5367999999999999e-05 2023-01-02T18:19:14.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322332+0000", 2023-01-02T18:19:14.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0642000000000001e-05 2023-01-02T18:19:14.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322342+0000", 2023-01-02T18:19:14.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0119999999999999e-05 2023-01-02T18:19:14.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322412+0000", 2023-01-02T18:19:14.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0169999999999996e-06 2023-01-02T18:19:14.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:14.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322420+0000", 2023-01-02T18:19:14.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048005519999999996 2023-01-02T18:19:14.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327221+0000", 2023-01-02T18:19:14.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8480000000000007e-05 2023-01-02T18:19:14.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327310+0000", 2023-01-02T18:19:14.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141008 2023-01-02T18:19:14.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327451+0000", 2023-01-02T18:19:14.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002 2023-01-02T18:19:14.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.851 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.852 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3318 11.5 e106/102 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head v 106'2, mlcod=0'0)", 2023-01-02T18:19:14.852 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:14.852 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.315834229999993, 2023-01-02T18:19:14.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978, 2023-01-02T18:19:14.852 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.852 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.853 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:14.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:14.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:14.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329084+0000", 2023-01-02T18:19:14.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9700000000000002e-06 2023-01-02T18:19:14.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329091+0000", 2023-01-02T18:19:14.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0783e-05 2023-01-02T18:19:14.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329102+0000", 2023-01-02T18:19:14.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5800000000000003e-06 2023-01-02T18:19:14.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329110+0000", 2023-01-02T18:19:14.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102808 2023-01-02T18:19:14.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329213+0000", 2023-01-02T18:19:14.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1041999999999999e-05 2023-01-02T18:19:14.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329234+0000", 2023-01-02T18:19:14.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040932829999999996 2023-01-02T18:19:14.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333327+0000", 2023-01-02T18:19:14.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7880000000000002e-05 2023-01-02T18:19:14.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333375+0000", 2023-01-02T18:19:14.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978 2023-01-02T18:19:14.862 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.862 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.863 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.863 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPull(7.1e e112/111 cost 1049576)", 2023-01-02T18:19:14.863 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:14.864 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.986741443, 2023-01-02T18:19:14.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012, 2023-01-02T18:19:14.864 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.864 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:14.864 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:14.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:14.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:14.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658177+0000", 2023-01-02T18:19:14.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7961e-05 2023-01-02T18:19:14.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658195+0000", 2023-01-02T18:19:14.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7309e-05 2023-01-02T18:19:14.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658212+0000", 2023-01-02T18:19:14.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2859999999999999e-06 2023-01-02T18:19:14.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658220+0000", 2023-01-02T18:19:14.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1268999999999998e-05 2023-01-02T18:19:14.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658292+0000", 2023-01-02T18:19:14.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039592480000000003 2023-01-02T18:19:14.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.662251+0000", 2023-01-02T18:19:14.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012 2023-01-02T18:19:14.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.872 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.872 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.873 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3454 12.1a e121/118 12:5cea7035:::rbd_info:head v 121'1, mlcod=0'0)", 2023-01-02T18:19:14.873 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:14.873 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.913146669, 2023-01-02T18:19:14.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001, 2023-01-02T18:19:14.873 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.874 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.874 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:14.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:14.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:14.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731772+0000", 2023-01-02T18:19:14.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1409999999999999e-06 2023-01-02T18:19:14.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731779+0000", 2023-01-02T18:19:14.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6167999999999998e-05 2023-01-02T18:19:14.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731795+0000", 2023-01-02T18:19:14.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2630000000000003e-06 2023-01-02T18:19:14.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731804+0000", 2023-01-02T18:19:14.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018042000000000001 2023-01-02T18:19:14.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731984+0000", 2023-01-02T18:19:14.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1704000000000001e-05 2023-01-02T18:19:14.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.732006+0000", 2023-01-02T18:19:14.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076487370000000001 2023-01-02T18:19:14.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739655+0000", 2023-01-02T18:19:14.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5726999999999999e-05 2023-01-02T18:19:14.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.883 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739690+0000", 2023-01-02T18:19:14.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001 2023-01-02T18:19:14.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.884 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.884 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.884 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(7.14 133/132 [PushOp(7:2d7624f7:::rbd_id.image26:head, version: 64'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(7:2d7624f7:::rbd_id.image26:head@64'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:19:14.885 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:14.885 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 60.239234637000003, 2023-01-02T18:19:14.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998, 2023-01-02T18:19:14.885 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.885 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:14.886 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:14.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:14.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:14.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405684+0000", 2023-01-02T18:19:14.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2345e-05 2023-01-02T18:19:14.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405697+0000", 2023-01-02T18:19:14.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4418e-05 2023-01-02T18:19:14.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405711+0000", 2023-01-02T18:19:14.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0879999999999999e-05 2023-01-02T18:19:14.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405722+0000", 2023-01-02T18:19:14.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133447 2023-01-02T18:19:14.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405855+0000", 2023-01-02T18:19:14.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5799999999999992e-06 2023-01-02T18:19:14.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405864+0000", 2023-01-02T18:19:14.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022636800000000001 2023-01-02T18:19:14.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408128+0000", 2023-01-02T18:19:14.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998 2023-01-02T18:19:14.894 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.894 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.894 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.895 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:28825 3.16 3:6aa41c7b:::rbd_header.12a211eeb54d:head [watch watch cookie 140114583906128] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:14.895 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:14.895 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 43.618108018999997, 2023-01-02T18:19:14.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737, 2023-01-02T18:19:14.896 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:14.896 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:14.896 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:14.896 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:14.896 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:14.897 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28825 2023-01-02T18:19:14.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.897 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:14.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:14.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:14.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:14.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:14.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:14.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:14.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:14.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:14.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0239999999999999e-06 2023-01-02T18:19:14.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:14.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026815+0000", 2023-01-02T18:19:14.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9989999999999997e-06 2023-01-02T18:19:14.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:14.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026824+0000", 2023-01-02T18:19:14.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1080000000000003e-06 2023-01-02T18:19:14.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.902 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:14.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026828+0000", 2023-01-02T18:19:14.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1114000000000001e-05 2023-01-02T18:19:14.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:14.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026859+0000", 2023-01-02T18:19:14.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1344999999999997e-05 2023-01-02T18:19:14.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:14.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026910+0000", 2023-01-02T18:19:14.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104691 2023-01-02T18:19:14.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:14.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027015+0000", 2023-01-02T18:19:14.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00059966399999999997 2023-01-02T18:19:14.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:14.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027615+0000", 2023-01-02T18:19:14.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018614879999999999 2023-01-02T18:19:14.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:14.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029476+0000", 2023-01-02T18:19:14.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1659999999999998e-05 2023-01-02T18:19:14.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:14.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029508+0000", 2023-01-02T18:19:14.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6330999999999997e-05 2023-01-02T18:19:14.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:14.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:14.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:14.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029594+0000", 2023-01-02T18:19:14.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737 2023-01-02T18:19:14.909 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.910 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.910 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.910 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:14.910 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:14.910 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:14.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:19:14.912 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:14.912+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:15.012 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:15.013+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:15.080 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:15.081 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:15.081 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:15.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:19:15.132 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:15.132+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:15.214 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:15.214+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:15.255 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:15.255 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:15.255 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:15.256 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:15.256 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:15.265 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:19:15.316 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:15.315+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:15.359 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:19:15.399 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:15.399 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:15.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:15.400 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:15.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.400 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:19:15.400 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:15.401 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 139.093368613, 2023-01-02T18:19:15.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:19:15.401 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.401 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:15.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:15.402 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:19:15.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.403 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:15.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:15.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:15.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:19:15.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:19:15.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:19:15.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:19:15.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:19:15.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:19:15.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:19:15.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:19:15.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:19:15.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:19:15.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:15.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:19:15.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:19:15.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:19:15.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:19:15.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:19:15.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:19:15.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:19:15.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:19:15.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.419 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.419 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.420 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:15.420 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:15.420 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 134.08824039199999, 2023-01-02T18:19:15.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:19:15.421 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.421 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.421 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.421 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.422 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.422 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:19:15.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.422 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:15.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:15.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:15.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:19:15.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:19:15.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:19:15.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:19:15.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:19:15.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:19:15.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:19:15.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:19:15.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:19:15.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:19:15.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:19:15.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:19:15.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:19:15.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:19:15.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:19:15.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:19:15.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:15.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:19:15.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:19:15.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:19:15.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:19:15.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:19:15.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:19:15.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:19:15.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:19:15.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:19:15.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:19:15.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.438 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.439 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:19:15.439 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:15.439 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.798175899, 2023-01-02T18:19:15.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:19:15.440 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.440 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.441 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.441 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:19:15.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.441 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:15.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:15.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:15.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:19:15.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:19:15.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:19:15.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:19:15.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:19:15.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:19:15.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:19:15.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:19:15.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:19:15.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:19:15.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:19:15.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:19:15.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:19:15.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:19:15.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:19:15.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:19:15.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:15.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:19:15.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:19:15.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:19:15.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:19:15.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:19:15.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:19:15.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:19:15.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:19:15.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:19:15.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:19:15.457 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.457 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.457 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.458 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:15.458 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:15.458 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 123.799450556, 2023-01-02T18:19:15.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:19:15.459 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.459 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.459 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.460 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:19:15.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.460 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:15.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:15.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:15.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:19:15.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:19:15.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.464 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:19:15.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:19:15.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:19:15.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:19:15.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:19:15.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:19:15.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:19:15.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:19:15.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:19:15.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:19:15.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:19:15.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:19:15.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:19:15.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:19:15.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:15.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:19:15.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:19:15.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:19:15.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:19:15.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:19:15.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:19:15.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:19:15.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:19:15.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:19:15.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:19:15.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.476 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.476 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.476 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:15.477 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:15.477 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 123.77508879200001, 2023-01-02T18:19:15.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:19:15.477 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.477 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.478 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:19:15.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.479 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:15.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:15.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:15.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:19:15.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:19:15.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:19:15.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:19:15.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:19:15.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:19:15.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:19:15.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:19:15.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:19:15.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:19:15.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:19:15.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:19:15.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:15.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:19:15.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:19:15.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:19:15.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:19:15.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:19:15.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:19:15.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:19:15.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:19:15.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:19:15.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:19:15.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.492 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.492 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.493 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:15.493 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:15.493 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 101.069494124, 2023-01-02T18:19:15.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:19:15.493 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.494 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.494 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.494 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:19:15.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.495 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:15.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:15.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:15.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:19:15.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:19:15.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:19:15.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:19:15.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:19:15.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:19:15.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:19:15.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:19:15.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:19:15.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:19:15.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:19:15.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:19:15.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:15.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:19:15.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:19:15.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:19:15.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:19:15.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:19:15.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:19:15.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:19:15.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:19:15.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:19:15.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:19:15.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.508 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.508 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.509 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3321 11.1 11:81555d77:::rbd_object_map.12a2d6b452e6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:15.509 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:15.509 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.061789055999995, 2023-01-02T18:19:15.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002, 2023-01-02T18:19:15.510 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.510 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.510 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.510 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.511 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.511 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3321 2023-01-02T18:19:15.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.511 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:15.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336124+0000", 2023-01-02T18:19:15.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:15.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.514 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.514 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336122+0000", 2023-01-02T18:19:15.514 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000004e-06 2023-01-02T18:19:15.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.515 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336130+0000", 2023-01-02T18:19:15.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4102e-05 2023-01-02T18:19:15.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.516 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336144+0000", 2023-01-02T18:19:15.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8210000000000004e-06 2023-01-02T18:19:15.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336151+0000", 2023-01-02T18:19:15.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6598999999999998e-05 2023-01-02T18:19:15.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336208+0000", 2023-01-02T18:19:15.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8439999999999998e-06 2023-01-02T18:19:15.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.336216+0000", 2023-01-02T18:19:15.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0028909740000000001 2023-01-02T18:19:15.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339107+0000", 2023-01-02T18:19:15.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1304999999999994e-05 2023-01-02T18:19:15.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339198+0000", 2023-01-02T18:19:15.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030390899999999999 2023-01-02T18:19:15.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:15.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.339502+0000", 2023-01-02T18:19:15.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00165285 2023-01-02T18:19:15.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341155+0000", 2023-01-02T18:19:15.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00047942200000000002 2023-01-02T18:19:15.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341634+0000", 2023-01-02T18:19:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1620999999999998e-05 2023-01-02T18:19:15.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341696+0000", 2023-01-02T18:19:15.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0988999999999997e-05 2023-01-02T18:19:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.341737+0000", 2023-01-02T18:19:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056128330000000002 2023-01-02T18:19:15.526 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.527 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:19:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.017086307, 2023-01-02T18:19:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:19:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.528 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.529 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:19:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:15.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:15.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:19:15.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:19:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:19:15.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:19:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:19:15.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:19:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:19:15.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:19:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:19:15.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:19:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:19:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:19:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:15.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:19:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:19:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:19:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:19:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:19:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:19:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:19:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:19:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:19:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:19:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:19:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:15.544 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.986756791000005, 2023-01-02T18:19:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:19:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.545 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:19:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.546 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:15.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:19:15.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:19:15.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:19:15.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:19:15.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:19:15.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:19:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:19:15.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:19:15.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:19:15.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:19:15.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:19:15.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:19:15.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:15.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:19:15.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:19:15.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:19:15.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:19:15.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:19:15.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:19:15.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:19:15.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:19:15.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:19:15.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:19:15.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.560 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.560 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.561 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:19:15.561 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:15.561 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 79.886310125999998, 2023-01-02T18:19:15.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:19:15.562 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.562 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.562 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.563 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.563 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:19:15.563 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.563 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.564 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.564 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:15.564 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.564 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.564 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.565 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.565 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:15.565 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:15.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:19:15.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:19:15.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:19:15.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:19:15.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:19:15.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:19:15.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:19:15.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:19:15.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:19:15.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:19:15.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:19:15.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:19:15.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:15.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:19:15.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:19:15.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:19:15.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:19:15.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:19:15.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:19:15.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:19:15.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:19:15.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:19:15.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:19:15.576 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.577 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.577 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.577 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:19:15.578 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:15.578 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.530772880000001, 2023-01-02T18:19:15.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:19:15.578 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.578 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.579 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.579 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:19:15.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.580 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:15.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.581 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:15.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:15.582 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.582 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:19:15.583 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:19:15.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.583 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:19:15.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:19:15.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:19:15.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:19:15.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.585 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:19:15.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:19:15.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.586 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:19:15.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:19:15.587 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:19:15.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:19:15.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:19:15.589 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:19:15.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:19:15.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:19:15.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:15.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:19:15.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:19:15.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:19:15.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:19:15.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.593 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.593 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.593 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:19:15.593 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:19:15.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:19:15.594 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.595 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.595 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.595 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:19:15.595 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:19:15.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.596 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.596 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.597 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:19:15.597 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:15.597 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.519868236999997, 2023-01-02T18:19:15.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:19:15.597 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.598 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:15.598 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.598 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.598 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.598 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:19:15.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.599 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:15.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:15.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:15.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.601 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:19:15.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:19:15.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.602 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:19:15.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:19:15.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.604 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:19:15.604 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:19:15.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:19:15.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:19:15.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.605 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.605 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.606 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:19:15.606 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:19:15.606 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.608 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:15.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:19:15.609 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:19:15.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.610 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.610 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:19:15.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:19:15.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:19:15.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:19:15.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:19:15.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:19:15.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:19:15.613 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.613 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:19:15.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:19:15.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:19:15.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:19:15.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.616 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.616 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:19:15.616 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:15.616 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 56.493925398000002, 2023-01-02T18:19:15.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:19:15.617 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.617 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.618 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:19:15.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.618 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:15.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.619 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:15.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:15.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:19:15.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:19:15.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:19:15.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:19:15.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:19:15.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:19:15.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:19:15.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:19:15.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.625 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:19:15.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:19:15.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:19:15.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:19:15.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:19:15.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:19:15.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:19:15.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:19:15.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:15.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:19:15.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:19:15.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:19:15.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:19:15.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:19:15.631 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:19:15.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.632 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:19:15.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:19:15.633 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.633 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.633 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:19:15.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:19:15.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.634 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.634 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.635 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:19:15.635 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:15.635 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.719148283000003, 2023-01-02T18:19:15.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:19:15.635 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.636 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:15.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.636 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.636 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:19:15.637 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.637 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.637 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.637 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.638 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:15.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.638 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.638 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.638 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.639 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:15.639 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:15.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.639 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.639 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:19:15.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:19:15.640 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:19:15.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:19:15.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:19:15.642 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:19:15.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:19:15.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:19:15.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:19:15.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:19:15.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.645 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.645 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:19:15.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:19:15.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.646 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:19:15.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:19:15.646 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.647 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:19:15.647 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:19:15.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.648 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.648 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:19:15.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:19:15.648 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.649 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.649 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.649 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.650 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:19:15.650 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:15.650 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 52.674643250000003, 2023-01-02T18:19:15.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:19:15.650 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.651 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.651 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.651 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.651 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.651 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:19:15.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.652 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.653 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:15.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.653 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.653 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.654 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:15.654 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:15.654 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.654 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.654 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.655 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:19:15.655 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:19:15.655 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.655 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.655 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.656 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:19:15.656 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:19:15.656 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.656 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:19:15.657 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:19:15.657 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.657 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:19:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:19:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:19:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:19:15.659 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:19:15.660 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:19:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:19:15.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:19:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:19:15.662 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:19:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.663 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:19:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:19:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:19:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:19:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.665 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:19:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:19:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.666 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:15.667 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 34.473659994000002, 2023-01-02T18:19:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:19:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.668 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:19:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:15.671 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:19:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:19:15.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:19:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:19:15.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:19:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:19:15.674 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:19:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:19:15.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:19:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:19:15.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:19:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:19:15.677 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:19:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:19:15.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:19:15.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:19:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:19:15.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:19:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:19:15.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:19:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:19:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:19:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 34.272407291, 2023-01-02T18:19:15.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:19:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.685 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:19:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.688 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:19:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:19:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.689 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:19:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:19:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.690 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:19:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:19:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.691 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:19:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:19:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:19:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:19:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.693 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:19:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:19:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:19:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:19:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:19:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:19:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:19:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:19:15.697 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:19:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:19:15.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:19:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:19:15.699 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.700 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35555 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [read 45056~4096] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e149)", 2023-01-02T18:19:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 34.000580825999997, 2023-01-02T18:19:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997, 2023-01-02T18:19:15.701 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.702 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35555 2023-01-02T18:19:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397332+0000", 2023-01-02T18:19:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5999999999999998e-06 2023-01-02T18:19:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397335+0000", 2023-01-02T18:19:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0539999999999997e-06 2023-01-02T18:19:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397342+0000", 2023-01-02T18:19:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2090000000000001e-06 2023-01-02T18:19:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397345+0000", 2023-01-02T18:19:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5210000000000002e-05 2023-01-02T18:19:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.709 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397401+0000", 2023-01-02T18:19:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8177999999999996e-05 2023-01-02T18:19:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.710 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.397479+0000", 2023-01-02T18:19:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052113059999999998 2023-01-02T18:19:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.711 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.402690+0000", 2023-01-02T18:19:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053580069999999997 2023-01-02T18:19:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.712 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4565.0:10838 3.d e156/147 3:b21fdca0:::rbd_id.image57:head v 156'10, mlcod=137'8)", 2023-01-02T18:19:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:15.713 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 20.031151704999999, 2023-01-02T18:19:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489, 2023-01-02T18:19:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366761+0000", 2023-01-02T18:19:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8000000000000001e-06 2023-01-02T18:19:15.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366767+0000", 2023-01-02T18:19:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0953e-05 2023-01-02T18:19:15.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366778+0000", 2023-01-02T18:19:15.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8860000000000003e-06 2023-01-02T18:19:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366783+0000", 2023-01-02T18:19:15.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3716e-05 2023-01-02T18:19:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366827+0000", 2023-01-02T18:19:15.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3964999999999998e-05 2023-01-02T18:19:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366851+0000", 2023-01-02T18:19:15.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054574560000000003 2023-01-02T18:19:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372308+0000", 2023-01-02T18:19:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2353e-05 2023-01-02T18:19:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372341+0000", 2023-01-02T18:19:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005579489 2023-01-02T18:19:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54804 3.17 3:ec8e444a:::rbd_header.12a28f082913:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.024087062, 2023-01-02T18:19:15.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001, 2023-01-02T18:19:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:15.727 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54804 2023-01-02T18:19:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:15.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.729 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373824+0000", 2023-01-02T18:19:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9380000000000004e-06 2023-01-02T18:19:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373834+0000", 2023-01-02T18:19:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6818999999999999e-05 2023-01-02T18:19:15.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373851+0000", 2023-01-02T18:19:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.481e-06 2023-01-02T18:19:15.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373858+0000", 2023-01-02T18:19:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2268999999999998e-05 2023-01-02T18:19:15.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373900+0000", 2023-01-02T18:19:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1660000000000002e-06 2023-01-02T18:19:15.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373906+0000", 2023-01-02T18:19:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060814570000000002 2023-01-02T18:19:15.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.379987+0000", 2023-01-02T18:19:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015394200000000001 2023-01-02T18:19:15.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380141+0000", 2023-01-02T18:19:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026425999999999999 2023-01-02T18:19:15.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380405+0000", 2023-01-02T18:19:15.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00098840499999999993 2023-01-02T18:19:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381394+0000", 2023-01-02T18:19:15.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1028e-05 2023-01-02T18:19:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381405+0000", 2023-01-02T18:19:15.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9657999999999997e-05 2023-01-02T18:19:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381464+0000", 2023-01-02T18:19:15.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1522e-05 2023-01-02T18:19:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381506+0000", 2023-01-02T18:19:15.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001 2023-01-02T18:19:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:15.744 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:15.745 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:15.746 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:15.746+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:15.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:19:15.847 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:15.847+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:15.878 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:15.878 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:15.879 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:15.879 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:15.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:19:15.948 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:15.948+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:16.049 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:16.049+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:16.053 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:16.053 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:16.053 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:16.053 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:16.054 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:16.063 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:19:16.149 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:16.150+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:16.230 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:16.230 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:16.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:16.230 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:16.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.231 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:19:16.231 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:16.231 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 148.91081638, 2023-01-02T18:19:16.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:19:16.232 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.232 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.232 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.232 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.232 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.233 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:19:16.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.233 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:16.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:16.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:16.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:19:16.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:19:16.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:19:16.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:19:16.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:19:16.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:19:16.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:19:16.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:19:16.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:19:16.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:16.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:16.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:19:16.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:19:16.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:19:16.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:19:16.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:19:16.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:19:16.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:16.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:19:16.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:19:16.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:19:16.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:19:16.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:19:16.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:19:16.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:19:16.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:19:16.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:19:16.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:19:16.249 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.249 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.250 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.250 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:19:16.250 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:16.251 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 143.89573292399999, 2023-01-02T18:19:16.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:19:16.251 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.251 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.251 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.252 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.252 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.252 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:19:16.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.252 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:16.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:16.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:16.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:19:16.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:19:16.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:19:16.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:19:16.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:19:16.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:19:16.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:19:16.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:19:16.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:19:16.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:19:16.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:19:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:19:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:19:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:19:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:19:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:19:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:16.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:19:16.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:19:16.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:19:16.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:19:16.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:19:16.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:19:16.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:19:16.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:19:16.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:19:16.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:19:16.268 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.268 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.268 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.269 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:16.269 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:16.269 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 134.91103534699999, 2023-01-02T18:19:16.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:19:16.270 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.270 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.270 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.270 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.271 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.271 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:19:16.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.271 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:16.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:16.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:16.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:19:16.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:19:16.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:19:16.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:19:16.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:19:16.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:19:16.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:19:16.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:19:16.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:19:16.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:19:16.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:19:16.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:19:16.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:19:16.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:19:16.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:19:16.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:19:16.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:16.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:19:16.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:19:16.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:19:16.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:19:16.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:19:16.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:19:16.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:19:16.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:19:16.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:19:16.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:19:16.286 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.286 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.287 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:19:16.287 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:16.288 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 120.913010656, 2023-01-02T18:19:16.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:19:16.288 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.288 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.289 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.289 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.289 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.289 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:19:16.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.290 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:16.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:16.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:16.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:19:16.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:19:16.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:19:16.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:19:16.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:19:16.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:19:16.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:19:16.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:19:16.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:19:16.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:19:16.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:19:16.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:19:16.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:19:16.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:19:16.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:19:16.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:19:16.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:16.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:19:16.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:19:16.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:19:16.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:19:16.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:19:16.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:19:16.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:19:16.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:19:16.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:19:16.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:19:16.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.305 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.305 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.305 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:19:16.306 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:16.306 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.91195220199999, 2023-01-02T18:19:16.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:19:16.306 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.306 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.306 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.307 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.307 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.307 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:19:16.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.307 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:16.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:16.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:16.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:19:16.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:19:16.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:19:16.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:19:16.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:19:16.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:19:16.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:19:16.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:19:16.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:19:16.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:19:16.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:19:16.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:19:16.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:19:16.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:19:16.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:19:16.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:19:16.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:16.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:19:16.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:19:16.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:19:16.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:19:16.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:19:16.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:19:16.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:19:16.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:19:16.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:19:16.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:19:16.322 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.322 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.323 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.323 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:19:16.323 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:16.323 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 118.906587555, 2023-01-02T18:19:16.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:19:16.324 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.324 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.324 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.325 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.325 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.325 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:19:16.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.325 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:16.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:16.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:16.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:19:16.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:19:16.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:19:16.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:19:16.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:19:16.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:19:16.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:19:16.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:19:16.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:19:16.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:19:16.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:19:16.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:19:16.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:19:16.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:19:16.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:19:16.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:19:16.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:16.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:19:16.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:19:16.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:19:16.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:19:16.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:19:16.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:19:16.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:19:16.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:19:16.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:19:16.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:19:16.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.340 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.340 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.341 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2191 3.13 3:c9901fad:::rbd_object_map.11d5ac377738.000000000000000e:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e87)", 2023-01-02T18:19:16.341 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:16.341 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 115.888748941, 2023-01-02T18:19:16.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996, 2023-01-02T18:19:16.342 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.342 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.342 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.342 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.343 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.343 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2191 2023-01-02T18:19:16.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.343 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:16.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340118+0000", 2023-01-02T18:19:16.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:16.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340115+0000", 2023-01-02T18:19:16.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2921999999999999e-05 2023-01-02T18:19:16.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340128+0000", 2023-01-02T18:19:16.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9213000000000001e-05 2023-01-02T18:19:16.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340147+0000", 2023-01-02T18:19:16.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0695e-05 2023-01-02T18:19:16.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340158+0000", 2023-01-02T18:19:16.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1227000000000001e-05 2023-01-02T18:19:16.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340229+0000", 2023-01-02T18:19:16.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7239999999999992e-06 2023-01-02T18:19:16.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.340237+0000", 2023-01-02T18:19:16.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001423248 2023-01-02T18:19:16.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341660+0000", 2023-01-02T18:19:16.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000158319 2023-01-02T18:19:16.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.341818+0000", 2023-01-02T18:19:16.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019205099999999999 2023-01-02T18:19:16.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:16.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.342011+0000", 2023-01-02T18:19:16.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001641558 2023-01-02T18:19:16.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.343652+0000", 2023-01-02T18:19:16.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001445895 2023-01-02T18:19:16.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345098+0000", 2023-01-02T18:19:16.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4589000000000003e-05 2023-01-02T18:19:16.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345143+0000", 2023-01-02T18:19:16.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9351000000000001e-05 2023-01-02T18:19:16.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:20.345172+0000", 2023-01-02T18:19:16.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050542929999999996 2023-01-02T18:19:16.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.358 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.359 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:19:16.359 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:16.359 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 113.86625605499999, 2023-01-02T18:19:16.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:19:16.360 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.360 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.360 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.360 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.361 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.361 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:19:16.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.361 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:16.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:16.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:16.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:19:16.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:19:16.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:19:16.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:19:16.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:19:16.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:19:16.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:19:16.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:19:16.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:19:16.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:19:16.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:19:16.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:19:16.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:19:16.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:19:16.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:19:16.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:19:16.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:16.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:19:16.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:19:16.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:19:16.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:19:16.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:19:16.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:19:16.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:19:16.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:19:16.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:19:16.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:19:16.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.376 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.376 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.377 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:16.377 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:16.377 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 109.86168580499999, 2023-01-02T18:19:16.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:19:16.378 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.378 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.378 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.379 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:19:16.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.379 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:16.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:16.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:16.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:19:16.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:19:16.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:19:16.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:19:16.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:19:16.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:19:16.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:19:16.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:19:16.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:19:16.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:19:16.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:19:16.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:19:16.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:19:16.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:19:16.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:19:16.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:19:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:19:16.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:19:16.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:19:16.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:19:16.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:19:16.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:19:16.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:19:16.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:19:16.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:19:16.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:19:16.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.394 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.394 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.395 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:19:16.395 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:16.395 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 108.848853789, 2023-01-02T18:19:16.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:19:16.395 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.396 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.396 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.396 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:19:16.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.397 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:16.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:16.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:16.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:19:16.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:19:16.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:19:16.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:19:16.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:19:16.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:19:16.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:19:16.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:19:16.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:19:16.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:19:16.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:19:16.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:19:16.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:19:16.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:19:16.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:19:16.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:19:16.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:16.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:19:16.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:19:16.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:19:16.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:19:16.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:19:16.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:19:16.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:19:16.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:19:16.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:19:16.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:19:16.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.412 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.412 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.413 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:19:16.413 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:16.413 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.90012029, 2023-01-02T18:19:16.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:19:16.414 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.414 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.414 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.414 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.415 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.415 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:19:16.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.415 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:16.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:16.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:16.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:19:16.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:19:16.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:19:16.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:19:16.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:19:16.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:19:16.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:19:16.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:19:16.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:19:16.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:19:16.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:19:16.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:19:16.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:19:16.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:19:16.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:19:16.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:19:16.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:16.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:19:16.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:19:16.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:19:16.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:19:16.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:19:16.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:19:16.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:19:16.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:19:16.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:19:16.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:19:16.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.430 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.431 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.431 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:16.431 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:16.431 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.900277235999994, 2023-01-02T18:19:16.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:19:16.432 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.432 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.432 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.432 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.433 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.433 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:19:16.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.433 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:16.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:16.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:16.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:19:16.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:19:16.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:19:16.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:19:16.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:19:16.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:19:16.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:19:16.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:19:16.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:19:16.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:19:16.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:19:16.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:19:16.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:19:16.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:19:16.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:19:16.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:19:16.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:19:16.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:19:16.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:19:16.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:19:16.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:19:16.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:19:16.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:19:16.445 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.446 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.446 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.446 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:16.447 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:16.447 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.357238012000003, 2023-01-02T18:19:16.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:19:16.447 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.447 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.448 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.448 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:19:16.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.448 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:16.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:16.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:16.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:19:16.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:19:16.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:19:16.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:19:16.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:19:16.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:19:16.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:19:16.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:19:16.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:19:16.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:19:16.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:19:16.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:19:16.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:16.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:19:16.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:19:16.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:19:16.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:19:16.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:19:16.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:19:16.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:19:16.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:19:16.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:19:16.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:19:16.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.461 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.462 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:16.462 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:16.462 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 20.862631270000001, 2023-01-02T18:19:16.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:19:16.463 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.463 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.463 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.463 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:16.463 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:16.464 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:19:16.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.464 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:16.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:16.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:16.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:19:16.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:19:16.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:19:16.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:19:16.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:19:16.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:19:16.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:19:16.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:19:16.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:19:16.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:19:16.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:19:16.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:19:16.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:16.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:19:16.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:19:16.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:19:16.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:19:16.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:19:16.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:19:16.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:19:16.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:19:16.475 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.476 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.476 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:19:16.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:19:16.476 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.476 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.477 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.477 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.477 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.477 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54769 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e160)", 2023-01-02T18:19:16.477 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:16.478 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.88893657, 2023-01-02T18:19:16.478 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999, 2023-01-02T18:19:16.478 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.478 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.479 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.479 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.479 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54769 2023-01-02T18:19:16.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.479 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:16.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:16.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:16.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339928+0000", 2023-01-02T18:19:16.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0937e-05 2023-01-02T18:19:16.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339939+0000", 2023-01-02T18:19:16.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8923000000000002e-05 2023-01-02T18:19:16.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339958+0000", 2023-01-02T18:19:16.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4999999999999999e-06 2023-01-02T18:19:16.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339966+0000", 2023-01-02T18:19:16.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1886999999999999e-05 2023-01-02T18:19:16.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340028+0000", 2023-01-02T18:19:16.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9189999999999999e-06 2023-01-02T18:19:16.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340036+0000", 2023-01-02T18:19:16.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012331458999999999 2023-01-02T18:19:16.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352367+0000", 2023-01-02T18:19:16.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5671000000000001e-05 2023-01-02T18:19:16.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.489 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.489 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352443+0000", 2023-01-02T18:19:16.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028359799999999998 2023-01-02T18:19:16.489 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.489 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:16.490 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352727+0000", 2023-01-02T18:19:16.490 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089580699999999998 2023-01-02T18:19:16.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.490 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353622+0000", 2023-01-02T18:19:16.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163995 2023-01-02T18:19:16.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353786+0000", 2023-01-02T18:19:16.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7710000000000002e-05 2023-01-02T18:19:16.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353834+0000", 2023-01-02T18:19:16.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3380999999999999e-05 2023-01-02T18:19:16.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353857+0000", 2023-01-02T18:19:16.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999 2023-01-02T18:19:16.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.494 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.494 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.495 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54785 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:16.495 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:16.495 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.885268839, 2023-01-02T18:19:16.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348, 2023-01-02T18:19:16.495 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.496 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.496 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.496 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.496 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.496 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54785 2023-01-02T18:19:16.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.497 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:16.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:16.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:16.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343595+0000", 2023-01-02T18:19:16.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2480000000000002e-06 2023-01-02T18:19:16.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343605+0000", 2023-01-02T18:19:16.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6588000000000001e-05 2023-01-02T18:19:16.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343621+0000", 2023-01-02T18:19:16.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2490000000000004e-06 2023-01-02T18:19:16.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343629+0000", 2023-01-02T18:19:16.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3723000000000001e-05 2023-01-02T18:19:16.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343672+0000", 2023-01-02T18:19:16.503 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.04e-06 2023-01-02T18:19:16.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.504 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.504 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343677+0000", 2023-01-02T18:19:16.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054799280000000002 2023-01-02T18:19:16.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.505 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349157+0000", 2023-01-02T18:19:16.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010108299999999999 2023-01-02T18:19:16.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349258+0000", 2023-01-02T18:19:16.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000406179 2023-01-02T18:19:16.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:16.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349665+0000", 2023-01-02T18:19:16.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051027499999999996 2023-01-02T18:19:16.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354767+0000", 2023-01-02T18:19:16.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000482819 2023-01-02T18:19:16.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355250+0000", 2023-01-02T18:19:16.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7871999999999998e-05 2023-01-02T18:19:16.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355298+0000", 2023-01-02T18:19:16.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6105e-05 2023-01-02T18:19:16.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355344+0000", 2023-01-02T18:19:16.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348 2023-01-02T18:19:16.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.512 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.513 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54793 3.12 3:48f2e415:::rbd_object_map.12a21a1bf873:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:16.513 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:16.513 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.869527191, 2023-01-02T18:19:16.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048462100000000001, 2023-01-02T18:19:16.514 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.514 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.514 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.514 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.514 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.515 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54793 2023-01-02T18:19:16.515 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.515 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.515 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.515 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.516 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:16.516 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.516 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359339+0000", 2023-01-02T18:19:16.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:16.517 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359338+0000", 2023-01-02T18:19:16.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5590000000000002e-06 2023-01-02T18:19:16.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359345+0000", 2023-01-02T18:19:16.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4041e-05 2023-01-02T18:19:16.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359359+0000", 2023-01-02T18:19:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8009999999999998e-06 2023-01-02T18:19:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359366+0000", 2023-01-02T18:19:16.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7101000000000002e-05 2023-01-02T18:19:16.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359413+0000", 2023-01-02T18:19:16.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0733e-05 2023-01-02T18:19:16.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359504+0000", 2023-01-02T18:19:16.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018615799999999999 2023-01-02T18:19:16.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:16.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.359690+0000", 2023-01-02T18:19:16.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000870461 2023-01-02T18:19:16.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.360560+0000", 2023-01-02T18:19:16.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035062750000000001 2023-01-02T18:19:16.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.525 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.525 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.526 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364066+0000", 2023-01-02T18:19:16.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7508000000000005e-05 2023-01-02T18:19:16.526 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.526 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364134+0000", 2023-01-02T18:19:16.527 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1615e-05 2023-01-02T18:19:16.527 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.364186+0000", 2023-01-02T18:19:16.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048462100000000001 2023-01-02T18:19:16.528 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.528 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.528 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.529 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56246 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:16.529 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:16.529 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.583867716, 2023-01-02T18:19:16.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998, 2023-01-02T18:19:16.530 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.530 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.530 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.531 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56246 2023-01-02T18:19:16.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.531 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:16.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:16.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:16.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644998+0000", 2023-01-02T18:19:16.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2189999999999998e-06 2023-01-02T18:19:16.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645002+0000", 2023-01-02T18:19:16.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0909999999999993e-06 2023-01-02T18:19:16.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645010+0000", 2023-01-02T18:19:16.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6880000000000001e-06 2023-01-02T18:19:16.536 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.537 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645014+0000", 2023-01-02T18:19:16.537 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6795999999999998e-05 2023-01-02T18:19:16.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.537 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.538 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645051+0000", 2023-01-02T18:19:16.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000001e-05 2023-01-02T18:19:16.538 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.538 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.538 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.539 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645135+0000", 2023-01-02T18:19:16.539 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199557 2023-01-02T18:19:16.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.539 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:16.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645335+0000", 2023-01-02T18:19:16.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00070655299999999996 2023-01-02T18:19:16.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.646041+0000", 2023-01-02T18:19:16.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047206009999999996 2023-01-02T18:19:16.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650762+0000", 2023-01-02T18:19:16.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5790999999999997e-05 2023-01-02T18:19:16.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650798+0000", 2023-01-02T18:19:16.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4202999999999997e-05 2023-01-02T18:19:16.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650842+0000", 2023-01-02T18:19:16.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998 2023-01-02T18:19:16.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.544 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.544 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.545 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56449 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", 2023-01-02T18:19:16.545 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:16.545 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.8594739760000003, 2023-01-02T18:19:16.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305, 2023-01-02T18:19:16.546 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.546 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.546 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56449 2023-01-02T18:19:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.550 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369390+0000", 2023-01-02T18:19:16.550 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1600000000000001e-05 2023-01-02T18:19:16.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.550 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.551 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369402+0000", 2023-01-02T18:19:16.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8179999999999999e-05 2023-01-02T18:19:16.551 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.551 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.551 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369420+0000", 2023-01-02T18:19:16.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.951e-06 2023-01-02T18:19:16.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369427+0000", 2023-01-02T18:19:16.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8652999999999995e-05 2023-01-02T18:19:16.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369496+0000", 2023-01-02T18:19:16.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1131000000000001e-05 2023-01-02T18:19:16.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369507+0000", 2023-01-02T18:19:16.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010015711 2023-01-02T18:19:16.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379523+0000", 2023-01-02T18:19:16.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017405799999999999 2023-01-02T18:19:16.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379697+0000", 2023-01-02T18:19:16.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097878599999999994 2023-01-02T18:19:16.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:16.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.380675+0000", 2023-01-02T18:19:16.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090579699999999996 2023-01-02T18:19:16.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.381581+0000", 2023-01-02T18:19:16.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062692200000000003 2023-01-02T18:19:16.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382208+0000", 2023-01-02T18:19:16.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1279000000000003e-05 2023-01-02T18:19:16.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382239+0000", 2023-01-02T18:19:16.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4488e-05 2023-01-02T18:19:16.561 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.561 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.561 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.562 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382264+0000", 2023-01-02T18:19:16.562 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305 2023-01-02T18:19:16.562 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.562 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.562 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.562 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.563 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.563 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56686 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e174)", 2023-01-02T18:19:16.563 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:16.563 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.8945792619999999, 2023-01-02T18:19:16.563 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999, 2023-01-02T18:19:16.564 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:16.564 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:16.564 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:16.564 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56686 2023-01-02T18:19:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:16.565 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.566 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.567 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:16.568 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334286+0000", 2023-01-02T18:19:16.568 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8629999999999997e-06 2023-01-02T18:19:16.568 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.568 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.568 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334295+0000", 2023-01-02T18:19:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:19:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334308+0000", 2023-01-02T18:19:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7819999999999994e-06 2023-01-02T18:19:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:16.570 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334316+0000", 2023-01-02T18:19:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0328000000000003e-05 2023-01-02T18:19:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.571 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334366+0000", 2023-01-02T18:19:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:19:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:16.572 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334375+0000", 2023-01-02T18:19:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0086939579999999999 2023-01-02T18:19:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343069+0000", 2023-01-02T18:19:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7719000000000004e-05 2023-01-02T18:19:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.574 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343166+0000", 2023-01-02T18:19:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040875599999999997 2023-01-02T18:19:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343575+0000", 2023-01-02T18:19:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00078807900000000001 2023-01-02T18:19:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.576 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.344363+0000", 2023-01-02T18:19:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018956439999999999 2023-01-02T18:19:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346259+0000", 2023-01-02T18:19:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6230999999999997e-05 2023-01-02T18:19:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.578 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346315+0000", 2023-01-02T18:19:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1152000000000002e-05 2023-01-02T18:19:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:16.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346356+0000", 2023-01-02T18:19:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999 2023-01-02T18:19:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.580 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:16.581 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:16.581 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:16.582 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:19:16.584 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:19:16.584 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:16.583+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:16.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:19:16.619 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 6, 7] out_osds: [3, 5, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:19:16.620 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:19:16.620 INFO:tasks.thrashosds.thrasher:Removing osd 1, in_osds are: [0, 1, 2, 6, 7] 2023-01-02T18:19:16.620 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 1 2023-01-02T18:19:16.683 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:16.684+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:16.759 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:16.760 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:16.760 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:19:16.760 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:16.775 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:19:16.778 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:16.784 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:16.785+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:16.801 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:16.827 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:16.847 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:16.866 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:16.885 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:16.886+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:16.887 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:16.912 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:16.919 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:16.920 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:16.931 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:19:16.932 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:19:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:19:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:19:16.933 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:19:16.934 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:19:16.934 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:19:16.934 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:19:16.934 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:19:16.987 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:16.987+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:16.988 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.989 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.989 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.989 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.989 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.990 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 1 2023-01-02T18:19:16.990 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:19:16.990 INFO:tasks.workunit.client.0.smithi007.stdout:child: image65 2023-01-02T18:19:16.990 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65/12a2fc42bad2 2023-01-02T18:19:16.991 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.991 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.991 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.991 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.991 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.992 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.992 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.992 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.992 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.992 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.993 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.993 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.993 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 2 2023-01-02T18:19:16.993 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:19:16.993 INFO:tasks.workunit.client.0.smithi007.stdout:child: image66 2023-01-02T18:19:16.994 INFO:tasks.workunit.client.0.smithi007.stdout:child: image65 2023-01-02T18:19:16.994 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65/12a2fc42bad2 2023-01-02T18:19:16.994 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.994 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66/12a21c75d01a 2023-01-02T18:19:16.994 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.995 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.995 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.995 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.995 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.995 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.996 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.996 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.996 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.996 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.996 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.997 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.997 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.997 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:16.997 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:16.997 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:16.998 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:16.998 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:16.998 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.998 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 3 2023-01-02T18:19:16.998 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 3 2023-01-02T18:19:16.999 INFO:tasks.workunit.client.0.smithi007.stdout:child: image66 2023-01-02T18:19:16.999 INFO:tasks.workunit.client.0.smithi007.stdout:child: image65 2023-01-02T18:19:16.999 INFO:tasks.workunit.client.0.smithi007.stdout:child: image67 2023-01-02T18:19:16.999 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65/12a2fc42bad2 2023-01-02T18:19:16.999 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:16.999 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66/12a21c75d01a 2023-01-02T18:19:17.000 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.000 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image67/12a218971fe3 2023-01-02T18:19:17.000 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.000 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.000 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.001 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.001 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.001 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.001 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.001 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.002 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.002 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.002 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.002 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.002 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 3 2023-01-02T18:19:17.003 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 3 2023-01-02T18:19:17.003 INFO:tasks.workunit.client.0.smithi007.stdout:child: image66 2023-01-02T18:19:17.003 INFO:tasks.workunit.client.0.smithi007.stdout:child: image65 2023-01-02T18:19:17.003 INFO:tasks.workunit.client.0.smithi007.stdout:child: image67 2023-01-02T18:19:17.003 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65/12a2fc42bad2 2023-01-02T18:19:17.004 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.004 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66/12a21c75d01a 2023-01-02T18:19:17.004 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.004 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image67/12a218971fe3 2023-01-02T18:19:17.004 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.005 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.005 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.005 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.005 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.005 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.006 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.006 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.006 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.006 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.006 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.006 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.007 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.007 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:17.007 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.007 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.007 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:17.008 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:17.008 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.008 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 4 2023-01-02T18:19:17.008 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 4 2023-01-02T18:19:17.008 INFO:tasks.workunit.client.0.smithi007.stdout:child: image66 2023-01-02T18:19:17.009 INFO:tasks.workunit.client.0.smithi007.stdout:child: image65 2023-01-02T18:19:17.009 INFO:tasks.workunit.client.0.smithi007.stdout:child: image67 2023-01-02T18:19:17.009 INFO:tasks.workunit.client.0.smithi007.stdout:child: image68 2023-01-02T18:19:17.009 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65/12a2fc42bad2 2023-01-02T18:19:17.009 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.010 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66/12a21c75d01a 2023-01-02T18:19:17.010 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.010 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image67/12a218971fe3 2023-01-02T18:19:17.010 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.010 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image68/12a21d774afb 2023-01-02T18:19:17.011 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.011 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.011 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.011 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.011 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.012 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.012 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.012 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.012 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.012 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.013 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.013 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.013 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.013 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:17.013 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.014 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:17.014 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:17.014 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:17.014 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.014 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:17.014 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:17.015 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:17.015 INFO:tasks.ceph.mon.a.smithi007.stderr:2023-01-02T18:19:16.994+0000 7fe18f96e700 -1 mon.a@0(leader).osd e176 definitely_dead 0 2023-01-02T18:19:17.069 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:17.069 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:17.080 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:19:17.121 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:17.121+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:17.188 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:17.188+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:17.254 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:17.255 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:17.266 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:19:17.307 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:17.307+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:17.390 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:17.390+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:17.442 INFO:teuthology.orchestra.run.smithi007.stderr:marked out osd.1. 2023-01-02T18:19:17.468 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:17.468 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:17.478 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:19:17.519 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:17.519+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:17.591 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:17.591+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:17.644 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:17.645 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:17.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:19:17.698 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:17.698+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:17.780 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:17.780 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:17.790 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:19:17.831 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:17.831+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:17.893 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:17.893+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:17.956 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:17.956 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:17.966 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:19:17.994 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:17.995+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:18.095 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:18.095+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:18.131 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:18.131 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:18.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:19:18.196 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:18.196+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:18.296 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:18.296+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:18.307 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:18.308 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:18.318 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:19:18.402 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:18.402+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:18.499 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:18.499+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:18.540 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:18.541 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:18.555 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:19:18.586 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:19:18.599 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:18.599+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:18.700 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:18.699+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:18.730 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:18.730 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:18.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:19:18.800 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:18.800+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:18.867 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:18.867 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:18.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:19:18.901 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:18.901+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:18.947 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:19:19.005 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:19.002+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:19.041 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:19.042 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:19.051 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:19:19.088 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:19.106 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:19.104+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:19.107 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:19.123 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:19.140 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:19.158 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:19.175 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:19.180 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:19.180 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:19.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:19:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:19:19.181 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.764329678, 2023-01-02T18:19:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:19:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.182 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:19:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:19:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:19:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:19:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:19:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:19:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:19:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:19:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:19:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:19:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:19:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:19:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:19:19.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:19:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:19:19.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:19:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:19:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:19:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:19:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:19:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:19:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:19:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:19:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:19:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:19:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:19:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:19:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:19:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:19:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.198 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:19.199 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:19:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 159.758661416, 2023-01-02T18:19:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:19:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.200 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:19:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:19:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:19:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:19:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:19:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:19:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:19:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:19:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:19:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:19:19.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:19:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:19:19.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:19:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:19.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:19:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:19:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:19:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:19:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:19:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:19:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:19:19.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:19:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:19:19.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:19:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:19:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:19:19.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:19:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:19:19.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:19:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:19:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.215 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:19:19.216 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:19:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 159.75312775399999, 2023-01-02T18:19:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:19:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.217 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:19:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:19:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:19:19.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:19:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:19:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:19:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:19:19.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:19:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:19:19.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:19:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:19:19.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:19:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:19:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:19:19.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:19:19.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:19:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:19:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:19:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:19:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:19:19.229 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 159.66742860100001, 2023-01-02T18:19:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:19:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:19:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:19:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:19:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:19:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:19:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:19:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:19:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:19:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:19:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:19:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:19:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:19:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:19:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:19:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:19:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:19:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:19:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:19:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:19:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:19:19.241 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 155.74547293800001, 2023-01-02T18:19:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:19:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.242 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:19:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:19:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:19:19.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:19.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:19:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:19:19.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:19:19.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:19:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:19:19.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:19:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:19:19.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:19:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:19:19.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:19:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:19:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:19:19.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:19:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:19:19.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:19:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:19:19.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:19:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:19:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:19:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:19:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:19:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:19:19.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:19:19.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:19:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:19:19.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:19:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.259 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:19:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:19:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 154.88069188, 2023-01-02T18:19:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:19:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.260 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:19:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.261 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:19:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:19:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:19.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:19:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:19:19.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:19:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:19:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:19:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:19:19.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:19:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:19:19.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:19:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:19:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:19:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:19:19.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:19:19.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:19:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:19:19.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:19:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:19:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:19:19.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:19:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:19:19.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:19:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:19:19.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:19:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:19:19.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:19:19.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:19:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3507 13.3 e134/124 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head v 134'3, mlcod=133'1)", 2023-01-02T18:19:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:19:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.284497397999999, 2023-01-02T18:19:19.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003658751, 2023-01-02T18:19:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:19:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:19:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894729+0000", 2023-01-02T18:19:19.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001143016 2023-01-02T18:19:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895872+0000", 2023-01-02T18:19:19.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6974999999999999e-05 2023-01-02T18:19:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895889+0000", 2023-01-02T18:19:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4590000000000004e-06 2023-01-02T18:19:19.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895899+0000", 2023-01-02T18:19:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2062000000000001e-05 2023-01-02T18:19:19.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895981+0000", 2023-01-02T18:19:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2603e-05 2023-01-02T18:19:19.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.896004+0000", 2023-01-02T18:19:19.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023445829999999999 2023-01-02T18:19:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.898348+0000", 2023-01-02T18:19:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2809999999999998e-05 2023-01-02T18:19:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.898391+0000", 2023-01-02T18:19:19.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003658751 2023-01-02T18:19:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.291 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.292 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3508 13.3 e134/124 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head v 134'4, mlcod=134'2)", 2023-01-02T18:19:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:19:19.295 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.279354443999999, 2023-01-02T18:19:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035122700000000001, 2023-01-02T18:19:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:19:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:19:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899872+0000", 2023-01-02T18:19:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001146268 2023-01-02T18:19:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901019+0000", 2023-01-02T18:19:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8525999999999998e-05 2023-01-02T18:19:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901037+0000", 2023-01-02T18:19:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.893e-06 2023-01-02T18:19:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901047+0000", 2023-01-02T18:19:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3754000000000001e-05 2023-01-02T18:19:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901101+0000", 2023-01-02T18:19:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5004999999999999e-05 2023-01-02T18:19:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901126+0000", 2023-01-02T18:19:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022245860000000002 2023-01-02T18:19:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.903350+0000", 2023-01-02T18:19:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6918000000000001e-05 2023-01-02T18:19:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.903387+0000", 2023-01-02T18:19:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035122700000000001 2023-01-02T18:19:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.306 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6058 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e137)", 2023-01-02T18:19:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.671994+0000", 2023-01-02T18:19:19.307 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 57.507235952999999, 2023-01-02T18:19:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062282559999999997, 2023-01-02T18:19:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.308 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6058 2023-01-02T18:19:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.671994+0000", 2023-01-02T18:19:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.671994+0000", 2023-01-02T18:19:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.671993+0000", 2023-01-02T18:19:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0279999999999997e-06 2023-01-02T18:19:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.671999+0000", 2023-01-02T18:19:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1270000000000001e-05 2023-01-02T18:19:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.672010+0000", 2023-01-02T18:19:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8229999999999997e-06 2023-01-02T18:19:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.672017+0000", 2023-01-02T18:19:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5556999999999998e-05 2023-01-02T18:19:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.672062+0000", 2023-01-02T18:19:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2729999999999999e-06 2023-01-02T18:19:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.672069+0000", 2023-01-02T18:19:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060877179999999998 2023-01-02T18:19:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678156+0000", 2023-01-02T18:19:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5415999999999998e-05 2023-01-02T18:19:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678222+0000", 2023-01-02T18:19:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062282559999999997 2023-01-02T18:19:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:16193 3.e e140/124 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head v 140'8, mlcod=46'6)", 2023-01-02T18:19:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.876242+0000", 2023-01-02T18:19:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 51.302987362000003, 2023-01-02T18:19:19.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017329062999999999, 2023-01-02T18:19:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876242+0000", 2023-01-02T18:19:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876242+0000", 2023-01-02T18:19:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967296 2023-01-02T18:19:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876242+0000", 2023-01-02T18:19:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023727710000000001 2023-01-02T18:19:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878615+0000", 2023-01-02T18:19:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4155000000000001e-05 2023-01-02T18:19:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878649+0000", 2023-01-02T18:19:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1907e-05 2023-01-02T18:19:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878661+0000", 2023-01-02T18:19:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6368e-05 2023-01-02T18:19:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878717+0000", 2023-01-02T18:19:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2062999999999999e-05 2023-01-02T18:19:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878739+0000", 2023-01-02T18:19:19.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014783843 2023-01-02T18:19:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893523+0000", 2023-01-02T18:19:19.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8170000000000001e-05 2023-01-02T18:19:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893571+0000", 2023-01-02T18:19:19.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017329062999999999 2023-01-02T18:19:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:28804 3.1a 3:5dc8c609:::rbd_data.12a211eeb54d.0000000000000007:head [create,set-alloc-hint object_size 4194304 write_size 4194304,write 4193792~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:31.011945+0000", 2023-01-02T18:19:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.167284193, 2023-01-02T18:19:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004928829, 2023-01-02T18:19:19.332 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.333 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28804 2023-01-02T18:19:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011945+0000", 2023-01-02T18:19:19.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011945+0000", 2023-01-02T18:19:19.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011945+0000", 2023-01-02T18:19:19.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.169e-06 2023-01-02T18:19:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011950+0000", 2023-01-02T18:19:19.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3400000000000004e-06 2023-01-02T18:19:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011959+0000", 2023-01-02T18:19:19.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3769999999999998e-06 2023-01-02T18:19:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011963+0000", 2023-01-02T18:19:19.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5519000000000003e-05 2023-01-02T18:19:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011999+0000", 2023-01-02T18:19:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3139000000000004e-05 2023-01-02T18:19:19.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.012092+0000", 2023-01-02T18:19:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7732999999999994e-05 2023-01-02T18:19:19.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.012190+0000", 2023-01-02T18:19:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095032899999999997 2023-01-02T18:19:19.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.013140+0000", 2023-01-02T18:19:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036617080000000001 2023-01-02T18:19:19.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.016802+0000", 2023-01-02T18:19:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4647999999999998e-05 2023-01-02T18:19:19.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.016837+0000", 2023-01-02T18:19:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7701999999999999e-05 2023-01-02T18:19:19.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.016874+0000", 2023-01-02T18:19:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004928829 2023-01-02T18:19:19.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.347 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:41668 3.b e150/132 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head v 150'17, mlcod=150'13)", 2023-01-02T18:19:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:45.381572+0000", 2023-01-02T18:19:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.797657409000003, 2023-01-02T18:19:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058493620000000003, 2023-01-02T18:19:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.348 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381572+0000", 2023-01-02T18:19:19.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381572+0000", 2023-01-02T18:19:19.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381571+0000", 2023-01-02T18:19:19.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3999999999999997e-06 2023-01-02T18:19:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381578+0000", 2023-01-02T18:19:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0849999999999997e-06 2023-01-02T18:19:19.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381586+0000", 2023-01-02T18:19:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2220000000000001e-06 2023-01-02T18:19:19.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381591+0000", 2023-01-02T18:19:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5863999999999998e-05 2023-01-02T18:19:19.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381617+0000", 2023-01-02T18:19:19.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1165999999999999e-05 2023-01-02T18:19:19.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381628+0000", 2023-01-02T18:19:19.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057652249999999997 2023-01-02T18:19:19.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.387393+0000", 2023-01-02T18:19:19.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.811e-05 2023-01-02T18:19:19.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.387422+0000", 2023-01-02T18:19:19.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058493620000000003 2023-01-02T18:19:19.358 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.358 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.359 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.359 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:41669 3.b e150/132 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head v 150'18, mlcod=150'14)", 2023-01-02T18:19:19.359 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:45.382129+0000", 2023-01-02T18:19:19.360 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.797100610999998, 2023-01-02T18:19:19.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056899669999999998, 2023-01-02T18:19:19.360 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.360 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.360 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382129+0000", 2023-01-02T18:19:19.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382129+0000", 2023-01-02T18:19:19.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:19.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382129+0000", 2023-01-02T18:19:19.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1359999999999999e-06 2023-01-02T18:19:19.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382133+0000", 2023-01-02T18:19:19.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0839999999999992e-06 2023-01-02T18:19:19.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382141+0000", 2023-01-02T18:19:19.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6100000000000002e-06 2023-01-02T18:19:19.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382147+0000", 2023-01-02T18:19:19.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8420000000000001e-05 2023-01-02T18:19:19.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382186+0000", 2023-01-02T18:19:19.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2589999999999998e-05 2023-01-02T18:19:19.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382218+0000", 2023-01-02T18:19:19.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055792439999999997 2023-01-02T18:19:19.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.387798+0000", 2023-01-02T18:19:19.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1338000000000001e-05 2023-01-02T18:19:19.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.387819+0000", 2023-01-02T18:19:19.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056899669999999998 2023-01-02T18:19:19.370 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.370 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.370 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.371 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:46499 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [read 123904~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e151)", 2023-01-02T18:19:19.371 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:46.671188+0000", 2023-01-02T18:19:19.371 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.508041536999997, 2023-01-02T18:19:19.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006141807, 2023-01-02T18:19:19.372 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.372 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:19.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.372 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.373 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 46499 2023-01-02T18:19:19.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.373 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671188+0000", 2023-01-02T18:19:19.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671188+0000", 2023-01-02T18:19:19.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:19.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671186+0000", 2023-01-02T18:19:19.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0696999999999999e-05 2023-01-02T18:19:19.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671197+0000", 2023-01-02T18:19:19.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2023-01-02T18:19:19.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671220+0000", 2023-01-02T18:19:19.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0166000000000001e-05 2023-01-02T18:19:19.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671230+0000", 2023-01-02T18:19:19.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010081600000000001 2023-01-02T18:19:19.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671331+0000", 2023-01-02T18:19:19.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6033e-05 2023-01-02T18:19:19.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:19.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671347+0000", 2023-01-02T18:19:19.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056472010000000001 2023-01-02T18:19:19.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.676994+0000", 2023-01-02T18:19:19.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000336025 2023-01-02T18:19:19.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.677330+0000", 2023-01-02T18:19:19.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006141807 2023-01-02T18:19:19.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.383 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.383 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.384 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10861 3.9 3:90dc8b0a:::rbd_data.11d5fbafd69b.0000000000000000:head [write 512~512 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected e157)", 2023-01-02T18:19:19.384 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.728068+0000", 2023-01-02T18:19:19.384 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.451161343999999, 2023-01-02T18:19:19.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047831870000000004, 2023-01-02T18:19:19.385 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.385 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.385 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.385 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:19.385 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:19.386 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10861 2023-01-02T18:19:19.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.386 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728068+0000", 2023-01-02T18:19:19.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728068+0000", 2023-01-02T18:19:19.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:19.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728067+0000", 2023-01-02T18:19:19.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4490000000000001e-06 2023-01-02T18:19:19.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728072+0000", 2023-01-02T18:19:19.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2730000000000002e-06 2023-01-02T18:19:19.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728080+0000", 2023-01-02T18:19:19.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.703e-06 2023-01-02T18:19:19.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728084+0000", 2023-01-02T18:19:19.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3649e-05 2023-01-02T18:19:19.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728107+0000", 2023-01-02T18:19:19.393 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.778e-05 2023-01-02T18:19:19.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728155+0000", 2023-01-02T18:19:19.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0832e-05 2023-01-02T18:19:19.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:19.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728246+0000", 2023-01-02T18:19:19.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004053971 2023-01-02T18:19:19.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:19.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.732300+0000", 2023-01-02T18:19:19.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045260400000000001 2023-01-02T18:19:19.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:19.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.732753+0000", 2023-01-02T18:19:19.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437999999999999e-05 2023-01-02T18:19:19.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.732811+0000", 2023-01-02T18:19:19.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0377999999999999e-05 2023-01-02T18:19:19.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.732851+0000", 2023-01-02T18:19:19.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047831870000000004 2023-01-02T18:19:19.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.399 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.400 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:12231 3.9 3:90dc8b0a:::rbd_data.11d5fbafd69b.0000000000000000:head [read 4608~512] snapc 0=[] ondisk+read+known_if_redirected e157)", 2023-01-02T18:19:19.400 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:56.121865+0000", 2023-01-02T18:19:19.400 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.057364102000001, 2023-01-02T18:19:19.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039799880000000003, 2023-01-02T18:19:19.400 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.401 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:19.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:19.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:19.401 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 12231 2023-01-02T18:19:19.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.402 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121865+0000", 2023-01-02T18:19:19.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121865+0000", 2023-01-02T18:19:19.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:19.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121865+0000", 2023-01-02T18:19:19.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3789999999999999e-06 2023-01-02T18:19:19.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121869+0000", 2023-01-02T18:19:19.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9989999999999997e-06 2023-01-02T18:19:19.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121878+0000", 2023-01-02T18:19:19.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:19:19.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121884+0000", 2023-01-02T18:19:19.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9502999999999999e-05 2023-01-02T18:19:19.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121913+0000", 2023-01-02T18:19:19.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5633000000000002e-05 2023-01-02T18:19:19.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121959+0000", 2023-01-02T18:19:19.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038867530000000002 2023-01-02T18:19:19.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.125845+0000", 2023-01-02T18:19:19.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039799880000000003 2023-01-02T18:19:19.410 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.411 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.411 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.411 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:16410 3.9 3:90dc8b0a:::rbd_data.11d5fbafd69b.0000000000000000:head [read 4608~512] snapc 0=[] ondisk+read+known_if_redirected e157)", 2023-01-02T18:19:19.412 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:57.250718+0000", 2023-01-02T18:19:19.412 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.928511358000002, 2023-01-02T18:19:19.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003771146, 2023-01-02T18:19:19.412 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.412 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:19.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:19.413 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:19.413 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16410 2023-01-02T18:19:19.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.414 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250718+0000", 2023-01-02T18:19:19.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250718+0000", 2023-01-02T18:19:19.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:19.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250717+0000", 2023-01-02T18:19:19.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6569999999999999e-06 2023-01-02T18:19:19.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250721+0000", 2023-01-02T18:19:19.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7279999999999995e-06 2023-01-02T18:19:19.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250729+0000", 2023-01-02T18:19:19.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7809999999999999e-06 2023-01-02T18:19:19.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250733+0000", 2023-01-02T18:19:19.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8127e-05 2023-01-02T18:19:19.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250761+0000", 2023-01-02T18:19:19.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1230999999999998e-05 2023-01-02T18:19:19.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250812+0000", 2023-01-02T18:19:19.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003677338 2023-01-02T18:19:19.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.254489+0000", 2023-01-02T18:19:19.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003771146 2023-01-02T18:19:19.422 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.423 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.423 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.423 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54785 3.f e161/124 3:f2d07b5d:::rbd_header.12a21a1bf873:head v 161'46, mlcod=160'44)", 2023-01-02T18:19:19.424 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.349777+0000", 2023-01-02T18:19:19.424 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 17.829452852999999, 2023-01-02T18:19:19.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048608970000000003, 2023-01-02T18:19:19.424 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.424 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.425 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349777+0000", 2023-01-02T18:19:19.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.426 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349777+0000", 2023-01-02T18:19:19.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967296 2023-01-02T18:19:19.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.427 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.427 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349777+0000", 2023-01-02T18:19:19.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.442e-06 2023-01-02T18:19:19.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349781+0000", 2023-01-02T18:19:19.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3157e-05 2023-01-02T18:19:19.428 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349794+0000", 2023-01-02T18:19:19.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4240000000000001e-06 2023-01-02T18:19:19.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349800+0000", 2023-01-02T18:19:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9571999999999999e-05 2023-01-02T18:19:19.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349849+0000", 2023-01-02T18:19:19.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5091e-05 2023-01-02T18:19:19.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349864+0000", 2023-01-02T18:19:19.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047321680000000001 2023-01-02T18:19:19.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354596+0000", 2023-01-02T18:19:19.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1255999999999999e-05 2023-01-02T18:19:19.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354638+0000", 2023-01-02T18:19:19.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048608970000000003 2023-01-02T18:19:19.434 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.435 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.435 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.435 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:55850 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e165)", 2023-01-02T18:19:19.435 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.389280+0000", 2023-01-02T18:19:19.436 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.789949193, 2023-01-02T18:19:19.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003377297, 2023-01-02T18:19:19.436 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.436 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:19.436 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.437 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.437 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 55850 2023-01-02T18:19:19.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.437 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389280+0000", 2023-01-02T18:19:19.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389280+0000", 2023-01-02T18:19:19.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:19.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389278+0000", 2023-01-02T18:19:19.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:19:19.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389287+0000", 2023-01-02T18:19:19.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2645e-05 2023-01-02T18:19:19.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389299+0000", 2023-01-02T18:19:19.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6189999999999999e-06 2023-01-02T18:19:19.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389305+0000", 2023-01-02T18:19:19.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2271000000000001e-05 2023-01-02T18:19:19.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389357+0000", 2023-01-02T18:19:19.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1181e-05 2023-01-02T18:19:19.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:19.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389368+0000", 2023-01-02T18:19:19.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030587040000000002 2023-01-02T18:19:19.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.392427+0000", 2023-01-02T18:19:19.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011006999999999999 2023-01-02T18:19:19.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.392537+0000", 2023-01-02T18:19:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120567 2023-01-02T18:19:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.392658+0000", 2023-01-02T18:19:19.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003377297 2023-01-02T18:19:19.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.448 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.448 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:56246 3.13 e165/124 3:c91665cb:::rbd_header.12a261246745:head v 165'87, mlcod=165'85)", 2023-01-02T18:19:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.645413+0000", 2023-01-02T18:19:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.5338169, 2023-01-02T18:19:19.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052432629999999997, 2023-01-02T18:19:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645413+0000", 2023-01-02T18:19:19.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645413+0000", 2023-01-02T18:19:19.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:19.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645412+0000", 2023-01-02T18:19:19.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7649999999999993e-06 2023-01-02T18:19:19.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645420+0000", 2023-01-02T18:19:19.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4603999999999999e-05 2023-01-02T18:19:19.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645434+0000", 2023-01-02T18:19:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7100000000000001e-06 2023-01-02T18:19:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645441+0000", 2023-01-02T18:19:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5796000000000001e-05 2023-01-02T18:19:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645477+0000", 2023-01-02T18:19:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7567999999999998e-05 2023-01-02T18:19:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645494+0000", 2023-01-02T18:19:19.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005128362 2023-01-02T18:19:19.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650623+0000", 2023-01-02T18:19:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3368999999999998e-05 2023-01-02T18:19:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650656+0000", 2023-01-02T18:19:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052432629999999997 2023-01-02T18:19:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.460 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.461 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.461 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:19.462 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:19.462 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:19.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:19:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:19:19.464 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:19:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:19:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:19:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:19:19.465 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'true' 2023-01-02T18:19:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:19:19.466 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:19:19.467 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:19:19.467 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image65 2023-01-02T18:19:19.467 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:19.468 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:19.468 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:19.468 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.468 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 4 2023-01-02T18:19:19.468 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 4 2023-01-02T18:19:19.469 INFO:tasks.workunit.client.0.smithi007.stdout:child: image66 2023-01-02T18:19:19.469 INFO:tasks.workunit.client.0.smithi007.stdout:child: image65 2023-01-02T18:19:19.469 INFO:tasks.workunit.client.0.smithi007.stdout:child: image67 2023-01-02T18:19:19.469 INFO:tasks.workunit.client.0.smithi007.stdout:child: image68 2023-01-02T18:19:19.469 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image65/12a2fc42bad2 2023-01-02T18:19:19.470 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.470 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66/12a21c75d01a 2023-01-02T18:19:19.470 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.470 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image67/12a218971fe3 2023-01-02T18:19:19.470 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.471 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image68/12a21d774afb 2023-01-02T18:19:19.471 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.471 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.471 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.471 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.472 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.472 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.472 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.472 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:19.472 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.473 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:19.473 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:19.473 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.473 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.473 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:19.474 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.474 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image67 2023-01-02T18:19:19.474 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:19.474 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:19.474 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.475 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 3 2023-01-02T18:19:19.475 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 3 2023-01-02T18:19:19.475 INFO:tasks.workunit.client.0.smithi007.stdout:child: image66 2023-01-02T18:19:19.475 INFO:tasks.workunit.client.0.smithi007.stdout:child: image67 2023-01-02T18:19:19.475 INFO:tasks.workunit.client.0.smithi007.stdout:child: image68 2023-01-02T18:19:19.476 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66/12a21c75d01a 2023-01-02T18:19:19.476 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.476 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image67/12a218971fe3 2023-01-02T18:19:19.476 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.476 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image68/12a21d774afb 2023-01-02T18:19:19.477 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.477 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.477 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.477 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.477 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.478 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.478 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.478 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:19.478 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.478 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:19.479 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image68 2023-01-02T18:19:19.479 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.479 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 2 2023-01-02T18:19:19.479 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:19:19.479 INFO:tasks.workunit.client.0.smithi007.stdout:child: image66 2023-01-02T18:19:19.479 INFO:tasks.workunit.client.0.smithi007.stdout:child: image68 2023-01-02T18:19:19.480 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66/12a21c75d01a 2023-01-02T18:19:19.480 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.480 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-14/image68/12a21d774afb 2023-01-02T18:19:19.480 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.480 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.481 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.481 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.481 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66 2023-01-02T18:19:19.481 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.481 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 1 2023-01-02T18:19:19.482 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:19:19.482 INFO:tasks.workunit.client.0.smithi007.stdout:child: image66 2023-01-02T18:19:19.482 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-13/image66/12a21c75d01a 2023-01-02T18:19:19.482 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:19.482 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 0 2023-01-02T18:19:19.483 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 0 2023-01-02T18:19:19.483 INFO:tasks.workunit.client.0.smithi007.stdout:[ OK ] TestLibRBD.ListChildren (12919 ms) 2023-01-02T18:19:19.483 INFO:tasks.workunit.client.0.smithi007.stdout:[ RUN ] TestLibRBD.ListChildrenTiered 2023-01-02T18:19:19.483 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:19.462+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:19.563 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:19.564+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:19.611 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:19.611 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:19.611 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:19.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2023-01-02T18:19:19.664 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:19.664+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:19.765 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:19.765+0000 7f08101d4700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 106892) UID: 0 2023-01-02T18:19:19.785 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:19.785 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:19.785 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:19.785 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:19.786 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:19.795 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2023-01-02T18:19:19.866 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:19.866+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:19.961 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:19.961 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2 3.17 3:ece625d0:::rbd_id.image1:head [stat] snapc 0=[] ondisk+read+known_if_redirected e44)", 2023-01-02T18:19:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:19.962 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 162.54387173000001, 2023-01-02T18:19:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001, 2023-01-02T18:19:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.963 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2 2023-01-02T18:19:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416795+0000", 2023-01-02T18:19:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416794+0000", 2023-01-02T18:19:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1639e-05 2023-01-02T18:19:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.967 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416806+0000", 2023-01-02T18:19:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7169999999999997e-06 2023-01-02T18:19:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.968 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416814+0000", 2023-01-02T18:19:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0390000000000004e-06 2023-01-02T18:19:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.969 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416819+0000", 2023-01-02T18:19:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4200000000000003e-05 2023-01-02T18:19:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416873+0000", 2023-01-02T18:19:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5050000000000004e-06 2023-01-02T18:19:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:19.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.416880+0000", 2023-01-02T18:19:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003595263 2023-01-02T18:19:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420475+0000", 2023-01-02T18:19:19.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5440000000000004e-06 2023-01-02T18:19:19.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:19.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.420482+0000", 2023-01-02T18:19:19.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014728149999999999 2023-01-02T18:19:19.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.421955+0000", 2023-01-02T18:19:19.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5858000000000004e-05 2023-01-02T18:19:19.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:37.422040+0000", 2023-01-02T18:19:19.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052450140000000001 2023-01-02T18:19:19.976 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.976 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.976 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.977 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:19.977 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:19.977 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.53508509100001, 2023-01-02T18:19:19.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997, 2023-01-02T18:19:19.977 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.978 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.978 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.978 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9 2023-01-02T18:19:19.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.979 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:19.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425582+0000", 2023-01-02T18:19:19.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:19.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425580+0000", 2023-01-02T18:19:19.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1592e-05 2023-01-02T18:19:19.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425592+0000", 2023-01-02T18:19:19.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5727e-05 2023-01-02T18:19:19.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:19.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425607+0000", 2023-01-02T18:19:19.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.204e-06 2023-01-02T18:19:19.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:19.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425615+0000", 2023-01-02T18:19:19.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3989000000000002e-05 2023-01-02T18:19:19.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:19.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425659+0000", 2023-01-02T18:19:19.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105519 2023-01-02T18:19:19.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:19.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425764+0000", 2023-01-02T18:19:19.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019538499999999999 2023-01-02T18:19:19.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:19.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425959+0000", 2023-01-02T18:19:19.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0045306399999999998 2023-01-02T18:19:19.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:19.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430490+0000", 2023-01-02T18:19:19.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6642000000000003e-05 2023-01-02T18:19:19.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:19.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430557+0000", 2023-01-02T18:19:19.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4468999999999997e-05 2023-01-02T18:19:19.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:19.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430601+0000", 2023-01-02T18:19:19.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.025e-05 2023-01-02T18:19:19.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:19.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430631+0000", 2023-01-02T18:19:19.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050493509999999997 2023-01-02T18:19:19.992 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.992 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:19.992 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:19.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.993 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:10 3.17 3:ece625d0:::rbd_id.image1:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:19.993 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:19.994 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.529858074, 2023-01-02T18:19:19.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982, 2023-01-02T18:19:19.994 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:19.994 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:19.994 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10 2023-01-02T18:19:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430809+0000", 2023-01-02T18:19:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430808+0000", 2023-01-02T18:19:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2579999999999998e-06 2023-01-02T18:19:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430815+0000", 2023-01-02T18:19:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430828+0000", 2023-01-02T18:19:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8730000000000004e-06 2023-01-02T18:19:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430834+0000", 2023-01-02T18:19:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6267000000000003e-05 2023-01-02T18:19:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430880+0000", 2023-01-02T18:19:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7486999999999997e-05 2023-01-02T18:19:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430978+0000", 2023-01-02T18:19:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000156785 2023-01-02T18:19:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.431135+0000", 2023-01-02T18:19:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089828900000000003 2023-01-02T18:19:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432033+0000", 2023-01-02T18:19:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057836200000000002 2023-01-02T18:19:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432611+0000", 2023-01-02T18:19:20.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7308000000000003e-05 2023-01-02T18:19:20.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432649+0000", 2023-01-02T18:19:20.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4532e-05 2023-01-02T18:19:20.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.432693+0000", 2023-01-02T18:19:20.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001883982 2023-01-02T18:19:20.008 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.008 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.008 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.009 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:14 3.17 3:ece625d0:::rbd_id.image1:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:20.009 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:20.009 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.51834292800001, 2023-01-02T18:19:20.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305, 2023-01-02T18:19:20.010 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.010 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:20.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.011 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 14 2023-01-02T18:19:20.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.011 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:20.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442324+0000", 2023-01-02T18:19:20.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:20.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442323+0000", 2023-01-02T18:19:20.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0670000000000003e-06 2023-01-02T18:19:20.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442330+0000", 2023-01-02T18:19:20.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2111e-05 2023-01-02T18:19:20.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442342+0000", 2023-01-02T18:19:20.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5030000000000002e-06 2023-01-02T18:19:20.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442349+0000", 2023-01-02T18:19:20.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4279999999999997e-05 2023-01-02T18:19:20.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442383+0000", 2023-01-02T18:19:20.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2152999999999999e-05 2023-01-02T18:19:20.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.442445+0000", 2023-01-02T18:19:20.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020234039999999999 2023-01-02T18:19:20.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.444469+0000", 2023-01-02T18:19:20.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002144305 2023-01-02T18:19:20.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.020 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.020 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.021 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:30 3.1c 3:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:20.021 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:20.021 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.50434412999999, 2023-01-02T18:19:20.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702, 2023-01-02T18:19:20.021 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.022 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.022 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.022 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 30 2023-01-02T18:19:20.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.023 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:20.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456323+0000", 2023-01-02T18:19:20.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:20.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456322+0000", 2023-01-02T18:19:20.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.267e-06 2023-01-02T18:19:20.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456329+0000", 2023-01-02T18:19:20.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4963999999999999e-05 2023-01-02T18:19:20.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456344+0000", 2023-01-02T18:19:20.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6860000000000006e-06 2023-01-02T18:19:20.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456352+0000", 2023-01-02T18:19:20.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1700000000000003e-05 2023-01-02T18:19:20.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456403+0000", 2023-01-02T18:19:20.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1058999999999997e-05 2023-01-02T18:19:20.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456494+0000", 2023-01-02T18:19:20.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026174 2023-01-02T18:19:20.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:20.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.456756+0000", 2023-01-02T18:19:20.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00057697200000000003 2023-01-02T18:19:20.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457333+0000", 2023-01-02T18:19:20.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00050206299999999997 2023-01-02T18:19:20.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457835+0000", 2023-01-02T18:19:20.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7630000000000002e-05 2023-01-02T18:19:20.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457893+0000", 2023-01-02T18:19:20.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7191000000000003e-05 2023-01-02T18:19:20.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.457940+0000", 2023-01-02T18:19:20.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00161702 2023-01-02T18:19:20.035 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.035 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.035 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.036 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:31 3.1c 3:3d3f3250:::rbd_id.image2:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:20.036 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:20.036 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.502589723, 2023-01-02T18:19:20.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002, 2023-01-02T18:19:20.037 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.037 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.037 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.037 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.038 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.038 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 31 2023-01-02T18:19:20.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.038 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:20.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:20.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458077+0000", 2023-01-02T18:19:20.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1799999999999999e-06 2023-01-02T18:19:20.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458084+0000", 2023-01-02T18:19:20.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3246e-05 2023-01-02T18:19:20.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458097+0000", 2023-01-02T18:19:20.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6010000000000002e-06 2023-01-02T18:19:20.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458103+0000", 2023-01-02T18:19:20.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2332000000000001e-05 2023-01-02T18:19:20.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.044 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458135+0000", 2023-01-02T18:19:20.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8839999999999996e-05 2023-01-02T18:19:20.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.045 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458234+0000", 2023-01-02T18:19:20.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000148947 2023-01-02T18:19:20.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:20.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.458383+0000", 2023-01-02T18:19:20.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001891876 2023-01-02T18:19:20.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460275+0000", 2023-01-02T18:19:20.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029464600000000002 2023-01-02T18:19:20.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460569+0000", 2023-01-02T18:19:20.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6334e-05 2023-01-02T18:19:20.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460626+0000", 2023-01-02T18:19:20.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7567e-05 2023-01-02T18:19:20.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.460673+0000", 2023-01-02T18:19:20.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0025956590000000002 2023-01-02T18:19:20.050 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.050 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.050 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.051 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:35 3.1c 3:3d3f3250:::rbd_id.image2:head [call] snapc 0=[] ondisk+read+known_if_redirected e46)", 2023-01-02T18:19:20.051 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:20.051 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.493603933, 2023-01-02T18:19:20.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134, 2023-01-02T18:19:20.052 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.052 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:20.052 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.052 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.053 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.053 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 35 2023-01-02T18:19:20.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.053 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:20.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:20.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467063+0000", 2023-01-02T18:19:20.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2440000000000004e-06 2023-01-02T18:19:20.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467067+0000", 2023-01-02T18:19:20.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1679999999999993e-06 2023-01-02T18:19:20.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467076+0000", 2023-01-02T18:19:20.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2880000000000003e-06 2023-01-02T18:19:20.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467080+0000", 2023-01-02T18:19:20.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3101e-05 2023-01-02T18:19:20.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467123+0000", 2023-01-02T18:19:20.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8630999999999999e-05 2023-01-02T18:19:20.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.467212+0000", 2023-01-02T18:19:20.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020884290000000002 2023-01-02T18:19:20.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.469300+0000", 2023-01-02T18:19:20.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002237134 2023-01-02T18:19:20.113 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.113 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.114 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.114 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2821 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:20.114 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:20.115 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.625728126, 2023-01-02T18:19:20.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999, 2023-01-02T18:19:20.115 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.115 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.115 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.116 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.116 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.116 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2821 2023-01-02T18:19:20.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.117 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:20.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334939+0000", 2023-01-02T18:19:20.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:20.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334937+0000", 2023-01-02T18:19:20.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0489999999999993e-06 2023-01-02T18:19:20.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334946+0000", 2023-01-02T18:19:20.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4776999999999999e-05 2023-01-02T18:19:20.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334961+0000", 2023-01-02T18:19:20.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:20.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334968+0000", 2023-01-02T18:19:20.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8257000000000001e-05 2023-01-02T18:19:20.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335027+0000", 2023-01-02T18:19:20.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104551 2023-01-02T18:19:20.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335131+0000", 2023-01-02T18:19:20.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024432700000000002 2023-01-02T18:19:20.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:20.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.335376+0000", 2023-01-02T18:19:20.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00087122800000000004 2023-01-02T18:19:20.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.336247+0000", 2023-01-02T18:19:20.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001616592 2023-01-02T18:19:20.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337863+0000", 2023-01-02T18:19:20.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6448e-05 2023-01-02T18:19:20.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337910+0000", 2023-01-02T18:19:20.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4098999999999999e-05 2023-01-02T18:19:20.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.337954+0000", 2023-01-02T18:19:20.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030149389999999999 2023-01-02T18:19:20.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.130 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.130 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.131 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:2823 10.15 e101/98 10:ab22c825:::rbd_object_map.12a2b7acd9c1:head v 101'1, mlcod=0'0)", 2023-01-02T18:19:20.131 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:20.131 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.620644556, 2023-01-02T18:19:20.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999, 2023-01-02T18:19:20.132 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.132 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.132 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:20.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340023+0000", 2023-01-02T18:19:20.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:20.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340022+0000", 2023-01-02T18:19:20.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6679999999999998e-06 2023-01-02T18:19:20.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340028+0000", 2023-01-02T18:19:20.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9619999999999999e-06 2023-01-02T18:19:20.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340037+0000", 2023-01-02T18:19:20.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9020000000000002e-06 2023-01-02T18:19:20.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340044+0000", 2023-01-02T18:19:20.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000121297 2023-01-02T18:19:20.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340165+0000", 2023-01-02T18:19:20.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7771e-05 2023-01-02T18:19:20.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.340183+0000", 2023-01-02T18:19:20.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022034379999999998 2023-01-02T18:19:20.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342386+0000", 2023-01-02T18:19:20.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3992000000000002e-05 2023-01-02T18:19:20.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.342430+0000", 2023-01-02T18:19:20.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024076779999999999 2023-01-02T18:19:20.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.142 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.142 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.143 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2915 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:20.143 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:20.143 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.54538637100001, 2023-01-02T18:19:20.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001, 2023-01-02T18:19:20.144 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.144 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.144 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.145 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.145 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.145 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2915 2023-01-02T18:19:20.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.146 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:20.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415281+0000", 2023-01-02T18:19:20.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415280+0000", 2023-01-02T18:19:20.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0479999999999998e-06 2023-01-02T18:19:20.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415285+0000", 2023-01-02T18:19:20.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2146e-05 2023-01-02T18:19:20.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415297+0000", 2023-01-02T18:19:20.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6869999999999994e-06 2023-01-02T18:19:20.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415305+0000", 2023-01-02T18:19:20.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7336999999999999e-05 2023-01-02T18:19:20.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415332+0000", 2023-01-02T18:19:20.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0314e-05 2023-01-02T18:19:20.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415382+0000", 2023-01-02T18:19:20.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2730000000000003e-05 2023-01-02T18:19:20.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:20.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415455+0000", 2023-01-02T18:19:20.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00052884199999999996 2023-01-02T18:19:20.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.415984+0000", 2023-01-02T18:19:20.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016222630000000001 2023-01-02T18:19:20.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417606+0000", 2023-01-02T18:19:20.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0604e-05 2023-01-02T18:19:20.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417637+0000", 2023-01-02T18:19:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.366e-05 2023-01-02T18:19:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417660+0000", 2023-01-02T18:19:20.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023795980000000001 2023-01-02T18:19:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2916 10.3 10:c1d27dae:::rbd_header.12a2b7acd9c1:head [delete] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.542784905, 2023-01-02T18:19:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999, 2023-01-02T18:19:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.161 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2916 2023-01-02T18:19:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:20.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417882+0000", 2023-01-02T18:19:20.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417881+0000", 2023-01-02T18:19:20.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7620000000000003e-06 2023-01-02T18:19:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417886+0000", 2023-01-02T18:19:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1369000000000001e-05 2023-01-02T18:19:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417897+0000", 2023-01-02T18:19:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6840000000000004e-06 2023-01-02T18:19:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417902+0000", 2023-01-02T18:19:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0825000000000003e-05 2023-01-02T18:19:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.417943+0000", 2023-01-02T18:19:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4980000000000003e-05 2023-01-02T18:19:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.418028+0000", 2023-01-02T18:19:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014752299999999999 2023-01-02T18:19:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.419503+0000", 2023-01-02T18:19:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016208139999999999 2023-01-02T18:19:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2.7c339972 (undecoded) ondisk+read+known_if_redirected e41)", 2023-01-02T18:19:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.408495067, 2023-01-02T18:19:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312, 2023-01-02T18:19:20.172 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:20.173 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552172+0000", 2023-01-02T18:19:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552171+0000", 2023-01-02T18:19:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3999999999999997e-06 2023-01-02T18:19:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552177+0000", 2023-01-02T18:19:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1396999999999999e-05 2023-01-02T18:19:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552189+0000", 2023-01-02T18:19:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9620000000000001e-06 2023-01-02T18:19:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.552194+0000", 2023-01-02T18:19:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060382329999999996 2023-01-02T18:19:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558232+0000", 2023-01-02T18:19:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3328e-05 2023-01-02T18:19:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558245+0000", 2023-01-02T18:19:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006073312 2023-01-02T18:19:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4200.0:3 2.2 2:4e99cc3e:::rbd_mirror_snapshot_schedule:head [omap-get-vals] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected e101)", 2023-01-02T18:19:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 105.40573189600001, 2023-01-02T18:19:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999, 2023-01-02T18:19:20.183 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4200", 2023-01-02T18:19:20.184 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.57:0/1700798785", 2023-01-02T18:19:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3 2023-01-02T18:19:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554935+0000", 2023-01-02T18:19:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554934+0000", 2023-01-02T18:19:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5679999999999999e-06 2023-01-02T18:19:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554940+0000", 2023-01-02T18:19:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0866999999999999e-05 2023-01-02T18:19:20.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554951+0000", 2023-01-02T18:19:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9819999999999999e-06 2023-01-02T18:19:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.554956+0000", 2023-01-02T18:19:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003315634 2023-01-02T18:19:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558271+0000", 2023-01-02T18:19:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3561999999999997e-05 2023-01-02T18:19:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.558355+0000", 2023-01-02T18:19:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034197659999999999 2023-01-02T18:19:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3195 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e102)", 2023-01-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:20.194 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 103.507625327, 2023-01-02T18:19:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001, 2023-01-02T18:19:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.195 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3195 2023-01-02T18:19:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.196 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453042+0000", 2023-01-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:20.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453040+0000", 2023-01-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0059999999999992e-06 2023-01-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453048+0000", 2023-01-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4034e-05 2023-01-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453062+0000", 2023-01-02T18:19:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6699999999999994e-06 2023-01-02T18:19:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453070+0000", 2023-01-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6203e-05 2023-01-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453166+0000", 2023-01-02T18:19:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012608000000000001 2023-01-02T18:19:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453292+0000", 2023-01-02T18:19:20.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019149799999999999 2023-01-02T18:19:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:20.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.453484+0000", 2023-01-02T18:19:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00074549399999999997 2023-01-02T18:19:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454229+0000", 2023-01-02T18:19:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038527599999999999 2023-01-02T18:19:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454614+0000", 2023-01-02T18:19:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0699000000000003e-05 2023-01-02T18:19:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454675+0000", 2023-01-02T18:19:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8510000000000001e-05 2023-01-02T18:19:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:36.454724+0000", 2023-01-02T18:19:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0016816960000000001 2023-01-02T18:19:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.209 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3316 11.1a 11:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+full_try e106)", 2023-01-02T18:19:20.210 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.63835900700001, 2023-01-02T18:19:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002, 2023-01-02T18:19:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.211 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3316 2023-01-02T18:19:20.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322308+0000", 2023-01-02T18:19:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322306+0000", 2023-01-02T18:19:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0338e-05 2023-01-02T18:19:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322316+0000", 2023-01-02T18:19:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5367999999999999e-05 2023-01-02T18:19:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322332+0000", 2023-01-02T18:19:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0642000000000001e-05 2023-01-02T18:19:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322342+0000", 2023-01-02T18:19:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0119999999999999e-05 2023-01-02T18:19:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322412+0000", 2023-01-02T18:19:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0169999999999996e-06 2023-01-02T18:19:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.322420+0000", 2023-01-02T18:19:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048005519999999996 2023-01-02T18:19:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327221+0000", 2023-01-02T18:19:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8480000000000007e-05 2023-01-02T18:19:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327310+0000", 2023-01-02T18:19:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000141008 2023-01-02T18:19:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.327451+0000", 2023-01-02T18:19:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051423520000000002 2023-01-02T18:19:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.224 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3318 11.5 e106/102 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head v 106'2, mlcod=0'0)", 2023-01-02T18:19:20.225 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.63158213200001, 2023-01-02T18:19:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978, 2023-01-02T18:19:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329085+0000", 2023-01-02T18:19:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329084+0000", 2023-01-02T18:19:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9700000000000002e-06 2023-01-02T18:19:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329091+0000", 2023-01-02T18:19:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0783e-05 2023-01-02T18:19:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329102+0000", 2023-01-02T18:19:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5800000000000003e-06 2023-01-02T18:19:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329110+0000", 2023-01-02T18:19:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102808 2023-01-02T18:19:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329213+0000", 2023-01-02T18:19:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1041999999999999e-05 2023-01-02T18:19:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.329234+0000", 2023-01-02T18:19:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040932829999999996 2023-01-02T18:19:20.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333327+0000", 2023-01-02T18:19:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7880000000000002e-05 2023-01-02T18:19:20.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333375+0000", 2023-01-02T18:19:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00428978 2023-01-02T18:19:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.236 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPull(7.1e e112/111 cost 1049576)", 2023-01-02T18:19:20.237 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.302489344999998, 2023-01-02T18:19:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012, 2023-01-02T18:19:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:20.238 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658178+0000", 2023-01-02T18:19:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658177+0000", 2023-01-02T18:19:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7961e-05 2023-01-02T18:19:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658195+0000", 2023-01-02T18:19:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7309e-05 2023-01-02T18:19:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658212+0000", 2023-01-02T18:19:20.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2859999999999999e-06 2023-01-02T18:19:20.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658220+0000", 2023-01-02T18:19:20.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1268999999999998e-05 2023-01-02T18:19:20.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.658292+0000", 2023-01-02T18:19:20.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039592480000000003 2023-01-02T18:19:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:48.662251+0000", 2023-01-02T18:19:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004073012 2023-01-02T18:19:20.246 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.247 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3454 12.1a e121/118 12:5cea7035:::rbd_info:head v 121'1, mlcod=0'0)", 2023-01-02T18:19:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 81.228894570999998, 2023-01-02T18:19:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001, 2023-01-02T18:19:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.248 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:20.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731773+0000", 2023-01-02T18:19:20.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731772+0000", 2023-01-02T18:19:20.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1409999999999999e-06 2023-01-02T18:19:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731779+0000", 2023-01-02T18:19:20.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6167999999999998e-05 2023-01-02T18:19:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731795+0000", 2023-01-02T18:19:20.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2630000000000003e-06 2023-01-02T18:19:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731804+0000", 2023-01-02T18:19:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018042000000000001 2023-01-02T18:19:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.731984+0000", 2023-01-02T18:19:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1704000000000001e-05 2023-01-02T18:19:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.732006+0000", 2023-01-02T18:19:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076487370000000001 2023-01-02T18:19:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739655+0000", 2023-01-02T18:19:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5726999999999999e-05 2023-01-02T18:19:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:58.739690+0000", 2023-01-02T18:19:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079176960000000001 2023-01-02T18:19:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "MOSDPGPush(7.14 133/132 [PushOp(7:2d7624f7:::rbd_id.image26:head, version: 64'1, data_included: [0~16], data_size: 16, omap_header_size: 0, omap_entries_size: 0, attrset_size: 2, recovery_info: ObjectRecoveryInfo(7:2d7624f7:::rbd_id.image26:head@64'1, size: 16, copy_subset: [0~16], clone_subset: {}, snapset: 0=[]:{}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:16, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(first, data_recovered_to:0, data_complete:false, omap_recovered_to:, omap_complete:false, error:false))])", 2023-01-02T18:19:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 65.554982538999994, 2023-01-02T18:19:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998, 2023-01-02T18:19:20.260 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405685+0000", 2023-01-02T18:19:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405684+0000", 2023-01-02T18:19:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2345e-05 2023-01-02T18:19:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405697+0000", 2023-01-02T18:19:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4418e-05 2023-01-02T18:19:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405711+0000", 2023-01-02T18:19:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0879999999999999e-05 2023-01-02T18:19:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405722+0000", 2023-01-02T18:19:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133447 2023-01-02T18:19:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405855+0000", 2023-01-02T18:19:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5799999999999992e-06 2023-01-02T18:19:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.405864+0000", 2023-01-02T18:19:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022636800000000001 2023-01-02T18:19:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408128+0000", 2023-01-02T18:19:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0024430469999999998 2023-01-02T18:19:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.270 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:28825 3.16 3:6aa41c7b:::rbd_header.12a211eeb54d:head [watch watch cookie 140114583906128] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.933855921000003, 2023-01-02T18:19:20.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737, 2023-01-02T18:19:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.272 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28825 2023-01-02T18:19:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:20.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026811+0000", 2023-01-02T18:19:20.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0239999999999999e-06 2023-01-02T18:19:20.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026815+0000", 2023-01-02T18:19:20.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9989999999999997e-06 2023-01-02T18:19:20.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026824+0000", 2023-01-02T18:19:20.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1080000000000003e-06 2023-01-02T18:19:20.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026828+0000", 2023-01-02T18:19:20.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1114000000000001e-05 2023-01-02T18:19:20.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026859+0000", 2023-01-02T18:19:20.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1344999999999997e-05 2023-01-02T18:19:20.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.026910+0000", 2023-01-02T18:19:20.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104691 2023-01-02T18:19:20.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:20.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027015+0000", 2023-01-02T18:19:20.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00059966399999999997 2023-01-02T18:19:20.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.027615+0000", 2023-01-02T18:19:20.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018614879999999999 2023-01-02T18:19:20.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029476+0000", 2023-01-02T18:19:20.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1659999999999998e-05 2023-01-02T18:19:20.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029508+0000", 2023-01-02T18:19:20.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6330999999999997e-05 2023-01-02T18:19:20.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.029594+0000", 2023-01-02T18:19:20.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002782737 2023-01-02T18:19:20.286 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.287 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.287 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.287 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.287 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:20.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:19:20.289 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:20.289+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:20.390 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:20.390+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:20.468 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:20.469 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:20.469 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:20.469 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:20.479 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:19:20.491 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:20.491+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:20.592 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:20.592+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:20.603 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:20.603 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:20.604 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:20.604 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:20.604 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:20.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:19:20.694 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:20.694+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:20.781 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:20.782 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:20.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:20.782 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:20.782 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.782 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:19:20.783 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:20.783 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 144.47575407900001, 2023-01-02T18:19:20.783 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:19:20.783 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.783 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.784 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.784 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:20.784 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:20.784 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:19:20.784 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.785 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.785 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.785 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.785 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:20.785 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.786 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:20.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:20.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:19:20.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:19:20.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:19:20.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:19:20.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:19:20.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:19:20.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:19:20.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:19:20.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:19:20.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:19:20.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:20.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:19:20.792 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:19:20.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:19:20.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:19:20.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:19:20.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:19:20.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:20.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:19:20.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:19:20.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:19:20.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:19:20.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:19:20.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:19:20.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:19:20.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:19:20.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.799 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.799 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:19:20.799 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:19:20.799 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.799 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.800 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.800 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.800 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.800 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:20.800 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:20.800 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 139.47062585800001, 2023-01-02T18:19:20.801 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:19:20.801 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.801 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.801 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.801 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.802 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.802 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:19:20.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.802 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:20.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:20.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:20.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:19:20.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:19:20.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:19:20.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:19:20.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:19:20.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:19:20.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:19:20.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:19:20.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:19:20.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:19:20.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:20.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:19:20.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:19:20.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:19:20.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:19:20.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:19:20.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:19:20.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:20.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:19:20.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:19:20.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:19:20.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:19:20.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.814 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:19:20.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:19:20.814 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.815 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.815 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:19:20.815 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:19:20.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.816 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.816 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.816 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:19:20.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:19:20.816 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.816 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.817 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.817 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:19:20.817 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:20.818 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 130.18056136499999, 2023-01-02T18:19:20.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:19:20.818 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.818 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.819 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.819 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.819 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.819 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:19:20.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.820 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:20.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.821 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:20.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:20.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:19:20.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:19:20.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:19:20.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:19:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:19:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:19:20.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:19:20.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:19:20.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:19:20.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:19:20.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:20.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:19:20.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:19:20.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:19:20.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:19:20.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:19:20.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:19:20.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.830 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:20.830 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:19:20.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:19:20.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.830 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.831 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:19:20.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:19:20.831 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.831 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.832 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:19:20.832 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:19:20.832 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.832 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.833 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:19:20.833 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:19:20.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:19:20.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:19:20.834 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.834 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.835 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.835 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:20.835 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:20.836 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 129.181836022, 2023-01-02T18:19:20.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:19:20.836 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.836 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.836 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.836 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.837 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.837 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:19:20.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.837 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:20.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:20.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:20.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:19:20.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:19:20.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:19:20.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:19:20.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:19:20.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:19:20.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:19:20.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:19:20.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:19:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:19:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:20.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:19:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:19:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:19:20.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:19:20.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:19:20.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:19:20.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:20.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:19:20.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:19:20.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.848 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.848 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:19:20.848 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:19:20.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.849 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.849 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:19:20.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:19:20.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.850 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.850 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:19:20.850 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:19:20.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:19:20.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:19:20.852 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.852 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.852 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.852 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:20.853 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:20.853 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 129.15747425800001, 2023-01-02T18:19:20.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:19:20.853 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.853 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.854 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.854 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.854 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.854 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:19:20.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.855 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:20.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:20.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:20.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:19:20.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:19:20.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:19:20.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:19:20.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:19:20.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:19:20.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:19:20.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:19:20.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:19:20.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:19:20.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:19:20.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:19:20.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:20.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:19:20.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:19:20.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:19:20.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:19:20.865 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.866 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.866 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:19:20.866 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:19:20.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.867 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.867 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.867 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:19:20.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:19:20.867 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.868 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.868 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.868 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:19:20.868 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:19:20.868 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.869 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.869 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.869 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.869 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:20.870 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:20.870 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.45187959, 2023-01-02T18:19:20.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:19:20.870 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.870 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.871 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.871 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.871 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.871 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:19:20.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.871 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:20.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:20.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:20.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:19:20.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:19:20.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:19:20.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:19:20.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:19:20.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:19:20.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:19:20.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:19:20.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:19:20.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:19:20.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:19:20.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:19:20.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:20.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:19:20.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:19:20.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:19:20.882 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:19:20.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.882 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.882 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:19:20.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:19:20.883 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.883 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.883 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.884 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:19:20.884 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:19:20.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.884 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:19:20.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:19:20.885 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.886 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.886 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.886 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:19:20.887 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:20.887 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 96.399471773000002, 2023-01-02T18:19:20.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:19:20.887 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.887 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.888 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.888 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:19:20.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.889 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:20.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:20.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:20.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:19:20.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:19:20.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:19:20.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:19:20.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:19:20.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:19:20.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:19:20.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:19:20.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:19:20.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:19:20.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:19:20.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:19:20.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:20.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:19:20.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:19:20.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:19:20.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:19:20.899 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.899 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.900 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.900 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:19:20.900 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:19:20.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.901 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.901 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:19:20.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:19:20.901 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.901 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.902 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.902 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:19:20.902 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:19:20.902 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.902 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.902 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.903 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:19:20.903 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:20.903 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 91.369142256999993, 2023-01-02T18:19:20.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:19:20.904 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.904 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.904 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.904 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.905 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.905 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:19:20.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.905 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:20.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:20.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:20.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:19:20.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:19:20.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:19:20.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:19:20.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:19:20.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:19:20.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:19:20.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:19:20.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:19:20.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:19:20.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:19:20.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:19:20.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:20.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:19:20.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:19:20.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:19:20.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:19:20.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:19:20.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:19:20.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:19:20.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:19:20.917 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.917 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.917 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:19:20.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:19:20.918 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.918 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.918 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.919 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:19:20.919 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:20.919 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 85.268695592, 2023-01-02T18:19:20.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:19:20.919 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.920 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.920 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.920 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.920 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.920 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:19:20.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.921 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:20.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:20.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:19:20.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:19:20.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:19:20.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:19:20.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:19:20.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:19:20.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:19:20.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:19:20.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:19:20.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:19:20.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:19:20.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:19:20.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:20.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:19:20.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:19:20.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:19:20.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:19:20.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:19:20.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:19:20.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:19:20.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:19:20.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:19:20.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:19:20.934 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.934 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.934 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.935 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:19:20.935 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:20.935 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.913158346000003, 2023-01-02T18:19:20.935 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:19:20.936 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.936 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.936 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.936 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.936 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.936 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:19:20.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.937 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.937 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.937 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.937 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:20.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.938 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:20.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:20.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:19:20.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:19:20.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:19:20.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:19:20.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:19:20.941 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:19:20.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:19:20.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:19:20.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:19:20.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:19:20.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:20.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:19:20.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:19:20.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.945 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:19:20.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:19:20.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:19:20.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:19:20.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:20.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:19:20.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:19:20.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:19:20.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:19:20.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:19:20.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:19:20.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:19:20.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:19:20.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:19:20.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:19:20.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.951 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.951 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.952 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:19:20.952 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:20.952 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.902253703, 2023-01-02T18:19:20.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:19:20.953 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.953 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:20.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.953 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.954 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.954 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:19:20.954 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.954 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.954 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.954 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.955 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:20.955 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.955 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.955 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.955 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.956 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:20.956 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:20.956 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.956 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.956 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.957 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:19:20.957 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:19:20.957 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.957 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.957 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:19:20.958 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:19:20.958 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.958 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.958 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.958 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:19:20.959 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:19:20.959 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.959 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.959 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.959 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:19:20.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:19:20.960 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.960 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.960 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.960 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:19:20.960 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:19:20.961 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.961 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.961 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:20.961 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:19:20.961 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:19:20.962 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.962 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.962 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.962 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:19:20.962 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:19:20.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.963 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.963 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:19:20.963 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:19:20.963 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:19:20.963 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.964 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.964 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.964 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:19:20.964 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:19:20.964 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.965 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.965 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.965 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:19:20.965 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:19:20.965 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.966 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.966 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.966 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:19:20.966 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:19:20.966 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.967 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.967 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.967 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.967 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.967 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:19:20.967 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:20.968 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 61.876310863999997, 2023-01-02T18:19:20.968 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:19:20.968 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.968 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:20.968 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.969 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.969 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.969 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:19:20.969 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.969 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.970 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.970 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.970 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:20.970 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.970 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.971 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.971 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:20.971 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:20.971 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.971 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.972 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.972 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:19:20.972 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:19:20.972 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.972 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.973 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.973 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:19:20.973 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:19:20.973 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.973 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.974 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:19:20.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:19:20.974 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.974 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.975 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:19:20.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:19:20.975 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.975 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.975 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.976 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:19:20.976 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:19:20.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.976 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:19:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:19:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:19:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:19:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:19:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:19:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:20.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:19:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:19:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:20.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:19:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:19:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:19:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:19:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:19:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:19:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:19:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:19:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.984 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:19:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:20.985 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 59.101533748999998, 2023-01-02T18:19:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:19:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:20.986 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:19:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:19:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:19:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:19:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:19:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:20.991 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:19:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:19:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:20.992 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:19:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:19:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.993 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:19:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:19:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:20.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:19:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:19:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:20.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:19:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:19:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:19:20.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:19:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:19:20.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:19:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:20.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:19:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.057028715999998, 2023-01-02T18:19:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:19:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:20.999 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:19:21.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:21.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:21.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:19:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:19:21.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:19:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:19:21.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:19:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:19:21.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:19:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:19:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:19:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:19:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:19:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:19:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:19:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:19:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:19:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:19:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:19:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:19:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:19:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:19:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:19:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:19:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.013 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 39.856045459999997, 2023-01-02T18:19:21.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:19:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.015 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:19:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:19:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:19:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:19:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:19:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:19:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:19:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:19:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:19:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:19:21.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:19:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:19:21.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:19:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:19:21.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:19:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:19:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:19:21.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:19:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:19:21.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:19:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:19:21.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:19:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:19:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 39.654792757000003, 2023-01-02T18:19:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:19:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.030 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:19:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.031 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:19:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:19:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:19:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:19:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:19:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:19:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:19:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:19:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:19:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:19:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:19:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:19:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:19:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:19:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:19:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:19:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:19:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:19:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:19:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:19:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:19:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:19:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.044 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54804 3.17 3:ec8e444a:::rbd_header.12a28f082913:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:21.045 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.406472527999998, 2023-01-02T18:19:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001, 2023-01-02T18:19:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.046 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54804 2023-01-02T18:19:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.047 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:21.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373824+0000", 2023-01-02T18:19:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9380000000000004e-06 2023-01-02T18:19:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373834+0000", 2023-01-02T18:19:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6818999999999999e-05 2023-01-02T18:19:21.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373851+0000", 2023-01-02T18:19:21.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.481e-06 2023-01-02T18:19:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373858+0000", 2023-01-02T18:19:21.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2268999999999998e-05 2023-01-02T18:19:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373900+0000", 2023-01-02T18:19:21.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1660000000000002e-06 2023-01-02T18:19:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373906+0000", 2023-01-02T18:19:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060814570000000002 2023-01-02T18:19:21.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.379987+0000", 2023-01-02T18:19:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015394200000000001 2023-01-02T18:19:21.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380141+0000", 2023-01-02T18:19:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026425999999999999 2023-01-02T18:19:21.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380405+0000", 2023-01-02T18:19:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00098840499999999993 2023-01-02T18:19:21.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381394+0000", 2023-01-02T18:19:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1028e-05 2023-01-02T18:19:21.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381405+0000", 2023-01-02T18:19:21.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9657999999999997e-05 2023-01-02T18:19:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381464+0000", 2023-01-02T18:19:21.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1522e-05 2023-01-02T18:19:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381506+0000", 2023-01-02T18:19:21.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001 2023-01-02T18:19:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.063 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56742 16.1a 16:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e175)", 2023-01-02T18:19:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.4396551540000004, 2023-01-02T18:19:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011704930000000001, 2023-01-02T18:19:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.064 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56742 2023-01-02T18:19:21.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:21.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340641+0000", 2023-01-02T18:19:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8539999999999992e-06 2023-01-02T18:19:21.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340651+0000", 2023-01-02T18:19:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7829000000000002e-05 2023-01-02T18:19:21.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340669+0000", 2023-01-02T18:19:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3170000000000002e-06 2023-01-02T18:19:21.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340677+0000", 2023-01-02T18:19:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9048000000000002e-05 2023-01-02T18:19:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340726+0000", 2023-01-02T18:19:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0350000000000004e-06 2023-01-02T18:19:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340733+0000", 2023-01-02T18:19:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067919770000000003 2023-01-02T18:19:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347525+0000", 2023-01-02T18:19:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012438400000000001 2023-01-02T18:19:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347650+0000", 2023-01-02T18:19:21.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000157252 2023-01-02T18:19:21.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:21.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347807+0000", 2023-01-02T18:19:21.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037935450000000002 2023-01-02T18:19:21.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.351600+0000", 2023-01-02T18:19:21.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00067858800000000004 2023-01-02T18:19:21.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352279+0000", 2023-01-02T18:19:21.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2793000000000003e-05 2023-01-02T18:19:21.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352312+0000", 2023-01-02T18:19:21.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6309000000000001e-05 2023-01-02T18:19:21.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352348+0000", 2023-01-02T18:19:21.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011704930000000001 2023-01-02T18:19:21.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.080 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.081 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56745 16.1a 16:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e176)", 2023-01-02T18:19:21.081 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:21.081 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 4.4382913620000002, 2023-01-02T18:19:21.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010738437999999999, 2023-01-02T18:19:21.082 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.082 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.083 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56745 2023-01-02T18:19:21.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.083 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:21.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:21.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:21.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342005+0000", 2023-01-02T18:19:21.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4179999999999997e-06 2023-01-02T18:19:21.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342014+0000", 2023-01-02T18:19:21.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0892e-05 2023-01-02T18:19:21.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342024+0000", 2023-01-02T18:19:21.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6720000000000001e-06 2023-01-02T18:19:21.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342030+0000", 2023-01-02T18:19:21.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3458999999999998e-05 2023-01-02T18:19:21.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342074+0000", 2023-01-02T18:19:21.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4819999999999999e-06 2023-01-02T18:19:21.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342080+0000", 2023-01-02T18:19:21.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076176819999999998 2023-01-02T18:19:21.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.349698+0000", 2023-01-02T18:19:21.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016925100000000001 2023-01-02T18:19:21.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.349867+0000", 2023-01-02T18:19:21.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017106700000000001 2023-01-02T18:19:21.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:21.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.350038+0000", 2023-01-02T18:19:21.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023704279999999999 2023-01-02T18:19:21.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352408+0000", 2023-01-02T18:19:21.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000255894 2023-01-02T18:19:21.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352664+0000", 2023-01-02T18:19:21.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3069999999999999e-05 2023-01-02T18:19:21.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352707+0000", 2023-01-02T18:19:21.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7987000000000001e-05 2023-01-02T18:19:21.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352745+0000", 2023-01-02T18:19:21.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010738437999999999 2023-01-02T18:19:21.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.097 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.097 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.098 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58335 15.1c 15:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected e179)", 2023-01-02T18:19:21.098 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:21.098 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 1.4245991629999999, 2023-01-02T18:19:21.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010193373, 2023-01-02T18:19:21.099 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.099 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:21.099 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.099 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.100 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.100 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58335 2023-01-02T18:19:21.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.100 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:21.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:21.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:21.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355697+0000", 2023-01-02T18:19:21.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.841e-06 2023-01-02T18:19:21.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355705+0000", 2023-01-02T18:19:21.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2976000000000001e-05 2023-01-02T18:19:21.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355718+0000", 2023-01-02T18:19:21.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9839999999999998e-06 2023-01-02T18:19:21.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355724+0000", 2023-01-02T18:19:21.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9267000000000002e-05 2023-01-02T18:19:21.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355764+0000", 2023-01-02T18:19:21.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8459999999999999e-06 2023-01-02T18:19:21.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355768+0000", 2023-01-02T18:19:21.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099580459999999999 2023-01-02T18:19:21.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365726+0000", 2023-01-02T18:19:21.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5611e-05 2023-01-02T18:19:21.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365782+0000", 2023-01-02T18:19:21.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110537 2023-01-02T18:19:21.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365893+0000", 2023-01-02T18:19:21.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010193373 2023-01-02T18:19:21.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.111 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.111 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.112 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:21.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:19:21.114 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:21.113+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:21.214 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:21.215+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:21.282 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:21.283 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:21.283 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:21.283 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:21.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:19:21.315 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:21.315+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:21.416 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:21.415+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:21.417 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:21.418 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:21.418 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:21.418 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:21.418 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:21.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:19:21.467 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:19:21.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:19:21.516 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:21.517+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:21.565 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:21.566 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:21.566 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:21.567 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:21.567 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.567 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:19:21.568 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:21.568 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 154.245783964, 2023-01-02T18:19:21.569 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:19:21.569 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.570 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.570 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.571 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:21.571 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:21.571 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:19:21.572 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.572 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.572 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.573 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.573 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:21.574 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.574 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.574 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.575 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.575 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:21.576 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:21.576 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.576 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.577 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.577 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:19:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:19:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.578 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.579 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.579 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:19:21.579 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:19:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.580 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.581 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:19:21.581 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:19:21.581 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.581 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:19:21.582 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:19:21.583 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.583 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.583 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.584 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:19:21.584 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:21.584 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.584 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.584 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:21.585 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:19:21.585 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:19:21.585 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.585 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.586 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.586 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:19:21.586 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:19:21.586 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.587 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.587 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.587 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:19:21.587 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:19:21.588 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.588 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.588 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:21.588 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:19:21.588 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:19:21.589 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.589 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.589 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.589 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:19:21.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:19:21.590 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.590 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.590 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.590 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:19:21.590 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:19:21.591 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.591 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.591 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.591 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:19:21.591 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:19:21.592 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.592 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.592 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.592 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:19:21.592 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:19:21.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.593 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.593 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.593 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.594 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.594 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:19:21.594 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:21.594 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 149.23070050800001, 2023-01-02T18:19:21.594 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:19:21.594 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.595 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.595 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.595 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.595 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.595 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:19:21.596 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.596 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.596 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.596 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.596 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:21.597 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.597 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.597 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.597 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.597 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:21.598 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:21.598 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.598 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.598 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.599 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:19:21.599 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:19:21.599 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.599 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.599 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.600 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:19:21.600 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:19:21.600 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.600 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.600 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.601 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:19:21.601 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:19:21.601 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.601 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.602 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.602 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:19:21.602 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:19:21.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.603 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.603 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.603 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:19:21.603 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:19:21.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.604 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.604 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:19:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:19:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.606 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.606 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.607 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:19:21.607 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:19:21.607 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.607 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.608 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.608 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:19:21.608 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:19:21.609 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.609 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.609 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:21.609 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:19:21.610 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:19:21.610 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.610 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.611 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.611 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:19:21.611 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:19:21.611 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.611 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.612 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.612 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:19:21.612 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:19:21.612 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.612 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.613 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.613 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:19:21.613 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:19:21.614 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.614 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.614 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.614 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:19:21.614 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:19:21.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.615 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.615 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.615 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.615 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.616 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:21.616 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:21.616 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 140.24600293099999, 2023-01-02T18:19:21.616 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:19:21.616 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.617 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.617 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.618 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.618 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:19:21.618 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.618 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.618 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.619 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.619 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:21.619 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.619 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.620 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.620 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:21.620 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:21.620 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.620 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.621 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.621 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:19:21.621 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:19:21.621 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.622 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.622 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.622 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:19:21.622 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:19:21.622 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.623 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.623 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:19:21.623 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:19:21.623 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.623 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.624 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.624 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:19:21.624 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:19:21.624 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.624 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.625 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.625 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:19:21.625 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:19:21.625 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.626 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.626 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.626 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:19:21.626 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:19:21.626 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.627 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.627 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.627 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:19:21.627 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:19:21.627 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.628 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.628 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.628 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:19:21.628 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:19:21.628 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.629 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.629 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:21.629 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:19:21.629 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:19:21.629 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.630 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.630 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.630 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:19:21.630 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:19:21.630 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.631 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.631 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.631 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:19:21.632 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:19:21.632 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.632 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.632 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.633 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:19:21.633 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:19:21.634 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.634 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.634 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:19:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:19:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.635 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.636 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.636 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.636 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.637 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:19:21.637 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:21.637 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 126.24797823999999, 2023-01-02T18:19:21.638 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:19:21.638 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.638 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.639 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.639 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:19:21.639 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.640 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.640 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.640 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.640 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:21.640 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.641 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.641 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.641 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.641 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:21.641 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:21.642 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.642 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.642 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.642 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:19:21.643 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:19:21.643 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.643 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.643 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.643 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:19:21.644 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:19:21.644 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.644 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.644 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.644 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:19:21.645 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:19:21.645 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.645 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.646 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.646 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:19:21.646 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:19:21.647 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.647 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.647 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.648 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:19:21.648 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:19:21.648 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.649 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.649 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.649 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:19:21.650 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:19:21.650 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.650 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.651 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.651 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:19:21.651 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:19:21.652 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.652 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.652 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.652 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:19:21.653 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:19:21.653 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.656 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.657 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:21.657 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:19:21.658 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:19:21.658 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.658 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.659 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.659 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:19:21.659 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:19:21.660 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.660 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.660 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.661 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:19:21.661 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:19:21.661 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.662 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.662 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.662 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:19:21.663 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:19:21.663 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.663 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.664 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.664 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:19:21.664 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:19:21.664 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.664 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.665 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.665 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.665 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.665 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:19:21.666 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:21.666 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 125.24691978600001, 2023-01-02T18:19:21.666 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:19:21.666 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.666 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.667 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.667 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:21.667 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:21.668 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:19:21.668 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.668 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.669 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.669 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.669 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:21.670 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.670 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.670 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.671 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.671 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:21.671 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:21.672 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.672 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.672 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.673 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:19:21.673 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:19:21.673 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.674 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.674 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.674 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:19:21.675 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:19:21.675 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.675 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.675 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.676 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:19:21.676 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:19:21.676 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.677 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.677 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.677 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:19:21.678 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:19:21.678 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.678 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.679 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.679 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:19:21.679 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:19:21.679 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.679 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.680 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.680 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:19:21.680 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:19:21.680 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.681 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.681 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.681 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:19:21.681 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:19:21.682 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.682 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.682 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.682 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:19:21.682 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:19:21.683 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.683 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.683 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:21.683 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:19:21.683 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:19:21.684 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.684 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.684 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.684 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:19:21.684 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:19:21.685 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.685 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.685 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.685 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:19:21.685 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:19:21.686 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.686 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.686 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.686 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:19:21.687 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:19:21.687 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.687 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.687 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.687 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:19:21.688 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:19:21.688 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.688 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.689 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.689 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.689 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.689 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:19:21.689 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:21.690 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 124.241555139, 2023-01-02T18:19:21.690 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:19:21.690 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.690 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.690 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.691 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:21.691 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:21.691 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:19:21.692 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.692 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.692 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.693 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.693 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:21.693 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.693 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.694 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.694 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.694 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:21.694 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:21.694 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.695 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.695 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.695 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:19:21.695 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:19:21.695 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.696 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.696 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.696 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:19:21.696 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:19:21.696 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.697 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.697 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.697 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:19:21.697 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:19:21.698 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.698 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.698 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.698 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:19:21.699 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:19:21.699 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.699 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.699 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.699 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:19:21.700 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:19:21.700 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.700 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.701 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.701 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:19:21.701 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:19:21.701 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.702 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.702 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.702 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:19:21.702 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:19:21.702 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.703 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.703 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.703 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:19:21.703 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:19:21.703 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.704 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.704 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:21.704 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:19:21.704 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:19:21.704 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.705 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.705 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.705 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:19:21.705 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:19:21.705 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.706 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.706 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.706 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:19:21.706 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:19:21.706 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.707 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.707 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.707 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:19:21.707 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:19:21.707 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.708 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.708 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.708 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:19:21.708 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:19:21.708 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.709 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.709 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.709 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.709 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.710 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:19:21.710 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:21.710 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.20122363900001, 2023-01-02T18:19:21.710 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:19:21.710 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.710 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:21.711 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:21.711 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:19:21.711 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:21.712 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:21.713 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:19:21.714 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:19:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:19:21.715 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:19:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:19:21.716 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:19:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:19:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:19:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.718 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:19:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:19:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.719 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:19:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:19:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.720 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:19:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:19:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.721 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:19:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:19:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:21.722 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:19:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:19:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.723 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:19:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:19:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.724 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:19:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:19:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.725 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:19:21.726 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:19:21.726 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.726 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.726 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:19:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:19:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.727 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 115.19665338900001, 2023-01-02T18:19:21.728 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:19:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.729 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:21.730 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:21.730 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:19:21.730 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.730 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.730 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.731 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.732 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:19:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:19:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.733 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:19:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:19:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.734 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:19:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:19:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.735 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:19:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:19:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.736 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.737 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.737 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:19:21.737 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:19:21.737 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:19:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:19:21.738 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:19:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:19:21.739 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:19:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:19:21.740 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:19:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:19:21.741 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:19:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:19:21.742 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:19:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:19:21.743 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:19:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:19:21.744 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.745 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.745 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.745 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:19:21.745 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:19:21.746 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.746 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.746 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.746 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.746 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.747 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:19:21.747 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:21.747 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.183821373, 2023-01-02T18:19:21.747 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:19:21.747 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.748 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.748 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.748 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:21.748 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:21.748 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:19:21.749 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.749 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.749 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.749 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.750 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:21.750 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.750 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.750 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.750 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.751 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:21.751 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:21.751 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.751 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.751 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.752 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:19:21.752 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:19:21.752 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.752 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.752 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.753 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:19:21.753 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:19:21.753 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.753 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.753 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.754 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:19:21.754 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:19:21.754 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.754 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.754 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.755 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:19:21.755 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:19:21.755 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.755 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.755 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.756 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:19:21.756 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:19:21.756 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.756 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.756 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.757 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:19:21.757 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:19:21.757 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.757 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.758 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.758 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:19:21.758 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:19:21.758 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.758 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.759 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:19:21.759 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:19:21.759 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.759 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.759 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:21.760 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:19:21.760 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:19:21.760 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.760 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.760 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.761 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:19:21.761 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:19:21.761 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.761 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.761 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.762 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:19:21.762 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:19:21.762 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.762 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.762 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.763 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:19:21.763 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:19:21.763 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.763 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.763 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.764 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:19:21.764 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:19:21.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.764 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.764 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.765 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.765 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.765 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:19:21.765 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:21.766 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 111.235087874, 2023-01-02T18:19:21.766 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:19:21.766 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.766 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.766 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.766 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:21.767 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:21.767 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:19:21.767 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.767 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.767 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.768 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.768 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:21.768 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.768 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.768 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.769 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.769 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:21.769 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:21.769 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.769 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:19:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:19:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.770 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:19:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:19:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.771 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:19:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:19:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.772 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:19:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:19:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:19:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:19:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:19:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:19:21.775 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:19:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:19:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.776 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:19:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:19:21.777 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:19:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:19:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.778 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:19:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:19:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.779 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:19:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:19:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.780 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:19:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:19:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.781 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:19:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:19:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.782 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.783 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 102.23524482000001, 2023-01-02T18:19:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:19:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.784 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:19:21.785 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:21.786 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:21.787 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:19:21.788 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:19:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:19:21.789 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:19:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:19:21.790 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:19:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:19:21.791 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:19:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.792 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:19:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:19:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.793 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:19:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:19:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:19:21.794 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:19:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:19:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:19:21.795 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:19:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:19:21.796 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:19:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:19:21.797 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:19:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:19:21.798 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:19:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.799 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.692205596000001, 2023-01-02T18:19:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:19:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.800 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.801 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:19:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:21.803 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:19:21.804 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:19:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:19:21.805 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:19:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:19:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:19:21.806 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:19:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:19:21.807 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:19:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:19:21.808 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:19:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:19:21.809 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:19:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:19:21.810 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:19:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:19:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.811 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:19:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:19:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.812 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:19:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:19:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.813 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:19:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:19:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.814 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:21.815 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 26.197598853999999, 2023-01-02T18:19:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:19:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.816 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:19:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.817 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.818 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.819 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.820 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:19:21.820 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:19:21.820 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.820 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.820 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.821 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:19:21.821 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:19:21.821 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.821 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.822 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:19:21.822 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:19:21.822 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.822 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.822 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.823 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:19:21.823 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:19:21.823 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.823 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.823 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.824 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:19:21.824 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:19:21.824 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.824 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.824 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.825 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:19:21.825 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:19:21.825 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.825 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.825 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:21.826 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:19:21.826 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:19:21.826 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.826 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.826 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:19:21.827 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:19:21.827 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.827 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.827 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.827 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:19:21.828 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:19:21.828 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.828 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.828 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.828 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:19:21.829 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:19:21.829 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.829 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.829 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.829 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:19:21.830 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:19:21.830 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.830 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.830 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.830 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.831 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.831 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54769 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e160)", 2023-01-02T18:19:21.831 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:21.831 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 21.223904154, 2023-01-02T18:19:21.831 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999, 2023-01-02T18:19:21.832 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.832 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.832 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.832 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.832 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.833 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54769 2023-01-02T18:19:21.833 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.833 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.833 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.833 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.834 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:21.834 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.834 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.834 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.834 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.835 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:21.835 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:21.835 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.835 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.835 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.836 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339928+0000", 2023-01-02T18:19:21.836 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0937e-05 2023-01-02T18:19:21.836 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.836 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.836 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.837 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339939+0000", 2023-01-02T18:19:21.837 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8923000000000002e-05 2023-01-02T18:19:21.837 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.837 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.837 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.838 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339958+0000", 2023-01-02T18:19:21.838 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4999999999999999e-06 2023-01-02T18:19:21.838 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.838 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.838 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339966+0000", 2023-01-02T18:19:21.839 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1886999999999999e-05 2023-01-02T18:19:21.839 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.839 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.839 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.839 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340028+0000", 2023-01-02T18:19:21.840 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9189999999999999e-06 2023-01-02T18:19:21.840 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.840 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.840 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.840 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340036+0000", 2023-01-02T18:19:21.841 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012331458999999999 2023-01-02T18:19:21.841 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.841 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.841 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.841 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352367+0000", 2023-01-02T18:19:21.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5671000000000001e-05 2023-01-02T18:19:21.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.842 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.842 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352443+0000", 2023-01-02T18:19:21.842 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028359799999999998 2023-01-02T18:19:21.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.843 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:21.843 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352727+0000", 2023-01-02T18:19:21.843 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089580699999999998 2023-01-02T18:19:21.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.844 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.844 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353622+0000", 2023-01-02T18:19:21.844 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163995 2023-01-02T18:19:21.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.845 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.845 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353786+0000", 2023-01-02T18:19:21.845 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7710000000000002e-05 2023-01-02T18:19:21.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.846 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.846 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353834+0000", 2023-01-02T18:19:21.846 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3380999999999999e-05 2023-01-02T18:19:21.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.847 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.847 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353857+0000", 2023-01-02T18:19:21.847 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999 2023-01-02T18:19:21.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.848 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.849 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54785 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:21.849 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:21.849 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 20.220236422999999, 2023-01-02T18:19:21.849 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348, 2023-01-02T18:19:21.849 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.850 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.850 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.850 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54785 2023-01-02T18:19:21.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.851 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.851 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.851 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:21.851 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.852 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.852 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:21.852 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:21.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.853 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.853 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343595+0000", 2023-01-02T18:19:21.853 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2480000000000002e-06 2023-01-02T18:19:21.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.854 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.854 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343605+0000", 2023-01-02T18:19:21.854 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6588000000000001e-05 2023-01-02T18:19:21.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.855 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.855 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343621+0000", 2023-01-02T18:19:21.855 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2490000000000004e-06 2023-01-02T18:19:21.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.856 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.856 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343629+0000", 2023-01-02T18:19:21.856 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3723000000000001e-05 2023-01-02T18:19:21.857 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.857 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.857 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.857 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343672+0000", 2023-01-02T18:19:21.857 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.04e-06 2023-01-02T18:19:21.858 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.858 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.858 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.858 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343677+0000", 2023-01-02T18:19:21.858 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054799280000000002 2023-01-02T18:19:21.859 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.859 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.859 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.859 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349157+0000", 2023-01-02T18:19:21.859 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010108299999999999 2023-01-02T18:19:21.860 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.860 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.860 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.860 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349258+0000", 2023-01-02T18:19:21.860 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000406179 2023-01-02T18:19:21.861 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.861 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.861 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:21.861 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349665+0000", 2023-01-02T18:19:21.861 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051027499999999996 2023-01-02T18:19:21.862 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.862 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.862 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.862 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354767+0000", 2023-01-02T18:19:21.862 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000482819 2023-01-02T18:19:21.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.863 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.863 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.863 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355250+0000", 2023-01-02T18:19:21.863 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7871999999999998e-05 2023-01-02T18:19:21.863 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.864 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.864 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.864 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355298+0000", 2023-01-02T18:19:21.864 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6105e-05 2023-01-02T18:19:21.864 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.865 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.865 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.865 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355344+0000", 2023-01-02T18:19:21.865 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348 2023-01-02T18:19:21.865 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.866 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.866 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.866 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.866 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.866 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56246 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:21.867 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:21.867 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.9188353, 2023-01-02T18:19:21.867 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998, 2023-01-02T18:19:21.867 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.867 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.868 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.868 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.868 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.868 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56246 2023-01-02T18:19:21.868 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.869 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.869 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.869 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.869 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:21.869 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.870 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.870 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.870 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.870 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:21.870 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:21.871 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.871 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.871 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.871 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644998+0000", 2023-01-02T18:19:21.871 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2189999999999998e-06 2023-01-02T18:19:21.872 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.872 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.872 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.872 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645002+0000", 2023-01-02T18:19:21.872 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0909999999999993e-06 2023-01-02T18:19:21.873 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.873 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.873 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.873 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645010+0000", 2023-01-02T18:19:21.873 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6880000000000001e-06 2023-01-02T18:19:21.874 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.874 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.874 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.874 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645014+0000", 2023-01-02T18:19:21.874 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6795999999999998e-05 2023-01-02T18:19:21.875 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.875 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.875 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.875 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645051+0000", 2023-01-02T18:19:21.875 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000001e-05 2023-01-02T18:19:21.876 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.876 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.876 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.876 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645135+0000", 2023-01-02T18:19:21.876 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199557 2023-01-02T18:19:21.877 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.877 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.877 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:21.877 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645335+0000", 2023-01-02T18:19:21.877 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00070655299999999996 2023-01-02T18:19:21.878 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.878 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.878 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.878 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.646041+0000", 2023-01-02T18:19:21.878 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047206009999999996 2023-01-02T18:19:21.879 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.879 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.879 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.879 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650762+0000", 2023-01-02T18:19:21.879 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5790999999999997e-05 2023-01-02T18:19:21.880 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.880 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.880 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.880 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650798+0000", 2023-01-02T18:19:21.880 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4202999999999997e-05 2023-01-02T18:19:21.881 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.881 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.881 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.881 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650842+0000", 2023-01-02T18:19:21.881 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998 2023-01-02T18:19:21.882 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.882 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.882 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.882 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.882 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.883 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56449 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", 2023-01-02T18:19:21.883 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:21.883 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.19444156, 2023-01-02T18:19:21.883 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305, 2023-01-02T18:19:21.883 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.883 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.884 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.884 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.884 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.884 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56449 2023-01-02T18:19:21.884 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.885 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.885 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.885 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.885 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:21.885 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.886 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.886 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.886 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.886 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:21.886 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:21.887 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.887 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.887 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.887 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369390+0000", 2023-01-02T18:19:21.887 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1600000000000001e-05 2023-01-02T18:19:21.888 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.888 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.888 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.888 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369402+0000", 2023-01-02T18:19:21.888 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8179999999999999e-05 2023-01-02T18:19:21.889 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.889 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.889 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.889 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369420+0000", 2023-01-02T18:19:21.889 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.951e-06 2023-01-02T18:19:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369427+0000", 2023-01-02T18:19:21.890 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8652999999999995e-05 2023-01-02T18:19:21.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.891 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.891 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.891 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369496+0000", 2023-01-02T18:19:21.891 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1131000000000001e-05 2023-01-02T18:19:21.891 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.892 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.892 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.892 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369507+0000", 2023-01-02T18:19:21.892 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010015711 2023-01-02T18:19:21.892 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.893 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.893 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.893 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379523+0000", 2023-01-02T18:19:21.893 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017405799999999999 2023-01-02T18:19:21.893 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.894 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.894 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.894 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379697+0000", 2023-01-02T18:19:21.894 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097878599999999994 2023-01-02T18:19:21.894 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.895 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.895 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:21.895 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.380675+0000", 2023-01-02T18:19:21.895 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090579699999999996 2023-01-02T18:19:21.895 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.896 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.896 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.381581+0000", 2023-01-02T18:19:21.896 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062692200000000003 2023-01-02T18:19:21.896 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.896 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.897 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.897 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382208+0000", 2023-01-02T18:19:21.897 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1279000000000003e-05 2023-01-02T18:19:21.897 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.897 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.898 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.898 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382239+0000", 2023-01-02T18:19:21.898 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4488e-05 2023-01-02T18:19:21.898 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.898 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.899 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.899 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382264+0000", 2023-01-02T18:19:21.899 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305 2023-01-02T18:19:21.899 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.899 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.900 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.900 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.900 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.900 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56686 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e174)", 2023-01-02T18:19:21.900 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:21.901 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 7.2295468459999999, 2023-01-02T18:19:21.901 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999, 2023-01-02T18:19:21.901 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.901 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.901 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.902 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.902 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.902 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56686 2023-01-02T18:19:21.902 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.902 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.903 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.903 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.903 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:21.903 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.903 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.904 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.904 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:21.904 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:21.904 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.904 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.905 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.905 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334286+0000", 2023-01-02T18:19:21.905 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8629999999999997e-06 2023-01-02T18:19:21.905 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.905 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.906 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.906 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334295+0000", 2023-01-02T18:19:21.906 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:19:21.906 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.906 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.907 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.907 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334308+0000", 2023-01-02T18:19:21.907 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7819999999999994e-06 2023-01-02T18:19:21.907 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.907 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.908 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.908 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334316+0000", 2023-01-02T18:19:21.908 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0328000000000003e-05 2023-01-02T18:19:21.908 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.908 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.909 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.909 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334366+0000", 2023-01-02T18:19:21.909 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:19:21.909 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.909 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.910 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334375+0000", 2023-01-02T18:19:21.910 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0086939579999999999 2023-01-02T18:19:21.910 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.910 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.910 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.911 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343069+0000", 2023-01-02T18:19:21.911 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7719000000000004e-05 2023-01-02T18:19:21.911 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.911 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.911 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.912 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343166+0000", 2023-01-02T18:19:21.912 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040875599999999997 2023-01-02T18:19:21.912 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.912 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.912 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:21.913 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343575+0000", 2023-01-02T18:19:21.913 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00078807900000000001 2023-01-02T18:19:21.913 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.913 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.913 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.914 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.344363+0000", 2023-01-02T18:19:21.914 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018956439999999999 2023-01-02T18:19:21.914 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.914 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.914 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.915 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346259+0000", 2023-01-02T18:19:21.915 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6230999999999997e-05 2023-01-02T18:19:21.915 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.915 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.915 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.916 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346315+0000", 2023-01-02T18:19:21.916 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1152000000000002e-05 2023-01-02T18:19:21.916 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.916 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.916 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.917 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346356+0000", 2023-01-02T18:19:21.917 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999 2023-01-02T18:19:21.917 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.917 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.917 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.918 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.918 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.918 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56749 16.13 16:ce684796:::rbd_object_map.12a2fc42bad2:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e176)", 2023-01-02T18:19:21.918 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:21.918 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.1988474729999998, 2023-01-02T18:19:21.919 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067753960000000004, 2023-01-02T18:19:21.919 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.919 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.919 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.919 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.919 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.920 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56749 2023-01-02T18:19:21.920 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.920 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.920 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.920 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.920 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:21.921 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.921 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.921 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.921 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.921 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:21.922 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:21.922 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.922 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.922 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.922 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364985+0000", 2023-01-02T18:19:21.923 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6770000000000001e-06 2023-01-02T18:19:21.923 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.923 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.923 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.923 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364993+0000", 2023-01-02T18:19:21.924 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4132e-05 2023-01-02T18:19:21.924 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.924 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.924 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.924 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365008+0000", 2023-01-02T18:19:21.925 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9789999999999998e-06 2023-01-02T18:19:21.925 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.925 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.925 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.925 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365014+0000", 2023-01-02T18:19:21.926 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8658999999999997e-05 2023-01-02T18:19:21.926 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.926 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.926 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.926 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365052+0000", 2023-01-02T18:19:21.927 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4580000000000003e-06 2023-01-02T18:19:21.927 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.927 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.927 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.927 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365057+0000", 2023-01-02T18:19:21.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039966869999999996 2023-01-02T18:19:21.928 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.928 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.928 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.928 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369053+0000", 2023-01-02T18:19:21.928 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016847699999999999 2023-01-02T18:19:21.929 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.929 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.929 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.929 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369222+0000", 2023-01-02T18:19:21.929 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000172483 2023-01-02T18:19:21.930 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.930 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.930 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:21.930 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369394+0000", 2023-01-02T18:19:21.930 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020318689999999999 2023-01-02T18:19:21.931 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.931 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.931 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.931 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371426+0000", 2023-01-02T18:19:21.931 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024218699999999999 2023-01-02T18:19:21.932 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.932 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.932 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.932 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371668+0000", 2023-01-02T18:19:21.932 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3369999999999999e-05 2023-01-02T18:19:21.933 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.933 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.933 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.933 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371722+0000", 2023-01-02T18:19:21.933 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0258e-05 2023-01-02T18:19:21.934 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.934 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.934 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.934 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371762+0000", 2023-01-02T18:19:21.934 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067753960000000004 2023-01-02T18:19:21.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.935 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.935 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.935 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.935 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.936 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58331 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e179)", 2023-01-02T18:19:21.936 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:21.936 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.2314054950000002, 2023-01-02T18:19:21.936 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017000080000000001, 2023-01-02T18:19:21.936 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:21.936 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:21.937 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:21.937 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:21.937 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:21.937 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58331 2023-01-02T18:19:21.937 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.938 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:21.938 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.938 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:21.938 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:21.938 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:21.939 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.939 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.939 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:21.939 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:21.939 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:21.940 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.940 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.940 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:21.940 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332427+0000", 2023-01-02T18:19:21.940 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8380000000000002e-06 2023-01-02T18:19:21.941 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.941 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.941 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:21.941 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332435+0000", 2023-01-02T18:19:21.942 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4547e-05 2023-01-02T18:19:21.942 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.942 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.942 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:21.942 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332449+0000", 2023-01-02T18:19:21.943 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7020000000000004e-06 2023-01-02T18:19:21.943 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.943 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.943 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:21.943 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332456+0000", 2023-01-02T18:19:21.944 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6797e-05 2023-01-02T18:19:21.944 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.944 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.944 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.944 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332493+0000", 2023-01-02T18:19:21.945 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3669999999999996e-06 2023-01-02T18:19:21.945 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.945 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.945 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:21.946 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332498+0000", 2023-01-02T18:19:21.946 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013552958 2023-01-02T18:19:21.946 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.946 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.946 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:21.947 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346051+0000", 2023-01-02T18:19:21.947 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010482 2023-01-02T18:19:21.947 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.947 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.947 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:21.948 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346156+0000", 2023-01-02T18:19:21.948 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00044760600000000002 2023-01-02T18:19:21.948 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.948 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.948 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:21.949 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346604+0000", 2023-01-02T18:19:21.949 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013066169999999999 2023-01-02T18:19:21.949 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.949 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.949 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:21.950 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.347910+0000", 2023-01-02T18:19:21.950 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392527 2023-01-02T18:19:21.950 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.950 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.950 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:21.951 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349303+0000", 2023-01-02T18:19:21.951 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4855999999999998e-05 2023-01-02T18:19:21.951 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.951 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.951 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:21.952 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349358+0000", 2023-01-02T18:19:21.952 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1042000000000002e-05 2023-01-02T18:19:21.952 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:21.952 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:21.952 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:21.953 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349429+0000", 2023-01-02T18:19:21.953 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017000080000000001 2023-01-02T18:19:21.953 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.953 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.953 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.954 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:21.954 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:21.954 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:21.956 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:21.956+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:21.957 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:19:21.957 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:21.958 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:21.958 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:21.958 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:21.958 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:21.958 INFO:teuthology.orchestra.run.smithi007.stdout:osd.5: {} 2023-01-02T18:19:21.959 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:21.959 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:19:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:19:21.960 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:19:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:19:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:19:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:osd.5: osd_enable_op_tracker = 'false' 2023-01-02T18:19:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:19:21.961 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:19:22.056 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:22.057+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:22.125 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:22.126 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:22.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:19:22.179 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:22.179+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:22.258 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:22.258+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:22.260 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:22.260 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:22.270 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:19:22.359 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:22.359+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:22.438 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:22.438 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:22.452 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 6, 7] out_osds: [3, 5, 4, 1] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:19:22.452 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:19:22.452 INFO:tasks.thrashosds.thrasher:Killing osd 5, live_osds are [0, 1, 2, 3, 4, 5, 6, 7] 2023-01-02T18:19:22.453 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-01-02T18:19:22.453 INFO:teuthology.orchestra.run:waiting for 300 2023-01-02T18:19:22.454 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:19:22.456 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:19:22.485 INFO:tasks.ceph.osd.5:Stopped 2023-01-02T18:19:22.485 INFO:tasks.thrashosds.thrasher:Testing ceph-objectstore-tool on down osd.5 2023-01-02T18:19:22.486 INFO:tasks.thrashosds.thrasher:remote for osd 5 is ubuntu@smithi057.front.sepia.ceph.com 2023-01-02T18:19:22.486 DEBUG:teuthology.orchestra.run.smithi057:> type ceph-objectstore-tool 2023-01-02T18:19:22.486 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:22.485+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:22.544 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2023-01-02T18:19:22.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-objectstore-tool --no-mon-config '--log-file=/var/log/ceph/objectstore_tool.$pid.log' --data-path /var/lib/ceph/osd/ceph-5 --journal-path /var/lib/ceph/osd/ceph-5/journal --op list-pgs 2023-01-02T18:19:22.584 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:22.585 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:22.586 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:22.586+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:22.595 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:19:22.662 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:22.662+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:22.722 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:22.722 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:22.731 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:19:22.763 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:22.764+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:22.864 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:22.864+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:22.897 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:22.898 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:22.908 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:19:22.994 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:22.994+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:23.066 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:23.067+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:23.074 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:23.075 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:23.085 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:19:23.168 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:23.168+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:23.251 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:23.251 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:23.261 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:19:23.268 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:23.269+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:23.369 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:23.370+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:23.387 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:23.387 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:23.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:19:23.470 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:23.471+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:23.533 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:23.534 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:23.543 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:19:23.588 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:23.588+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:23.674 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:23.673+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:23.674 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:23.675 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:23.685 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:19:23.775 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:23.776+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:23.851 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:23.851 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:23.861 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:19:23.875 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:23.875+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:23.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:19:23.987 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:23.987 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:23.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:19:24.007 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:24.007+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:24.078 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:24.077+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:24.104 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:24.121 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:24.122 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:24.122 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:24.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:19:24.138 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:24.155 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:24.173 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:24.178 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:24.178+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:24.191 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:24.210 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:24.210 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:19:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:19:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:19:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:19:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:19:24.211 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.5 2023-01-02T18:19:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:19:24.212 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:19:24.212 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-01-02T18:19:24.213 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-01-02T18:19:24.242 INFO:tasks.thrashosds.thrasher:No PGs found for osd.5 2023-01-02T18:19:24.279 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:24.279+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:24.299 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:24.300 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:24.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:24.300 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:24.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.301 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6 3.1a 3:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e45)", 2023-01-02T18:19:24.301 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:19:24.301 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 165.884407224, 2023-01-02T18:19:24.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003, 2023-01-02T18:19:24.301 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.302 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:24.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:24.302 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6 2023-01-02T18:19:24.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.303 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:19:24.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414900+0000", 2023-01-02T18:19:24.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:24.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414898+0000", 2023-01-02T18:19:24.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1226999999999999e-05 2023-01-02T18:19:24.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414909+0000", 2023-01-02T18:19:24.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6152999999999999e-05 2023-01-02T18:19:24.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414925+0000", 2023-01-02T18:19:24.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1080000000000004e-06 2023-01-02T18:19:24.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414932+0000", 2023-01-02T18:19:24.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7491000000000003e-05 2023-01-02T18:19:24.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414980+0000", 2023-01-02T18:19:24.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1470000000000004e-06 2023-01-02T18:19:24.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:24.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.414987+0000", 2023-01-02T18:19:24.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020360500000000002 2023-01-02T18:19:24.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417023+0000", 2023-01-02T18:19:24.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000124048 2023-01-02T18:19:24.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417147+0000", 2023-01-02T18:19:24.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000105455 2023-01-02T18:19:24.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:24.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.417252+0000", 2023-01-02T18:19:24.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0010835529999999999 2023-01-02T18:19:24.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:24.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.418336+0000", 2023-01-02T18:19:24.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039691040000000002 2023-01-02T18:19:24.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:24.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422305+0000", 2023-01-02T18:19:24.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9363000000000002e-05 2023-01-02T18:19:24.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422344+0000", 2023-01-02T18:19:24.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7058000000000001e-05 2023-01-02T18:19:24.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:38.422371+0000", 2023-01-02T18:19:24.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0074715090000000003 2023-01-02T18:19:24.317 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.317 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.317 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.318 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:8 3.1a 3:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e46)", 2023-01-02T18:19:24.318 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:19:24.318 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 164.878738962, 2023-01-02T18:19:24.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997, 2023-01-02T18:19:24.319 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.319 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:24.319 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:24.320 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 8 2023-01-02T18:19:24.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.320 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:19:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420568+0000", 2023-01-02T18:19:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420565+0000", 2023-01-02T18:19:24.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2422999999999999e-05 2023-01-02T18:19:24.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420578+0000", 2023-01-02T18:19:24.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8117e-05 2023-01-02T18:19:24.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420596+0000", 2023-01-02T18:19:24.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1804000000000001e-05 2023-01-02T18:19:24.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420608+0000", 2023-01-02T18:19:24.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4623999999999996e-05 2023-01-02T18:19:24.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420682+0000", 2023-01-02T18:19:24.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1593999999999999e-05 2023-01-02T18:19:24.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:24.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.420694+0000", 2023-01-02T18:19:24.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002866726 2023-01-02T18:19:24.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423561+0000", 2023-01-02T18:19:24.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0605000000000006e-05 2023-01-02T18:19:24.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423631+0000", 2023-01-02T18:19:24.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016726499999999999 2023-01-02T18:19:24.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:24.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.423798+0000", 2023-01-02T18:19:24.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012109340000000001 2023-01-02T18:19:24.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:24.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425009+0000", 2023-01-02T18:19:24.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027761499999999999 2023-01-02T18:19:24.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:24.332 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425287+0000", 2023-01-02T18:19:24.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0758999999999999e-05 2023-01-02T18:19:24.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425348+0000", 2023-01-02T18:19:24.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9521999999999998e-05 2023-01-02T18:19:24.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.425397+0000", 2023-01-02T18:19:24.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048291059999999997 2023-01-02T18:19:24.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.334 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.334 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.335 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:9 3.1c e46/43 3:3831950c:::rbd_directory:head v 46'1, mlcod=0'0)", 2023-01-02T18:19:24.335 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:19:24.335 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 164.8732053, 2023-01-02T18:19:24.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002, 2023-01-02T18:19:24.336 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.336 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.336 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:19:24.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426102+0000", 2023-01-02T18:19:24.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:24.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426101+0000", 2023-01-02T18:19:24.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5469999999999997e-06 2023-01-02T18:19:24.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426110+0000", 2023-01-02T18:19:24.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2282e-05 2023-01-02T18:19:24.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426122+0000", 2023-01-02T18:19:24.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:19:24.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426131+0000", 2023-01-02T18:19:24.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6014999999999999e-05 2023-01-02T18:19:24.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426177+0000", 2023-01-02T18:19:24.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6328e-05 2023-01-02T18:19:24.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.426193+0000", 2023-01-02T18:19:24.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0041082039999999998 2023-01-02T18:19:24.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430301+0000", 2023-01-02T18:19:24.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2492e-05 2023-01-02T18:19:24.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.430334+0000", 2023-01-02T18:19:24.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042319990000000002 2023-01-02T18:19:24.345 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.346 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.346 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.346 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54 3.1 e46/43 3:80bf5b62:::rbd_object_map.12a279b662cb:head v 46'4, mlcod=46'2)", 2023-01-02T18:19:24.346 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:19:24.347 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 164.78750614699999, 2023-01-02T18:19:24.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002, 2023-01-02T18:19:24.347 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.347 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.347 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.348 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.348 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:19:24.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511801+0000", 2023-01-02T18:19:24.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:24.349 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.350 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511800+0000", 2023-01-02T18:19:24.350 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.3189999999999997e-06 2023-01-02T18:19:24.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511807+0000", 2023-01-02T18:19:24.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0499999999999999e-05 2023-01-02T18:19:24.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511818+0000", 2023-01-02T18:19:24.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7099999999999998e-06 2023-01-02T18:19:24.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511823+0000", 2023-01-02T18:19:24.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9288000000000001e-05 2023-01-02T18:19:24.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511862+0000", 2023-01-02T18:19:24.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5781999999999999e-05 2023-01-02T18:19:24.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.511878+0000", 2023-01-02T18:19:24.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031602869999999999 2023-01-02T18:19:24.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515038+0000", 2023-01-02T18:19:24.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1501000000000002e-05 2023-01-02T18:19:24.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:39.515069+0000", 2023-01-02T18:19:24.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032685040000000002 2023-01-02T18:19:24.357 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.357 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.357 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.358 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:268 4.1a 4:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e50)", 2023-01-02T18:19:24.358 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:19:24.358 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.86555048400001, 2023-01-02T18:19:24.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001, 2023-01-02T18:19:24.359 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.359 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.359 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.359 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:24.359 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:24.359 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 268 2023-01-02T18:19:24.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.360 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:19:24.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433757+0000", 2023-01-02T18:19:24.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:24.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433753+0000", 2023-01-02T18:19:24.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7139999999999999e-05 2023-01-02T18:19:24.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433771+0000", 2023-01-02T18:19:24.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6865000000000004e-05 2023-01-02T18:19:24.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433837+0000", 2023-01-02T18:19:24.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.111e-05 2023-01-02T18:19:24.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433849+0000", 2023-01-02T18:19:24.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2648e-05 2023-01-02T18:19:24.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433921+0000", 2023-01-02T18:19:24.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7130000000000002e-06 2023-01-02T18:19:24.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:24.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.433927+0000", 2023-01-02T18:19:24.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048089439999999999 2023-01-02T18:19:24.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438736+0000", 2023-01-02T18:19:24.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000104146 2023-01-02T18:19:24.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438840+0000", 2023-01-02T18:19:24.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110821 2023-01-02T18:19:24.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:24.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.438951+0000", 2023-01-02T18:19:24.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099114499999999992 2023-01-02T18:19:24.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:24.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.439942+0000", 2023-01-02T18:19:24.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062541400000000003 2023-01-02T18:19:24.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:24.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440567+0000", 2023-01-02T18:19:24.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0256e-05 2023-01-02T18:19:24.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440628+0000", 2023-01-02T18:19:24.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9929999999999998e-05 2023-01-02T18:19:24.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:43.440678+0000", 2023-01-02T18:19:24.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069209620000000001 2023-01-02T18:19:24.374 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.374 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.374 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.375 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:270 4.1a 4:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e51)", 2023-01-02T18:19:24.375 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:19:24.375 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 160.00076942600001, 2023-01-02T18:19:24.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001, 2023-01-02T18:19:24.376 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.376 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:24.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:24.377 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 270 2023-01-02T18:19:24.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.377 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.377 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.377 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.377 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:19:24.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.378 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298538+0000", 2023-01-02T18:19:24.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:24.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.379 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.379 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298536+0000", 2023-01-02T18:19:24.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9389999999999997e-06 2023-01-02T18:19:24.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298544+0000", 2023-01-02T18:19:24.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2522e-05 2023-01-02T18:19:24.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298557+0000", 2023-01-02T18:19:24.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1260000000000004e-06 2023-01-02T18:19:24.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298566+0000", 2023-01-02T18:19:24.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6520000000000001e-05 2023-01-02T18:19:24.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298622+0000", 2023-01-02T18:19:24.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.22e-06 2023-01-02T18:19:24.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:24.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.298628+0000", 2023-01-02T18:19:24.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052882160000000001 2023-01-02T18:19:24.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.303916+0000", 2023-01-02T18:19:24.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4512000000000006e-05 2023-01-02T18:19:24.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304010+0000", 2023-01-02T18:19:24.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016052899999999999 2023-01-02T18:19:24.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:24.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.304171+0000", 2023-01-02T18:19:24.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001200462 2023-01-02T18:19:24.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:24.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.305371+0000", 2023-01-02T18:19:24.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0033637699999999999 2023-01-02T18:19:24.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:24.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308735+0000", 2023-01-02T18:19:24.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2925e-05 2023-01-02T18:19:24.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308778+0000", 2023-01-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2110999999999998e-05 2023-01-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:44.308810+0000", 2023-01-02T18:19:24.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010272364000000001 2023-01-02T18:19:24.391 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.391 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.391 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3507 13.3 e134/124 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head v 134'3, mlcod=133'1)", 2023-01-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.404574944000004, 2023-01-02T18:19:24.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003658751, 2023-01-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.393 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:19:24.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.394 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.394 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.394 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894732+0000", 2023-01-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.395 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.894729+0000", 2023-01-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001143016 2023-01-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895872+0000", 2023-01-02T18:19:24.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6974999999999999e-05 2023-01-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895889+0000", 2023-01-02T18:19:24.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4590000000000004e-06 2023-01-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895899+0000", 2023-01-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2062000000000001e-05 2023-01-02T18:19:24.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.895981+0000", 2023-01-02T18:19:24.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2603e-05 2023-01-02T18:19:24.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.896004+0000", 2023-01-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023445829999999999 2023-01-02T18:19:24.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.898348+0000", 2023-01-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2809999999999998e-05 2023-01-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:16.898391+0000", 2023-01-02T18:19:24.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003658751 2023-01-02T18:19:24.402 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.402 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:3508 13.3 e134/124 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head v 134'4, mlcod=134'2)", 2023-01-02T18:19:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:19:24.403 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.399431989999997, 2023-01-02T18:19:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035122700000000001, 2023-01-02T18:19:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:19:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899875+0000", 2023-01-02T18:19:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.899872+0000", 2023-01-02T18:19:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001146268 2023-01-02T18:19:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901019+0000", 2023-01-02T18:19:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8525999999999998e-05 2023-01-02T18:19:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901037+0000", 2023-01-02T18:19:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.893e-06 2023-01-02T18:19:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901047+0000", 2023-01-02T18:19:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3754000000000001e-05 2023-01-02T18:19:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901101+0000", 2023-01-02T18:19:24.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5004999999999999e-05 2023-01-02T18:19:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.901126+0000", 2023-01-02T18:19:24.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022245860000000002 2023-01-02T18:19:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.903350+0000", 2023-01-02T18:19:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6918000000000001e-05 2023-01-02T18:19:24.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:17.903387+0000", 2023-01-02T18:19:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035122700000000001 2023-01-02T18:19:24.413 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.414 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6058 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e137)", 2023-01-02T18:19:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.671994+0000", 2023-01-02T18:19:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.627313499000003, 2023-01-02T18:19:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062282559999999997, 2023-01-02T18:19:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:24.415 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6058 2023-01-02T18:19:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.416 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.671994+0000", 2023-01-02T18:19:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.671994+0000", 2023-01-02T18:19:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.671993+0000", 2023-01-02T18:19:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0279999999999997e-06 2023-01-02T18:19:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.671999+0000", 2023-01-02T18:19:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1270000000000001e-05 2023-01-02T18:19:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.672010+0000", 2023-01-02T18:19:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8229999999999997e-06 2023-01-02T18:19:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.672017+0000", 2023-01-02T18:19:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5556999999999998e-05 2023-01-02T18:19:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.672062+0000", 2023-01-02T18:19:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2729999999999999e-06 2023-01-02T18:19:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:24.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.672069+0000", 2023-01-02T18:19:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060877179999999998 2023-01-02T18:19:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678156+0000", 2023-01-02T18:19:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5415999999999998e-05 2023-01-02T18:19:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678222+0000", 2023-01-02T18:19:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062282559999999997 2023-01-02T18:19:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:16193 3.e e140/124 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head v 140'8, mlcod=46'6)", 2023-01-02T18:19:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.876242+0000", 2023-01-02T18:19:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 56.423064908000001, 2023-01-02T18:19:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017329062999999999, 2023-01-02T18:19:24.427 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876242+0000", 2023-01-02T18:19:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.429 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876242+0000", 2023-01-02T18:19:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967296 2023-01-02T18:19:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876242+0000", 2023-01-02T18:19:24.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023727710000000001 2023-01-02T18:19:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878615+0000", 2023-01-02T18:19:24.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4155000000000001e-05 2023-01-02T18:19:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878649+0000", 2023-01-02T18:19:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1907e-05 2023-01-02T18:19:24.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878661+0000", 2023-01-02T18:19:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6368e-05 2023-01-02T18:19:24.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878717+0000", 2023-01-02T18:19:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2062999999999999e-05 2023-01-02T18:19:24.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.878739+0000", 2023-01-02T18:19:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.014783843 2023-01-02T18:19:24.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893523+0000", 2023-01-02T18:19:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8170000000000001e-05 2023-01-02T18:19:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893571+0000", 2023-01-02T18:19:24.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017329062999999999 2023-01-02T18:19:24.437 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.437 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.438 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.438 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:28804 3.1a 3:5dc8c609:::rbd_data.12a211eeb54d.0000000000000007:head [create,set-alloc-hint object_size 4194304 write_size 4194304,write 4193792~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:24.438 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:31.011945+0000", 2023-01-02T18:19:24.438 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 53.287361738999998, 2023-01-02T18:19:24.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004928829, 2023-01-02T18:19:24.439 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.439 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.439 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:24.440 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:24.440 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 28804 2023-01-02T18:19:24.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.440 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011945+0000", 2023-01-02T18:19:24.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011945+0000", 2023-01-02T18:19:24.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:24.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011945+0000", 2023-01-02T18:19:24.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.169e-06 2023-01-02T18:19:24.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011950+0000", 2023-01-02T18:19:24.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3400000000000004e-06 2023-01-02T18:19:24.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.444 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.444 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011959+0000", 2023-01-02T18:19:24.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3769999999999998e-06 2023-01-02T18:19:24.445 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.445 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011963+0000", 2023-01-02T18:19:24.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5519000000000003e-05 2023-01-02T18:19:24.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.446 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.011999+0000", 2023-01-02T18:19:24.446 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3139000000000004e-05 2023-01-02T18:19:24.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.012092+0000", 2023-01-02T18:19:24.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7732999999999994e-05 2023-01-02T18:19:24.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:24.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.012190+0000", 2023-01-02T18:19:24.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095032899999999997 2023-01-02T18:19:24.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:24.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.013140+0000", 2023-01-02T18:19:24.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0036617080000000001 2023-01-02T18:19:24.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:24.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.016802+0000", 2023-01-02T18:19:24.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4647999999999998e-05 2023-01-02T18:19:24.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.016837+0000", 2023-01-02T18:19:24.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7701999999999999e-05 2023-01-02T18:19:24.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:31.016874+0000", 2023-01-02T18:19:24.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004928829 2023-01-02T18:19:24.452 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.452 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.453 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.453 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:41668 3.b e150/132 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head v 150'17, mlcod=150'13)", 2023-01-02T18:19:24.453 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:45.381572+0000", 2023-01-02T18:19:24.454 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.917734955, 2023-01-02T18:19:24.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058493620000000003, 2023-01-02T18:19:24.454 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.454 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.454 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381572+0000", 2023-01-02T18:19:24.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381572+0000", 2023-01-02T18:19:24.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:24.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381571+0000", 2023-01-02T18:19:24.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3999999999999997e-06 2023-01-02T18:19:24.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381578+0000", 2023-01-02T18:19:24.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0849999999999997e-06 2023-01-02T18:19:24.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381586+0000", 2023-01-02T18:19:24.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2220000000000001e-06 2023-01-02T18:19:24.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381591+0000", 2023-01-02T18:19:24.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5863999999999998e-05 2023-01-02T18:19:24.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381617+0000", 2023-01-02T18:19:24.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1165999999999999e-05 2023-01-02T18:19:24.461 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.461 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.461 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.381628+0000", 2023-01-02T18:19:24.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0057652249999999997 2023-01-02T18:19:24.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.462 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.462 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.387393+0000", 2023-01-02T18:19:24.463 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.811e-05 2023-01-02T18:19:24.463 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.463 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.463 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.463 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.387422+0000", 2023-01-02T18:19:24.464 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058493620000000003 2023-01-02T18:19:24.464 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.464 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.464 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.465 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:41669 3.b e150/132 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head v 150'18, mlcod=150'14)", 2023-01-02T18:19:24.465 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:45.382129+0000", 2023-01-02T18:19:24.465 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.917178157000002, 2023-01-02T18:19:24.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056899669999999998, 2023-01-02T18:19:24.465 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.466 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.466 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382129+0000", 2023-01-02T18:19:24.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382129+0000", 2023-01-02T18:19:24.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:24.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382129+0000", 2023-01-02T18:19:24.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1359999999999999e-06 2023-01-02T18:19:24.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382133+0000", 2023-01-02T18:19:24.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0839999999999992e-06 2023-01-02T18:19:24.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382141+0000", 2023-01-02T18:19:24.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6100000000000002e-06 2023-01-02T18:19:24.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382147+0000", 2023-01-02T18:19:24.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8420000000000001e-05 2023-01-02T18:19:24.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382186+0000", 2023-01-02T18:19:24.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2589999999999998e-05 2023-01-02T18:19:24.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.382218+0000", 2023-01-02T18:19:24.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055792439999999997 2023-01-02T18:19:24.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.387798+0000", 2023-01-02T18:19:24.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1338000000000001e-05 2023-01-02T18:19:24.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:45.387819+0000", 2023-01-02T18:19:24.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056899669999999998 2023-01-02T18:19:24.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.475 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.476 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:46499 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [read 123904~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e151)", 2023-01-02T18:19:24.476 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:46.671188+0000", 2023-01-02T18:19:24.476 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 37.628119083000001, 2023-01-02T18:19:24.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006141807, 2023-01-02T18:19:24.477 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.477 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "reached pg", 2023-01-02T18:19:24.477 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.477 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:24.478 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:24.478 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 46499 2023-01-02T18:19:24.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.478 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671188+0000", 2023-01-02T18:19:24.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.479 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671188+0000", 2023-01-02T18:19:24.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:24.480 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.480 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671186+0000", 2023-01-02T18:19:24.481 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0696999999999999e-05 2023-01-02T18:19:24.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.481 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.481 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671197+0000", 2023-01-02T18:19:24.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2606e-05 2023-01-02T18:19:24.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.482 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671220+0000", 2023-01-02T18:19:24.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0166000000000001e-05 2023-01-02T18:19:24.483 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671230+0000", 2023-01-02T18:19:24.483 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010081600000000001 2023-01-02T18:19:24.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671331+0000", 2023-01-02T18:19:24.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6033e-05 2023-01-02T18:19:24.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.485 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.485 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:24.485 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.671347+0000", 2023-01-02T18:19:24.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056472010000000001 2023-01-02T18:19:24.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.676994+0000", 2023-01-02T18:19:24.486 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000336025 2023-01-02T18:19:24.486 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.487 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.487 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:46.677330+0000", 2023-01-02T18:19:24.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.006141807 2023-01-02T18:19:24.487 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.488 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.488 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.488 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.488 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.488 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10861 3.9 3:90dc8b0a:::rbd_data.11d5fbafd69b.0000000000000000:head [write 512~512 [fadvise_nocache]] snapc 0=[] ondisk+write+known_if_redirected e157)", 2023-01-02T18:19:24.489 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.728068+0000", 2023-01-02T18:19:24.489 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.57123889, 2023-01-02T18:19:24.489 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047831870000000004, 2023-01-02T18:19:24.489 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.489 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.489 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.490 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:24.490 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:24.490 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10861 2023-01-02T18:19:24.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.490 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.491 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.491 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.491 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728068+0000", 2023-01-02T18:19:24.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.491 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.492 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.492 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728068+0000", 2023-01-02T18:19:24.492 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:24.492 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.492 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.493 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.493 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728067+0000", 2023-01-02T18:19:24.493 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4490000000000001e-06 2023-01-02T18:19:24.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.493 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.494 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728072+0000", 2023-01-02T18:19:24.494 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2730000000000002e-06 2023-01-02T18:19:24.494 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728080+0000", 2023-01-02T18:19:24.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.703e-06 2023-01-02T18:19:24.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.495 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.495 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.496 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728084+0000", 2023-01-02T18:19:24.496 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3649e-05 2023-01-02T18:19:24.496 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728107+0000", 2023-01-02T18:19:24.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.778e-05 2023-01-02T18:19:24.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.497 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.497 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728155+0000", 2023-01-02T18:19:24.498 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0832e-05 2023-01-02T18:19:24.498 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:24.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.728246+0000", 2023-01-02T18:19:24.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004053971 2023-01-02T18:19:24.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.499 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:24.499 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.732300+0000", 2023-01-02T18:19:24.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045260400000000001 2023-01-02T18:19:24.500 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.500 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:24.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.732753+0000", 2023-01-02T18:19:24.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8437999999999999e-05 2023-01-02T18:19:24.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.501 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.732811+0000", 2023-01-02T18:19:24.501 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0377999999999999e-05 2023-01-02T18:19:24.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.502 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.502 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.732851+0000", 2023-01-02T18:19:24.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047831870000000004 2023-01-02T18:19:24.502 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.503 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.503 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.503 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.503 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:12231 3.9 3:90dc8b0a:::rbd_data.11d5fbafd69b.0000000000000000:head [read 4608~512] snapc 0=[] ondisk+read+known_if_redirected e157)", 2023-01-02T18:19:24.504 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:56.121865+0000", 2023-01-02T18:19:24.504 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.177441647999999, 2023-01-02T18:19:24.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039799880000000003, 2023-01-02T18:19:24.504 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.504 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:24.504 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:24.505 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:24.505 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 12231 2023-01-02T18:19:24.505 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.505 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121865+0000", 2023-01-02T18:19:24.506 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.507 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.507 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121865+0000", 2023-01-02T18:19:24.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:24.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.507 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121865+0000", 2023-01-02T18:19:24.508 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3789999999999999e-06 2023-01-02T18:19:24.508 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.509 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121869+0000", 2023-01-02T18:19:24.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9989999999999997e-06 2023-01-02T18:19:24.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.509 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.509 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121878+0000", 2023-01-02T18:19:24.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5160000000000002e-06 2023-01-02T18:19:24.510 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121884+0000", 2023-01-02T18:19:24.511 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9502999999999999e-05 2023-01-02T18:19:24.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.511 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121913+0000", 2023-01-02T18:19:24.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5633000000000002e-05 2023-01-02T18:19:24.512 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.512 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.512 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.121959+0000", 2023-01-02T18:19:24.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038867530000000002 2023-01-02T18:19:24.513 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.513 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.513 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.513 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:56.125845+0000", 2023-01-02T18:19:24.513 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039799880000000003 2023-01-02T18:19:24.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.514 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.514 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.514 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.514 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.515 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:16410 3.9 3:90dc8b0a:::rbd_data.11d5fbafd69b.0000000000000000:head [read 4608~512] snapc 0=[] ondisk+read+known_if_redirected e157)", 2023-01-02T18:19:24.515 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:57.250718+0000", 2023-01-02T18:19:24.515 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.048588903999999, 2023-01-02T18:19:24.515 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003771146, 2023-01-02T18:19:24.515 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.515 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:24.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:24.516 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:24.516 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16410 2023-01-02T18:19:24.516 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.517 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.517 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.517 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.517 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250718+0000", 2023-01-02T18:19:24.517 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.518 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.518 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.518 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250718+0000", 2023-01-02T18:19:24.518 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:24.518 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.519 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.519 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.519 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250717+0000", 2023-01-02T18:19:24.519 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6569999999999999e-06 2023-01-02T18:19:24.519 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.520 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.520 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250721+0000", 2023-01-02T18:19:24.520 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7279999999999995e-06 2023-01-02T18:19:24.520 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.520 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.521 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.521 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250729+0000", 2023-01-02T18:19:24.521 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7809999999999999e-06 2023-01-02T18:19:24.521 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.521 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.522 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.522 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250733+0000", 2023-01-02T18:19:24.522 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8127e-05 2023-01-02T18:19:24.522 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.522 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.523 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250761+0000", 2023-01-02T18:19:24.523 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1230999999999998e-05 2023-01-02T18:19:24.523 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.523 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.523 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.524 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.250812+0000", 2023-01-02T18:19:24.524 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003677338 2023-01-02T18:19:24.524 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.524 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.524 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.525 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:57.254489+0000", 2023-01-02T18:19:24.525 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003771146 2023-01-02T18:19:24.525 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.525 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.525 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.525 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:54785 3.f e161/124 3:f2d07b5d:::rbd_header.12a21a1bf873:head v 161'46, mlcod=160'44)", 2023-01-02T18:19:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.349777+0000", 2023-01-02T18:19:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 22.949530399, 2023-01-02T18:19:24.526 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048608970000000003, 2023-01-02T18:19:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.527 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349777+0000", 2023-01-02T18:19:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.528 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349777+0000", 2023-01-02T18:19:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967296 2023-01-02T18:19:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.529 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349777+0000", 2023-01-02T18:19:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.442e-06 2023-01-02T18:19:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349781+0000", 2023-01-02T18:19:24.530 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3157e-05 2023-01-02T18:19:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349794+0000", 2023-01-02T18:19:24.531 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4240000000000001e-06 2023-01-02T18:19:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349800+0000", 2023-01-02T18:19:24.532 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9571999999999999e-05 2023-01-02T18:19:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349849+0000", 2023-01-02T18:19:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5091e-05 2023-01-02T18:19:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349864+0000", 2023-01-02T18:19:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047321680000000001 2023-01-02T18:19:24.534 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354596+0000", 2023-01-02T18:19:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1255999999999999e-05 2023-01-02T18:19:24.535 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.536 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.536 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.536 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354638+0000", 2023-01-02T18:19:24.536 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048608970000000003 2023-01-02T18:19:24.536 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.536 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.537 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.537 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.537 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.537 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:55850 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e165)", 2023-01-02T18:19:24.537 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.389280+0000", 2023-01-02T18:19:24.538 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.910026738999999, 2023-01-02T18:19:24.538 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003377297, 2023-01-02T18:19:24.538 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.538 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:24.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:24.538 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:24.539 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:24.539 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 55850 2023-01-02T18:19:24.539 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.539 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.539 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.540 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389280+0000", 2023-01-02T18:19:24.540 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.540 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.540 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.540 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.541 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389280+0000", 2023-01-02T18:19:24.541 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:24.541 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.541 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.541 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.542 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389278+0000", 2023-01-02T18:19:24.542 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4880000000000007e-06 2023-01-02T18:19:24.542 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.542 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.542 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389287+0000", 2023-01-02T18:19:24.543 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2645e-05 2023-01-02T18:19:24.543 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.543 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.543 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.543 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389299+0000", 2023-01-02T18:19:24.544 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6189999999999999e-06 2023-01-02T18:19:24.544 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.544 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.544 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.544 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389305+0000", 2023-01-02T18:19:24.545 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2271000000000001e-05 2023-01-02T18:19:24.545 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.545 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.545 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.545 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389357+0000", 2023-01-02T18:19:24.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1181e-05 2023-01-02T18:19:24.546 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.546 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.546 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:24.546 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.389368+0000", 2023-01-02T18:19:24.546 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0030587040000000002 2023-01-02T18:19:24.547 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.547 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.547 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.547 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.392427+0000", 2023-01-02T18:19:24.547 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011006999999999999 2023-01-02T18:19:24.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.548 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.548 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.548 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.392537+0000", 2023-01-02T18:19:24.548 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000120567 2023-01-02T18:19:24.548 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.549 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.549 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.549 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.392658+0000", 2023-01-02T18:19:24.549 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003377297 2023-01-02T18:19:24.549 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.550 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.550 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.550 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.550 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.550 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_repop(client.4770.0:56246 3.13 e165/124 3:c91665cb:::rbd_header.12a261246745:head v 165'87, mlcod=165'85)", 2023-01-02T18:19:24.551 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.645413+0000", 2023-01-02T18:19:24.551 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 18.653894445999999, 2023-01-02T18:19:24.551 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052432629999999997, 2023-01-02T18:19:24.551 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:24.551 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:24.551 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:24.552 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.552 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:24.552 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645413+0000", 2023-01-02T18:19:24.552 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:24.552 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.553 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.553 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:24.553 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645413+0000", 2023-01-02T18:19:24.553 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:24.553 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.554 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:24.554 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645412+0000", 2023-01-02T18:19:24.554 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7649999999999993e-06 2023-01-02T18:19:24.554 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.554 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.555 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:24.555 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645420+0000", 2023-01-02T18:19:24.555 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4603999999999999e-05 2023-01-02T18:19:24.555 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.555 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.556 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:24.556 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645434+0000", 2023-01-02T18:19:24.556 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7100000000000001e-06 2023-01-02T18:19:24.556 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.556 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:24.557 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645441+0000", 2023-01-02T18:19:24.557 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5796000000000001e-05 2023-01-02T18:19:24.557 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.557 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.557 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:24.558 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645477+0000", 2023-01-02T18:19:24.558 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7567999999999998e-05 2023-01-02T18:19:24.558 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.558 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.558 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:24.559 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645494+0000", 2023-01-02T18:19:24.559 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005128362 2023-01-02T18:19:24.559 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.559 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.559 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:24.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650623+0000", 2023-01-02T18:19:24.560 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3368999999999998e-05 2023-01-02T18:19:24.560 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:24.560 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:24.560 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:24.560 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650656+0000", 2023-01-02T18:19:24.561 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0052432629999999997 2023-01-02T18:19:24.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.561 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.561 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:24.562 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:24.562 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:24.562 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-01-02T18:19:24.564 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:24.564+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:24.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:19:24.664 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:24.664+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:24.732 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:24.732 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:24.733 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:24.733 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:24.743 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:19:24.787 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:24.788+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:24.866 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:24.866+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:24.869 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:24.869 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:24.869 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:24.869 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:24.869 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:24.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:19:24.968 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:24.969+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:25.052 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:25.053 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:25.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:25.053 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:25.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.054 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:19:25.054 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:25.054 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 148.747101528, 2023-01-02T18:19:25.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:19:25.054 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.055 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:25.055 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:25.055 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:19:25.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.056 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:25.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:25.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:25.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:19:25.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:19:25.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:19:25.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:19:25.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:19:25.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:19:25.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:19:25.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:19:25.061 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.062 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.062 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:19:25.062 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:19:25.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:19:25.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:19:25.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:19:25.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:19:25.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:19:25.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:19:25.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:25.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:19:25.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:19:25.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:19:25.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:19:25.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:19:25.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:19:25.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:19:25.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:19:25.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:19:25.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:19:25.073 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.074 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.074 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.074 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:25.074 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:25.075 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 143.74197330699999, 2023-01-02T18:19:25.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:19:25.075 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.075 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.075 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.076 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.076 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.076 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:19:25.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.076 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:25.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:25.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:25.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.079 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:19:25.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:19:25.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:19:25.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:19:25.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.080 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.080 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:19:25.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:19:25.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:19:25.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:19:25.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:19:25.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:19:25.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:19:25.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:19:25.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:19:25.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:19:25.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:19:25.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:19:25.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:19:25.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:19:25.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:19:25.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:19:25.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:19:25.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:19:25.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:19:25.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:19:25.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:19:25.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:19:25.090 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.090 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.091 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.091 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:19:25.091 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:25.092 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 134.45190881400001, 2023-01-02T18:19:25.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:19:25.092 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.092 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.092 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.093 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.093 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.093 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:19:25.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.093 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:25.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:25.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:25.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:19:25.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:19:25.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:19:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:19:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:19:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:19:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:19:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:19:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:19:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:19:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:19:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:19:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:19:25.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:19:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:19:25.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:19:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:19:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:19:25.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:19:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:19:25.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:19:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:19:25.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:19:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:19:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:19:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:19:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.107 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:25.108 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 133.45318347099999, 2023-01-02T18:19:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:19:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.109 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:19:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:19:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:19:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:19:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:19:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:19:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:19:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:19:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:19:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:19:25.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:19:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:19:25.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:19:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:19:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:19:25.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:19:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:19:25.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:19:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:19:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:19:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:19:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:19:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:19:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:19:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:19:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:19:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:19:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.124 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:25.125 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 133.428821707, 2023-01-02T18:19:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:19:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.126 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:19:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:19:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:19:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:19:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:19:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:19:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:19:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:19:25.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:19:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:19:25.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:19:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:19:25.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:19:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:19:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:19:25.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:19:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:19:25.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:19:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:19:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:19:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:19:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:19:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:19:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.139 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:25.140 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.72322703899999, 2023-01-02T18:19:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:19:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.141 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:19:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:25.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:25.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:25.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:19:25.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:19:25.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:19:25.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:19:25.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:19:25.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:19:25.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:19:25.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:19:25.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:19:25.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:19:25.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:19:25.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:19:25.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:25.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:19:25.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:19:25.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:19:25.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:19:25.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:19:25.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:19:25.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:19:25.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:19:25.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:19:25.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:19:25.157 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.157 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.158 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.158 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:19:25.158 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:25.159 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 100.67081922200001, 2023-01-02T18:19:25.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:19:25.159 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.159 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.159 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.160 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.160 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.160 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:19:25.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.160 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:25.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:25.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:25.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:19:25.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:19:25.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:19:25.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:19:25.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:19:25.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:19:25.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:19:25.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:19:25.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:19:25.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:19:25.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:19:25.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:19:25.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:25.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:19:25.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:19:25.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:19:25.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:19:25.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:19:25.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:19:25.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:19:25.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:19:25.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:19:25.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:19:25.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.174 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.175 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.175 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:19:25.175 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:25.176 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 95.640489705999997, 2023-01-02T18:19:25.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:19:25.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.176 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.177 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:19:25.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.177 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:25.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:25.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:25.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:19:25.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:19:25.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:19:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:19:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:19:25.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:19:25.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:19:25.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:19:25.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:19:25.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:19:25.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:19:25.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:19:25.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:25.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:19:25.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:19:25.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:19:25.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:19:25.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:19:25.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:19:25.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:19:25.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:19:25.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:19:25.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:19:25.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.191 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.192 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:19:25.192 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:25.192 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 89.540043041000004, 2023-01-02T18:19:25.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:19:25.193 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.193 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.193 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.194 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:19:25.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.194 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:25.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:25.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:25.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:19:25.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:19:25.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:19:25.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:19:25.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:19:25.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:19:25.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:19:25.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:19:25.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:19:25.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:19:25.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:19:25.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:19:25.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:25.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:19:25.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:19:25.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:19:25.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:19:25.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:19:25.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:19:25.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:19:25.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:19:25.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:19:25.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:19:25.210 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.210 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.211 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.211 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:19:25.212 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:25.212 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 72.184505795000007, 2023-01-02T18:19:25.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:19:25.212 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.213 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.213 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.213 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.214 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.214 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:19:25.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.214 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:25.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:25.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:25.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:19:25.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:19:25.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:19:25.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:19:25.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:19:25.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:19:25.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:19:25.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:19:25.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:19:25.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:19:25.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:19:25.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:19:25.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:19:25.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:19:25.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:19:25.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:19:25.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:25.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:19:25.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:19:25.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:19:25.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:19:25.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:19:25.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:19:25.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:19:25.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:19:25.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:19:25.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:19:25.239 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.240 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.241 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:19:25.242 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:25.242 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 71.173601152000003, 2023-01-02T18:19:25.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:19:25.242 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.243 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:25.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.244 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:19:25.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.244 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:25.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:25.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:25.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:19:25.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:19:25.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:19:25.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:19:25.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:19:25.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:19:25.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:19:25.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:19:25.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:19:25.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:19:25.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:25.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:19:25.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:19:25.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:19:25.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:19:25.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:19:25.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:19:25.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:19:25.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:19:25.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:19:25.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:19:25.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:19:25.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:19:25.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:19:25.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.267 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.267 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.269 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:19:25.269 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:25.269 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.147658312999994, 2023-01-02T18:19:25.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:19:25.270 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.271 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.271 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.272 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.272 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.272 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:19:25.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.273 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:25.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:25.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:25.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:19:25.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:19:25.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:19:25.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:19:25.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:19:25.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:19:25.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:19:25.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:19:25.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:19:25.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:19:25.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:19:25.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:19:25.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:19:25.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:19:25.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:19:25.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:19:25.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:25.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:19:25.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:19:25.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:19:25.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:19:25.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:19:25.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:19:25.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:19:25.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:19:25.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:19:25.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:19:25.297 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.298 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.298 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.299 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:19:25.299 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:25.299 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 63.372881198000002, 2023-01-02T18:19:25.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:19:25.300 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.300 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:25.301 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.301 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.302 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.302 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:19:25.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.303 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:25.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:25.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:25.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:19:25.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:19:25.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:19:25.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:19:25.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:19:25.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:19:25.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:19:25.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:19:25.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:19:25.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:19:25.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:19:25.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:19:25.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:19:25.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:19:25.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:19:25.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:19:25.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:19:25.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:19:25.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.319 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.319 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.320 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:19:25.320 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:25.321 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.328376165000002, 2023-01-02T18:19:25.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:19:25.321 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.321 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.322 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.322 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.322 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.323 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:19:25.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.323 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:25.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:25.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:25.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:19:25.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:19:25.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:19:25.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:19:25.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:19:25.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:19:25.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.331 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.331 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:19:25.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:19:25.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.332 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:19:25.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:19:25.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:19:25.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:19:25.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:25.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:19:25.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:19:25.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:19:25.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:19:25.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:19:25.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:19:25.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:19:25.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:19:25.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:19:25.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:19:25.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.343 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.343 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.344 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:25.345 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:25.345 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 44.127392909000001, 2023-01-02T18:19:25.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:19:25.346 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.346 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.346 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.347 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.347 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.347 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:19:25.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.348 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.349 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.349 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.349 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:25.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.350 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.350 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:25.351 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:19:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:19:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:19:25.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:19:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:19:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:19:25.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:19:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:19:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:19:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:19:25.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:19:25.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:19:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:19:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:19:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:19:25.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:19:25.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:19:25.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:19:25.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:19:25.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:19:25.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:19:25.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:19:25.371 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.371 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.372 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.373 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:25.373 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:25.374 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 43.926140205999999, 2023-01-02T18:19:25.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:19:25.374 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.375 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.375 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.376 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.376 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:19:25.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.377 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.378 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.378 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:25.379 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.379 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.379 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.380 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:25.380 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:25.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:19:25.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:19:25.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:19:25.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:19:25.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:19:25.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:19:25.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:19:25.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:19:25.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:19:25.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:19:25.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:19:25.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:19:25.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:19:25.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:19:25.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.393 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.394 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:19:25.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:19:25.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.395 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.395 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:19:25.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:19:25.396 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:19:25.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:19:25.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:19:25.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:19:25.398 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.399 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.399 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54804 3.17 3:ec8e444a:::rbd_header.12a28f082913:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.677819976999999, 2023-01-02T18:19:25.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001, 2023-01-02T18:19:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.401 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54804 2023-01-02T18:19:25.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:25.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373824+0000", 2023-01-02T18:19:25.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9380000000000004e-06 2023-01-02T18:19:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373834+0000", 2023-01-02T18:19:25.409 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6818999999999999e-05 2023-01-02T18:19:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.410 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373851+0000", 2023-01-02T18:19:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.481e-06 2023-01-02T18:19:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.411 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373858+0000", 2023-01-02T18:19:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2268999999999998e-05 2023-01-02T18:19:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373900+0000", 2023-01-02T18:19:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1660000000000002e-06 2023-01-02T18:19:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373906+0000", 2023-01-02T18:19:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060814570000000002 2023-01-02T18:19:25.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.379987+0000", 2023-01-02T18:19:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015394200000000001 2023-01-02T18:19:25.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380141+0000", 2023-01-02T18:19:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026425999999999999 2023-01-02T18:19:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380405+0000", 2023-01-02T18:19:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00098840499999999993 2023-01-02T18:19:25.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381394+0000", 2023-01-02T18:19:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1028e-05 2023-01-02T18:19:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381405+0000", 2023-01-02T18:19:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9657999999999997e-05 2023-01-02T18:19:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.426 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381464+0000", 2023-01-02T18:19:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1522e-05 2023-01-02T18:19:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381506+0000", 2023-01-02T18:19:25.428 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001 2023-01-02T18:19:25.429 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.431 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56742 16.1a 16:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e175)", 2023-01-02T18:19:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.7110026030000007, 2023-01-02T18:19:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011704930000000001, 2023-01-02T18:19:25.432 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.433 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56742 2023-01-02T18:19:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.434 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:25.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340641+0000", 2023-01-02T18:19:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8539999999999992e-06 2023-01-02T18:19:25.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340651+0000", 2023-01-02T18:19:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7829000000000002e-05 2023-01-02T18:19:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340669+0000", 2023-01-02T18:19:25.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3170000000000002e-06 2023-01-02T18:19:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340677+0000", 2023-01-02T18:19:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9048000000000002e-05 2023-01-02T18:19:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340726+0000", 2023-01-02T18:19:25.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0350000000000004e-06 2023-01-02T18:19:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.446 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340733+0000", 2023-01-02T18:19:25.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067919770000000003 2023-01-02T18:19:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347525+0000", 2023-01-02T18:19:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012438400000000001 2023-01-02T18:19:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347650+0000", 2023-01-02T18:19:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000157252 2023-01-02T18:19:25.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347807+0000", 2023-01-02T18:19:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037935450000000002 2023-01-02T18:19:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.351600+0000", 2023-01-02T18:19:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00067858800000000004 2023-01-02T18:19:25.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352279+0000", 2023-01-02T18:19:25.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2793000000000003e-05 2023-01-02T18:19:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352312+0000", 2023-01-02T18:19:25.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6309000000000001e-05 2023-01-02T18:19:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352348+0000", 2023-01-02T18:19:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011704930000000001 2023-01-02T18:19:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.459 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56745 16.1a 16:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e176)", 2023-01-02T18:19:25.461 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 8.7096388109999996, 2023-01-02T18:19:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010738437999999999, 2023-01-02T18:19:25.462 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.463 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.464 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56745 2023-01-02T18:19:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:25.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342005+0000", 2023-01-02T18:19:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4179999999999997e-06 2023-01-02T18:19:25.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.470 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342014+0000", 2023-01-02T18:19:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0892e-05 2023-01-02T18:19:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.471 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342024+0000", 2023-01-02T18:19:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6720000000000001e-06 2023-01-02T18:19:25.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342030+0000", 2023-01-02T18:19:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3458999999999998e-05 2023-01-02T18:19:25.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342074+0000", 2023-01-02T18:19:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4819999999999999e-06 2023-01-02T18:19:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.476 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342080+0000", 2023-01-02T18:19:25.477 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076176819999999998 2023-01-02T18:19:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.478 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.349698+0000", 2023-01-02T18:19:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016925100000000001 2023-01-02T18:19:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.479 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.349867+0000", 2023-01-02T18:19:25.480 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017106700000000001 2023-01-02T18:19:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.481 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.350038+0000", 2023-01-02T18:19:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023704279999999999 2023-01-02T18:19:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:25.483 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352408+0000", 2023-01-02T18:19:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000255894 2023-01-02T18:19:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352664+0000", 2023-01-02T18:19:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3069999999999999e-05 2023-01-02T18:19:25.485 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:25.486 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352707+0000", 2023-01-02T18:19:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7987000000000001e-05 2023-01-02T18:19:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.487 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352745+0000", 2023-01-02T18:19:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010738437999999999 2023-01-02T18:19:25.488 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.489 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.490 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58335 15.1c 15:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected e179)", 2023-01-02T18:19:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 5.6959466120000002, 2023-01-02T18:19:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010193373, 2023-01-02T18:19:25.491 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:25.492 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58335 2023-01-02T18:19:25.493 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.494 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:25.495 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.496 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.496 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:25.497 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:25.497 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:25.497 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.498 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.498 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:25.498 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355697+0000", 2023-01-02T18:19:25.499 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.841e-06 2023-01-02T18:19:25.499 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.499 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.500 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:25.500 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355705+0000", 2023-01-02T18:19:25.500 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2976000000000001e-05 2023-01-02T18:19:25.501 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.501 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.501 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:25.502 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355718+0000", 2023-01-02T18:19:25.502 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9839999999999998e-06 2023-01-02T18:19:25.502 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.503 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.503 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:25.503 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355724+0000", 2023-01-02T18:19:25.504 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9267000000000002e-05 2023-01-02T18:19:25.504 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.504 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.505 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.505 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355764+0000", 2023-01-02T18:19:25.505 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8459999999999999e-06 2023-01-02T18:19:25.506 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.506 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.506 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:25.506 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355768+0000", 2023-01-02T18:19:25.507 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099580459999999999 2023-01-02T18:19:25.507 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.508 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.508 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:25.508 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365726+0000", 2023-01-02T18:19:25.509 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5611e-05 2023-01-02T18:19:25.509 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.510 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.510 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:25.510 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365782+0000", 2023-01-02T18:19:25.510 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110537 2023-01-02T18:19:25.511 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:25.511 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:25.511 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:25.512 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365893+0000", 2023-01-02T18:19:25.512 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010193373 2023-01-02T18:19:25.512 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.513 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:25.513 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:25.514 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:25.517 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-01-02T18:19:25.517 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:19:25.519 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:25.516+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:25.617 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:25.617+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:25.685 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:25.686 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:25.686 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:25.686 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:25.696 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:19:25.740 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:25.740+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:25.820 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:25.821+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:25.866 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:25.866 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:25.866 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:25.866 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:25.867 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:25.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:19:25.918 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:25.919+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:26.005 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:26.006 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:26.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:26.006 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:26.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.007 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:19:26.007 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:26.007 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 158.68689955100001, 2023-01-02T18:19:26.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:19:26.007 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.008 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.008 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.008 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:26.008 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:26.008 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:19:26.009 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.009 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.009 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.009 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.009 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:26.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.010 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.010 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:26.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:26.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:19:26.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:19:26.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:19:26.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:19:26.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:19:26.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:19:26.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:19:26.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:19:26.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:19:26.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:26.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:26.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:19:26.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:19:26.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:19:26.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:19:26.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:19:26.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:19:26.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:26.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:19:26.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:19:26.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:19:26.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:19:26.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:19:26.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:19:26.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:19:26.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:19:26.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:19:26.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:19:26.024 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.024 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.025 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.025 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:19:26.025 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:26.026 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 153.671816095, 2023-01-02T18:19:26.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:19:26.026 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.026 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.026 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.027 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:19:26.027 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.027 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.027 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.028 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.028 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:26.028 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:26.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:26.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:19:26.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:19:26.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:19:26.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:19:26.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:19:26.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:19:26.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:19:26.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:19:26.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:19:26.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:19:26.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:19:26.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:19:26.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:19:26.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:19:26.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:19:26.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:19:26.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:26.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:19:26.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:19:26.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:19:26.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:19:26.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:19:26.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:19:26.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:19:26.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:19:26.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:19:26.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:19:26.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.043 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.043 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.044 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.044 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:26.044 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:26.044 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 144.68711851800001, 2023-01-02T18:19:26.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:19:26.044 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.045 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.045 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.045 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.045 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.046 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:19:26.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.046 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:26.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:26.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:26.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:19:26.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:19:26.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:19:26.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:19:26.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:19:26.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:19:26.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:19:26.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:19:26.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:19:26.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:19:26.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:19:26.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:19:26.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:19:26.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:19:26.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:19:26.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:19:26.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:26.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:19:26.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:19:26.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:19:26.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:19:26.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:19:26.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:19:26.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:19:26.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:19:26.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.061 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:19:26.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:19:26.061 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.062 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.062 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.062 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:19:26.063 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:26.063 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 130.68909382699999, 2023-01-02T18:19:26.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:19:26.063 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.063 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.064 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.064 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.064 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.064 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:19:26.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.064 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:26.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:26.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:26.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:19:26.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:19:26.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:19:26.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:19:26.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:19:26.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:19:26.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:19:26.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:19:26.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:19:26.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:19:26.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:19:26.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:19:26.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:19:26.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:19:26.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:19:26.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:19:26.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:26.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:19:26.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:19:26.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:19:26.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:19:26.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:19:26.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:19:26.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:19:26.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:19:26.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.079 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.080 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:19:26.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:19:26.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.080 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.080 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.081 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:19:26.081 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:26.082 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 129.68803537299999, 2023-01-02T18:19:26.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:19:26.082 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.082 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.082 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.083 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:26.083 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:26.083 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:19:26.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.083 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:26.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:26.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:26.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:19:26.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:19:26.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:19:26.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:19:26.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:19:26.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:19:26.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:19:26.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:19:26.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:19:26.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:19:26.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:19:26.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:19:26.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:19:26.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:19:26.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:19:26.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:19:26.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:26.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:19:26.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:19:26.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:19:26.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:19:26.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.096 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.096 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:19:26.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:19:26.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.097 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.097 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.097 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:19:26.097 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:19:26.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:19:26.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:19:26.099 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.099 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.099 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.100 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:19:26.100 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:26.100 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 128.682670726, 2023-01-02T18:19:26.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:19:26.101 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.101 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.101 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.101 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:26.101 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:26.102 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:19:26.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.102 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:26.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:26.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:26.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:19:26.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:19:26.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:19:26.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:19:26.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:19:26.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:19:26.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:19:26.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:19:26.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:19:26.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:19:26.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:19:26.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:19:26.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:19:26.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:19:26.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.112 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.112 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:19:26.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:19:26.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:26.113 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:19:26.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:19:26.113 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.113 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.113 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.114 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:19:26.114 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:19:26.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:19:26.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:19:26.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:19:26.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:19:26.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:19:26.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:19:26.117 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.117 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.118 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.118 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:19:26.118 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:26.119 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 123.642339226, 2023-01-02T18:19:26.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:19:26.119 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.119 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.119 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.120 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:26.120 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:26.120 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:19:26.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.120 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:26.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:26.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:26.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:19:26.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:19:26.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:19:26.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:19:26.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:19:26.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:19:26.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:19:26.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:19:26.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:19:26.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:19:26.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:19:26.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:19:26.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.129 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.129 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:19:26.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:19:26.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.130 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.130 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.130 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:19:26.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:19:26.130 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:26.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:19:26.131 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:19:26.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:19:26.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:19:26.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:19:26.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:19:26.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:19:26.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:19:26.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:19:26.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:19:26.135 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.135 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.136 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.136 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:26.136 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:26.136 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.637768976, 2023-01-02T18:19:26.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:19:26.137 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.137 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.137 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.137 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:26.138 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:26.138 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:19:26.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.138 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:26.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:26.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:26.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:19:26.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:19:26.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:19:26.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:19:26.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:19:26.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:19:26.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:19:26.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:19:26.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:19:26.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:19:26.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:19:26.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:19:26.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:19:26.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:19:26.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:19:26.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:19:26.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:26.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:19:26.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:19:26.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:19:26.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:19:26.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:19:26.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:19:26.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:19:26.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:19:26.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:19:26.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:19:26.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.154 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.154 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.155 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:19:26.155 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:26.155 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 118.62493696, 2023-01-02T18:19:26.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:19:26.155 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.156 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.156 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.156 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:26.156 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:26.156 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:19:26.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.157 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:26.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:26.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:26.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:19:26.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:19:26.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:19:26.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:19:26.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:19:26.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:19:26.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:19:26.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:19:26.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:19:26.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:19:26.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:19:26.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:19:26.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:19:26.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:19:26.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:19:26.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:19:26.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:26.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:19:26.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:19:26.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:19:26.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:19:26.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:19:26.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:19:26.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:19:26.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:19:26.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:19:26.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:19:26.171 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.171 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.172 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.172 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:19:26.172 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:26.173 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 115.676203461, 2023-01-02T18:19:26.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:19:26.173 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.173 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.173 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:26.174 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:26.174 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:19:26.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.174 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:26.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:26.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:26.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:19:26.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:19:26.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:19:26.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:19:26.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:19:26.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:19:26.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:19:26.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:19:26.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:19:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:19:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:19:26.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:19:26.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:19:26.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:19:26.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:19:26.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:19:26.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:26.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:19:26.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:19:26.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:19:26.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:19:26.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:19:26.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:19:26.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:19:26.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:19:26.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:19:26.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:19:26.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.190 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 106.676360407, 2023-01-02T18:19:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:19:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.192 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.192 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.192 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.192 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.192 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:19:26.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.193 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:26.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:26.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:26.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:19:26.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:19:26.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:19:26.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:19:26.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:19:26.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:19:26.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:19:26.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:19:26.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:19:26.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:19:26.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:19:26.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:19:26.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:19:26.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:19:26.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:19:26.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:19:26.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:19:26.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:19:26.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:19:26.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:19:26.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:19:26.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:19:26.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:19:26.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.206 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.207 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:26.207 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:26.207 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 58.133321183, 2023-01-02T18:19:26.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:19:26.207 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.208 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.208 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.208 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.208 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.208 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:19:26.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.209 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:26.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:26.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:26.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:19:26.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:19:26.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:19:26.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:19:26.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:19:26.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:19:26.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:19:26.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:19:26.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:19:26.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:19:26.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:19:26.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:19:26.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:26.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:19:26.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:19:26.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:19:26.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:19:26.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:19:26.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:19:26.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:19:26.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:19:26.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:19:26.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:19:26.221 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.222 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.222 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.222 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:26.223 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:26.223 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 30.638714441000001, 2023-01-02T18:19:26.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:19:26.223 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.223 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.224 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.224 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:26.224 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:26.224 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:19:26.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.225 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.225 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.225 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:26.225 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:26.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:26.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:19:26.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:19:26.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:19:26.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:19:26.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:19:26.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:19:26.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:19:26.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:19:26.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:19:26.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:19:26.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:19:26.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:19:26.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:26.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:19:26.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:19:26.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:19:26.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:19:26.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:19:26.236 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:19:26.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:19:26.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:19:26.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:19:26.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:19:26.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:19:26.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.240 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.240 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.241 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54769 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e160)", 2023-01-02T18:19:26.241 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:26.242 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 25.665019740999998, 2023-01-02T18:19:26.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999, 2023-01-02T18:19:26.242 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.242 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.243 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.243 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54769 2023-01-02T18:19:26.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.244 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:26.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:26.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:26.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339928+0000", 2023-01-02T18:19:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0937e-05 2023-01-02T18:19:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339939+0000", 2023-01-02T18:19:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8923000000000002e-05 2023-01-02T18:19:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339958+0000", 2023-01-02T18:19:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4999999999999999e-06 2023-01-02T18:19:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339966+0000", 2023-01-02T18:19:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1886999999999999e-05 2023-01-02T18:19:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340028+0000", 2023-01-02T18:19:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9189999999999999e-06 2023-01-02T18:19:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340036+0000", 2023-01-02T18:19:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012331458999999999 2023-01-02T18:19:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352367+0000", 2023-01-02T18:19:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5671000000000001e-05 2023-01-02T18:19:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352443+0000", 2023-01-02T18:19:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028359799999999998 2023-01-02T18:19:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:26.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352727+0000", 2023-01-02T18:19:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089580699999999998 2023-01-02T18:19:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353622+0000", 2023-01-02T18:19:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163995 2023-01-02T18:19:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353786+0000", 2023-01-02T18:19:26.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7710000000000002e-05 2023-01-02T18:19:26.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353834+0000", 2023-01-02T18:19:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3380999999999999e-05 2023-01-02T18:19:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353857+0000", 2023-01-02T18:19:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999 2023-01-02T18:19:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54785 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:26.260 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.661352010000002, 2023-01-02T18:19:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348, 2023-01-02T18:19:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54785 2023-01-02T18:19:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343595+0000", 2023-01-02T18:19:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2480000000000002e-06 2023-01-02T18:19:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343605+0000", 2023-01-02T18:19:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6588000000000001e-05 2023-01-02T18:19:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343621+0000", 2023-01-02T18:19:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2490000000000004e-06 2023-01-02T18:19:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343629+0000", 2023-01-02T18:19:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3723000000000001e-05 2023-01-02T18:19:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343672+0000", 2023-01-02T18:19:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.04e-06 2023-01-02T18:19:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343677+0000", 2023-01-02T18:19:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054799280000000002 2023-01-02T18:19:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349157+0000", 2023-01-02T18:19:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010108299999999999 2023-01-02T18:19:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349258+0000", 2023-01-02T18:19:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000406179 2023-01-02T18:19:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349665+0000", 2023-01-02T18:19:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051027499999999996 2023-01-02T18:19:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354767+0000", 2023-01-02T18:19:26.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000482819 2023-01-02T18:19:26.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355250+0000", 2023-01-02T18:19:26.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7871999999999998e-05 2023-01-02T18:19:26.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355298+0000", 2023-01-02T18:19:26.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6105e-05 2023-01-02T18:19:26.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355344+0000", 2023-01-02T18:19:26.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348 2023-01-02T18:19:26.277 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.277 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.278 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.279 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56246 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:26.279 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:26.280 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 20.359950887, 2023-01-02T18:19:26.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998, 2023-01-02T18:19:26.280 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.280 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.280 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.281 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.281 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.281 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56246 2023-01-02T18:19:26.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.281 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:26.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:26.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:26.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644998+0000", 2023-01-02T18:19:26.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2189999999999998e-06 2023-01-02T18:19:26.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645002+0000", 2023-01-02T18:19:26.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0909999999999993e-06 2023-01-02T18:19:26.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645010+0000", 2023-01-02T18:19:26.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6880000000000001e-06 2023-01-02T18:19:26.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645014+0000", 2023-01-02T18:19:26.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6795999999999998e-05 2023-01-02T18:19:26.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645051+0000", 2023-01-02T18:19:26.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000001e-05 2023-01-02T18:19:26.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645135+0000", 2023-01-02T18:19:26.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199557 2023-01-02T18:19:26.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:26.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645335+0000", 2023-01-02T18:19:26.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00070655299999999996 2023-01-02T18:19:26.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.646041+0000", 2023-01-02T18:19:26.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047206009999999996 2023-01-02T18:19:26.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650762+0000", 2023-01-02T18:19:26.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5790999999999997e-05 2023-01-02T18:19:26.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650798+0000", 2023-01-02T18:19:26.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4202999999999997e-05 2023-01-02T18:19:26.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650842+0000", 2023-01-02T18:19:26.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998 2023-01-02T18:19:26.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.294 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.294 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.295 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56449 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", 2023-01-02T18:19:26.295 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:26.295 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.635557147, 2023-01-02T18:19:26.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305, 2023-01-02T18:19:26.296 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.296 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.296 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.297 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56449 2023-01-02T18:19:26.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.297 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:26.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:26.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:26.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369390+0000", 2023-01-02T18:19:26.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1600000000000001e-05 2023-01-02T18:19:26.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369402+0000", 2023-01-02T18:19:26.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8179999999999999e-05 2023-01-02T18:19:26.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369420+0000", 2023-01-02T18:19:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.951e-06 2023-01-02T18:19:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369427+0000", 2023-01-02T18:19:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8652999999999995e-05 2023-01-02T18:19:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369496+0000", 2023-01-02T18:19:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1131000000000001e-05 2023-01-02T18:19:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369507+0000", 2023-01-02T18:19:26.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010015711 2023-01-02T18:19:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379523+0000", 2023-01-02T18:19:26.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017405799999999999 2023-01-02T18:19:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379697+0000", 2023-01-02T18:19:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097878599999999994 2023-01-02T18:19:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.380675+0000", 2023-01-02T18:19:26.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090579699999999996 2023-01-02T18:19:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.381581+0000", 2023-01-02T18:19:26.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062692200000000003 2023-01-02T18:19:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382208+0000", 2023-01-02T18:19:26.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1279000000000003e-05 2023-01-02T18:19:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382239+0000", 2023-01-02T18:19:26.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4488e-05 2023-01-02T18:19:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382264+0000", 2023-01-02T18:19:26.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305 2023-01-02T18:19:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56686 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e174)", 2023-01-02T18:19:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 11.670662433, 2023-01-02T18:19:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999, 2023-01-02T18:19:26.313 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56686 2023-01-02T18:19:26.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.315 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.316 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334286+0000", 2023-01-02T18:19:26.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8629999999999997e-06 2023-01-02T18:19:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334295+0000", 2023-01-02T18:19:26.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:19:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334308+0000", 2023-01-02T18:19:26.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7819999999999994e-06 2023-01-02T18:19:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334316+0000", 2023-01-02T18:19:26.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0328000000000003e-05 2023-01-02T18:19:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334366+0000", 2023-01-02T18:19:26.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:19:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334375+0000", 2023-01-02T18:19:26.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0086939579999999999 2023-01-02T18:19:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343069+0000", 2023-01-02T18:19:26.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7719000000000004e-05 2023-01-02T18:19:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343166+0000", 2023-01-02T18:19:26.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040875599999999997 2023-01-02T18:19:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343575+0000", 2023-01-02T18:19:26.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00078807900000000001 2023-01-02T18:19:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.344363+0000", 2023-01-02T18:19:26.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018956439999999999 2023-01-02T18:19:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346259+0000", 2023-01-02T18:19:26.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6230999999999997e-05 2023-01-02T18:19:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346315+0000", 2023-01-02T18:19:26.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1152000000000002e-05 2023-01-02T18:19:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346356+0000", 2023-01-02T18:19:26.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999 2023-01-02T18:19:26.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.330 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56749 16.13 16:ce684796:::rbd_object_map.12a2fc42bad2:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e176)", 2023-01-02T18:19:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.6399630599999995, 2023-01-02T18:19:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067753960000000004, 2023-01-02T18:19:26.331 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56749 2023-01-02T18:19:26.332 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:26.333 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:26.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:26.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364985+0000", 2023-01-02T18:19:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6770000000000001e-06 2023-01-02T18:19:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364993+0000", 2023-01-02T18:19:26.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4132e-05 2023-01-02T18:19:26.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365008+0000", 2023-01-02T18:19:26.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9789999999999998e-06 2023-01-02T18:19:26.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365014+0000", 2023-01-02T18:19:26.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8658999999999997e-05 2023-01-02T18:19:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365052+0000", 2023-01-02T18:19:26.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4580000000000003e-06 2023-01-02T18:19:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365057+0000", 2023-01-02T18:19:26.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039966869999999996 2023-01-02T18:19:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369053+0000", 2023-01-02T18:19:26.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016847699999999999 2023-01-02T18:19:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369222+0000", 2023-01-02T18:19:26.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000172483 2023-01-02T18:19:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369394+0000", 2023-01-02T18:19:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020318689999999999 2023-01-02T18:19:26.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371426+0000", 2023-01-02T18:19:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024218699999999999 2023-01-02T18:19:26.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371668+0000", 2023-01-02T18:19:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3369999999999999e-05 2023-01-02T18:19:26.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371722+0000", 2023-01-02T18:19:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0258e-05 2023-01-02T18:19:26.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371762+0000", 2023-01-02T18:19:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067753960000000004 2023-01-02T18:19:26.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.348 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58331 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e179)", 2023-01-02T18:19:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 6.6725210820000003, 2023-01-02T18:19:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017000080000000001, 2023-01-02T18:19:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:26.349 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58331 2023-01-02T18:19:26.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:26.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:26.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332427+0000", 2023-01-02T18:19:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8380000000000002e-06 2023-01-02T18:19:26.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:26.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332435+0000", 2023-01-02T18:19:26.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4547e-05 2023-01-02T18:19:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332449+0000", 2023-01-02T18:19:26.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7020000000000004e-06 2023-01-02T18:19:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332456+0000", 2023-01-02T18:19:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6797e-05 2023-01-02T18:19:26.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332493+0000", 2023-01-02T18:19:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3669999999999996e-06 2023-01-02T18:19:26.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332498+0000", 2023-01-02T18:19:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013552958 2023-01-02T18:19:26.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346051+0000", 2023-01-02T18:19:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010482 2023-01-02T18:19:26.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346156+0000", 2023-01-02T18:19:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00044760600000000002 2023-01-02T18:19:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346604+0000", 2023-01-02T18:19:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013066169999999999 2023-01-02T18:19:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.361 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.347910+0000", 2023-01-02T18:19:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392527 2023-01-02T18:19:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349303+0000", 2023-01-02T18:19:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4855999999999998e-05 2023-01-02T18:19:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.363 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349358+0000", 2023-01-02T18:19:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1042000000000002e-05 2023-01-02T18:19:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:26.364 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349429+0000", 2023-01-02T18:19:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017000080000000001 2023-01-02T18:19:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.365 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.366 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:26.366 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:26.366 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:26.366 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:26.237+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:26.367 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:19:26.368 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:26.369+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:26.401 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:26.419 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:26.437 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:26.454 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:26.469 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:26.469+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:26.475 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:26.495 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:26.502 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:26.503 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:26.513 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:19:26.520 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:26.520 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:19:26.521 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:19:26.521 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:19:26.521 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:19:26.521 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:19:26.521 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.5 2023-01-02T18:19:26.522 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:19:26.522 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:19:26.523 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-01-02T18:19:26.523 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-01-02T18:19:26.570 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:26.570+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:26.644 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:26.644 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:26.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:19:26.695 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:26.695+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:26.772 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:26.772+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:26.820 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:26.820 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:26.830 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:19:26.872 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:26.873+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:26.973 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:26.974+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:26.996 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:26.996 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:27.007 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:19:27.074 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:27.074+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:27.131 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:27.131 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:27.141 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:19:27.176 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:27.176+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:27.277 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:27.277+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:27.306 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:27.316 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:19:27.378 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:27.379+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:27.449 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:27.449 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:27.458 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:19:27.502 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:27.502+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:27.520 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-01-02T18:19:27.580 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:27.581+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:27.585 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:27.585 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:27.596 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:19:27.681 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:27.682+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:27.726 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:27.726 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:27.736 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:19:27.782 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:27.782+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:27.861 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:27.862 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:27.871 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:19:27.912 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:27.913+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:27.984 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:27.984+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:28.036 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:28.037 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:28.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:19:28.087 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:28.087+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:28.186 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:28.187+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:28.211 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:28.211 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:28.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:19:28.287 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:28.287+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:28.346 INFO:tasks.workunit.client.0.smithi007.stdout:using new format! 2023-01-02T18:19:28.351 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-01-02T18:19:28.365 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:28.365 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:28.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:19:28.420 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:28.421+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:28.489 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:28.489+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:28.525 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:19:28.545 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:28.546 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:28.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:19:28.590 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:28.590+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:28.670 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:28.682 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:28.682 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:28.687 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:28.691 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:28.691+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:28.692 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:19:28.705 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:28.722 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:28.740 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:28.759 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:28.777 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:28.777 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:19:28.778 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:19:28.778 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:19:28.778 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:19:28.778 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:19:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.5 2023-01-02T18:19:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:19:28.779 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:19:28.780 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-01-02T18:19:28.781 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-01-02T18:19:28.818 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:28.819 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:28.819 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:28.822 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:28.823+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:28.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:19:28.892 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:28.892+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:28.954 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:28.954 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:28.955 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:28.955 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:28.955 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:28.964 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:19:29.005 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:29.006+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:29.094 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:29.094+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:29.131 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:29.132 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:29.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:29.132 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:29.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.133 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:366 7.1a 7:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e63)", 2023-01-02T18:19:29.133 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:29.133 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 152.825991378, 2023-01-02T18:19:29.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007, 2023-01-02T18:19:29.134 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.134 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.134 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.134 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:29.134 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:29.135 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 366 2023-01-02T18:19:29.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.135 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:29.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304544+0000", 2023-01-02T18:19:29.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304543+0000", 2023-01-02T18:19:29.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2266000000000001e-05 2023-01-02T18:19:29.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304555+0000", 2023-01-02T18:19:29.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6971000000000001e-05 2023-01-02T18:19:29.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304572+0000", 2023-01-02T18:19:29.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.4720000000000001e-06 2023-01-02T18:19:29.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304581+0000", 2023-01-02T18:19:29.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4059000000000005e-05 2023-01-02T18:19:29.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304645+0000", 2023-01-02T18:19:29.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:19:29.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.304652+0000", 2023-01-02T18:19:29.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064857980000000001 2023-01-02T18:19:29.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311138+0000", 2023-01-02T18:19:29.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017786599999999999 2023-01-02T18:19:29.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311316+0000", 2023-01-02T18:19:29.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011793 2023-01-02T18:19:29.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:29.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.311434+0000", 2023-01-02T18:19:29.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090350900000000004 2023-01-02T18:19:29.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.146 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.146 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312337+0000", 2023-01-02T18:19:29.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00064456400000000003 2023-01-02T18:19:29.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.147 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.147 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.147 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.312982+0000", 2023-01-02T18:19:29.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2595000000000001e-05 2023-01-02T18:19:29.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313025+0000", 2023-01-02T18:19:29.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5550999999999998e-05 2023-01-02T18:19:29.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:56.313070+0000", 2023-01-02T18:19:29.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0085257790000000007 2023-01-02T18:19:29.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.150 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.150 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.151 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1229 8.1a 8:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:29.151 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:29.151 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 147.82086315699999, 2023-01-02T18:19:29.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005, 2023-01-02T18:19:29.152 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.152 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.152 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.152 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.152 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.153 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1229 2023-01-02T18:19:29.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.153 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:29.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309673+0000", 2023-01-02T18:19:29.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:29.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309669+0000", 2023-01-02T18:19:29.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8617000000000001e-05 2023-01-02T18:19:29.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309688+0000", 2023-01-02T18:19:29.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5599000000000003e-05 2023-01-02T18:19:29.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309723+0000", 2023-01-02T18:19:29.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5349999999999999e-05 2023-01-02T18:19:29.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309759+0000", 2023-01-02T18:19:29.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012286400000000001 2023-01-02T18:19:29.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309881+0000", 2023-01-02T18:19:29.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9330000000000007e-06 2023-01-02T18:19:29.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.309890+0000", 2023-01-02T18:19:29.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060522029999999999 2023-01-02T18:19:29.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.161 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.161 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.315943+0000", 2023-01-02T18:19:29.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000113936 2023-01-02T18:19:29.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.162 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.162 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.162 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316056+0000", 2023-01-02T18:19:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00019542800000000001 2023-01-02T18:19:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.316252+0000", 2023-01-02T18:19:29.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001187965 2023-01-02T18:19:29.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317440+0000", 2023-01-02T18:19:29.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00011105800000000001 2023-01-02T18:19:29.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317551+0000", 2023-01-02T18:19:29.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9391000000000002e-05 2023-01-02T18:19:29.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317600+0000", 2023-01-02T18:19:29.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6463999999999999e-05 2023-01-02T18:19:29.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317627+0000", 2023-01-02T18:19:29.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079542580000000005 2023-01-02T18:19:29.167 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.168 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.168 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.168 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2641 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e77)", 2023-01-02T18:19:29.169 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:29.169 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 138.530798664, 2023-01-02T18:19:29.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999, 2023-01-02T18:19:29.169 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.169 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.170 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.170 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2641 2023-01-02T18:19:29.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.171 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:29.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599737+0000", 2023-01-02T18:19:29.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:29.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599734+0000", 2023-01-02T18:19:29.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6562000000000002e-05 2023-01-02T18:19:29.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599750+0000", 2023-01-02T18:19:29.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5880999999999997e-05 2023-01-02T18:19:29.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599786+0000", 2023-01-02T18:19:29.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.9276999999999999e-05 2023-01-02T18:19:29.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.176 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.176 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599805+0000", 2023-01-02T18:19:29.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9523000000000005e-05 2023-01-02T18:19:29.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.177 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.177 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599875+0000", 2023-01-02T18:19:29.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5780000000000001e-06 2023-01-02T18:19:29.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.599883+0000", 2023-01-02T18:19:29.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0080566700000000002 2023-01-02T18:19:29.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.607939+0000", 2023-01-02T18:19:29.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016706800000000001 2023-01-02T18:19:29.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608106+0000", 2023-01-02T18:19:29.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00058372100000000004 2023-01-02T18:19:29.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.608690+0000", 2023-01-02T18:19:29.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00072548899999999995 2023-01-02T18:19:29.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.609415+0000", 2023-01-02T18:19:29.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060462299999999999 2023-01-02T18:19:29.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610020+0000", 2023-01-02T18:19:29.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3766999999999997e-05 2023-01-02T18:19:29.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610054+0000", 2023-01-02T18:19:29.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4589000000000001e-05 2023-01-02T18:19:29.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:10.610078+0000", 2023-01-02T18:19:29.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010341428999999999 2023-01-02T18:19:29.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.185 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.185 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.186 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2670 3.10 3:0f155940:::rbd_header.12a23fc13ef0:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:29.186 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:29.186 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 137.53207332100001, 2023-01-02T18:19:29.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999, 2023-01-02T18:19:29.187 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.187 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.187 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.187 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.187 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.188 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2670 2023-01-02T18:19:29.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.188 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:29.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598462+0000", 2023-01-02T18:19:29.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:29.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598461+0000", 2023-01-02T18:19:29.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2740000000000007e-06 2023-01-02T18:19:29.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598469+0000", 2023-01-02T18:19:29.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6082999999999998e-05 2023-01-02T18:19:29.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598485+0000", 2023-01-02T18:19:29.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9670000000000004e-06 2023-01-02T18:19:29.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598492+0000", 2023-01-02T18:19:29.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0361e-05 2023-01-02T18:19:29.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598552+0000", 2023-01-02T18:19:29.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2509999999999994e-06 2023-01-02T18:19:29.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.598561+0000", 2023-01-02T18:19:29.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.018633619000000001 2023-01-02T18:19:29.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617194+0000", 2023-01-02T18:19:29.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000111678 2023-01-02T18:19:29.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617306+0000", 2023-01-02T18:19:29.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00068329399999999998 2023-01-02T18:19:29.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.617989+0000", 2023-01-02T18:19:29.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00082564900000000002 2023-01-02T18:19:29.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.618815+0000", 2023-01-02T18:19:29.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000395468 2023-01-02T18:19:29.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619210+0000", 2023-01-02T18:19:29.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7210000000000003e-05 2023-01-02T18:19:29.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619268+0000", 2023-01-02T18:19:29.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2017000000000001e-05 2023-01-02T18:19:29.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.619310+0000", 2023-01-02T18:19:29.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.020847332999999999 2023-01-02T18:19:29.202 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.203 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.203 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.203 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2672 3.3 3:c682a8f9:::rbd_object_map.12a23fc13ef0.0000000000000005:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e78)", 2023-01-02T18:19:29.204 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:29.204 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 137.50771155699999, 2023-01-02T18:19:29.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999, 2023-01-02T18:19:29.204 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.204 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.204 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.205 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.205 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.205 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2672 2023-01-02T18:19:29.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.206 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:29.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622824+0000", 2023-01-02T18:19:29.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:29.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622821+0000", 2023-01-02T18:19:29.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7672999999999998e-05 2023-01-02T18:19:29.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622839+0000", 2023-01-02T18:19:29.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2935999999999998e-05 2023-01-02T18:19:29.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622872+0000", 2023-01-02T18:19:29.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3953e-05 2023-01-02T18:19:29.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622886+0000", 2023-01-02T18:19:29.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7652999999999996e-05 2023-01-02T18:19:29.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.622973+0000", 2023-01-02T18:19:29.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016483399999999999 2023-01-02T18:19:29.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623138+0000", 2023-01-02T18:19:29.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000109424 2023-01-02T18:19:29.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.623247+0000", 2023-01-02T18:19:29.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00095783900000000004 2023-01-02T18:19:29.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.624205+0000", 2023-01-02T18:19:29.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047402310000000001 2023-01-02T18:19:29.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.628946+0000", 2023-01-02T18:19:29.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103979 2023-01-02T18:19:29.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629049+0000", 2023-01-02T18:19:29.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.3221999999999999e-05 2023-01-02T18:19:29.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:11.629113+0000", 2023-01-02T18:19:29.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062885969999999999 2023-01-02T18:19:29.218 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.218 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.219 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.219 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2819 10.1c 10:3b239907:::rbd_id.image42:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e101)", 2023-01-02T18:19:29.219 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:29.220 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 114.802116889, 2023-01-02T18:19:29.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002, 2023-01-02T18:19:29.220 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.220 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.220 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.221 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.221 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.221 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2819 2023-01-02T18:19:29.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.221 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:29.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328419+0000", 2023-01-02T18:19:29.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:29.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328417+0000", 2023-01-02T18:19:29.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4340000000000003e-06 2023-01-02T18:19:29.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328425+0000", 2023-01-02T18:19:29.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0181e-05 2023-01-02T18:19:29.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328435+0000", 2023-01-02T18:19:29.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:19:29.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.328441+0000", 2023-01-02T18:19:29.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073155099999999999 2023-01-02T18:19:29.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329173+0000", 2023-01-02T18:19:29.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9036000000000005e-05 2023-01-02T18:19:29.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329272+0000", 2023-01-02T18:19:29.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138627 2023-01-02T18:19:29.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:29.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.329410+0000", 2023-01-02T18:19:29.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00092378600000000001 2023-01-02T18:19:29.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.330334+0000", 2023-01-02T18:19:29.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042789430000000003 2023-01-02T18:19:29.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334613+0000", 2023-01-02T18:19:29.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3509000000000001e-05 2023-01-02T18:19:29.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334647+0000", 2023-01-02T18:19:29.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6789000000000001e-05 2023-01-02T18:19:29.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:34.334673+0000", 2023-01-02T18:19:29.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062545780000000002 2023-01-02T18:19:29.248 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.249 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.249 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.249 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3333 11.14 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e107)", 2023-01-02T18:19:29.250 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:29.250 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 104.749709072, 2023-01-02T18:19:29.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004, 2023-01-02T18:19:29.250 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.250 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.251 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.251 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.251 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.251 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3333 2023-01-02T18:19:29.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.252 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:29.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380827+0000", 2023-01-02T18:19:29.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:29.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380823+0000", 2023-01-02T18:19:29.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8946000000000001e-05 2023-01-02T18:19:29.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380842+0000", 2023-01-02T18:19:29.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6405999999999997e-05 2023-01-02T18:19:29.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380878+0000", 2023-01-02T18:19:29.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2183000000000001e-05 2023-01-02T18:19:29.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.380900+0000", 2023-01-02T18:19:29.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000103152 2023-01-02T18:19:29.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381004+0000", 2023-01-02T18:19:29.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000167097 2023-01-02T18:19:29.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381171+0000", 2023-01-02T18:19:29.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046331399999999999 2023-01-02T18:19:29.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:29.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.381634+0000", 2023-01-02T18:19:29.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0032124139999999998 2023-01-02T18:19:29.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.384846+0000", 2023-01-02T18:19:29.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00304908 2023-01-02T18:19:29.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387895+0000", 2023-01-02T18:19:29.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4104999999999997e-05 2023-01-02T18:19:29.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.387960+0000", 2023-01-02T18:19:29.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4199999999999997e-05 2023-01-02T18:19:29.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:44.388004+0000", 2023-01-02T18:19:29.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071771810000000004 2023-01-02T18:19:29.264 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.264 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.265 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.265 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3340 11.1 11:8280b2d5:::rbd_data.12a2d6b452e6.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e111)", 2023-01-02T18:19:29.265 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:29.266 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 99.719379556000007, 2023-01-02T18:19:29.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006, 2023-01-02T18:19:29.266 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.266 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.266 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.267 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.267 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.267 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3340 2023-01-02T18:19:29.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.267 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:29.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411156+0000", 2023-01-02T18:19:29.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999962 2023-01-02T18:19:29.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411152+0000", 2023-01-02T18:19:29.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0608999999999999e-05 2023-01-02T18:19:29.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411173+0000", 2023-01-02T18:19:29.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7663000000000002e-05 2023-01-02T18:19:29.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411211+0000", 2023-01-02T18:19:29.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3896999999999998e-05 2023-01-02T18:19:29.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411234+0000", 2023-01-02T18:19:29.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000194983 2023-01-02T18:19:29.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411429+0000", 2023-01-02T18:19:29.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4067000000000007e-05 2023-01-02T18:19:29.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411514+0000", 2023-01-02T18:19:29.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038337499999999998 2023-01-02T18:19:29.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:29.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.411897+0000", 2023-01-02T18:19:29.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035691759999999999 2023-01-02T18:19:29.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.415466+0000", 2023-01-02T18:19:29.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039151419999999999 2023-01-02T18:19:29.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419381+0000", 2023-01-02T18:19:29.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1489999999999997e-05 2023-01-02T18:19:29.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419423+0000", 2023-01-02T18:19:29.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6879000000000002e-05 2023-01-02T18:19:29.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:49.419480+0000", 2023-01-02T18:19:29.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0083234810000000006 2023-01-02T18:19:29.280 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.280 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.281 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.281 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3412 11.3 11:c4c92e5a:::rbd_trash:head [call rbd.trash_state_set in=18b] snapc 0=[] ondisk+write+known_if_redirected+full_try e117)", 2023-01-02T18:19:29.282 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:29.282 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 93.618932891, 2023-01-02T18:19:29.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002, 2023-01-02T18:19:29.282 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.282 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.283 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.283 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.283 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.283 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3412 2023-01-02T18:19:29.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.284 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:29.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511603+0000", 2023-01-02T18:19:29.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:29.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511602+0000", 2023-01-02T18:19:29.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8110000000000002e-06 2023-01-02T18:19:29.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511607+0000", 2023-01-02T18:19:29.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.064e-06 2023-01-02T18:19:29.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511616+0000", 2023-01-02T18:19:29.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6470000000000003e-06 2023-01-02T18:19:29.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511621+0000", 2023-01-02T18:19:29.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2610000000000001e-05 2023-01-02T18:19:29.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511654+0000", 2023-01-02T18:19:29.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7549000000000002e-05 2023-01-02T18:19:29.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511702+0000", 2023-01-02T18:19:29.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133089 2023-01-02T18:19:29.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:29.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.511835+0000", 2023-01-02T18:19:29.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00073412 2023-01-02T18:19:29.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.512569+0000", 2023-01-02T18:19:29.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0048382449999999997 2023-01-02T18:19:29.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517407+0000", 2023-01-02T18:19:29.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5658000000000003e-05 2023-01-02T18:19:29.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517443+0000", 2023-01-02T18:19:29.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2739e-05 2023-01-02T18:19:29.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:55.517465+0000", 2023-01-02T18:19:29.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058626440000000002 2023-01-02T18:19:29.296 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.296 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.297 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.297 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3500 13.1c 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e131)", 2023-01-02T18:19:29.297 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:29.298 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 76.263395645000003, 2023-01-02T18:19:29.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464, 2023-01-02T18:19:29.298 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.298 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.298 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.299 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.299 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.299 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3500 2023-01-02T18:19:29.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.299 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:29.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867140+0000", 2023-01-02T18:19:29.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867138+0000", 2023-01-02T18:19:29.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0957e-05 2023-01-02T18:19:29.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867149+0000", 2023-01-02T18:19:29.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7195999999999999e-05 2023-01-02T18:19:29.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867166+0000", 2023-01-02T18:19:29.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.6760000000000007e-06 2023-01-02T18:19:29.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867174+0000", 2023-01-02T18:19:29.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7596999999999997e-05 2023-01-02T18:19:29.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867242+0000", 2023-01-02T18:19:29.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0311e-05 2023-01-02T18:19:29.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.867252+0000", 2023-01-02T18:19:29.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003881897 2023-01-02T18:19:29.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871134+0000", 2023-01-02T18:19:29.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000112581 2023-01-02T18:19:29.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871246+0000", 2023-01-02T18:19:29.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00051573000000000005 2023-01-02T18:19:29.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:29.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.871762+0000", 2023-01-02T18:19:29.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035202879999999999 2023-01-02T18:19:29.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.875282+0000", 2023-01-02T18:19:29.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018063230000000001 2023-01-02T18:19:29.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877089+0000", 2023-01-02T18:19:29.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1471000000000003e-05 2023-01-02T18:19:29.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877130+0000", 2023-01-02T18:19:29.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0366999999999999e-05 2023-01-02T18:19:29.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.314 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.314 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:12.877160+0000", 2023-01-02T18:19:29.314 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010020464 2023-01-02T18:19:29.314 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.314 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.315 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.315 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.315 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.315 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3502 12.4 12:22ab6653:::rbd_header.12a21d7fc3ba:head [watch reconnect cookie 140114583906208 gen 1] snapc 0=[] ondisk+write+known_if_redirected+full_try e132)", 2023-01-02T18:19:29.315 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:29.316 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 75.252491001999999, 2023-01-02T18:19:29.316 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437, 2023-01-02T18:19:29.316 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.316 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:29.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.317 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.317 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.317 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3502 2023-01-02T18:19:29.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.317 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:29.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878045+0000", 2023-01-02T18:19:29.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:29.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878044+0000", 2023-01-02T18:19:29.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4969999999999998e-06 2023-01-02T18:19:29.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878050+0000", 2023-01-02T18:19:29.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1829e-05 2023-01-02T18:19:29.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878062+0000", 2023-01-02T18:19:29.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9040000000000003e-06 2023-01-02T18:19:29.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878069+0000", 2023-01-02T18:19:29.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0802000000000004e-05 2023-01-02T18:19:29.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878140+0000", 2023-01-02T18:19:29.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.5569999999999996e-06 2023-01-02T18:19:29.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:29.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:13.878148+0000", 2023-01-02T18:19:29.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.53052582699999995 2023-01-02T18:19:29.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.408674+0000", 2023-01-02T18:19:29.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000451216 2023-01-02T18:19:29.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for degraded object", 2023-01-02T18:19:29.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.409125+0000", 2023-01-02T18:19:29.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002676552 2023-01-02T18:19:29.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411802+0000", 2023-01-02T18:19:29.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6087000000000004e-05 2023-01-02T18:19:29.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.411888+0000", 2023-01-02T18:19:29.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040762430000000002 2023-01-02T18:19:29.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:14.415964+0000", 2023-01-02T18:19:29.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.537919437 2023-01-02T18:19:29.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.330 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.330 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.331 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.331 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3509 12.16 12:6c6a05b8:::rbd_object_map.12a21d7fc3ba:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:19:29.331 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:29.331 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 70.226548163000004, 2023-01-02T18:19:29.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004, 2023-01-02T18:19:29.332 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.332 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.332 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.333 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3509 2023-01-02T18:19:29.333 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.333 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.333 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.333 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:29.334 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903988+0000", 2023-01-02T18:19:29.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903986+0000", 2023-01-02T18:19:29.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2884000000000001e-05 2023-01-02T18:19:29.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.903998+0000", 2023-01-02T18:19:29.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7946000000000001e-05 2023-01-02T18:19:29.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904016+0000", 2023-01-02T18:19:29.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2930000000000001e-06 2023-01-02T18:19:29.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904025+0000", 2023-01-02T18:19:29.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3483000000000003e-05 2023-01-02T18:19:29.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904078+0000", 2023-01-02T18:19:29.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0630000000000002e-06 2023-01-02T18:19:29.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.904084+0000", 2023-01-02T18:19:29.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0034617459999999999 2023-01-02T18:19:29.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907546+0000", 2023-01-02T18:19:29.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000101593 2023-01-02T18:19:29.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907648+0000", 2023-01-02T18:19:29.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030316700000000002 2023-01-02T18:19:29.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:29.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.907951+0000", 2023-01-02T18:19:29.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002697938 2023-01-02T18:19:29.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910649+0000", 2023-01-02T18:19:29.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000126737 2023-01-02T18:19:29.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910775+0000", 2023-01-02T18:19:29.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5716999999999997e-05 2023-01-02T18:19:29.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910811+0000", 2023-01-02T18:19:29.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6028000000000001e-05 2023-01-02T18:19:29.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:18.910847+0000", 2023-01-02T18:19:29.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0068596000000000004 2023-01-02T18:19:29.347 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.348 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.348 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.348 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.348 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:6059 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [read 137216~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e137)", 2023-01-02T18:19:29.349 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:29.349 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 67.451771047999998, 2023-01-02T18:19:29.349 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004, 2023-01-02T18:19:29.349 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.349 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:29.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.350 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.350 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 6059 2023-01-02T18:19:29.350 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.351 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.351 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.351 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.351 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:29.351 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.352 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.352 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.352 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678765+0000", 2023-01-02T18:19:29.352 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.352 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.353 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.353 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.353 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678763+0000", 2023-01-02T18:19:29.353 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3349999999999996e-06 2023-01-02T18:19:29.353 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.354 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.354 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.354 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678772+0000", 2023-01-02T18:19:29.354 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.0185000000000001e-05 2023-01-02T18:19:29.354 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.355 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.355 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.355 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678792+0000", 2023-01-02T18:19:29.355 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7782e-05 2023-01-02T18:19:29.355 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.356 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.356 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.356 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678810+0000", 2023-01-02T18:19:29.356 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7674000000000001e-05 2023-01-02T18:19:29.356 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.357 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.357 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.357 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678898+0000", 2023-01-02T18:19:29.357 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0155e-05 2023-01-02T18:19:29.357 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.358 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.358 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.678908+0000", 2023-01-02T18:19:29.358 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067138240000000002 2023-01-02T18:19:29.358 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.358 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.359 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.359 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685622+0000", 2023-01-02T18:19:29.359 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7702999999999998e-05 2023-01-02T18:19:29.359 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.359 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.360 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.360 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685699+0000", 2023-01-02T18:19:29.360 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4908999999999997e-05 2023-01-02T18:19:29.360 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.360 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.361 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.361 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:21.685774+0000", 2023-01-02T18:19:29.361 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070095950000000004 2023-01-02T18:19:29.361 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.361 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.362 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.362 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.362 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.362 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:9975 3.a 3:55986f67:::rbd_data.12a26f62b1fb.0000000000000000:head [write-same] snapc 0=[] ondisk+write+known_if_redirected e137)", 2023-01-02T18:19:29.362 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:29.363 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.407266015000005, 2023-01-02T18:19:29.363 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003, 2023-01-02T18:19:29.363 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.363 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.363 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.364 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.364 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.364 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 9975 2023-01-02T18:19:29.364 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.364 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.365 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.365 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.365 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:29.365 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.365 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.366 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.366 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.366 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723270+0000", 2023-01-02T18:19:29.366 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:29.366 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.367 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.367 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723269+0000", 2023-01-02T18:19:29.367 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3900000000000003e-06 2023-01-02T18:19:29.367 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.367 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.368 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.368 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723273+0000", 2023-01-02T18:19:29.368 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1879999999999996e-06 2023-01-02T18:19:29.368 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.368 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.369 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.369 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723280+0000", 2023-01-02T18:19:29.369 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.056e-06 2023-01-02T18:19:29.369 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.369 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.370 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.370 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723284+0000", 2023-01-02T18:19:29.370 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9624999999999998e-05 2023-01-02T18:19:29.370 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.370 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.371 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.371 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723313+0000", 2023-01-02T18:19:29.371 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7389000000000003e-05 2023-01-02T18:19:29.371 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.371 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.372 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723361+0000", 2023-01-02T18:19:29.372 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000102531 2023-01-02T18:19:29.372 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.372 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.372 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:29.373 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.723463+0000", 2023-01-02T18:19:29.373 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00121737 2023-01-02T18:19:29.373 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.373 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.373 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.374 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.724680+0000", 2023-01-02T18:19:29.374 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004541883 2023-01-02T18:19:29.374 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.374 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.374 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.375 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729222+0000", 2023-01-02T18:19:29.375 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1464999999999998e-05 2023-01-02T18:19:29.375 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.375 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.375 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729254+0000", 2023-01-02T18:19:29.376 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5570000000000001e-05 2023-01-02T18:19:29.376 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.376 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.376 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.376 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:22.729279+0000", 2023-01-02T18:19:29.377 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060096990000000003 2023-01-02T18:19:29.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.377 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.377 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.377 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.378 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.378 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34055 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v68,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:29.378 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:29.378 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.206282758999997, 2023-01-02T18:19:29.378 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996, 2023-01-02T18:19:29.379 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.379 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.379 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.379 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.379 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.380 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34055 2023-01-02T18:19:29.380 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.380 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.380 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.380 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.381 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:29.381 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.381 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.381 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.381 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924253+0000", 2023-01-02T18:19:29.382 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:29.382 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.382 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.382 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.382 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924252+0000", 2023-01-02T18:19:29.383 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00045194499999999998 2023-01-02T18:19:29.383 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.383 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.383 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.383 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924704+0000", 2023-01-02T18:19:29.384 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4789999999999996e-06 2023-01-02T18:19:29.384 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.384 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.384 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.384 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924713+0000", 2023-01-02T18:19:29.385 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3239999999999996e-06 2023-01-02T18:19:29.385 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.385 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.385 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.385 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924717+0000", 2023-01-02T18:19:29.386 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6057000000000001e-05 2023-01-02T18:19:29.386 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.386 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.386 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.386 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924743+0000", 2023-01-02T18:19:29.387 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3520999999999999e-05 2023-01-02T18:19:29.387 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.387 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.387 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.387 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924787+0000", 2023-01-02T18:19:29.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010431 2023-01-02T18:19:29.388 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.388 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.388 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.388 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.924891+0000", 2023-01-02T18:19:29.388 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0017377270000000001 2023-01-02T18:19:29.389 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.389 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.389 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.389 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.926629+0000", 2023-01-02T18:19:29.389 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040138120000000003 2023-01-02T18:19:29.390 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.390 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.390 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.390 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930643+0000", 2023-01-02T18:19:29.390 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8172e-05 2023-01-02T18:19:29.391 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.391 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.391 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.391 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930681+0000", 2023-01-02T18:19:29.391 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6004999999999998e-05 2023-01-02T18:19:29.392 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.392 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.392 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.392 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:40.930717+0000", 2023-01-02T18:19:29.392 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064637719999999996 2023-01-02T18:19:29.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.393 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.393 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.393 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.393 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.394 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:34698 3.17 3:eeb9cd3d:::rbd_data.12a229f0e522.0000000000000004:head [assert-version v69,write 0~217088] snapc 0=[] ondisk+write+known_if_redirected e149)", 2023-01-02T18:19:29.394 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:29.394 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 48.005030056000003, 2023-01-02T18:19:29.394 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004, 2023-01-02T18:19:29.394 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.394 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.395 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.395 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 34698 2023-01-02T18:19:29.395 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.396 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.396 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.396 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.396 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:29.396 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.397 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.397 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.397 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.397 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125506+0000", 2023-01-02T18:19:29.397 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:29.398 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.398 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.398 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.398 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.125505+0000", 2023-01-02T18:19:29.398 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00055438999999999998 2023-01-02T18:19:29.399 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.399 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.399 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.399 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126059+0000", 2023-01-02T18:19:29.399 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.3589999999999997e-06 2023-01-02T18:19:29.400 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.400 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.400 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.400 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126069+0000", 2023-01-02T18:19:29.400 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0520000000000003e-06 2023-01-02T18:19:29.401 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.401 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.401 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.401 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126073+0000", 2023-01-02T18:19:29.401 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4317999999999999e-05 2023-01-02T18:19:29.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.402 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.402 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.402 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126107+0000", 2023-01-02T18:19:29.402 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.7629e-05 2023-01-02T18:19:29.402 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.403 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.403 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.403 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126165+0000", 2023-01-02T18:19:29.403 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108928 2023-01-02T18:19:29.403 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.404 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.404 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.404 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.126274+0000", 2023-01-02T18:19:29.404 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0014924490000000001 2023-01-02T18:19:29.404 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.405 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.405 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.405 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.127766+0000", 2023-01-02T18:19:29.405 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0042150429999999999 2023-01-02T18:19:29.405 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.406 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.406 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.131981+0000", 2023-01-02T18:19:29.406 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7907000000000001e-05 2023-01-02T18:19:29.406 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.406 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.407 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.407 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132019+0000", 2023-01-02T18:19:29.407 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9232e-05 2023-01-02T18:19:29.407 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.407 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.408 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.408 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:41.132058+0000", 2023-01-02T18:19:29.408 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0065525770000000004 2023-01-02T18:19:29.408 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.408 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.409 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.409 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.409 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.409 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54804 3.17 3:ec8e444a:::rbd_header.12a28f082913:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:29.409 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:29.410 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.756709827000002, 2023-01-02T18:19:29.410 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001, 2023-01-02T18:19:29.410 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.410 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.410 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.411 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.411 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54804 2023-01-02T18:19:29.411 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.411 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.412 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.412 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:29.412 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.412 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.412 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.413 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.413 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373826+0000", 2023-01-02T18:19:29.413 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.413 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.413 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.414 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.414 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373824+0000", 2023-01-02T18:19:29.414 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.9380000000000004e-06 2023-01-02T18:19:29.414 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.414 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.415 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.415 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373834+0000", 2023-01-02T18:19:29.415 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6818999999999999e-05 2023-01-02T18:19:29.415 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.415 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.416 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.416 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373851+0000", 2023-01-02T18:19:29.416 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.481e-06 2023-01-02T18:19:29.416 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.416 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.417 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.417 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373858+0000", 2023-01-02T18:19:29.417 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2268999999999998e-05 2023-01-02T18:19:29.417 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.417 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.418 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373900+0000", 2023-01-02T18:19:29.418 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1660000000000002e-06 2023-01-02T18:19:29.418 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.418 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.418 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.419 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.373906+0000", 2023-01-02T18:19:29.419 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0060814570000000002 2023-01-02T18:19:29.419 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.419 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.419 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.420 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.379987+0000", 2023-01-02T18:19:29.420 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015394200000000001 2023-01-02T18:19:29.420 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.420 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.420 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.421 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380141+0000", 2023-01-02T18:19:29.421 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00026425999999999999 2023-01-02T18:19:29.421 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.421 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.421 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.422 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.380405+0000", 2023-01-02T18:19:29.422 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00098840499999999993 2023-01-02T18:19:29.422 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.422 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.422 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381394+0000", 2023-01-02T18:19:29.423 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1028e-05 2023-01-02T18:19:29.423 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.423 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.423 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.423 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381405+0000", 2023-01-02T18:19:29.424 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9657999999999997e-05 2023-01-02T18:19:29.424 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.424 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.424 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.424 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381464+0000", 2023-01-02T18:19:29.425 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1522e-05 2023-01-02T18:19:29.425 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.425 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.425 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.425 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.381506+0000", 2023-01-02T18:19:29.426 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076800710000000001 2023-01-02T18:19:29.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.426 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.426 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.426 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.427 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.427 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56742 16.1a 16:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e175)", 2023-01-02T18:19:29.427 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:29.427 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.789892453, 2023-01-02T18:19:29.427 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011704930000000001, 2023-01-02T18:19:29.428 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.428 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.428 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.429 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56742 2023-01-02T18:19:29.429 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.429 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.429 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.429 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.430 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:29.430 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.430 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.430 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.430 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340643+0000", 2023-01-02T18:19:29.431 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.431 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.431 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.431 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.431 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340641+0000", 2023-01-02T18:19:29.432 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.8539999999999992e-06 2023-01-02T18:19:29.432 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.432 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.432 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.432 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340651+0000", 2023-01-02T18:19:29.433 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7829000000000002e-05 2023-01-02T18:19:29.433 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.433 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.433 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.433 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340669+0000", 2023-01-02T18:19:29.434 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3170000000000002e-06 2023-01-02T18:19:29.434 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.434 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.434 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.434 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340677+0000", 2023-01-02T18:19:29.435 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9048000000000002e-05 2023-01-02T18:19:29.435 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.435 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.435 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.435 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340726+0000", 2023-01-02T18:19:29.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.0350000000000004e-06 2023-01-02T18:19:29.436 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.436 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.436 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.436 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.340733+0000", 2023-01-02T18:19:29.436 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067919770000000003 2023-01-02T18:19:29.437 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.437 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.437 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.437 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347525+0000", 2023-01-02T18:19:29.437 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012438400000000001 2023-01-02T18:19:29.438 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.438 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.438 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.438 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347650+0000", 2023-01-02T18:19:29.438 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000157252 2023-01-02T18:19:29.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.439 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.439 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.439 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.347807+0000", 2023-01-02T18:19:29.439 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0037935450000000002 2023-01-02T18:19:29.439 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.440 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.440 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.440 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.351600+0000", 2023-01-02T18:19:29.440 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00067858800000000004 2023-01-02T18:19:29.440 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.441 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.441 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.441 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352279+0000", 2023-01-02T18:19:29.441 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2793000000000003e-05 2023-01-02T18:19:29.441 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.442 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.442 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352312+0000", 2023-01-02T18:19:29.442 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6309000000000001e-05 2023-01-02T18:19:29.442 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.442 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.443 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.443 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:15.352348+0000", 2023-01-02T18:19:29.443 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011704930000000001 2023-01-02T18:19:29.443 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.443 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.444 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.444 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.444 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.444 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56745 16.1a 16:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected e176)", 2023-01-02T18:19:29.444 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:29.445 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 12.788528661000001, 2023-01-02T18:19:29.445 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010738437999999999, 2023-01-02T18:19:29.445 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.445 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.445 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.446 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.446 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.446 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56745 2023-01-02T18:19:29.446 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.446 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.447 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.447 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.447 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:29.447 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.447 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.448 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.448 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342007+0000", 2023-01-02T18:19:29.448 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.448 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.448 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.449 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.449 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342005+0000", 2023-01-02T18:19:29.449 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4179999999999997e-06 2023-01-02T18:19:29.449 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.449 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.450 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.450 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342014+0000", 2023-01-02T18:19:29.450 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0892e-05 2023-01-02T18:19:29.450 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.450 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.451 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.451 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342024+0000", 2023-01-02T18:19:29.451 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6720000000000001e-06 2023-01-02T18:19:29.451 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.451 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.452 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342030+0000", 2023-01-02T18:19:29.452 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3458999999999998e-05 2023-01-02T18:19:29.452 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.452 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.452 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.453 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342074+0000", 2023-01-02T18:19:29.453 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4819999999999999e-06 2023-01-02T18:19:29.453 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.453 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.453 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.454 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.342080+0000", 2023-01-02T18:19:29.454 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0076176819999999998 2023-01-02T18:19:29.454 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.454 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.454 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.455 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.349698+0000", 2023-01-02T18:19:29.455 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016925100000000001 2023-01-02T18:19:29.455 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.455 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.455 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.456 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.349867+0000", 2023-01-02T18:19:29.456 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017106700000000001 2023-01-02T18:19:29.456 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.456 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.456 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:29.457 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.350038+0000", 2023-01-02T18:19:29.457 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0023704279999999999 2023-01-02T18:19:29.457 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.457 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.457 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.458 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352408+0000", 2023-01-02T18:19:29.458 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000255894 2023-01-02T18:19:29.458 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.458 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.458 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.459 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352664+0000", 2023-01-02T18:19:29.459 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3069999999999999e-05 2023-01-02T18:19:29.459 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.459 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.459 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.460 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352707+0000", 2023-01-02T18:19:29.460 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7987000000000001e-05 2023-01-02T18:19:29.460 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.460 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.460 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.461 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.352745+0000", 2023-01-02T18:19:29.461 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010738437999999999 2023-01-02T18:19:29.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.461 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.461 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.462 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.462 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.462 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58335 15.1c 15:3831950c:::rbd_directory:head [call rbd.dir_get_id in=13b] snapc 0=[] ondisk+read+known_if_redirected e179)", 2023-01-02T18:19:29.462 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:29.462 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 9.7748364619999997, 2023-01-02T18:19:29.462 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010193373, 2023-01-02T18:19:29.463 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.463 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "started", 2023-01-02T18:19:29.463 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.463 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.463 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.464 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58335 2023-01-02T18:19:29.464 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.464 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.464 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.464 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.465 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:29.465 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.465 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.465 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.465 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355699+0000", 2023-01-02T18:19:29.466 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.466 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.466 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.466 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.466 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355697+0000", 2023-01-02T18:19:29.467 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.841e-06 2023-01-02T18:19:29.467 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.467 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.467 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.467 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355705+0000", 2023-01-02T18:19:29.468 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2976000000000001e-05 2023-01-02T18:19:29.468 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.468 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.468 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.468 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355718+0000", 2023-01-02T18:19:29.469 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9839999999999998e-06 2023-01-02T18:19:29.469 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.469 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.469 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.469 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355724+0000", 2023-01-02T18:19:29.470 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9267000000000002e-05 2023-01-02T18:19:29.470 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.470 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.470 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.471 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355764+0000", 2023-01-02T18:19:29.471 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8459999999999999e-06 2023-01-02T18:19:29.471 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.471 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.472 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:29.472 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.355768+0000", 2023-01-02T18:19:29.472 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0099580459999999999 2023-01-02T18:19:29.472 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.472 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.473 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.473 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365726+0000", 2023-01-02T18:19:29.473 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5611e-05 2023-01-02T18:19:29.473 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.473 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.474 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.474 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365782+0000", 2023-01-02T18:19:29.474 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000110537 2023-01-02T18:19:29.474 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.474 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.475 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.475 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.365893+0000", 2023-01-02T18:19:29.475 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010193373 2023-01-02T18:19:29.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.475 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.475 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.476 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.476 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.476 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:29.477 INFO:tasks.thrashosds.thrasher:in_osds: [0, 2, 6, 7] out_osds: [3, 5, 4, 1] dead_osds: [5] live_osds: [0, 1, 2, 3, 4, 6, 7] 2023-01-02T18:19:29.477 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2023-01-02T18:19:29.477 INFO:tasks.thrashosds.thrasher:Reviving osd 5 2023-01-02T18:19:29.477 INFO:tasks.ceph.osd.5:Restarting daemon 2023-01-02T18:19:29.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-01-02T18:19:29.479 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:29.478+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:29.480 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:19:29.521 INFO:tasks.ceph.osd.5:Started 2023-01-02T18:19:29.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:19:29.578 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:29.579+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:29.652 INFO:teuthology.orchestra.run.smithi057.stderr:no valid command found; 10 closest matches: 2023-01-02T18:19:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:0 2023-01-02T18:19:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:1 2023-01-02T18:19:29.653 INFO:teuthology.orchestra.run.smithi057.stderr:2 2023-01-02T18:19:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:abort 2023-01-02T18:19:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:assert 2023-01-02T18:19:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:config diff 2023-01-02T18:19:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:config diff get 2023-01-02T18:19:29.654 INFO:teuthology.orchestra.run.smithi057.stderr:config get 2023-01-02T18:19:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:config help [] 2023-01-02T18:19:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:config set ... 2023-01-02T18:19:29.655 INFO:teuthology.orchestra.run.smithi057.stderr:admin_socket: invalid command 2023-01-02T18:19:29.655 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-01-02T18:19:29.656 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-5, ['dump_ops_in_flight'] 2023-01-02T18:19:29.659 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:29.659 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:29.660 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:29.660 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:29.670 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:19:29.679 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:29.679+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:29.780 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:29.780+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:29.835 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:29.836 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:29.837 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:29.837 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:29.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:19:29.881 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:29.882+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:29.973 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:29.973 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:29.974 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:29.974 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:29.974 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.974 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:19:29.974 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:29.975 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 162.654112701, 2023-01-02T18:19:29.975 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:19:29.975 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.975 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.975 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.975 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:29.976 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:29.976 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:19:29.976 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.976 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.976 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.977 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.977 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:29.977 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.977 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.977 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.978 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:29.978 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:29.978 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.978 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.978 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.979 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:19:29.979 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:19:29.979 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.979 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.979 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.980 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:19:29.980 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:19:29.980 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.980 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.980 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:19:29.981 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:19:29.981 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.981 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.981 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.981 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:19:29.982 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:19:29.982 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.982 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.982 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.982 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:19:29.983 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:29.983 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.983 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.983 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:29.983 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:19:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:19:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:19:29.984 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:19:29.985 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.985 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.985 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:29.985 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:19:29.985 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:19:29.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.986 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.986 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:29.986 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:19:29.986 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:19:29.986 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.987 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.987 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:29.987 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:19:29.987 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:19:29.987 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.988 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.988 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:29.988 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:19:29.988 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:19:29.988 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.989 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:29.989 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:19:29.989 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:19:29.989 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.989 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.990 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:29.990 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:19:29.990 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:19:29.990 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.990 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:29.991 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:29.991 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.991 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.991 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:19:29.991 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:29.991 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 157.63902924499999, 2023-01-02T18:19:29.992 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:19:29.992 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:29.992 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:29.992 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:29.992 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:29.993 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:29.993 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:19:29.993 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.993 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:29.993 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.994 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:29.994 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:29.994 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:29.994 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.994 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.995 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:29.995 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:29.995 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:29.995 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.995 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.996 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:29.996 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:19:29.996 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:19:29.996 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.996 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.997 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:29.997 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:19:29.997 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:19:29.997 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.997 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.998 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:29.998 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:19:29.998 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:19:29.998 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.998 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:29.999 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:29.999 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:19:29.999 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:19:29.999 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:29.999 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.000 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:19:30.000 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:19:30.000 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.000 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.000 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.001 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:19:30.001 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:19:30.001 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.001 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.001 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.002 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:19:30.002 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:19:30.002 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.002 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.002 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.003 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:19:30.003 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:19:30.003 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.003 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.003 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:19:30.004 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:19:30.004 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.004 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.004 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.004 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:19:30.005 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:19:30.005 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.005 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.005 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.005 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:19:30.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:19:30.006 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.006 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.006 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.006 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:19:30.006 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:19:30.007 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.007 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.007 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.007 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:19:30.007 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:19:30.008 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.008 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.008 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.008 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.008 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.009 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:1230 8.1c 8:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e68)", 2023-01-02T18:19:30.009 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:30.009 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 148.654331668, 2023-01-02T18:19:30.009 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003, 2023-01-02T18:19:30.009 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.010 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.010 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.010 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 1230 2023-01-02T18:19:30.011 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.011 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.011 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.011 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.011 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:30.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.012 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.012 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.012 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317831+0000", 2023-01-02T18:19:30.012 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:30.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317828+0000", 2023-01-02T18:19:30.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3288000000000001e-05 2023-01-02T18:19:30.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317851+0000", 2023-01-02T18:19:30.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8610999999999999e-05 2023-01-02T18:19:30.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317870+0000", 2023-01-02T18:19:30.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8060000000000001e-06 2023-01-02T18:19:30.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317879+0000", 2023-01-02T18:19:30.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5368000000000002e-05 2023-01-02T18:19:30.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317944+0000", 2023-01-02T18:19:30.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.1450000000000008e-06 2023-01-02T18:19:30.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.317952+0000", 2023-01-02T18:19:30.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0031211030000000001 2023-01-02T18:19:30.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321073+0000", 2023-01-02T18:19:30.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000138269 2023-01-02T18:19:30.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321212+0000", 2023-01-02T18:19:30.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00029651500000000002 2023-01-02T18:19:30.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:30.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.321508+0000", 2023-01-02T18:19:30.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093539199999999995 2023-01-02T18:19:30.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.322443+0000", 2023-01-02T18:19:30.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060227499999999999 2023-01-02T18:19:30.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323046+0000", 2023-01-02T18:19:30.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.1609e-05 2023-01-02T18:19:30.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323097+0000", 2023-01-02T18:19:30.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1233999999999999e-05 2023-01-02T18:19:30.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:01.323139+0000", 2023-01-02T18:19:30.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0053073770000000003 2023-01-02T18:19:30.025 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.025 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.025 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.026 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:19:30.026 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:30.026 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 134.65630697700001, 2023-01-02T18:19:30.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:19:30.027 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.027 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.027 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.028 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.028 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:19:30.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.028 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.029 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:30.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.029 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.029 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.029 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.030 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:30.030 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:30.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:19:30.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:19:30.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:19:30.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:19:30.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:19:30.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:19:30.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:19:30.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:19:30.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:19:30.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:19:30.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:19:30.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:19:30.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:19:30.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:19:30.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:19:30.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:19:30.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:30.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:19:30.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:19:30.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:19:30.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:19:30.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:19:30.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:19:30.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:19:30.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:19:30.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:19:30.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:19:30.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.042 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.042 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.043 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:19:30.043 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:30.043 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 133.65524852300001, 2023-01-02T18:19:30.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:19:30.044 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.044 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:30.044 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:30.045 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:19:30.045 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.045 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.045 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:30.046 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.046 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.046 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.046 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.046 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:30.047 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:30.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:19:30.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:19:30.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:19:30.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:19:30.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:19:30.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:19:30.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:19:30.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:19:30.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:19:30.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:19:30.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:19:30.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:19:30.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:19:30.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:19:30.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:19:30.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:19:30.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:30.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:19:30.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:19:30.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:19:30.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:19:30.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:19:30.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:19:30.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:19:30.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:19:30.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:19:30.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:19:30.059 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.060 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.060 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.060 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2112 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e84)", 2023-01-02T18:19:30.060 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:30.061 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 132.64988387599999, 2023-01-02T18:19:30.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996, 2023-01-02T18:19:30.061 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.061 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.061 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.062 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:30.062 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:30.062 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2112 2023-01-02T18:19:30.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.062 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.063 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.063 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.063 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:30.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.063 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.064 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322279+0000", 2023-01-02T18:19:30.064 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:30.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322277+0000", 2023-01-02T18:19:30.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0539e-05 2023-01-02T18:19:30.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322288+0000", 2023-01-02T18:19:30.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8490000000000001e-05 2023-01-02T18:19:30.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322306+0000", 2023-01-02T18:19:30.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0547000000000001e-05 2023-01-02T18:19:30.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322317+0000", 2023-01-02T18:19:30.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.5281000000000001e-05 2023-01-02T18:19:30.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322382+0000", 2023-01-02T18:19:30.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8030000000000003e-06 2023-01-02T18:19:30.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.322391+0000", 2023-01-02T18:19:30.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0038589050000000001 2023-01-02T18:19:30.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326250+0000", 2023-01-02T18:19:30.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5638999999999999e-05 2023-01-02T18:19:30.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326326+0000", 2023-01-02T18:19:30.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028804200000000002 2023-01-02T18:19:30.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:30.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.326614+0000", 2023-01-02T18:19:30.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00083122100000000004 2023-01-02T18:19:30.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327445+0000", 2023-01-02T18:19:30.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000330055 2023-01-02T18:19:30.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327775+0000", 2023-01-02T18:19:30.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5942000000000002e-05 2023-01-02T18:19:30.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327821+0000", 2023-01-02T18:19:30.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.9611000000000002e-05 2023-01-02T18:19:30.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:17.327850+0000", 2023-01-02T18:19:30.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055714349999999996 2023-01-02T18:19:30.078 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.078 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.078 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.079 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:19:30.079 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:30.079 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 127.609552376, 2023-01-02T18:19:30.079 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:19:30.079 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.079 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.080 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.080 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:30.080 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:30.080 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:19:30.080 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.081 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.081 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.081 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:30.081 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:30.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:30.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:19:30.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:19:30.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:19:30.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:19:30.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:19:30.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:19:30.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:19:30.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:19:30.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:19:30.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:19:30.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:19:30.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:19:30.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:19:30.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:19:30.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:19:30.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:19:30.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:30.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:19:30.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:19:30.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:19:30.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:19:30.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:19:30.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:19:30.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:19:30.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:19:30.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:19:30.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:19:30.094 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.095 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.095 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.095 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.095 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.095 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:30.096 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:30.096 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 123.604982126, 2023-01-02T18:19:30.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:19:30.096 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.096 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.096 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.097 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:30.097 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:30.097 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:19:30.097 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.097 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:30.098 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:30.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:30.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:19:30.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:19:30.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:19:30.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:19:30.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:19:30.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:19:30.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:19:30.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:19:30.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:19:30.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:19:30.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:19:30.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:19:30.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:19:30.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:19:30.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:19:30.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:19:30.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:30.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:19:30.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:19:30.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:19:30.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:19:30.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:19:30.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:19:30.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:19:30.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:19:30.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:19:30.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:19:30.111 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.111 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.112 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:19:30.112 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:30.112 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 122.59215011000001, 2023-01-02T18:19:30.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:19:30.113 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.113 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.113 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.113 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:30.114 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:30.114 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:19:30.114 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.114 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.114 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.114 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:30.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:30.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:30.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:19:30.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:19:30.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:19:30.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:19:30.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:19:30.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:19:30.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:19:30.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:19:30.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:19:30.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:19:30.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:19:30.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:19:30.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:19:30.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:19:30.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:19:30.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:19:30.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:30.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:19:30.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:19:30.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:19:30.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:19:30.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:19:30.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:19:30.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:19:30.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:19:30.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:19:30.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:19:30.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.128 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.128 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.129 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:19:30.129 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:30.129 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 119.64341661100001, 2023-01-02T18:19:30.129 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:19:30.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.130 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.130 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.130 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:30.130 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:30.130 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:19:30.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.131 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.131 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.131 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.131 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:30.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:30.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:30.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:19:30.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:19:30.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:19:30.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:19:30.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:19:30.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:19:30.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:19:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:19:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:19:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:19:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:19:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:19:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:19:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:19:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:19:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:19:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:30.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:19:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:19:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:19:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:19:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:19:30.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:19:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:19:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:19:30.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:19:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:19:30.144 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.145 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:3318 11.5 11:a4fc8dc1:::rbd_header.12a2d6b452e6:head [watch watch cookie 140115457119424] snapc 0=[] ondisk+write+known_if_redirected+full_try e106)", 2023-01-02T18:19:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 110.643573557, 2023-01-02T18:19:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001, 2023-01-02T18:19:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.146 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 3318 2023-01-02T18:19:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.147 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328589+0000", 2023-01-02T18:19:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328588+0000", 2023-01-02T18:19:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0639999999999999e-06 2023-01-02T18:19:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328594+0000", 2023-01-02T18:19:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3091999999999999e-05 2023-01-02T18:19:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328607+0000", 2023-01-02T18:19:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.5539999999999997e-06 2023-01-02T18:19:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328613+0000", 2023-01-02T18:19:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.9184999999999997e-05 2023-01-02T18:19:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328662+0000", 2023-01-02T18:19:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106153 2023-01-02T18:19:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328768+0000", 2023-01-02T18:19:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016551599999999999 2023-01-02T18:19:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 5", 2023-01-02T18:19:30.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.328934+0000", 2023-01-02T18:19:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0022365890000000002 2023-01-02T18:19:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.331170+0000", 2023-01-02T18:19:30.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.002343805 2023-01-02T18:19:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333514+0000", 2023-01-02T18:19:30.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2032000000000005e-05 2023-01-02T18:19:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333576+0000", 2023-01-02T18:19:30.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000108885 2023-01-02T18:19:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:39.333685+0000", 2023-01-02T18:19:30.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0050958610000000001 2023-01-02T18:19:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.160 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 62.100534332999999, 2023-01-02T18:19:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:19:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.161 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:19:30.162 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:30.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:19:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:19:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:19:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:19:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:19:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:19:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:19:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:19:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:19:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:19:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:19:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:19:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:30.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:19:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:19:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:19:30.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:19:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:19:30.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:19:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:19:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:19:30.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:19:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:19:30.174 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:30.175 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 34.605927590999997, 2023-01-02T18:19:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:19:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.176 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:19:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.177 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.178 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:19:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:19:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:19:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:19:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:19:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:19:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:19:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:19:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:19:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:19:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:19:30.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:19:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:19:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:19:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:19:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:19:30.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:19:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:19:30.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:19:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:19:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:19:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:19:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.189 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54769 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e160)", 2023-01-02T18:19:30.190 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 29.632232891000001, 2023-01-02T18:19:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999, 2023-01-02T18:19:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.191 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54769 2023-01-02T18:19:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.193 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.194 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339928+0000", 2023-01-02T18:19:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0937e-05 2023-01-02T18:19:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.195 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339939+0000", 2023-01-02T18:19:30.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8923000000000002e-05 2023-01-02T18:19:30.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339958+0000", 2023-01-02T18:19:30.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4999999999999999e-06 2023-01-02T18:19:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339966+0000", 2023-01-02T18:19:30.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1886999999999999e-05 2023-01-02T18:19:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340028+0000", 2023-01-02T18:19:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9189999999999999e-06 2023-01-02T18:19:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340036+0000", 2023-01-02T18:19:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012331458999999999 2023-01-02T18:19:30.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352367+0000", 2023-01-02T18:19:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5671000000000001e-05 2023-01-02T18:19:30.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352443+0000", 2023-01-02T18:19:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028359799999999998 2023-01-02T18:19:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352727+0000", 2023-01-02T18:19:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089580699999999998 2023-01-02T18:19:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353622+0000", 2023-01-02T18:19:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163995 2023-01-02T18:19:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353786+0000", 2023-01-02T18:19:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7710000000000002e-05 2023-01-02T18:19:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353834+0000", 2023-01-02T18:19:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3380999999999999e-05 2023-01-02T18:19:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353857+0000", 2023-01-02T18:19:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999 2023-01-02T18:19:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.206 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54785 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.628565160000001, 2023-01-02T18:19:30.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348, 2023-01-02T18:19:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.208 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54785 2023-01-02T18:19:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.210 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343595+0000", 2023-01-02T18:19:30.211 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2480000000000002e-06 2023-01-02T18:19:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343605+0000", 2023-01-02T18:19:30.212 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6588000000000001e-05 2023-01-02T18:19:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343621+0000", 2023-01-02T18:19:30.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2490000000000004e-06 2023-01-02T18:19:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343629+0000", 2023-01-02T18:19:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3723000000000001e-05 2023-01-02T18:19:30.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343672+0000", 2023-01-02T18:19:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.04e-06 2023-01-02T18:19:30.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343677+0000", 2023-01-02T18:19:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054799280000000002 2023-01-02T18:19:30.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349157+0000", 2023-01-02T18:19:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010108299999999999 2023-01-02T18:19:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349258+0000", 2023-01-02T18:19:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000406179 2023-01-02T18:19:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349665+0000", 2023-01-02T18:19:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051027499999999996 2023-01-02T18:19:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354767+0000", 2023-01-02T18:19:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000482819 2023-01-02T18:19:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355250+0000", 2023-01-02T18:19:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7871999999999998e-05 2023-01-02T18:19:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355298+0000", 2023-01-02T18:19:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6105e-05 2023-01-02T18:19:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355344+0000", 2023-01-02T18:19:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348 2023-01-02T18:19:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56246 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 24.327164036999999, 2023-01-02T18:19:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998, 2023-01-02T18:19:30.224 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.225 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56246 2023-01-02T18:19:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:30.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:30.227 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644998+0000", 2023-01-02T18:19:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2189999999999998e-06 2023-01-02T18:19:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645002+0000", 2023-01-02T18:19:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0909999999999993e-06 2023-01-02T18:19:30.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645010+0000", 2023-01-02T18:19:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6880000000000001e-06 2023-01-02T18:19:30.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645014+0000", 2023-01-02T18:19:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6795999999999998e-05 2023-01-02T18:19:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645051+0000", 2023-01-02T18:19:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000001e-05 2023-01-02T18:19:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645135+0000", 2023-01-02T18:19:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199557 2023-01-02T18:19:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645335+0000", 2023-01-02T18:19:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00070655299999999996 2023-01-02T18:19:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.646041+0000", 2023-01-02T18:19:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047206009999999996 2023-01-02T18:19:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650762+0000", 2023-01-02T18:19:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5790999999999997e-05 2023-01-02T18:19:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650798+0000", 2023-01-02T18:19:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4202999999999997e-05 2023-01-02T18:19:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650842+0000", 2023-01-02T18:19:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998 2023-01-02T18:19:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56449 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", 2023-01-02T18:19:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 23.602770296999999, 2023-01-02T18:19:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305, 2023-01-02T18:19:30.239 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.240 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56449 2023-01-02T18:19:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:30.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369390+0000", 2023-01-02T18:19:30.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1600000000000001e-05 2023-01-02T18:19:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369402+0000", 2023-01-02T18:19:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8179999999999999e-05 2023-01-02T18:19:30.244 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369420+0000", 2023-01-02T18:19:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.951e-06 2023-01-02T18:19:30.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369427+0000", 2023-01-02T18:19:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8652999999999995e-05 2023-01-02T18:19:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369496+0000", 2023-01-02T18:19:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1131000000000001e-05 2023-01-02T18:19:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369507+0000", 2023-01-02T18:19:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010015711 2023-01-02T18:19:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379523+0000", 2023-01-02T18:19:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017405799999999999 2023-01-02T18:19:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379697+0000", 2023-01-02T18:19:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097878599999999994 2023-01-02T18:19:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.380675+0000", 2023-01-02T18:19:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090579699999999996 2023-01-02T18:19:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.381581+0000", 2023-01-02T18:19:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062692200000000003 2023-01-02T18:19:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382208+0000", 2023-01-02T18:19:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1279000000000003e-05 2023-01-02T18:19:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382239+0000", 2023-01-02T18:19:30.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4488e-05 2023-01-02T18:19:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382264+0000", 2023-01-02T18:19:30.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305 2023-01-02T18:19:30.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.255 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.255 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.255 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56686 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e174)", 2023-01-02T18:19:30.256 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:30.256 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 15.637875583, 2023-01-02T18:19:30.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999, 2023-01-02T18:19:30.256 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.256 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.257 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.257 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.257 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.257 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56686 2023-01-02T18:19:30.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.257 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:30.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.259 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:30.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:30.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.259 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.260 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.260 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334286+0000", 2023-01-02T18:19:30.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8629999999999997e-06 2023-01-02T18:19:30.260 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.261 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334295+0000", 2023-01-02T18:19:30.261 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:19:30.261 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.261 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.261 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334308+0000", 2023-01-02T18:19:30.262 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7819999999999994e-06 2023-01-02T18:19:30.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334316+0000", 2023-01-02T18:19:30.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0328000000000003e-05 2023-01-02T18:19:30.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334366+0000", 2023-01-02T18:19:30.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:19:30.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334375+0000", 2023-01-02T18:19:30.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0086939579999999999 2023-01-02T18:19:30.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343069+0000", 2023-01-02T18:19:30.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7719000000000004e-05 2023-01-02T18:19:30.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343166+0000", 2023-01-02T18:19:30.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040875599999999997 2023-01-02T18:19:30.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:30.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343575+0000", 2023-01-02T18:19:30.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00078807900000000001 2023-01-02T18:19:30.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.344363+0000", 2023-01-02T18:19:30.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018956439999999999 2023-01-02T18:19:30.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346259+0000", 2023-01-02T18:19:30.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6230999999999997e-05 2023-01-02T18:19:30.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346315+0000", 2023-01-02T18:19:30.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1152000000000002e-05 2023-01-02T18:19:30.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346356+0000", 2023-01-02T18:19:30.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999 2023-01-02T18:19:30.271 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.271 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.272 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.272 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56749 16.13 16:ce684796:::rbd_object_map.12a2fc42bad2:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e176)", 2023-01-02T18:19:30.272 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:30.272 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 13.60717621, 2023-01-02T18:19:30.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067753960000000004, 2023-01-02T18:19:30.273 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.273 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.273 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.273 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.274 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.274 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56749 2023-01-02T18:19:30.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.274 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:30.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:30.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:30.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.276 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.276 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.276 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364985+0000", 2023-01-02T18:19:30.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6770000000000001e-06 2023-01-02T18:19:30.277 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.277 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.277 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364993+0000", 2023-01-02T18:19:30.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4132e-05 2023-01-02T18:19:30.278 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.278 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.278 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.278 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365008+0000", 2023-01-02T18:19:30.278 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9789999999999998e-06 2023-01-02T18:19:30.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365014+0000", 2023-01-02T18:19:30.279 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8658999999999997e-05 2023-01-02T18:19:30.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365052+0000", 2023-01-02T18:19:30.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4580000000000003e-06 2023-01-02T18:19:30.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365057+0000", 2023-01-02T18:19:30.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039966869999999996 2023-01-02T18:19:30.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369053+0000", 2023-01-02T18:19:30.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016847699999999999 2023-01-02T18:19:30.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369222+0000", 2023-01-02T18:19:30.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000172483 2023-01-02T18:19:30.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369394+0000", 2023-01-02T18:19:30.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020318689999999999 2023-01-02T18:19:30.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371426+0000", 2023-01-02T18:19:30.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024218699999999999 2023-01-02T18:19:30.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371668+0000", 2023-01-02T18:19:30.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3369999999999999e-05 2023-01-02T18:19:30.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371722+0000", 2023-01-02T18:19:30.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0258e-05 2023-01-02T18:19:30.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371762+0000", 2023-01-02T18:19:30.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067753960000000004 2023-01-02T18:19:30.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.288 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.288 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.289 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58331 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e179)", 2023-01-02T18:19:30.289 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:30.289 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 10.639734232, 2023-01-02T18:19:30.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017000080000000001, 2023-01-02T18:19:30.289 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:30.290 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:30.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:30.290 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.290 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58331 2023-01-02T18:19:30.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.291 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:30.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:30.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:30.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:30.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:30.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:30.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:30.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.293 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:30.293 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332427+0000", 2023-01-02T18:19:30.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8380000000000002e-06 2023-01-02T18:19:30.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.294 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.294 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:30.294 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332435+0000", 2023-01-02T18:19:30.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4547e-05 2023-01-02T18:19:30.294 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.295 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.295 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:30.295 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332449+0000", 2023-01-02T18:19:30.295 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7020000000000004e-06 2023-01-02T18:19:30.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332456+0000", 2023-01-02T18:19:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6797e-05 2023-01-02T18:19:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332493+0000", 2023-01-02T18:19:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3669999999999996e-06 2023-01-02T18:19:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332498+0000", 2023-01-02T18:19:30.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013552958 2023-01-02T18:19:30.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346051+0000", 2023-01-02T18:19:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010482 2023-01-02T18:19:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346156+0000", 2023-01-02T18:19:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00044760600000000002 2023-01-02T18:19:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:30.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346604+0000", 2023-01-02T18:19:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013066169999999999 2023-01-02T18:19:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.347910+0000", 2023-01-02T18:19:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392527 2023-01-02T18:19:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349303+0000", 2023-01-02T18:19:30.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4855999999999998e-05 2023-01-02T18:19:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349358+0000", 2023-01-02T18:19:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1042000000000002e-05 2023-01-02T18:19:30.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349429+0000", 2023-01-02T18:19:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017000080000000001 2023-01-02T18:19:30.304 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:30.305 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:30.305 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:30.307 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:30.120+0000 7f6fe5509200 -1 Falling back to public interface 2023-01-02T18:19:30.307 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:19:30.308 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:30.307+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:30.363 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-01-02T18:19:30.407 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:30.408+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:30.461 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:30.461 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:30.462 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:19:30.462 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:30.472 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:19:30.508 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:30.509+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:30.600 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:30.600 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:30.600 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:19:30.600 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:19:30.601 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:30.609 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:30.609+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:30.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:19:30.709 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:30.710+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:30.779 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:30.779 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:19:30.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:19:30.779 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:19:30.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.780 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2319 3.1 3:83da4b60:::rbd_object_map.11d54907a3eb.0000000000000014:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:30.780 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:19:30.780 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 124.403432345, 2023-01-02T18:19:30.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001, 2023-01-02T18:19:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:19:30.781 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2319 2023-01-02T18:19:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.782 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:19:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.783 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:19:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.784 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374312+0000", 2023-01-02T18:19:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2023-01-02T18:19:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374323+0000", 2023-01-02T18:19:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8349e-05 2023-01-02T18:19:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374341+0000", 2023-01-02T18:19:30.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9909999999999997e-06 2023-01-02T18:19:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374351+0000", 2023-01-02T18:19:30.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.617e-05 2023-01-02T18:19:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374398+0000", 2023-01-02T18:19:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:19:30.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374403+0000", 2023-01-02T18:19:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001918765 2023-01-02T18:19:30.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376322+0000", 2023-01-02T18:19:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015418100000000001 2023-01-02T18:19:30.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376476+0000", 2023-01-02T18:19:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016648999999999999 2023-01-02T18:19:30.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376642+0000", 2023-01-02T18:19:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001972976 2023-01-02T18:19:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.378615+0000", 2023-01-02T18:19:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020004570000000002 2023-01-02T18:19:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380616+0000", 2023-01-02T18:19:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3064000000000005e-05 2023-01-02T18:19:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.794 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380679+0000", 2023-01-02T18:19:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9119000000000002e-05 2023-01-02T18:19:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380728+0000", 2023-01-02T18:19:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001 2023-01-02T18:19:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.796 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3507 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:19:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:19:30.797 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 73.884006495999998, 2023-01-02T18:19:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002, 2023-01-02T18:19:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.798 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3507 2023-01-02T18:19:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:19:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:19:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:30.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893738+0000", 2023-01-02T18:19:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4447000000000001e-05 2023-01-02T18:19:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893752+0000", 2023-01-02T18:19:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8085999999999999e-05 2023-01-02T18:19:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893770+0000", 2023-01-02T18:19:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5949999999999999e-06 2023-01-02T18:19:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893779+0000", 2023-01-02T18:19:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4619000000000001e-05 2023-01-02T18:19:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.805 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893824+0000", 2023-01-02T18:19:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0294000000000002e-05 2023-01-02T18:19:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893894+0000", 2023-01-02T18:19:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034635200000000002 2023-01-02T18:19:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.894240+0000", 2023-01-02T18:19:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024283040000000001 2023-01-02T18:19:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.896669+0000", 2023-01-02T18:19:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018365300000000001 2023-01-02T18:19:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898505+0000", 2023-01-02T18:19:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2230000000000001e-05 2023-01-02T18:19:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898537+0000", 2023-01-02T18:19:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6251e-05 2023-01-02T18:19:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898564+0000", 2023-01-02T18:19:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002 2023-01-02T18:19:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3508 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:19:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:19:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 72.878902939, 2023-01-02T18:19:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001, 2023-01-02T18:19:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3508 2023-01-02T18:19:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:19:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:19:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898841+0000", 2023-01-02T18:19:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:19:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898867+0000", 2023-01-02T18:19:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323999999999999e-05 2023-01-02T18:19:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898890+0000", 2023-01-02T18:19:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8820000000000007e-06 2023-01-02T18:19:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898899+0000", 2023-01-02T18:19:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1070999999999999e-05 2023-01-02T18:19:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898950+0000", 2023-01-02T18:19:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2550000000000002e-05 2023-01-02T18:19:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899022+0000", 2023-01-02T18:19:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317836 2023-01-02T18:19:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899340+0000", 2023-01-02T18:19:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002728931 2023-01-02T18:19:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.902069+0000", 2023-01-02T18:19:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014209419999999999 2023-01-02T18:19:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903490+0000", 2023-01-02T18:19:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3368000000000003e-05 2023-01-02T18:19:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903523+0000", 2023-01-02T18:19:30.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5165999999999999e-05 2023-01-02T18:19:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903549+0000", 2023-01-02T18:19:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001 2023-01-02T18:19:30.829 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.831 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16198 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1536~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:19:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.880880632, 2023-01-02T18:19:30.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003, 2023-01-02T18:19:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.833 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16198 2023-01-02T18:19:30.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.835 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:19:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.836 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:19:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896865+0000", 2023-01-02T18:19:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6900000000000001e-06 2023-01-02T18:19:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896868+0000", 2023-01-02T18:19:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:19:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896874+0000", 2023-01-02T18:19:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.447e-06 2023-01-02T18:19:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896876+0000", 2023-01-02T18:19:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001873179 2023-01-02T18:19:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898750+0000", 2023-01-02T18:19:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7626000000000005e-05 2023-01-02T18:19:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898827+0000", 2023-01-02T18:19:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012927899999999999 2023-01-02T18:19:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898957+0000", 2023-01-02T18:19:30.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023139749999999998 2023-01-02T18:19:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901271+0000", 2023-01-02T18:19:30.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4455000000000005e-05 2023-01-02T18:19:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901335+0000", 2023-01-02T18:19:30.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7706999999999994e-05 2023-01-02T18:19:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901403+0000", 2023-01-02T18:19:30.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3409999999999999e-05 2023-01-02T18:19:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901446+0000", 2023-01-02T18:19:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003 2023-01-02T18:19:30.847 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.848 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16199 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2048~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:19:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.880867543999997, 2023-01-02T18:19:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004, 2023-01-02T18:19:30.849 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.850 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16199 2023-01-02T18:19:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:19:30.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:19:30.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:19:30.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.69e-06 2023-01-02T18:19:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896883+0000", 2023-01-02T18:19:30.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2909999999999999e-06 2023-01-02T18:19:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896887+0000", 2023-01-02T18:19:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.238e-06 2023-01-02T18:19:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896889+0000", 2023-01-02T18:19:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002707919 2023-01-02T18:19:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899597+0000", 2023-01-02T18:19:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2546000000000002e-05 2023-01-02T18:19:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899639+0000", 2023-01-02T18:19:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4080999999999996e-05 2023-01-02T18:19:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899733+0000", 2023-01-02T18:19:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001771826 2023-01-02T18:19:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901505+0000", 2023-01-02T18:19:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6619999999999994e-06 2023-01-02T18:19:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901514+0000", 2023-01-02T18:19:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0059999999999998e-05 2023-01-02T18:19:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901564+0000", 2023-01-02T18:19:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1318e-05 2023-01-02T18:19:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901605+0000", 2023-01-02T18:19:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004 2023-01-02T18:19:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.864 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16200 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2560~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:19:30.865 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.880855357000002, 2023-01-02T18:19:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998, 2023-01-02T18:19:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.866 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16200 2023-01-02T18:19:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.867 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:19:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.868 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.869 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.869 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:19:30.869 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.871 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:19:30.871 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0820000000000001e-06 2023-01-02T18:19:30.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896893+0000", 2023-01-02T18:19:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8679999999999999e-06 2023-01-02T18:19:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896896+0000", 2023-01-02T18:19:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1390000000000002e-06 2023-01-02T18:19:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.874 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896898+0000", 2023-01-02T18:19:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032553590000000002 2023-01-02T18:19:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.875 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900153+0000", 2023-01-02T18:19:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8237000000000003e-05 2023-01-02T18:19:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.876 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900232+0000", 2023-01-02T18:19:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018062300000000001 2023-01-02T18:19:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900412+0000", 2023-01-02T18:19:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012047169999999999 2023-01-02T18:19:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.878 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901617+0000", 2023-01-02T18:19:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042531099999999999 2023-01-02T18:19:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902042+0000", 2023-01-02T18:19:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1499000000000003e-05 2023-01-02T18:19:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902094+0000", 2023-01-02T18:19:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9249000000000003e-05 2023-01-02T18:19:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902133+0000", 2023-01-02T18:19:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998 2023-01-02T18:19:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16201 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:19:30.883 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.880846472999998, 2023-01-02T18:19:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004, 2023-01-02T18:19:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.884 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16201 2023-01-02T18:19:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:19:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:19:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:19:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4200000000000001e-06 2023-01-02T18:19:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.890 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896902+0000", 2023-01-02T18:19:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8849999999999999e-06 2023-01-02T18:19:30.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.892 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896905+0000", 2023-01-02T18:19:30.893 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2500000000000001e-06 2023-01-02T18:19:30.893 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.894 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.894 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896907+0000", 2023-01-02T18:19:30.895 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038386549999999998 2023-01-02T18:19:30.895 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.895 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.896 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900746+0000", 2023-01-02T18:19:30.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8287000000000004e-05 2023-01-02T18:19:30.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900834+0000", 2023-01-02T18:19:30.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016278899999999999 2023-01-02T18:19:30.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900997+0000", 2023-01-02T18:19:30.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011903720000000001 2023-01-02T18:19:30.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.899 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.899 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902187+0000", 2023-01-02T18:19:30.900 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634200000000004 2023-01-02T18:19:30.900 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902704+0000", 2023-01-02T18:19:30.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.957e-05 2023-01-02T18:19:30.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.901 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902733+0000", 2023-01-02T18:19:30.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4341e-05 2023-01-02T18:19:30.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.902 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902758+0000", 2023-01-02T18:19:30.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004 2023-01-02T18:19:30.903 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.904 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.904 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.905 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16202 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:30.905 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:19:30.906 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.880837055999997, 2023-01-02T18:19:30.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001, 2023-01-02T18:19:30.906 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.906 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.907 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.907 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.907 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.908 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16202 2023-01-02T18:19:30.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.908 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:19:30.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.910 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:19:30.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:30.910 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.911 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.911 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:19:30.911 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.092e-06 2023-01-02T18:19:30.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.912 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.912 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896911+0000", 2023-01-02T18:19:30.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1019999999999999e-06 2023-01-02T18:19:30.912 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.912 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.913 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.913 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896915+0000", 2023-01-02T18:19:30.913 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7930000000000002e-06 2023-01-02T18:19:30.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.913 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896918+0000", 2023-01-02T18:19:30.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047231770000000003 2023-01-02T18:19:30.914 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901641+0000", 2023-01-02T18:19:30.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2209000000000002e-05 2023-01-02T18:19:30.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901684+0000", 2023-01-02T18:19:30.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104726 2023-01-02T18:19:30.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901788+0000", 2023-01-02T18:19:30.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015539740000000001 2023-01-02T18:19:30.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903342+0000", 2023-01-02T18:19:30.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1817999999999998e-05 2023-01-02T18:19:30.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903394+0000", 2023-01-02T18:19:30.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8734999999999998e-05 2023-01-02T18:19:30.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903423+0000", 2023-01-02T18:19:30.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9155000000000001e-05 2023-01-02T18:19:30.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.922 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903452+0000", 2023-01-02T18:19:30.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001 2023-01-02T18:19:30.924 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.924 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.924 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16203 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:19:30.925 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.880825962000003, 2023-01-02T18:19:30.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998, 2023-01-02T18:19:30.926 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.926 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.926 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.926 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.927 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.927 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16203 2023-01-02T18:19:30.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.927 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.927 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.928 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:19:30.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.928 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.928 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.928 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.929 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:19:30.929 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:30.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.929 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896920+0000", 2023-01-02T18:19:30.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1600000000000001e-06 2023-01-02T18:19:30.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896922+0000", 2023-01-02T18:19:30.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5219999999999999e-06 2023-01-02T18:19:30.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896926+0000", 2023-01-02T18:19:30.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9470000000000002e-06 2023-01-02T18:19:30.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896928+0000", 2023-01-02T18:19:30.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052862669999999999 2023-01-02T18:19:30.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.933 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902214+0000", 2023-01-02T18:19:30.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3084999999999994e-05 2023-01-02T18:19:30.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902307+0000", 2023-01-02T18:19:30.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013711100000000001 2023-01-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902444+0000", 2023-01-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090387900000000001 2023-01-02T18:19:30.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903348+0000", 2023-01-02T18:19:30.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015428300000000001 2023-01-02T18:19:30.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903503+0000", 2023-01-02T18:19:30.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7078999999999999e-05 2023-01-02T18:19:30.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903530+0000", 2023-01-02T18:19:30.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9266000000000002e-05 2023-01-02T18:19:30.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903549+0000", 2023-01-02T18:19:30.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998 2023-01-02T18:19:30.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.939 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.939 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.940 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16204 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:30.940 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:19:30.940 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.880816512999999, 2023-01-02T18:19:30.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996, 2023-01-02T18:19:30.941 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.941 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.941 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.941 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.942 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.942 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16204 2023-01-02T18:19:30.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.942 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.942 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.943 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:19:30.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.943 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.943 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.943 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.944 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:19:30.944 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:30.944 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.944 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.944 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:19:30.945 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1679999999999997e-06 2023-01-02T18:19:30.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.945 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896934+0000", 2023-01-02T18:19:30.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.039e-06 2023-01-02T18:19:30.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896937+0000", 2023-01-02T18:19:30.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0389999999999999e-06 2023-01-02T18:19:30.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896939+0000", 2023-01-02T18:19:30.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058543179999999998 2023-01-02T18:19:30.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902793+0000", 2023-01-02T18:19:30.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5451999999999996e-05 2023-01-02T18:19:30.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902859+0000", 2023-01-02T18:19:30.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5087999999999996e-05 2023-01-02T18:19:30.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902944+0000", 2023-01-02T18:19:30.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086757900000000005 2023-01-02T18:19:30.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903811+0000", 2023-01-02T18:19:30.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9238000000000002e-05 2023-01-02T18:19:30.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903901+0000", 2023-01-02T18:19:30.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0630000000000001e-05 2023-01-02T18:19:30.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903951+0000", 2023-01-02T18:19:30.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6187999999999998e-05 2023-01-02T18:19:30.953 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904007+0000", 2023-01-02T18:19:30.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996 2023-01-02T18:19:30.954 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.954 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.955 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.955 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16205 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 0~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e140)", 2023-01-02T18:19:30.955 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:19:30.956 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 62.878073493999999, 2023-01-02T18:19:30.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868, 2023-01-02T18:19:30.956 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.956 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:30.956 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.956 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.957 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.957 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16205 2023-01-02T18:19:30.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.957 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.958 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.958 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:19:30.958 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.959 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.959 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:19:30.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:30.959 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.959 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.960 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.960 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899672+0000", 2023-01-02T18:19:30.960 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2650000000000004e-06 2023-01-02T18:19:30.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.960 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899677+0000", 2023-01-02T18:19:30.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1850000000000004e-06 2023-01-02T18:19:30.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899686+0000", 2023-01-02T18:19:30.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4259999999999996e-06 2023-01-02T18:19:30.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899690+0000", 2023-01-02T18:19:30.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576512 2023-01-02T18:19:30.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903266+0000", 2023-01-02T18:19:30.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5141000000000005e-05 2023-01-02T18:19:30.964 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:19:30.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903332+0000", 2023-01-02T18:19:30.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070156899999999998 2023-01-02T18:19:30.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904033+0000", 2023-01-02T18:19:30.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0550000000000003e-05 2023-01-02T18:19:30.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904074+0000", 2023-01-02T18:19:30.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7970000000000001e-05 2023-01-02T18:19:30.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904142+0000", 2023-01-02T18:19:30.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868 2023-01-02T18:19:30.968 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.968 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.968 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.969 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28602 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 146432~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e143)", 2023-01-02T18:19:30.969 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:19:30.969 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.840089091000003, 2023-01-02T18:19:30.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996, 2023-01-02T18:19:30.969 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.970 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:30.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.970 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.970 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28602 2023-01-02T18:19:30.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.971 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.971 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:19:30.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:19:30.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:30.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.973 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937656+0000", 2023-01-02T18:19:30.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3520000000000003e-06 2023-01-02T18:19:30.973 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.974 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.974 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937663+0000", 2023-01-02T18:19:30.974 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4744e-05 2023-01-02T18:19:30.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.975 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.975 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937677+0000", 2023-01-02T18:19:30.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5119999999999997e-06 2023-01-02T18:19:30.975 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.975 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.976 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.976 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937684+0000", 2023-01-02T18:19:30.976 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2098999999999997e-05 2023-01-02T18:19:30.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.976 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937736+0000", 2023-01-02T18:19:30.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:19:30.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:30.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937745+0000", 2023-01-02T18:19:30.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073198109999999999 2023-01-02T18:19:30.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945065+0000", 2023-01-02T18:19:30.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1624000000000002e-05 2023-01-02T18:19:30.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945156+0000", 2023-01-02T18:19:30.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123879 2023-01-02T18:19:30.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945280+0000", 2023-01-02T18:19:30.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996 2023-01-02T18:19:30.981 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.981 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.981 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.982 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28808 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [assert-version v64,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:30.982 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:19:30.982 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 59.764910811999997, 2023-01-02T18:19:30.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002, 2023-01-02T18:19:30.983 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.983 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.983 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.983 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.983 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.983 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28808 2023-01-02T18:19:30.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.984 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:30.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:19:30.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:30.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.985 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:30.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:19:30.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:30.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:30.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012835+0000", 2023-01-02T18:19:30.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0229999999999998e-06 2023-01-02T18:19:30.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:30.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012841+0000", 2023-01-02T18:19:30.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1938e-05 2023-01-02T18:19:30.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:30.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012853+0000", 2023-01-02T18:19:30.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5520000000000004e-06 2023-01-02T18:19:30.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.989 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:30.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012858+0000", 2023-01-02T18:19:30.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9961999999999999e-05 2023-01-02T18:19:30.989 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.990 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:30.990 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012888+0000", 2023-01-02T18:19:30.990 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2904e-05 2023-01-02T18:19:30.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.991 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:30.991 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012941+0000", 2023-01-02T18:19:30.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016403699999999999 2023-01-02T18:19:30.991 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.991 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:30.992 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013105+0000", 2023-01-02T18:19:30.992 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074456399999999997 2023-01-02T18:19:30.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.992 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:30.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013850+0000", 2023-01-02T18:19:30.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027539999999999999 2023-01-02T18:19:30.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:30.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016604+0000", 2023-01-02T18:19:30.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4141999999999999e-05 2023-01-02T18:19:30.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:30.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016638+0000", 2023-01-02T18:19:30.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7827000000000002e-05 2023-01-02T18:19:30.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.995 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016676+0000", 2023-01-02T18:19:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002 2023-01-02T18:19:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:30.996 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41666 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:19:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.400252101, 2023-01-02T18:19:30.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043435039999999998, 2023-01-02T18:19:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:30.998 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41666 2023-01-02T18:19:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:30.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:19:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:31.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:19:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:31.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:19:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7869999999999999e-06 2023-01-02T18:19:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:31.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377498+0000", 2023-01-02T18:19:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7349999999999999e-06 2023-01-02T18:19:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377505+0000", 2023-01-02T18:19:31.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9289999999999997e-06 2023-01-02T18:19:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377509+0000", 2023-01-02T18:19:31.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028717389999999999 2023-01-02T18:19:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380381+0000", 2023-01-02T18:19:31.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2969999999999997e-05 2023-01-02T18:19:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380424+0000", 2023-01-02T18:19:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107729 2023-01-02T18:19:31.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.007 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.007 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:31.007 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380532+0000", 2023-01-02T18:19:31.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001230039 2023-01-02T18:19:31.007 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.008 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:31.008 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381762+0000", 2023-01-02T18:19:31.008 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0010000000000007e-06 2023-01-02T18:19:31.008 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.008 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:31.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381771+0000", 2023-01-02T18:19:31.009 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6591999999999997e-05 2023-01-02T18:19:31.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:31.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381818+0000", 2023-01-02T18:19:31.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0386000000000001e-05 2023-01-02T18:19:31.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:31.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381838+0000", 2023-01-02T18:19:31.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043435039999999998 2023-01-02T18:19:31.011 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.011 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:31.011 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.012 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41667 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:31.012 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:19:31.012 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.400232432000003, 2023-01-02T18:19:31.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048409819999999998, 2023-01-02T18:19:31.013 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:31.013 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:31.013 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:31.013 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:31.013 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:31.014 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41667 2023-01-02T18:19:31.014 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.014 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:31.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:31.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:19:31.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:31.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:31.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:19:31.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:31.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:31.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:19:31.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2910000000000001e-06 2023-01-02T18:19:31.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:31.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377518+0000", 2023-01-02T18:19:31.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9619999999999996e-06 2023-01-02T18:19:31.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:31.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377525+0000", 2023-01-02T18:19:31.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0780000000000001e-06 2023-01-02T18:19:31.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:31.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377531+0000", 2023-01-02T18:19:31.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032340340000000002 2023-01-02T18:19:31.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380765+0000", 2023-01-02T18:19:31.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1267999999999999e-05 2023-01-02T18:19:31.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:31.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380806+0000", 2023-01-02T18:19:31.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.975e-05 2023-01-02T18:19:31.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.022 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:31.022 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380886+0000", 2023-01-02T18:19:31.022 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098581100000000007 2023-01-02T18:19:31.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.023 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:31.023 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381872+0000", 2023-01-02T18:19:31.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042798899999999998 2023-01-02T18:19:31.023 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.023 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:31.024 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382300+0000", 2023-01-02T18:19:31.024 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2042000000000003e-05 2023-01-02T18:19:31.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.024 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.024 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:31.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382332+0000", 2023-01-02T18:19:31.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3221999999999999e-05 2023-01-02T18:19:31.025 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:31.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382355+0000", 2023-01-02T18:19:31.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048409819999999998 2023-01-02T18:19:31.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.026 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:31.026 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.027 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41668 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:31.027 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:19:31.027 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.400210837000003, 2023-01-02T18:19:31.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010315690000000001, 2023-01-02T18:19:31.028 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:31.028 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:31.028 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:31.028 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:31.028 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:31.029 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41668 2023-01-02T18:19:31.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.029 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:31.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:31.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:19:31.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:31.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:31.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:19:31.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:31.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:31.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377535+0000", 2023-01-02T18:19:31.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7050000000000001e-06 2023-01-02T18:19:31.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:31.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377539+0000", 2023-01-02T18:19:31.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:19:31.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:31.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377548+0000", 2023-01-02T18:19:31.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5299999999999998e-06 2023-01-02T18:19:31.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:31.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377552+0000", 2023-01-02T18:19:31.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037753740000000002 2023-01-02T18:19:31.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381328+0000", 2023-01-02T18:19:31.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7478000000000002e-05 2023-01-02T18:19:31.035 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.036 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:31.036 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381375+0000", 2023-01-02T18:19:31.036 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103408 2023-01-02T18:19:31.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.037 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:31.037 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381478+0000", 2023-01-02T18:19:31.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088558899999999999 2023-01-02T18:19:31.037 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.037 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.038 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:31.038 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382364+0000", 2023-01-02T18:19:31.038 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053292160000000003 2023-01-02T18:19:31.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.038 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:31.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387693+0000", 2023-01-02T18:19:31.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2136e-05 2023-01-02T18:19:31.039 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:31.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387785+0000", 2023-01-02T18:19:31.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5914000000000006e-05 2023-01-02T18:19:31.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:31.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387851+0000", 2023-01-02T18:19:31.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010315690000000001 2023-01-02T18:19:31.041 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.041 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:31.041 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.042 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41669 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:31.042 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:19:31.042 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.400189836999999, 2023-01-02T18:19:31.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010395639, 2023-01-02T18:19:31.043 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:31.043 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:31.043 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:31.043 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:31.043 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:31.044 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41669 2023-01-02T18:19:31.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.044 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:31.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:31.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:19:31.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:31.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:31.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:19:31.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:31.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:31.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377556+0000", 2023-01-02T18:19:31.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1570000000000003e-06 2023-01-02T18:19:31.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:31.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377563+0000", 2023-01-02T18:19:31.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1639999999999998e-06 2023-01-02T18:19:31.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:31.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377570+0000", 2023-01-02T18:19:31.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0329999999999999e-06 2023-01-02T18:19:31.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.049 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.049 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:31.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377575+0000", 2023-01-02T18:19:31.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043243480000000004 2023-01-02T18:19:31.049 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.050 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.050 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381899+0000", 2023-01-02T18:19:31.050 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7437e-05 2023-01-02T18:19:31.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.051 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:31.051 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381946+0000", 2023-01-02T18:19:31.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5799999999999998e-05 2023-01-02T18:19:31.051 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.051 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.052 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:31.052 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382042+0000", 2023-01-02T18:19:31.052 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054838499999999997 2023-01-02T18:19:31.052 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.052 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.053 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:31.053 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382591+0000", 2023-01-02T18:19:31.053 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053095540000000002 2023-01-02T18:19:31.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:31.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387900+0000", 2023-01-02T18:19:31.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5627e-05 2023-01-02T18:19:31.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:31.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387926+0000", 2023-01-02T18:19:31.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6576000000000001e-05 2023-01-02T18:19:31.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:31.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387952+0000", 2023-01-02T18:19:31.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010395639 2023-01-02T18:19:31.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.056 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:31.056 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.057 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41670 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [cmpext 0~512,write 0~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:31.057 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:19:31.057 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.398295351999998, 2023-01-02T18:19:31.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0096660940000000001, 2023-01-02T18:19:31.058 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:31.058 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:31.058 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:31.058 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:31.058 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:31.058 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41670 2023-01-02T18:19:31.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.059 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:31.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:31.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:19:31.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:31.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:31.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:19:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:31.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379450+0000", 2023-01-02T18:19:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1359999999999996e-06 2023-01-02T18:19:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379455+0000", 2023-01-02T18:19:31.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1508999999999999e-05 2023-01-02T18:19:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379467+0000", 2023-01-02T18:19:31.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0369999999999997e-06 2023-01-02T18:19:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379474+0000", 2023-01-02T18:19:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029082439999999999 2023-01-02T18:19:31.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382382+0000", 2023-01-02T18:19:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5390999999999998e-05 2023-01-02T18:19:31.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:19:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382448+0000", 2023-01-02T18:19:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055373549999999999 2023-01-02T18:19:31.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387985+0000", 2023-01-02T18:19:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2169999999999998e-05 2023-01-02T18:19:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388027+0000", 2023-01-02T18:19:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013321900000000001 2023-01-02T18:19:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.068 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388160+0000", 2023-01-02T18:19:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050349900000000003 2023-01-02T18:19:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388664+0000", 2023-01-02T18:19:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040003400000000001 2023-01-02T18:19:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389064+0000", 2023-01-02T18:19:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2549999999999998e-05 2023-01-02T18:19:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.071 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389096+0000", 2023-01-02T18:19:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0778999999999999e-05 2023-01-02T18:19:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:31.072 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389117+0000", 2023-01-02T18:19:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0096660940000000001 2023-01-02T18:19:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:42207 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [read 44548~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e150)", 2023-01-02T18:19:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:19:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 45.238214358, 2023-01-02T18:19:31.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024391863999999999, 2023-01-02T18:19:31.075 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:31.075 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:31.075 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:31.075 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:31.075 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:31.075 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 42207 2023-01-02T18:19:31.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.076 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:31.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:31.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:19:31.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:31.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:31.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:19:31.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:31.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:31.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539531+0000", 2023-01-02T18:19:31.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.822e-06 2023-01-02T18:19:31.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:31.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539535+0000", 2023-01-02T18:19:31.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2060000000000004e-06 2023-01-02T18:19:31.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:31.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539541+0000", 2023-01-02T18:19:31.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0029999999999999e-06 2023-01-02T18:19:31.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:31.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539544+0000", 2023-01-02T18:19:31.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5829e-05 2023-01-02T18:19:31.081 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.082 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539570+0000", 2023-01-02T18:19:31.082 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5000999999999999e-05 2023-01-02T18:19:31.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.083 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:31.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539605+0000", 2023-01-02T18:19:31.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024318678999999999 2023-01-02T18:19:31.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:31.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.563924+0000", 2023-01-02T18:19:31.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024391863999999999 2023-01-02T18:19:31.084 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.084 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:31.084 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.085 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:54299 14.1a 14:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e154)", 2023-01-02T18:19:31.085 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:19:31.085 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 39.093043923000003, 2023-01-02T18:19:31.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063022640000000001, 2023-01-02T18:19:31.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:31.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:31.086 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:31.086 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:31.087 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:31.087 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 54299 2023-01-02T18:19:31.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.087 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:31.087 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:31.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:19:31.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:31.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:31.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:19:31.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:31.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:31.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684700+0000", 2023-01-02T18:19:31.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4088e-05 2023-01-02T18:19:31.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:31.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684714+0000", 2023-01-02T18:19:31.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6232e-05 2023-01-02T18:19:31.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:31.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684730+0000", 2023-01-02T18:19:31.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5450000000000003e-06 2023-01-02T18:19:31.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:31.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684739+0000", 2023-01-02T18:19:31.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8902e-05 2023-01-02T18:19:31.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.093 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684788+0000", 2023-01-02T18:19:31.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2610000000000001e-06 2023-01-02T18:19:31.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:31.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684793+0000", 2023-01-02T18:19:31.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001184554 2023-01-02T18:19:31.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:31.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.685978+0000", 2023-01-02T18:19:31.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013823899999999999 2023-01-02T18:19:31.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:31.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.686116+0000", 2023-01-02T18:19:31.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003439442 2023-01-02T18:19:31.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:31.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.689555+0000", 2023-01-02T18:19:31.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000894128 2023-01-02T18:19:31.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:31.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690450+0000", 2023-01-02T18:19:31.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00049250100000000001 2023-01-02T18:19:31.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:31.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690942+0000", 2023-01-02T18:19:31.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7042000000000002e-05 2023-01-02T18:19:31.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:31.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690979+0000", 2023-01-02T18:19:31.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5789999999999999e-05 2023-01-02T18:19:31.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:31.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:31.101 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:31.101 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.691005+0000", 2023-01-02T18:19:31.101 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063022640000000001 2023-01-02T18:19:31.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.101 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:31.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:31.102 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:31.102 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:31.102 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-01-02T18:19:31.104 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:19:31.105 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:31.104+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:31.204 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:31.205+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:31.278 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:31.279 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:31.279 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:19:31.279 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:31.289 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:19:31.290 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:31.307 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:31.308 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:31.309+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:31.325 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:31.343 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:31.363 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:31.371 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-01-02T18:19:31.405 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:31.406 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:31.406+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:31.425 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:31.425 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:31.425 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:31.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-01-02T18:19:31.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-01-02T18:19:31.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-01-02T18:19:31.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'false' 2023-01-02T18:19:31.426 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'false' 2023-01-02T18:19:31.427 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.5 2023-01-02T18:19:31.427 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'false' 2023-01-02T18:19:31.427 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'false' 2023-01-02T18:19:31.428 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-01-02T18:19:31.429 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-01-02T18:19:31.436 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:19:31.506 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:31.507+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:31.601 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:31.602 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:31.607 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:31.608+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:31.613 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-01-02T18:19:31.707 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:31.708+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:31.779 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:31.779 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:31.789 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-01-02T18:19:31.808 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:31.809+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:31.910 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:31.910+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:31.954 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:31.955 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:31.965 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-01-02T18:19:32.011 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:32.012+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:32.092 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:32.103 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2023-01-02T18:19:32.146 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:32.147+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:32.213 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:32.214+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:32.229 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:32.229 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:32.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2023-01-02T18:19:32.323 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:32.324+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:32.409 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:32.409 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:32.415 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:32.416+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:32.419 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2023-01-02T18:19:32.517 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:32.517+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:32.586 INFO:teuthology.orchestra.run.smithi007.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:32.586 INFO:teuthology.orchestra.run.smithi007.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:32.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2023-01-02T18:19:32.618 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:32.619+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:32.719 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:32.720+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:32.733 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:32.733 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:32.745 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2023-01-02T18:19:32.820 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:32.820+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:32.883 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:32.883 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:32.897 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2023-01-02T18:19:32.921 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:32.922+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:33.022 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:33.023+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:33.061 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:33.062 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:33.071 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2023-01-02T18:19:33.123 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:33.124+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:33.197 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:33.197 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:33.207 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2023-01-02T18:19:33.250 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:33.251+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:33.324 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:33.324+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:33.346 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:33.346 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:33.356 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2023-01-02T18:19:33.384 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-01-02T18:19:33.429 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:33.430+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:33.430 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-01-02T18:19:33.525 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:33.526+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:33.531 INFO:teuthology.orchestra.run.smithi057.stdout:ERROR: (22) Invalid argument 2023-01-02T18:19:33.532 INFO:teuthology.orchestra.run.smithi057.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-01-02T18:19:33.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2023-01-02T18:19:33.580 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:33.580+0000 7f6fe5509200 -1 osd.5 182 log_to_monitors {default=true} 2023-01-02T18:19:33.591 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-01-02T18:19:33.612 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-01-02T18:19:33.627 INFO:tasks.ceph.osd.2.smithi007.stderr:2023-01-02T18:19:33.627+0000 7f208b37a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 107045) UID: 0 2023-01-02T18:19:33.632 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-01-02T18:19:33.651 INFO:teuthology.orchestra.run.smithi007.stdout:osd.3: {} 2023-01-02T18:19:33.671 INFO:teuthology.orchestra.run.smithi007.stdout:osd.4: {} 2023-01-02T18:19:33.692 INFO:teuthology.orchestra.run.smithi007.stdout:osd.6: {} 2023-01-02T18:19:33.714 INFO:teuthology.orchestra.run.smithi007.stdout:osd.7: {} 2023-01-02T18:19:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-01-02T18:19:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-01-02T18:19:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-01-02T18:19:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:osd.3: osd_enable_op_tracker = 'true' 2023-01-02T18:19:33.715 INFO:teuthology.orchestra.run.smithi007.stderr:osd.4: osd_enable_op_tracker = 'true' 2023-01-02T18:19:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.5 2023-01-02T18:19:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:osd.6: osd_enable_op_tracker = 'true' 2023-01-02T18:19:33.716 INFO:teuthology.orchestra.run.smithi007.stderr:osd.7: osd_enable_op_tracker = 'true' 2023-01-02T18:19:33.716 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:33.717 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:33.717 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:33.718 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-01-02T18:19:33.718 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-01-02T18:19:33.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2023-01-02T18:19:33.761 INFO:tasks.ceph.osd.0.smithi007.stderr:2023-01-02T18:19:33.761+0000 7f54d5951700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 107030) UID: 0 2023-01-02T18:19:33.828 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:33.829+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:33.862 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:33.862 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:33.862 INFO:teuthology.orchestra.run.smithi057.stdout: "complaint_time": 30, 2023-01-02T18:19:33.862 INFO:teuthology.orchestra.run.smithi057.stdout: "num_blocked_ops": 0 2023-01-02T18:19:33.863 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:33.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2023-01-02T18:19:33.929 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:33.929+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:33.948 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.948 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.948 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.948 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.949 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.949 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 1 2023-01-02T18:19:33.949 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 1 2023-01-02T18:19:33.949 INFO:tasks.workunit.client.0.smithi007.stdout:child: image70 2023-01-02T18:19:33.949 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70/12a2de66876e 2023-01-02T18:19:33.950 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.950 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.950 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.950 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.950 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.951 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.951 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.951 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.951 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.951 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.952 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.952 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.952 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 2 2023-01-02T18:19:33.952 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 2 2023-01-02T18:19:33.952 INFO:tasks.workunit.client.0.smithi007.stdout:child: image71 2023-01-02T18:19:33.952 INFO:tasks.workunit.client.0.smithi007.stdout:child: image70 2023-01-02T18:19:33.953 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70/12a2de66876e 2023-01-02T18:19:33.953 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.953 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71/12a2a7e41035 2023-01-02T18:19:33.953 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.953 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.954 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.954 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.954 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.954 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.954 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.954 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.955 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.955 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.955 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.955 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.955 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.956 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image72 2023-01-02T18:19:33.956 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.956 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.956 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image72 2023-01-02T18:19:33.956 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image72 2023-01-02T18:19:33.956 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.957 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 3 2023-01-02T18:19:33.957 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 3 2023-01-02T18:19:33.957 INFO:tasks.workunit.client.0.smithi007.stdout:child: image71 2023-01-02T18:19:33.957 INFO:tasks.workunit.client.0.smithi007.stdout:child: image70 2023-01-02T18:19:33.958 INFO:tasks.workunit.client.0.smithi007.stdout:child: image72 2023-01-02T18:19:33.958 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70/12a2de66876e 2023-01-02T18:19:33.958 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.958 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71/12a2a7e41035 2023-01-02T18:19:33.958 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.958 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image72/12a2374c18d1 2023-01-02T18:19:33.959 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.959 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.959 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.959 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.959 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.960 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.960 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.960 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.960 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.960 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.960 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.961 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.961 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 3 2023-01-02T18:19:33.961 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 3 2023-01-02T18:19:33.961 INFO:tasks.workunit.client.0.smithi007.stdout:child: image71 2023-01-02T18:19:33.961 INFO:tasks.workunit.client.0.smithi007.stdout:child: image70 2023-01-02T18:19:33.962 INFO:tasks.workunit.client.0.smithi007.stdout:child: image72 2023-01-02T18:19:33.962 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70/12a2de66876e 2023-01-02T18:19:33.962 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.962 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71/12a2a7e41035 2023-01-02T18:19:33.962 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.963 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image72/12a2374c18d1 2023-01-02T18:19:33.963 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.963 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.963 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.963 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.964 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.964 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.964 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.964 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.964 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.964 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.965 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.965 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.965 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.965 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image73 2023-01-02T18:19:33.965 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.966 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.966 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image73 2023-01-02T18:19:33.966 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image73 2023-01-02T18:19:33.966 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.966 INFO:tasks.workunit.client.0.smithi007.stdout:num children is: 4 2023-01-02T18:19:33.967 INFO:tasks.workunit.client.0.smithi007.stdout:expected: 4 2023-01-02T18:19:33.967 INFO:tasks.workunit.client.0.smithi007.stdout:child: image71 2023-01-02T18:19:33.967 INFO:tasks.workunit.client.0.smithi007.stdout:child: image70 2023-01-02T18:19:33.967 INFO:tasks.workunit.client.0.smithi007.stdout:child: image72 2023-01-02T18:19:33.967 INFO:tasks.workunit.client.0.smithi007.stdout:child: image73 2023-01-02T18:19:33.967 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70/12a2de66876e 2023-01-02T18:19:33.968 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.968 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71/12a2a7e41035 2023-01-02T18:19:33.968 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.968 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image72/12a2374c18d1 2023-01-02T18:19:33.968 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.969 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image73/12a29fb7e1a7 2023-01-02T18:19:33.969 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.969 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.969 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.969 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.970 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.970 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.970 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.970 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.970 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.970 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.971 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.971 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.971 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.971 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image72 2023-01-02T18:19:33.971 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:33.972 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image70 2023-01-02T18:19:33.972 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-16/image72 2023-01-02T18:19:33.972 INFO:tasks.workunit.client.0.smithi007.stdout:found child test-librbd-smithi007-118686-16/image72 2023-01-02T18:19:33.972 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.972 INFO:tasks.workunit.client.0.smithi007.stdout: 2023-01-02T18:19:33.973 INFO:tasks.workunit.client.0.smithi007.stdout:trying to find test-librbd-smithi007-118686-16/image73 2023-01-02T18:19:33.973 INFO:tasks.workunit.client.0.smithi007.stdout:checking test-librbd-smithi007-118686-15/image71 2023-01-02T18:19:34.009 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:34.010 INFO:teuthology.orchestra.run.smithi057.stdout: "size": 20, 2023-01-02T18:19:34.010 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 600, 2023-01-02T18:19:34.010 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [ 2023-01-02T18:19:34.010 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.010 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:246 5.1a 5:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e54)", 2023-01-02T18:19:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 166.69002888700001, 2023-01-02T18:19:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453, 2023-01-02T18:19:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.011 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 246 2023-01-02T18:19:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.012 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.013 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318050+0000", 2023-01-02T18:19:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:34.014 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.015 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.015 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.015 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318047+0000", 2023-01-02T18:19:34.015 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2123999999999999e-05 2023-01-02T18:19:34.015 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.016 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.016 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.016 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318059+0000", 2023-01-02T18:19:34.016 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3779e-05 2023-01-02T18:19:34.016 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.017 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.017 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.017 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.318073+0000", 2023-01-02T18:19:34.017 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.003853797 2023-01-02T18:19:34.017 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.018 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.018 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.018 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.321927+0000", 2023-01-02T18:19:34.018 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00042792699999999998 2023-01-02T18:19:34.018 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.019 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.019 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.019 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322355+0000", 2023-01-02T18:19:34.019 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3210999999999999e-05 2023-01-02T18:19:34.019 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.020 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.020 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for peered", 2023-01-02T18:19:34.020 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:47.322368+0000", 2023-01-02T18:19:34.020 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0053911209999999 2023-01-02T18:19:34.020 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327759+0000", 2023-01-02T18:19:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016292699999999999 2023-01-02T18:19:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.021 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.022 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.022 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.327922+0000", 2023-01-02T18:19:34.022 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000184112 2023-01-02T18:19:34.022 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.022 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.328106+0000", 2023-01-02T18:19:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005165528 2023-01-02T18:19:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.333272+0000", 2023-01-02T18:19:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0029400619999999998 2023-01-02T18:19:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.024 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336212+0000", 2023-01-02T18:19:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4803999999999999e-05 2023-01-02T18:19:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.025 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336267+0000", 2023-01-02T18:19:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5000999999999998e-05 2023-01-02T18:19:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.026 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:48.336312+0000", 2023-01-02T18:19:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.018261453 2023-01-02T18:19:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.027 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:400 6.1a 6:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e59)", 2023-01-02T18:19:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:34.028 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 161.674945431, 2023-01-02T18:19:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654, 2023-01-02T18:19:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.029 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 400 2023-01-02T18:19:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.030 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.031 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333134+0000", 2023-01-02T18:19:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.032 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333132+0000", 2023-01-02T18:19:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.198e-05 2023-01-02T18:19:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.033 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333144+0000", 2023-01-02T18:19:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.772e-05 2023-01-02T18:19:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.034 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333162+0000", 2023-01-02T18:19:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.4290000000000004e-06 2023-01-02T18:19:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333169+0000", 2023-01-02T18:19:34.035 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.727e-05 2023-01-02T18:19:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333216+0000", 2023-01-02T18:19:34.036 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3759999999999999e-06 2023-01-02T18:19:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.333222+0000", 2023-01-02T18:19:34.037 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071941210000000004 2023-01-02T18:19:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340416+0000", 2023-01-02T18:19:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017667299999999999 2023-01-02T18:19:34.038 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340592+0000", 2023-01-02T18:19:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00018840799999999999 2023-01-02T18:19:34.039 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.340781+0000", 2023-01-02T18:19:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00130474 2023-01-02T18:19:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.040 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342086+0000", 2023-01-02T18:19:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.2086000000000002e-05 2023-01-02T18:19:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.041 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342148+0000", 2023-01-02T18:19:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6952000000000001e-05 2023-01-02T18:19:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.042 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342185+0000", 2023-01-02T18:19:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2712999999999997e-05 2023-01-02T18:19:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.043 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:16:52.342217+0000", 2023-01-02T18:19:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.009083654 2023-01-02T18:19:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.044 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:2764 3.f 3:f2a050a2:::rbd_header.12a27d57f136:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e82)", 2023-01-02T18:19:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 138.69222316299999, 2023-01-02T18:19:34.045 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001, 2023-01-02T18:19:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.046 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2764 2023-01-02T18:19:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.047 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:34.048 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.048 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.048 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.048 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.048 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315856+0000", 2023-01-02T18:19:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.049 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315854+0000", 2023-01-02T18:19:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2240000000000001e-06 2023-01-02T18:19:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.050 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315863+0000", 2023-01-02T18:19:34.051 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6935e-05 2023-01-02T18:19:34.051 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.051 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.051 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.051 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315880+0000", 2023-01-02T18:19:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.9530000000000002e-06 2023-01-02T18:19:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315887+0000", 2023-01-02T18:19:34.052 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.2068999999999999e-05 2023-01-02T18:19:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315939+0000", 2023-01-02T18:19:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8900000000000007e-06 2023-01-02T18:19:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.315947+0000", 2023-01-02T18:19:34.054 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0059746340000000004 2023-01-02T18:19:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.321921+0000", 2023-01-02T18:19:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000106962 2023-01-02T18:19:34.055 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322028+0000", 2023-01-02T18:19:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00043155199999999998 2023-01-02T18:19:34.056 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.322460+0000", 2023-01-02T18:19:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00085358199999999997 2023-01-02T18:19:34.057 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323313+0000", 2023-01-02T18:19:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00046129 2023-01-02T18:19:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.058 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323775+0000", 2023-01-02T18:19:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7605000000000002e-05 2023-01-02T18:19:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.059 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.060 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.060 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323822+0000", 2023-01-02T18:19:34.060 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7013999999999999e-05 2023-01-02T18:19:34.060 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.060 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:15.323849+0000", 2023-01-02T18:19:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0079934450000000001 2023-01-02T18:19:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.062 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.062 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.062 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2085 3.15 3:ae03070a:::rbd_header.11d574d0a887:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e83)", 2023-01-02T18:19:34.062 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:34.062 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 137.69116470899999, 2023-01-02T18:19:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998, 2023-01-02T18:19:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:34.063 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2085 2023-01-02T18:19:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.064 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.065 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316914+0000", 2023-01-02T18:19:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.066 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316913+0000", 2023-01-02T18:19:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1958e-05 2023-01-02T18:19:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.067 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316925+0000", 2023-01-02T18:19:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.7881999999999999e-05 2023-01-02T18:19:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.068 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316943+0000", 2023-01-02T18:19:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8469999999999998e-06 2023-01-02T18:19:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.069 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.316949+0000", 2023-01-02T18:19:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6317999999999998e-05 2023-01-02T18:19:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.070 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317016+0000", 2023-01-02T18:19:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8109999999999992e-06 2023-01-02T18:19:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.071 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.317025+0000", 2023-01-02T18:19:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00562774 2023-01-02T18:19:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322652+0000", 2023-01-02T18:19:34.072 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9195000000000002e-05 2023-01-02T18:19:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.322742+0000", 2023-01-02T18:19:34.073 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028321200000000003 2023-01-02T18:19:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323025+0000", 2023-01-02T18:19:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00071714800000000003 2023-01-02T18:19:34.074 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323742+0000", 2023-01-02T18:19:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000256748 2023-01-02T18:19:34.075 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.323999+0000", 2023-01-02T18:19:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5979000000000002e-05 2023-01-02T18:19:34.076 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324035+0000", 2023-01-02T18:19:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6512999999999998e-05 2023-01-02T18:19:34.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:16.324061+0000", 2023-01-02T18:19:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0071468019999999998 2023-01-02T18:19:34.078 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2226 3.13 3:cedc437f:::rbd_object_map.11d5ac377738.0000000000000010:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e89)", 2023-01-02T18:19:34.079 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 131.64546856199999, 2023-01-02T18:19:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762, 2023-01-02T18:19:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.080 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2226 2023-01-02T18:19:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.081 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.082 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362610+0000", 2023-01-02T18:19:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.083 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362608+0000", 2023-01-02T18:19:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4899000000000001e-05 2023-01-02T18:19:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.084 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362623+0000", 2023-01-02T18:19:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.1648999999999999e-05 2023-01-02T18:19:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.085 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362644+0000", 2023-01-02T18:19:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1537e-05 2023-01-02T18:19:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.086 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362656+0000", 2023-01-02T18:19:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0525000000000006e-05 2023-01-02T18:19:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.087 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362736+0000", 2023-01-02T18:19:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2852e-05 2023-01-02T18:19:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.088 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.362749+0000", 2023-01-02T18:19:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0035403100000000001 2023-01-02T18:19:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.089 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366290+0000", 2023-01-02T18:19:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015778400000000001 2023-01-02T18:19:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366447+0000", 2023-01-02T18:19:34.090 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00038217699999999998 2023-01-02T18:19:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.366830+0000", 2023-01-02T18:19:34.091 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0012779829999999999 2023-01-02T18:19:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368107+0000", 2023-01-02T18:19:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00027039399999999997 2023-01-02T18:19:34.092 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.093 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.093 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.093 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368378+0000", 2023-01-02T18:19:34.093 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.7904999999999997e-05 2023-01-02T18:19:34.093 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368416+0000", 2023-01-02T18:19:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.7458e-05 2023-01-02T18:19:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:22.368443+0000", 2023-01-02T18:19:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.005832762 2023-01-02T18:19:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.095 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2317 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 127.640898312, 2023-01-02T18:19:34.096 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472, 2023-01-02T18:19:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:34.097 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2317 2023-01-02T18:19:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.099 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367181+0000", 2023-01-02T18:19:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367179+0000", 2023-01-02T18:19:34.100 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0372999999999999e-05 2023-01-02T18:19:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367209+0000", 2023-01-02T18:19:34.101 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0150000000000001e-05 2023-01-02T18:19:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367239+0000", 2023-01-02T18:19:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1477999999999999e-05 2023-01-02T18:19:34.102 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.103 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.103 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.103 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367251+0000", 2023-01-02T18:19:34.103 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.5828000000000005e-05 2023-01-02T18:19:34.103 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367347+0000", 2023-01-02T18:19:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.1179999999999998e-06 2023-01-02T18:19:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.104 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.367356+0000", 2023-01-02T18:19:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004529033 2023-01-02T18:19:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.105 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.371885+0000", 2023-01-02T18:19:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012276400000000001 2023-01-02T18:19:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.106 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372007+0000", 2023-01-02T18:19:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00060349500000000001 2023-01-02T18:19:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.107 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.372611+0000", 2023-01-02T18:19:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00099768399999999998 2023-01-02T18:19:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.108 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373609+0000", 2023-01-02T18:19:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.09e-05 2023-01-02T18:19:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.109 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373630+0000", 2023-01-02T18:19:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1277000000000003e-05 2023-01-02T18:19:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.110 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373691+0000", 2023-01-02T18:19:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4681000000000001e-05 2023-01-02T18:19:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.111 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:26.373735+0000", 2023-01-02T18:19:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00655472 2023-01-02T18:19:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.112 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2344 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e94)", 2023-01-02T18:19:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 126.628066296, 2023-01-02T18:19:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004, 2023-01-02T18:19:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.114 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.114 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.114 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:34.114 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:34.114 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2344 2023-01-02T18:19:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:34.115 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380013+0000", 2023-01-02T18:19:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:34.116 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380010+0000", 2023-01-02T18:19:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4331000000000001e-05 2023-01-02T18:19:34.117 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380024+0000", 2023-01-02T18:19:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2504999999999999e-05 2023-01-02T18:19:34.118 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380047+0000", 2023-01-02T18:19:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.6229999999999992e-06 2023-01-02T18:19:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.119 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380057+0000", 2023-01-02T18:19:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.4302999999999997e-05 2023-01-02T18:19:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.120 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380121+0000", 2023-01-02T18:19:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.469e-06 2023-01-02T18:19:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.121 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.380128+0000", 2023-01-02T18:19:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044070610000000003 2023-01-02T18:19:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.122 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384535+0000", 2023-01-02T18:19:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000114097 2023-01-02T18:19:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.123 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.384649+0000", 2023-01-02T18:19:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00049332100000000002 2023-01-02T18:19:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:34.124 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.385143+0000", 2023-01-02T18:19:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090778400000000002 2023-01-02T18:19:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.125 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386051+0000", 2023-01-02T18:19:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00093467400000000003 2023-01-02T18:19:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.386985+0000", 2023-01-02T18:19:34.126 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.137e-05 2023-01-02T18:19:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387017+0000", 2023-01-02T18:19:34.127 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2487e-05 2023-01-02T18:19:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:27.387039+0000", 2023-01-02T18:19:34.128 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0070263620000000004 2023-01-02T18:19:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.129 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:2397 3.13 3:ce472256:::rbd_header.11d54907a3eb:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e97)", 2023-01-02T18:19:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 123.679332797, 2023-01-02T18:19:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004, 2023-01-02T18:19:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.130 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 2397 2023-01-02T18:19:34.131 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328746+0000", 2023-01-02T18:19:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:34.133 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328744+0000", 2023-01-02T18:19:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.9830000000000002e-06 2023-01-02T18:19:34.134 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328753+0000", 2023-01-02T18:19:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4399999999999999e-05 2023-01-02T18:19:34.135 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328768+0000", 2023-01-02T18:19:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2730000000000008e-06 2023-01-02T18:19:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.136 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328777+0000", 2023-01-02T18:19:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.8999000000000002e-05 2023-01-02T18:19:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.137 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328836+0000", 2023-01-02T18:19:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.6630000000000004e-06 2023-01-02T18:19:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.138 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.328843+0000", 2023-01-02T18:19:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0044475060000000004 2023-01-02T18:19:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.139 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333290+0000", 2023-01-02T18:19:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00014450199999999999 2023-01-02T18:19:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.140 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333435+0000", 2023-01-02T18:19:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00056097799999999995 2023-01-02T18:19:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.333996+0000", 2023-01-02T18:19:34.141 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001491636 2023-01-02T18:19:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335487+0000", 2023-01-02T18:19:34.142 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000117197 2023-01-02T18:19:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335605+0000", 2023-01-02T18:19:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.2143000000000003e-05 2023-01-02T18:19:34.143 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335687+0000", 2023-01-02T18:19:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7426999999999998e-05 2023-01-02T18:19:34.144 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:17:30.335734+0000", 2023-01-02T18:19:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0069878350000000004 2023-01-02T18:19:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.145 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:16193 3.e 3:70975960:::rbd_data.12a211eeb54d.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:34.146 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 66.136450518999993, 2023-01-02T18:19:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999, 2023-01-02T18:19:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.147 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 16193 2023-01-02T18:19:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.148 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.149 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871629+0000", 2023-01-02T18:19:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.150 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.871626+0000", 2023-01-02T18:19:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0040368560000000001 2023-01-02T18:19:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.151 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875663+0000", 2023-01-02T18:19:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.6815999999999999e-05 2023-01-02T18:19:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.152 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875689+0000", 2023-01-02T18:19:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.3119999999999994e-06 2023-01-02T18:19:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.153 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875698+0000", 2023-01-02T18:19:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000100497 2023-01-02T18:19:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.154 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875798+0000", 2023-01-02T18:19:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012965599999999999 2023-01-02T18:19:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.875928+0000", 2023-01-02T18:19:34.155 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013702899999999999 2023-01-02T18:19:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.876065+0000", 2023-01-02T18:19:34.156 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017026781000000001 2023-01-02T18:19:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893092+0000", 2023-01-02T18:19:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00069074700000000002 2023-01-02T18:19:34.157 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893782+0000", 2023-01-02T18:19:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.0631999999999998e-05 2023-01-02T18:19:34.158 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893843+0000", 2023-01-02T18:19:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.3797000000000002e-05 2023-01-02T18:19:34.159 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:27.893877+0000", 2023-01-02T18:19:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.022248344999999999 2023-01-02T18:19:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.160 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4565.0:10838 3.d 3:b21fdca0:::rbd_id.image57:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:34.161 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 38.641843776999998, 2023-01-02T18:19:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004, 2023-01-02T18:19:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.162 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4565", 2023-01-02T18:19:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 10838 2023-01-02T18:19:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.163 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.164 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366235+0000", 2023-01-02T18:19:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.999999 2023-01-02T18:19:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.165 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366234+0000", 2023-01-02T18:19:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3879999999999999e-06 2023-01-02T18:19:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366240+0000", 2023-01-02T18:19:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0944000000000001e-05 2023-01-02T18:19:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.167 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366251+0000", 2023-01-02T18:19:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.5449999999999997e-06 2023-01-02T18:19:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.168 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366255+0000", 2023-01-02T18:19:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8612999999999997e-05 2023-01-02T18:19:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366304+0000", 2023-01-02T18:19:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00013421400000000001 2023-01-02T18:19:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.170 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366438+0000", 2023-01-02T18:19:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000236326 2023-01-02T18:19:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:34.171 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.366675+0000", 2023-01-02T18:19:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0055769499999999998 2023-01-02T18:19:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.172 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372251+0000", 2023-01-02T18:19:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017484299999999999 2023-01-02T18:19:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.173 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372426+0000", 2023-01-02T18:19:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.0710000000000002e-05 2023-01-02T18:19:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372457+0000", 2023-01-02T18:19:34.174 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.2402999999999999e-05 2023-01-02T18:19:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:18:55.372479+0000", 2023-01-02T18:19:34.175 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0062441450000000004 2023-01-02T18:19:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.176 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54769 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e160)", 2023-01-02T18:19:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 33.668149077000002, 2023-01-02T18:19:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999, 2023-01-02T18:19:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.177 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54769 2023-01-02T18:19:34.178 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.179 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339930+0000", 2023-01-02T18:19:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:34.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339928+0000", 2023-01-02T18:19:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.0937e-05 2023-01-02T18:19:34.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339939+0000", 2023-01-02T18:19:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8923000000000002e-05 2023-01-02T18:19:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.182 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339958+0000", 2023-01-02T18:19:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4999999999999999e-06 2023-01-02T18:19:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.183 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.339966+0000", 2023-01-02T18:19:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.1886999999999999e-05 2023-01-02T18:19:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.184 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340028+0000", 2023-01-02T18:19:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.9189999999999999e-06 2023-01-02T18:19:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.185 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.340036+0000", 2023-01-02T18:19:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012331458999999999 2023-01-02T18:19:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352367+0000", 2023-01-02T18:19:34.186 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5671000000000001e-05 2023-01-02T18:19:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352443+0000", 2023-01-02T18:19:34.187 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00028359799999999998 2023-01-02T18:19:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.352727+0000", 2023-01-02T18:19:34.188 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00089580699999999998 2023-01-02T18:19:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353622+0000", 2023-01-02T18:19:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000163995 2023-01-02T18:19:34.189 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353786+0000", 2023-01-02T18:19:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7710000000000002e-05 2023-01-02T18:19:34.190 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353834+0000", 2023-01-02T18:19:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3380999999999999e-05 2023-01-02T18:19:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:00.353857+0000", 2023-01-02T18:19:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013927485999999999 2023-01-02T18:19:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.192 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:54785 3.f 3:f2d07b5d:::rbd_header.12a21a1bf873:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e161)", 2023-01-02T18:19:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:34.193 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 32.664481346000002, 2023-01-02T18:19:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348, 2023-01-02T18:19:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.194 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 54785 2023-01-02T18:19:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.195 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.196 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343598+0000", 2023-01-02T18:19:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.197 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343595+0000", 2023-01-02T18:19:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.2480000000000002e-06 2023-01-02T18:19:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.198 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343605+0000", 2023-01-02T18:19:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.6588000000000001e-05 2023-01-02T18:19:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343621+0000", 2023-01-02T18:19:34.199 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.2490000000000004e-06 2023-01-02T18:19:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343629+0000", 2023-01-02T18:19:34.200 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.3723000000000001e-05 2023-01-02T18:19:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343672+0000", 2023-01-02T18:19:34.201 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.04e-06 2023-01-02T18:19:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.343677+0000", 2023-01-02T18:19:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0054799280000000002 2023-01-02T18:19:34.202 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349157+0000", 2023-01-02T18:19:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010108299999999999 2023-01-02T18:19:34.203 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349258+0000", 2023-01-02T18:19:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000406179 2023-01-02T18:19:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.204 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.349665+0000", 2023-01-02T18:19:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0051027499999999996 2023-01-02T18:19:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.205 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.354767+0000", 2023-01-02T18:19:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000482819 2023-01-02T18:19:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.206 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355250+0000", 2023-01-02T18:19:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.7871999999999998e-05 2023-01-02T18:19:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.207 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355298+0000", 2023-01-02T18:19:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.6105e-05 2023-01-02T18:19:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.208 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:01.355344+0000", 2023-01-02T18:19:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.011746348 2023-01-02T18:19:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56246 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.metadata_set in=15b] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 28.363080223000001, 2023-01-02T18:19:34.210 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998, 2023-01-02T18:19:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.211 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56246 2023-01-02T18:19:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.212 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.213 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644999+0000", 2023-01-02T18:19:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.214 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.644998+0000", 2023-01-02T18:19:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.2189999999999998e-06 2023-01-02T18:19:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.215 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645002+0000", 2023-01-02T18:19:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.0909999999999993e-06 2023-01-02T18:19:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.216 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645010+0000", 2023-01-02T18:19:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6880000000000001e-06 2023-01-02T18:19:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.217 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645014+0000", 2023-01-02T18:19:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6795999999999998e-05 2023-01-02T18:19:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645051+0000", 2023-01-02T18:19:34.218 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.4330000000000001e-05 2023-01-02T18:19:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645135+0000", 2023-01-02T18:19:34.219 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000199557 2023-01-02T18:19:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.645335+0000", 2023-01-02T18:19:34.220 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00070655299999999996 2023-01-02T18:19:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.646041+0000", 2023-01-02T18:19:34.221 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0047206009999999996 2023-01-02T18:19:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650762+0000", 2023-01-02T18:19:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5790999999999997e-05 2023-01-02T18:19:34.222 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650798+0000", 2023-01-02T18:19:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4202999999999997e-05 2023-01-02T18:19:34.223 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:05.650842+0000", 2023-01-02T18:19:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0058431339999999998 2023-01-02T18:19:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.225 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56449 3.13 3:c91665cb:::rbd_header.12a261246745:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e166)", 2023-01-02T18:19:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 27.638686483000001, 2023-01-02T18:19:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305, 2023-01-02T18:19:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.226 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56449 2023-01-02T18:19:34.227 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.228 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.228 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.228 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.228 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:34.228 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.229 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.229 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.229 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369393+0000", 2023-01-02T18:19:34.229 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:34.229 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.230 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.230 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.230 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369390+0000", 2023-01-02T18:19:34.230 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1600000000000001e-05 2023-01-02T18:19:34.230 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.231 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.231 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369402+0000", 2023-01-02T18:19:34.231 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.8179999999999999e-05 2023-01-02T18:19:34.231 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.231 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.232 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.232 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369420+0000", 2023-01-02T18:19:34.232 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.951e-06 2023-01-02T18:19:34.232 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.232 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.233 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.233 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369427+0000", 2023-01-02T18:19:34.233 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.8652999999999995e-05 2023-01-02T18:19:34.233 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.233 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.234 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.234 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369496+0000", 2023-01-02T18:19:34.234 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1131000000000001e-05 2023-01-02T18:19:34.234 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.234 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.235 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.369507+0000", 2023-01-02T18:19:34.235 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010015711 2023-01-02T18:19:34.235 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.235 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.235 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.236 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379523+0000", 2023-01-02T18:19:34.236 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00017405799999999999 2023-01-02T18:19:34.236 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.236 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.236 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.237 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.379697+0000", 2023-01-02T18:19:34.237 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00097878599999999994 2023-01-02T18:19:34.237 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.237 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.237 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:34.238 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.380675+0000", 2023-01-02T18:19:34.238 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00090579699999999996 2023-01-02T18:19:34.238 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.238 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.238 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.239 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.381581+0000", 2023-01-02T18:19:34.239 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00062692200000000003 2023-01-02T18:19:34.239 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.239 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.239 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.240 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382208+0000", 2023-01-02T18:19:34.240 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.1279000000000003e-05 2023-01-02T18:19:34.240 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.240 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.240 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.241 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382239+0000", 2023-01-02T18:19:34.241 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.4488e-05 2023-01-02T18:19:34.241 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.241 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.241 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.242 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:06.382264+0000", 2023-01-02T18:19:34.242 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012871305 2023-01-02T18:19:34.242 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.242 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.242 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.243 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.243 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.243 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56686 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e174)", 2023-01-02T18:19:34.243 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:34.243 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 19.673791769000001, 2023-01-02T18:19:34.243 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999, 2023-01-02T18:19:34.244 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.244 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.244 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.245 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56686 2023-01-02T18:19:34.245 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.245 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.245 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.245 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:34.246 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.246 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.246 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.246 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334287+0000", 2023-01-02T18:19:34.247 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:34.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.247 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.247 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.247 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334286+0000", 2023-01-02T18:19:34.248 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8629999999999997e-06 2023-01-02T18:19:34.248 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.248 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.248 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.248 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334295+0000", 2023-01-02T18:19:34.249 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3147e-05 2023-01-02T18:19:34.249 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.249 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.249 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.249 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334308+0000", 2023-01-02T18:19:34.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.7819999999999994e-06 2023-01-02T18:19:34.250 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.250 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.250 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.250 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334316+0000", 2023-01-02T18:19:34.250 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.0328000000000003e-05 2023-01-02T18:19:34.251 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.251 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.251 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.251 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334366+0000", 2023-01-02T18:19:34.251 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.7839999999999992e-06 2023-01-02T18:19:34.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.252 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.252 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.252 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.334375+0000", 2023-01-02T18:19:34.252 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0086939579999999999 2023-01-02T18:19:34.252 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.253 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.253 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.253 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343069+0000", 2023-01-02T18:19:34.253 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.7719000000000004e-05 2023-01-02T18:19:34.253 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.254 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.254 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343166+0000", 2023-01-02T18:19:34.254 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00040875599999999997 2023-01-02T18:19:34.254 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.254 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.255 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:34.255 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.343575+0000", 2023-01-02T18:19:34.255 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00078807900000000001 2023-01-02T18:19:34.255 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.255 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.256 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.344363+0000", 2023-01-02T18:19:34.256 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0018956439999999999 2023-01-02T18:19:34.256 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.256 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.256 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.257 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346259+0000", 2023-01-02T18:19:34.257 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.6230999999999997e-05 2023-01-02T18:19:34.257 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.257 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.257 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.258 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346315+0000", 2023-01-02T18:19:34.258 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.1152000000000002e-05 2023-01-02T18:19:34.258 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.258 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.258 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.259 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:14.346356+0000", 2023-01-02T18:19:34.259 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.012068878999999999 2023-01-02T18:19:34.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.259 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.259 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.259 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.260 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.260 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:56749 16.13 16:ce684796:::rbd_object_map.12a2fc42bad2:head [call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected e176)", 2023-01-02T18:19:34.260 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:34.260 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 17.643092396, 2023-01-02T18:19:34.260 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067753960000000004, 2023-01-02T18:19:34.261 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.261 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.261 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.261 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 56749 2023-01-02T18:19:34.262 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.262 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.262 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.262 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.262 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:34.263 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.263 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.263 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.263 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.263 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364987+0000", 2023-01-02T18:19:34.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:34.264 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.264 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.264 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.264 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364985+0000", 2023-01-02T18:19:34.264 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6770000000000001e-06 2023-01-02T18:19:34.265 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.265 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.265 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.265 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.364993+0000", 2023-01-02T18:19:34.265 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4132e-05 2023-01-02T18:19:34.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.266 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.266 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.266 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365008+0000", 2023-01-02T18:19:34.266 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9789999999999998e-06 2023-01-02T18:19:34.266 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.267 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.267 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.267 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365014+0000", 2023-01-02T18:19:34.267 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8658999999999997e-05 2023-01-02T18:19:34.267 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.268 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.268 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365052+0000", 2023-01-02T18:19:34.268 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.4580000000000003e-06 2023-01-02T18:19:34.268 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.268 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.269 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.269 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.365057+0000", 2023-01-02T18:19:34.269 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0039966869999999996 2023-01-02T18:19:34.269 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.269 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.270 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369053+0000", 2023-01-02T18:19:34.270 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00016847699999999999 2023-01-02T18:19:34.270 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.270 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.270 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.271 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369222+0000", 2023-01-02T18:19:34.271 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000172483 2023-01-02T18:19:34.271 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.271 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.271 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:34.272 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.369394+0000", 2023-01-02T18:19:34.272 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0020318689999999999 2023-01-02T18:19:34.272 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.272 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.272 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371426+0000", 2023-01-02T18:19:34.273 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00024218699999999999 2023-01-02T18:19:34.273 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.273 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.273 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.273 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371668+0000", 2023-01-02T18:19:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3369999999999999e-05 2023-01-02T18:19:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.274 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371722+0000", 2023-01-02T18:19:34.275 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.0258e-05 2023-01-02T18:19:34.275 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.275 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.275 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.275 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:16.371762+0000", 2023-01-02T18:19:34.276 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0067753960000000004 2023-01-02T18:19:34.276 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.276 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.276 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.276 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.277 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.277 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58331 15.19 15:9ae170cc:::rbd_header.12a2185cf5a6:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e179)", 2023-01-02T18:19:34.277 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:34.277 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 14.675650418, 2023-01-02T18:19:34.277 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017000080000000001, 2023-01-02T18:19:34.278 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.278 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.278 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.278 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.278 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.278 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58331 2023-01-02T18:19:34.279 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.279 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.279 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.279 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.279 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:34.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.280 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.280 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.280 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.280 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332429+0000", 2023-01-02T18:19:34.280 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:34.281 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.281 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.281 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.281 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332427+0000", 2023-01-02T18:19:34.281 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.8380000000000002e-06 2023-01-02T18:19:34.282 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.282 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.282 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.282 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332435+0000", 2023-01-02T18:19:34.282 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4547e-05 2023-01-02T18:19:34.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.283 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.283 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.283 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332449+0000", 2023-01-02T18:19:34.283 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7020000000000004e-06 2023-01-02T18:19:34.283 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.284 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.284 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.284 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332456+0000", 2023-01-02T18:19:34.284 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.6797e-05 2023-01-02T18:19:34.284 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.285 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.285 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332493+0000", 2023-01-02T18:19:34.285 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.3669999999999996e-06 2023-01-02T18:19:34.285 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.285 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.286 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.286 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.332498+0000", 2023-01-02T18:19:34.286 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.013552958 2023-01-02T18:19:34.286 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.286 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.287 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.287 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346051+0000", 2023-01-02T18:19:34.287 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00010482 2023-01-02T18:19:34.287 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.287 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.288 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346156+0000", 2023-01-02T18:19:34.288 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00044760600000000002 2023-01-02T18:19:34.288 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.288 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.288 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:34.289 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.346604+0000", 2023-01-02T18:19:34.289 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0013066169999999999 2023-01-02T18:19:34.289 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.289 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.289 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.347910+0000", 2023-01-02T18:19:34.290 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001392527 2023-01-02T18:19:34.290 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.290 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.290 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.290 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349303+0000", 2023-01-02T18:19:34.291 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.4855999999999998e-05 2023-01-02T18:19:34.291 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.291 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.291 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.291 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349358+0000", 2023-01-02T18:19:34.292 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.1042000000000002e-05 2023-01-02T18:19:34.292 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.292 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.292 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.292 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:19.349429+0000", 2023-01-02T18:19:34.293 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017000080000000001 2023-01-02T18:19:34.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.293 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.293 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.293 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.293 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.294 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58435 19.1c 19:3831950c:::rbd_directory:head [call rbd.dir_add_image in=16b] snapc 0=[] ondisk+write+known_if_redirected e190)", 2023-01-02T18:19:34.294 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:30.363479+0000", 2023-01-02T18:19:34.294 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 3.6446005509999999, 2023-01-02T18:19:34.294 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019218809, 2023-01-02T18:19:34.294 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.295 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.295 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.295 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.295 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.295 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58435 2023-01-02T18:19:34.295 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.296 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.296 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.296 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.296 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.363479+0000", 2023-01-02T18:19:34.296 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.297 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.297 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.297 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.297 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.363479+0000", 2023-01-02T18:19:34.297 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:34.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.298 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.298 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.298 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.363476+0000", 2023-01-02T18:19:34.298 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.8599999999999999e-06 2023-01-02T18:19:34.298 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.299 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.299 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.299 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.363485+0000", 2023-01-02T18:19:34.299 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.1651000000000001e-05 2023-01-02T18:19:34.299 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.300 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.300 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.363497+0000", 2023-01-02T18:19:34.300 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.806e-06 2023-01-02T18:19:34.300 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.300 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.301 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.301 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.363502+0000", 2023-01-02T18:19:34.301 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4.8847000000000002e-05 2023-01-02T18:19:34.301 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.301 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.302 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.363551+0000", 2023-01-02T18:19:34.302 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 9.0310000000000004e-06 2023-01-02T18:19:34.302 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.302 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.302 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.303 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.363560+0000", 2023-01-02T18:19:34.303 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.010088222000000001 2023-01-02T18:19:34.303 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.303 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.303 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.304 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.373649+0000", 2023-01-02T18:19:34.304 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000368258 2023-01-02T18:19:34.304 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.304 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.304 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for blocked object", 2023-01-02T18:19:34.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.374017+0000", 2023-01-02T18:19:34.305 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.001867844 2023-01-02T18:19:34.305 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.305 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.305 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.305 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.375885+0000", 2023-01-02T18:19:34.306 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 8.6427000000000004e-05 2023-01-02T18:19:34.306 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.306 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.306 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for rw locks", 2023-01-02T18:19:34.306 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.375971+0000", 2023-01-02T18:19:34.307 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0056754029999999999 2023-01-02T18:19:34.307 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.307 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.307 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.307 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.381646+0000", 2023-01-02T18:19:34.308 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 5.9259000000000003e-05 2023-01-02T18:19:34.308 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.308 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.308 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.308 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.381706+0000", 2023-01-02T18:19:34.309 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00015773100000000001 2023-01-02T18:19:34.309 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.309 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.309 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:34.309 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.381863+0000", 2023-01-02T18:19:34.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00076325500000000001 2023-01-02T18:19:34.310 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.310 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.310 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.310 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.382627+0000", 2023-01-02T18:19:34.310 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.2023e-05 2023-01-02T18:19:34.311 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.311 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.311 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.311 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.382639+0000", 2023-01-02T18:19:34.311 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.5215000000000001e-05 2023-01-02T18:19:34.312 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.312 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.312 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.312 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.382674+0000", 2023-01-02T18:19:34.312 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.3332e-05 2023-01-02T18:19:34.313 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.313 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.313 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.313 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:30.382697+0000", 2023-01-02T18:19:34.313 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019218809 2023-01-02T18:19:34.313 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.314 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.314 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.314 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.314 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.314 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58461 19.4 19:21146a11:::rbd_header.12a26fb67f1f:head [call rbd.snapshot_add in=15b] snapc 0=[] ondisk+write+known_if_redirected e191)", 2023-01-02T18:19:34.315 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:31.365483+0000", 2023-01-02T18:19:34.315 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.6425964070000001, 2023-01-02T18:19:34.315 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019692600000000001, 2023-01-02T18:19:34.315 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.315 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.316 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.316 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58461 2023-01-02T18:19:34.316 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.316 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.317 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.317 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.317 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.365483+0000", 2023-01-02T18:19:34.317 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.317 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.318 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.318 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.318 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.365483+0000", 2023-01-02T18:19:34.318 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:34.318 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.319 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.319 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.319 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.365480+0000", 2023-01-02T18:19:34.319 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5977e-05 2023-01-02T18:19:34.319 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.320 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.320 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.320 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.365496+0000", 2023-01-02T18:19:34.320 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.4876000000000003e-05 2023-01-02T18:19:34.320 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.321 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.321 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.365530+0000", 2023-01-02T18:19:34.321 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.4276e-05 2023-01-02T18:19:34.321 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.321 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.322 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.322 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.365545+0000", 2023-01-02T18:19:34.322 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000169445 2023-01-02T18:19:34.322 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.322 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.323 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.365714+0000", 2023-01-02T18:19:34.323 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.358e-05 2023-01-02T18:19:34.323 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.323 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.323 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.324 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.365728+0000", 2023-01-02T18:19:34.324 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.017512381 2023-01-02T18:19:34.324 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.324 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.324 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.325 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.383240+0000", 2023-01-02T18:19:34.325 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000133671 2023-01-02T18:19:34.325 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.325 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.325 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.326 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.383374+0000", 2023-01-02T18:19:34.326 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000491103 2023-01-02T18:19:34.326 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.326 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.326 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 6", 2023-01-02T18:19:34.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.383865+0000", 2023-01-02T18:19:34.327 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0011668329999999999 2023-01-02T18:19:34.327 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.327 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.327 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.327 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.385032+0000", 2023-01-02T18:19:34.328 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 7.5767999999999997e-05 2023-01-02T18:19:34.328 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.328 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.328 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.328 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.385108+0000", 2023-01-02T18:19:34.329 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.9585999999999997e-05 2023-01-02T18:19:34.329 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.329 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.329 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.329 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.385147+0000", 2023-01-02T18:19:34.330 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.8121000000000001e-05 2023-01-02T18:19:34.330 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.330 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.330 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.330 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.385175+0000", 2023-01-02T18:19:34.331 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.019692600000000001 2023-01-02T18:19:34.331 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.331 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.331 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.331 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.332 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.332 INFO:teuthology.orchestra.run.smithi057.stdout: "description": "osd_op(client.4770.0:58463 19.1d 19:bdb37935:::rbd_object_map.12a26fb67f1f.0000000000000004:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e191)", 2023-01-02T18:19:34.332 INFO:teuthology.orchestra.run.smithi057.stdout: "initiated_at": "2023-01-02T18:19:31.390607+0000", 2023-01-02T18:19:34.332 INFO:teuthology.orchestra.run.smithi057.stdout: "age": 2.61747219, 2023-01-02T18:19:34.332 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064624950000000004, 2023-01-02T18:19:34.332 INFO:teuthology.orchestra.run.smithi057.stdout: "type_data": { 2023-01-02T18:19:34.333 INFO:teuthology.orchestra.run.smithi057.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client_info": { 2023-01-02T18:19:34.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client": "client.4770", 2023-01-02T18:19:34.333 INFO:teuthology.orchestra.run.smithi057.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.333 INFO:teuthology.orchestra.run.smithi057.stdout: "tid": 58463 2023-01-02T18:19:34.334 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.334 INFO:teuthology.orchestra.run.smithi057.stdout: "events": [ 2023-01-02T18:19:34.334 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.334 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "initiated", 2023-01-02T18:19:34.334 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.390607+0000", 2023-01-02T18:19:34.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0 2023-01-02T18:19:34.335 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.335 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.335 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "throttled", 2023-01-02T18:19:34.335 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.390607+0000", 2023-01-02T18:19:34.335 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 4294967295.9999971 2023-01-02T18:19:34.336 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.336 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.336 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "header_read", 2023-01-02T18:19:34.336 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.390604+0000", 2023-01-02T18:19:34.336 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.5406000000000001e-05 2023-01-02T18:19:34.337 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.337 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.337 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "all_read", 2023-01-02T18:19:34.337 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.390619+0000", 2023-01-02T18:19:34.337 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.2203999999999999e-05 2023-01-02T18:19:34.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.338 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.338 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "dispatched", 2023-01-02T18:19:34.338 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.390652+0000", 2023-01-02T18:19:34.338 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 1.3606e-05 2023-01-02T18:19:34.338 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.339 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.339 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.339 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.390665+0000", 2023-01-02T18:19:34.339 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.000119652 2023-01-02T18:19:34.339 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.340 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.340 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.340 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.390785+0000", 2023-01-02T18:19:34.340 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00030140800000000003 2023-01-02T18:19:34.340 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.341 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for blocked object", 2023-01-02T18:19:34.341 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.391086+0000", 2023-01-02T18:19:34.341 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00080363099999999996 2023-01-02T18:19:34.341 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.341 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.342 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "reached_pg", 2023-01-02T18:19:34.342 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.391890+0000", 2023-01-02T18:19:34.342 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 6.7056000000000003e-05 2023-01-02T18:19:34.342 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.342 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.343 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "started", 2023-01-02T18:19:34.343 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.391957+0000", 2023-01-02T18:19:34.343 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00012433999999999999 2023-01-02T18:19:34.343 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.343 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "waiting for subops from 0", 2023-01-02T18:19:34.344 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.392081+0000", 2023-01-02T18:19:34.344 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.00084163800000000002 2023-01-02T18:19:34.344 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.344 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.344 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "op_commit", 2023-01-02T18:19:34.345 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.392923+0000", 2023-01-02T18:19:34.345 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.004081744 2023-01-02T18:19:34.345 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.345 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.345 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.397005+0000", 2023-01-02T18:19:34.346 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 3.8937999999999999e-05 2023-01-02T18:19:34.346 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.346 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.346 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "commit_sent", 2023-01-02T18:19:34.346 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.397044+0000", 2023-01-02T18:19:34.347 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 2.5755e-05 2023-01-02T18:19:34.347 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2023-01-02T18:19:34.347 INFO:teuthology.orchestra.run.smithi057.stdout: { 2023-01-02T18:19:34.347 INFO:teuthology.orchestra.run.smithi057.stdout: "event": "done", 2023-01-02T18:19:34.347 INFO:teuthology.orchestra.run.smithi057.stdout: "time": "2023-01-02T18:19:31.397069+0000", 2023-01-02T18:19:34.348 INFO:teuthology.orchestra.run.smithi057.stdout: "duration": 0.0064624950000000004 2023-01-02T18:19:34.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.348 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.348 INFO:teuthology.orchestra.run.smithi057.stdout: } 2023-01-02T18:19:34.348 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2023-01-02T18:19:34.349 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:34.350 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:34.350+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:34.351 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-01-02T18:19:34.395 INFO:tasks.ceph.osd.5.smithi057.stderr:2023-01-02T18:19:34.396+0000 7f6fd862c700 -1 osd.5 182 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-01-02T18:19:34.396 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-01-02T18:19:34.450 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:34.451+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:34.496 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:34.496 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:34.496 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:19:34.497 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:34.506 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-01-02T18:19:34.590 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:34.591+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:34.653 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:34.654+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:34.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2023-01-02T18:19:34.672 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:34.672 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:34.672 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:19:34.672 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:19:34.672 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:34.683 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-01-02T18:19:34.754 INFO:tasks.ceph.osd.4.smithi057.stderr:2023-01-02T18:19:34.754+0000 7fce5bf18700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 106889) UID: 0 2023-01-02T18:19:34.783 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2023-01-02T18:19:34.784 INFO:teuthology.orchestra.run.smithi057.stdout: "ops": [], 2023-01-02T18:19:34.784 INFO:teuthology.orchestra.run.smithi057.stdout: "num_ops": 0 2023-01-02T18:19:34.784 INFO:teuthology.orchestra.run.smithi057.stdout:} 2023-01-02T18:19:34.850 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:19:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:19:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:19:34.851 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.852 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2319 3.1 3:83da4b60:::rbd_object_map.11d54907a3eb.0000000000000014:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e93)", 2023-01-02T18:19:34.852 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:19:34.852 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 128.47531698, 2023-01-02T18:19:34.852 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001, 2023-01-02T18:19:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:19:34.853 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2319 2023-01-02T18:19:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:19:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374314+0000", 2023-01-02T18:19:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.856 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374312+0000", 2023-01-02T18:19:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0774000000000001e-05 2023-01-02T18:19:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.857 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374323+0000", 2023-01-02T18:19:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8349e-05 2023-01-02T18:19:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.858 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374341+0000", 2023-01-02T18:19:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.9909999999999997e-06 2023-01-02T18:19:34.859 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374351+0000", 2023-01-02T18:19:34.860 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.617e-05 2023-01-02T18:19:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374398+0000", 2023-01-02T18:19:34.861 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.4500000000000003e-06 2023-01-02T18:19:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.374403+0000", 2023-01-02T18:19:34.862 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001918765 2023-01-02T18:19:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376322+0000", 2023-01-02T18:19:34.863 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015418100000000001 2023-01-02T18:19:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:34.864 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376476+0000", 2023-01-02T18:19:34.865 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016648999999999999 2023-01-02T18:19:34.865 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.865 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.866 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 3", 2023-01-02T18:19:34.866 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.376642+0000", 2023-01-02T18:19:34.867 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001972976 2023-01-02T18:19:34.867 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.867 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.378615+0000", 2023-01-02T18:19:34.868 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0020004570000000002 2023-01-02T18:19:34.869 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.869 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.870 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:34.870 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380616+0000", 2023-01-02T18:19:34.870 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3064000000000005e-05 2023-01-02T18:19:34.871 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.871 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.871 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380679+0000", 2023-01-02T18:19:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9119000000000002e-05 2023-01-02T18:19:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.872 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.873 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:34.873 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:26.380728+0000", 2023-01-02T18:19:34.873 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0064138590000000001 2023-01-02T18:19:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.874 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3507 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:19:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:19:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 77.955891131000001, 2023-01-02T18:19:34.875 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002, 2023-01-02T18:19:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.876 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3507 2023-01-02T18:19:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.877 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:19:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.878 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893740+0000", 2023-01-02T18:19:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.879 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893738+0000", 2023-01-02T18:19:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4447000000000001e-05 2023-01-02T18:19:34.880 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893752+0000", 2023-01-02T18:19:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8085999999999999e-05 2023-01-02T18:19:34.881 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893770+0000", 2023-01-02T18:19:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5949999999999999e-06 2023-01-02T18:19:34.882 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893779+0000", 2023-01-02T18:19:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4619000000000001e-05 2023-01-02T18:19:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.883 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893824+0000", 2023-01-02T18:19:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0294000000000002e-05 2023-01-02T18:19:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.884 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.893894+0000", 2023-01-02T18:19:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00034635200000000002 2023-01-02T18:19:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.885 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.894240+0000", 2023-01-02T18:19:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024283040000000001 2023-01-02T18:19:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.886 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.896669+0000", 2023-01-02T18:19:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0018365300000000001 2023-01-02T18:19:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.887 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898505+0000", 2023-01-02T18:19:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2230000000000001e-05 2023-01-02T18:19:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.888 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898537+0000", 2023-01-02T18:19:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6251e-05 2023-01-02T18:19:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.889 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:16.898564+0000", 2023-01-02T18:19:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048235220000000002 2023-01-02T18:19:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.890 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.891 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3508 13.3 13:c320b604:::rbd_data.12.12a21d7fc3ba.0000000000000003:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e134)", 2023-01-02T18:19:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:19:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.950787574000003, 2023-01-02T18:19:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001, 2023-01-02T18:19:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.892 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:34.893 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3508 2023-01-02T18:19:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.894 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.895 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.895 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:19:34.896 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.896 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.896 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.897 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.897 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898844+0000", 2023-01-02T18:19:34.897 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:34.898 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.898 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.898 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898841+0000", 2023-01-02T18:19:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5335000000000001e-05 2023-01-02T18:19:34.899 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.900 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898867+0000", 2023-01-02T18:19:34.901 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3323999999999999e-05 2023-01-02T18:19:34.901 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.901 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898890+0000", 2023-01-02T18:19:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8820000000000007e-06 2023-01-02T18:19:34.902 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898899+0000", 2023-01-02T18:19:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1070999999999999e-05 2023-01-02T18:19:34.903 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.898950+0000", 2023-01-02T18:19:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.2550000000000002e-05 2023-01-02T18:19:34.904 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899022+0000", 2023-01-02T18:19:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000317836 2023-01-02T18:19:34.905 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.899340+0000", 2023-01-02T18:19:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002728931 2023-01-02T18:19:34.906 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.902069+0000", 2023-01-02T18:19:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014209419999999999 2023-01-02T18:19:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.907 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903490+0000", 2023-01-02T18:19:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3368000000000003e-05 2023-01-02T18:19:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.908 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903523+0000", 2023-01-02T18:19:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5165999999999999e-05 2023-01-02T18:19:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.909 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:17.903549+0000", 2023-01-02T18:19:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047050410000000001 2023-01-02T18:19:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.910 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16198 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 1536~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:34.911 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:19:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.952765267000004, 2023-01-02T18:19:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003, 2023-01-02T18:19:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.912 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16198 2023-01-02T18:19:34.913 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:19:34.914 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896866+0000", 2023-01-02T18:19:34.915 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896865+0000", 2023-01-02T18:19:34.916 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6900000000000001e-06 2023-01-02T18:19:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896868+0000", 2023-01-02T18:19:34.917 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8470000000000001e-06 2023-01-02T18:19:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896874+0000", 2023-01-02T18:19:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.447e-06 2023-01-02T18:19:34.918 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896876+0000", 2023-01-02T18:19:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001873179 2023-01-02T18:19:34.919 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898750+0000", 2023-01-02T18:19:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7626000000000005e-05 2023-01-02T18:19:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.920 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898827+0000", 2023-01-02T18:19:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012927899999999999 2023-01-02T18:19:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.921 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.898957+0000", 2023-01-02T18:19:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023139749999999998 2023-01-02T18:19:34.922 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901271+0000", 2023-01-02T18:19:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.4455000000000005e-05 2023-01-02T18:19:34.923 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901335+0000", 2023-01-02T18:19:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7706999999999994e-05 2023-01-02T18:19:34.924 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901403+0000", 2023-01-02T18:19:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.3409999999999999e-05 2023-01-02T18:19:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.925 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901446+0000", 2023-01-02T18:19:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0045802150000000003 2023-01-02T18:19:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.926 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16199 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2048~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:19:34.927 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.952752179000001, 2023-01-02T18:19:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004, 2023-01-02T18:19:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.928 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16199 2023-01-02T18:19:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.929 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:19:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.930 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:19:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.931 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896879+0000", 2023-01-02T18:19:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.69e-06 2023-01-02T18:19:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.932 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896883+0000", 2023-01-02T18:19:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2909999999999999e-06 2023-01-02T18:19:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.933 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896887+0000", 2023-01-02T18:19:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.238e-06 2023-01-02T18:19:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.934 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896889+0000", 2023-01-02T18:19:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002707919 2023-01-02T18:19:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.935 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899597+0000", 2023-01-02T18:19:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2546000000000002e-05 2023-01-02T18:19:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.936 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899639+0000", 2023-01-02T18:19:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4080999999999996e-05 2023-01-02T18:19:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.937 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899733+0000", 2023-01-02T18:19:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001771826 2023-01-02T18:19:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.938 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901505+0000", 2023-01-02T18:19:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6619999999999994e-06 2023-01-02T18:19:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:34.939 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901514+0000", 2023-01-02T18:19:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0059999999999998e-05 2023-01-02T18:19:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:34.940 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901564+0000", 2023-01-02T18:19:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1318e-05 2023-01-02T18:19:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:34.941 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901605+0000", 2023-01-02T18:19:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047263720000000004 2023-01-02T18:19:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.942 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16200 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2560~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:19:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.952739992000005, 2023-01-02T18:19:34.943 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998, 2023-01-02T18:19:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:34.944 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16200 2023-01-02T18:19:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.945 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:19:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.946 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:19:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.947 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896891+0000", 2023-01-02T18:19:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0820000000000001e-06 2023-01-02T18:19:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.948 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896893+0000", 2023-01-02T18:19:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8679999999999999e-06 2023-01-02T18:19:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.949 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896896+0000", 2023-01-02T18:19:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1390000000000002e-06 2023-01-02T18:19:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896898+0000", 2023-01-02T18:19:34.950 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032553590000000002 2023-01-02T18:19:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900153+0000", 2023-01-02T18:19:34.951 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8237000000000003e-05 2023-01-02T18:19:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900232+0000", 2023-01-02T18:19:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00018062300000000001 2023-01-02T18:19:34.952 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900412+0000", 2023-01-02T18:19:34.953 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0012047169999999999 2023-01-02T18:19:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901617+0000", 2023-01-02T18:19:34.954 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042531099999999999 2023-01-02T18:19:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902042+0000", 2023-01-02T18:19:34.955 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1499000000000003e-05 2023-01-02T18:19:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902094+0000", 2023-01-02T18:19:34.956 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9249000000000003e-05 2023-01-02T18:19:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902133+0000", 2023-01-02T18:19:34.957 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052418159999999998 2023-01-02T18:19:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.958 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16201 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:19:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.952731107999995, 2023-01-02T18:19:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004, 2023-01-02T18:19:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.959 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16201 2023-01-02T18:19:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.960 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:19:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.961 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:19:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:34.962 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896900+0000", 2023-01-02T18:19:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4200000000000001e-06 2023-01-02T18:19:34.963 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896902+0000", 2023-01-02T18:19:34.964 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8849999999999999e-06 2023-01-02T18:19:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896905+0000", 2023-01-02T18:19:34.965 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2500000000000001e-06 2023-01-02T18:19:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896907+0000", 2023-01-02T18:19:34.966 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038386549999999998 2023-01-02T18:19:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900746+0000", 2023-01-02T18:19:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8287000000000004e-05 2023-01-02T18:19:34.967 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900834+0000", 2023-01-02T18:19:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016278899999999999 2023-01-02T18:19:34.968 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.900997+0000", 2023-01-02T18:19:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0011903720000000001 2023-01-02T18:19:34.969 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902187+0000", 2023-01-02T18:19:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051634200000000004 2023-01-02T18:19:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.970 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902704+0000", 2023-01-02T18:19:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.957e-05 2023-01-02T18:19:34.971 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902733+0000", 2023-01-02T18:19:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.4341e-05 2023-01-02T18:19:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.972 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902758+0000", 2023-01-02T18:19:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058576670000000004 2023-01-02T18:19:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.973 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.974 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16202 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:19:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.952721690999994, 2023-01-02T18:19:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001, 2023-01-02T18:19:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.975 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16202 2023-01-02T18:19:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.976 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:19:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.977 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:19:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:34.978 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896909+0000", 2023-01-02T18:19:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.092e-06 2023-01-02T18:19:34.979 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896911+0000", 2023-01-02T18:19:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1019999999999999e-06 2023-01-02T18:19:34.980 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896915+0000", 2023-01-02T18:19:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7930000000000002e-06 2023-01-02T18:19:34.981 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896918+0000", 2023-01-02T18:19:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047231770000000003 2023-01-02T18:19:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.982 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901641+0000", 2023-01-02T18:19:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2209000000000002e-05 2023-01-02T18:19:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.983 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901684+0000", 2023-01-02T18:19:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000104726 2023-01-02T18:19:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.984 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.901788+0000", 2023-01-02T18:19:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0015539740000000001 2023-01-02T18:19:34.985 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903342+0000", 2023-01-02T18:19:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1817999999999998e-05 2023-01-02T18:19:34.986 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903394+0000", 2023-01-02T18:19:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.8734999999999998e-05 2023-01-02T18:19:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.987 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903423+0000", 2023-01-02T18:19:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9155000000000001e-05 2023-01-02T18:19:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.988 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903452+0000", 2023-01-02T18:19:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0065425420000000001 2023-01-02T18:19:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.989 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16203 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:19:34.990 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.952710597000006, 2023-01-02T18:19:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998, 2023-01-02T18:19:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:34.991 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16203 2023-01-02T18:19:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:34.992 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:19:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.993 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896921+0000", 2023-01-02T18:19:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.994 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896920+0000", 2023-01-02T18:19:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.1600000000000001e-06 2023-01-02T18:19:34.995 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:34.996 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896922+0000", 2023-01-02T18:19:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5219999999999999e-06 2023-01-02T18:19:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:34.997 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896926+0000", 2023-01-02T18:19:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9470000000000002e-06 2023-01-02T18:19:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:34.998 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896928+0000", 2023-01-02T18:19:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0052862669999999999 2023-01-02T18:19:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:34.999 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902214+0000", 2023-01-02T18:19:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3084999999999994e-05 2023-01-02T18:19:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902307+0000", 2023-01-02T18:19:35.000 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013711100000000001 2023-01-02T18:19:35.001 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.001 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.001 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:35.001 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902444+0000", 2023-01-02T18:19:35.001 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00090387900000000001 2023-01-02T18:19:35.002 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.002 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.002 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.002 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903348+0000", 2023-01-02T18:19:35.002 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015428300000000001 2023-01-02T18:19:35.003 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.003 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.003 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.003 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903503+0000", 2023-01-02T18:19:35.003 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7078999999999999e-05 2023-01-02T18:19:35.004 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.004 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.004 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.004 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903530+0000", 2023-01-02T18:19:35.004 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9266000000000002e-05 2023-01-02T18:19:35.005 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.005 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.005 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.005 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903549+0000", 2023-01-02T18:19:35.005 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066283369999999998 2023-01-02T18:19:35.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.006 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.006 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.006 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.006 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.006 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16204 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512] snapc 0=[] ondisk+write+known_if_redirected e140)", 2023-01-02T18:19:35.007 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:19:35.007 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.952701148000003, 2023-01-02T18:19:35.007 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996, 2023-01-02T18:19:35.007 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.008 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.008 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.008 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.008 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.008 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16204 2023-01-02T18:19:35.009 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.009 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.009 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.009 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.009 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:19:35.010 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.010 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.010 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.010 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.010 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:19:35.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:35.011 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.011 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.011 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.011 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896930+0000", 2023-01-02T18:19:35.011 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1679999999999997e-06 2023-01-02T18:19:35.012 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.012 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.012 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.012 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896934+0000", 2023-01-02T18:19:35.012 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.039e-06 2023-01-02T18:19:35.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.013 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.013 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.013 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896937+0000", 2023-01-02T18:19:35.013 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0389999999999999e-06 2023-01-02T18:19:35.013 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.014 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.014 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.014 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.896939+0000", 2023-01-02T18:19:35.014 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0058543179999999998 2023-01-02T18:19:35.015 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.015 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.015 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.015 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902793+0000", 2023-01-02T18:19:35.015 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5451999999999996e-05 2023-01-02T18:19:35.016 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.016 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.016 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.016 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902859+0000", 2023-01-02T18:19:35.016 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5087999999999996e-05 2023-01-02T18:19:35.017 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.017 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.017 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:35.017 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.902944+0000", 2023-01-02T18:19:35.017 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00086757900000000005 2023-01-02T18:19:35.018 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.018 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.018 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.018 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903811+0000", 2023-01-02T18:19:35.018 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.9238000000000002e-05 2023-01-02T18:19:35.019 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.019 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.019 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.019 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903901+0000", 2023-01-02T18:19:35.019 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0630000000000001e-05 2023-01-02T18:19:35.020 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.020 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.020 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.020 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903951+0000", 2023-01-02T18:19:35.020 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6187999999999998e-05 2023-01-02T18:19:35.021 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.021 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.021 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.021 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904007+0000", 2023-01-02T18:19:35.021 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070774999999999996 2023-01-02T18:19:35.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.022 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.022 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.022 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.022 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.023 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16205 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 0~512] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e140)", 2023-01-02T18:19:35.023 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:19:35.023 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 66.949958128999995, 2023-01-02T18:19:35.023 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868, 2023-01-02T18:19:35.023 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.023 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:35.024 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.024 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.024 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.024 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16205 2023-01-02T18:19:35.024 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.025 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.025 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.025 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.025 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:19:35.025 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.026 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.026 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.026 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.026 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899673+0000", 2023-01-02T18:19:35.026 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:35.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.027 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.027 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.027 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899672+0000", 2023-01-02T18:19:35.027 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2650000000000004e-06 2023-01-02T18:19:35.027 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.028 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.028 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.028 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899677+0000", 2023-01-02T18:19:35.028 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.1850000000000004e-06 2023-01-02T18:19:35.029 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.029 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.029 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.029 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899686+0000", 2023-01-02T18:19:35.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.4259999999999996e-06 2023-01-02T18:19:35.030 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.030 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.030 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.030 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.899690+0000", 2023-01-02T18:19:35.030 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003576512 2023-01-02T18:19:35.031 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.031 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.031 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.031 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903266+0000", 2023-01-02T18:19:35.031 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5141000000000005e-05 2023-01-02T18:19:35.032 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.032 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.032 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:19:35.032 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.903332+0000", 2023-01-02T18:19:35.032 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00070156899999999998 2023-01-02T18:19:35.033 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.033 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.033 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.033 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904033+0000", 2023-01-02T18:19:35.033 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0550000000000003e-05 2023-01-02T18:19:35.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.034 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.034 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.034 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904074+0000", 2023-01-02T18:19:35.034 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7970000000000001e-05 2023-01-02T18:19:35.034 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.035 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.035 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.035 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.904142+0000", 2023-01-02T18:19:35.035 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00446868 2023-01-02T18:19:35.035 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.036 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.036 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.036 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.036 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.036 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28602 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 146432~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e143)", 2023-01-02T18:19:35.037 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:19:35.037 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.911973725999999, 2023-01-02T18:19:35.037 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996, 2023-01-02T18:19:35.037 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.037 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:35.037 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.038 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.038 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.038 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28602 2023-01-02T18:19:35.038 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.039 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.039 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.039 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.039 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:19:35.039 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.040 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.040 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.040 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.040 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937657+0000", 2023-01-02T18:19:35.040 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:35.041 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.041 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.041 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.041 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937656+0000", 2023-01-02T18:19:35.041 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3520000000000003e-06 2023-01-02T18:19:35.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.042 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.042 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.042 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937663+0000", 2023-01-02T18:19:35.042 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4744e-05 2023-01-02T18:19:35.042 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.043 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.043 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.043 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937677+0000", 2023-01-02T18:19:35.043 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5119999999999997e-06 2023-01-02T18:19:35.043 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.044 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.044 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.044 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937684+0000", 2023-01-02T18:19:35.044 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2098999999999997e-05 2023-01-02T18:19:35.044 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.045 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.045 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.045 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937736+0000", 2023-01-02T18:19:35.045 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:19:35.045 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.046 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.046 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.937745+0000", 2023-01-02T18:19:35.046 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073198109999999999 2023-01-02T18:19:35.046 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.046 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.047 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.047 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945065+0000", 2023-01-02T18:19:35.047 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1624000000000002e-05 2023-01-02T18:19:35.047 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.047 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.048 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945156+0000", 2023-01-02T18:19:35.048 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000123879 2023-01-02T18:19:35.048 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.048 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.048 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.049 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:30.945280+0000", 2023-01-02T18:19:35.049 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0076228829999999996 2023-01-02T18:19:35.050 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.050 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.050 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.050 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.050 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.051 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:28808 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [assert-version v64,write 0~512] snapc 0=[] ondisk+write+known_if_redirected e143)", 2023-01-02T18:19:35.051 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:19:35.051 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 63.836795447, 2023-01-02T18:19:35.051 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002, 2023-01-02T18:19:35.052 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.052 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.052 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.052 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.053 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.053 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 28808 2023-01-02T18:19:35.053 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.053 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.053 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.054 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.054 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:19:35.054 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.054 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.054 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.055 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.055 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012836+0000", 2023-01-02T18:19:35.055 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:35.055 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.055 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.056 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.056 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012835+0000", 2023-01-02T18:19:35.056 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0229999999999998e-06 2023-01-02T18:19:35.056 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.056 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.057 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.057 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012841+0000", 2023-01-02T18:19:35.057 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1938e-05 2023-01-02T18:19:35.057 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.057 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.058 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.058 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012853+0000", 2023-01-02T18:19:35.058 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.5520000000000004e-06 2023-01-02T18:19:35.058 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.058 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.059 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.059 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012858+0000", 2023-01-02T18:19:35.059 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9961999999999999e-05 2023-01-02T18:19:35.059 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.059 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.060 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.060 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012888+0000", 2023-01-02T18:19:35.060 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2904e-05 2023-01-02T18:19:35.060 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.060 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.061 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.061 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012941+0000", 2023-01-02T18:19:35.061 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016403699999999999 2023-01-02T18:19:35.061 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.061 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:35.062 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013105+0000", 2023-01-02T18:19:35.062 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00074456399999999997 2023-01-02T18:19:35.062 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.062 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.062 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.063 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013850+0000", 2023-01-02T18:19:35.063 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027539999999999999 2023-01-02T18:19:35.063 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.063 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.063 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016604+0000", 2023-01-02T18:19:35.064 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4141999999999999e-05 2023-01-02T18:19:35.064 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.064 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.064 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.064 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016638+0000", 2023-01-02T18:19:35.065 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7827000000000002e-05 2023-01-02T18:19:35.065 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.065 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.065 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.065 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016676+0000", 2023-01-02T18:19:35.066 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038399380000000002 2023-01-02T18:19:35.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.066 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.066 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.066 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.067 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.067 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41666 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3072~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:35.067 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:19:35.067 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.472136736000003, 2023-01-02T18:19:35.067 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043435039999999998, 2023-01-02T18:19:35.067 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.068 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.068 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.068 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.068 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.068 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41666 2023-01-02T18:19:35.069 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.069 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.069 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.069 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:19:35.070 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.070 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.070 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.070 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.071 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:19:35.071 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:35.073 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.073 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.073 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.073 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377494+0000", 2023-01-02T18:19:35.074 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7869999999999999e-06 2023-01-02T18:19:35.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.074 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.074 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.074 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377498+0000", 2023-01-02T18:19:35.075 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.7349999999999999e-06 2023-01-02T18:19:35.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.075 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.075 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.075 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377505+0000", 2023-01-02T18:19:35.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9289999999999997e-06 2023-01-02T18:19:35.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.076 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.076 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.076 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377509+0000", 2023-01-02T18:19:35.076 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0028717389999999999 2023-01-02T18:19:35.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.077 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.077 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380381+0000", 2023-01-02T18:19:35.077 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2969999999999997e-05 2023-01-02T18:19:35.078 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.078 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.078 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.078 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380424+0000", 2023-01-02T18:19:35.078 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000107729 2023-01-02T18:19:35.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.079 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.079 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:35.079 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380532+0000", 2023-01-02T18:19:35.079 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001230039 2023-01-02T18:19:35.079 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.080 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.080 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.080 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381762+0000", 2023-01-02T18:19:35.080 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0010000000000007e-06 2023-01-02T18:19:35.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381771+0000", 2023-01-02T18:19:35.081 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6591999999999997e-05 2023-01-02T18:19:35.082 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.082 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.082 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.083 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381818+0000", 2023-01-02T18:19:35.083 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0386000000000001e-05 2023-01-02T18:19:35.083 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.083 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.084 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.084 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381838+0000", 2023-01-02T18:19:35.084 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043435039999999998 2023-01-02T18:19:35.084 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.084 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.085 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.085 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.085 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.085 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41667 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3584~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:35.085 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:19:35.086 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.472117066999999, 2023-01-02T18:19:35.086 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048409819999999998, 2023-01-02T18:19:35.086 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.086 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.086 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.087 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.087 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.087 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41667 2023-01-02T18:19:35.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.087 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.088 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.088 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:19:35.088 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.088 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.088 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.089 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.089 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:19:35.089 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:35.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.089 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.090 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.090 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377514+0000", 2023-01-02T18:19:35.090 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2910000000000001e-06 2023-01-02T18:19:35.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.091 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.091 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377518+0000", 2023-01-02T18:19:35.091 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9619999999999996e-06 2023-01-02T18:19:35.091 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.091 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.092 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.092 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377525+0000", 2023-01-02T18:19:35.092 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0780000000000001e-06 2023-01-02T18:19:35.092 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.092 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.093 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.093 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377531+0000", 2023-01-02T18:19:35.093 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0032340340000000002 2023-01-02T18:19:35.094 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.094 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.094 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.094 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380765+0000", 2023-01-02T18:19:35.094 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1267999999999999e-05 2023-01-02T18:19:35.095 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.095 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.095 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.095 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380806+0000", 2023-01-02T18:19:35.095 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.975e-05 2023-01-02T18:19:35.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.096 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.096 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:35.096 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.380886+0000", 2023-01-02T18:19:35.096 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00098581100000000007 2023-01-02T18:19:35.097 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.097 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.097 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.097 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381872+0000", 2023-01-02T18:19:35.097 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00042798899999999998 2023-01-02T18:19:35.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.098 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.098 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.098 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382300+0000", 2023-01-02T18:19:35.098 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2042000000000003e-05 2023-01-02T18:19:35.099 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.099 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.099 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.099 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382332+0000", 2023-01-02T18:19:35.099 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.3221999999999999e-05 2023-01-02T18:19:35.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.100 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.100 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.100 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382355+0000", 2023-01-02T18:19:35.100 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0048409819999999998 2023-01-02T18:19:35.100 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.101 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.101 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.101 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.101 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.101 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41668 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4096~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:35.102 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:19:35.102 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.472095471999999, 2023-01-02T18:19:35.102 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010315690000000001, 2023-01-02T18:19:35.102 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.103 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.103 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41668 2023-01-02T18:19:35.103 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.104 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.104 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.104 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.104 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:19:35.104 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.105 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.105 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.105 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377536+0000", 2023-01-02T18:19:35.105 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:35.106 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.106 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.106 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.106 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377535+0000", 2023-01-02T18:19:35.106 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7050000000000001e-06 2023-01-02T18:19:35.107 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.107 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.107 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.107 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377539+0000", 2023-01-02T18:19:35.107 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.8710000000000003e-06 2023-01-02T18:19:35.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.108 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.108 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.108 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377548+0000", 2023-01-02T18:19:35.108 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.5299999999999998e-06 2023-01-02T18:19:35.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.109 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.109 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.109 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377552+0000", 2023-01-02T18:19:35.109 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0037753740000000002 2023-01-02T18:19:35.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.110 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.110 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.110 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381328+0000", 2023-01-02T18:19:35.110 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7478000000000002e-05 2023-01-02T18:19:35.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.111 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.111 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381375+0000", 2023-01-02T18:19:35.111 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000103408 2023-01-02T18:19:35.111 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.112 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:35.112 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381478+0000", 2023-01-02T18:19:35.112 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00088558899999999999 2023-01-02T18:19:35.112 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.113 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.114 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382364+0000", 2023-01-02T18:19:35.114 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053292160000000003 2023-01-02T18:19:35.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.115 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.115 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387693+0000", 2023-01-02T18:19:35.116 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2136e-05 2023-01-02T18:19:35.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.117 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.117 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387785+0000", 2023-01-02T18:19:35.117 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5914000000000006e-05 2023-01-02T18:19:35.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.118 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.119 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387851+0000", 2023-01-02T18:19:35.119 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010315690000000001 2023-01-02T18:19:35.119 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.119 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.120 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.120 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41669 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4608~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:35.120 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:19:35.120 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.472074472000003, 2023-01-02T18:19:35.121 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010395639, 2023-01-02T18:19:35.121 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.121 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.121 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.121 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.122 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.122 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41669 2023-01-02T18:19:35.122 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.122 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.122 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.123 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.123 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:19:35.123 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.124 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377557+0000", 2023-01-02T18:19:35.124 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:35.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.124 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.125 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377556+0000", 2023-01-02T18:19:35.125 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.1570000000000003e-06 2023-01-02T18:19:35.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377563+0000", 2023-01-02T18:19:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1639999999999998e-06 2023-01-02T18:19:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377570+0000", 2023-01-02T18:19:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0329999999999999e-06 2023-01-02T18:19:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.128 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.377575+0000", 2023-01-02T18:19:35.128 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0043243480000000004 2023-01-02T18:19:35.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.128 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.128 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.129 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381899+0000", 2023-01-02T18:19:35.129 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.7437e-05 2023-01-02T18:19:35.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.129 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.130 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.381946+0000", 2023-01-02T18:19:35.130 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.5799999999999998e-05 2023-01-02T18:19:35.130 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.130 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.130 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382042+0000", 2023-01-02T18:19:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00054838499999999997 2023-01-02T18:19:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.131 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382591+0000", 2023-01-02T18:19:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0053095540000000002 2023-01-02T18:19:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.132 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387900+0000", 2023-01-02T18:19:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5627e-05 2023-01-02T18:19:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.133 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387926+0000", 2023-01-02T18:19:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.6576000000000001e-05 2023-01-02T18:19:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.134 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387952+0000", 2023-01-02T18:19:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010395639 2023-01-02T18:19:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.135 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:41670 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [cmpext 0~512,write 0~512 [fadvise_dontneed]] snapc 0=[] ondisk+write+known_if_redirected e150)", 2023-01-02T18:19:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:19:35.136 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.470179987000002, 2023-01-02T18:19:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0096660940000000001, 2023-01-02T18:19:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.137 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 41670 2023-01-02T18:19:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.138 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:19:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.139 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379451+0000", 2023-01-02T18:19:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.140 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379450+0000", 2023-01-02T18:19:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1359999999999996e-06 2023-01-02T18:19:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.141 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379455+0000", 2023-01-02T18:19:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1508999999999999e-05 2023-01-02T18:19:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.142 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379467+0000", 2023-01-02T18:19:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0369999999999997e-06 2023-01-02T18:19:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.143 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.379474+0000", 2023-01-02T18:19:35.144 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029082439999999999 2023-01-02T18:19:35.144 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.144 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.144 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.144 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382382+0000", 2023-01-02T18:19:35.145 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.5390999999999998e-05 2023-01-02T18:19:35.145 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.145 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.145 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for rw locks", 2023-01-02T18:19:35.145 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.382448+0000", 2023-01-02T18:19:35.146 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055373549999999999 2023-01-02T18:19:35.146 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.146 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.146 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.387985+0000", 2023-01-02T18:19:35.147 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2169999999999998e-05 2023-01-02T18:19:35.147 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.147 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.147 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.147 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388027+0000", 2023-01-02T18:19:35.148 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013321900000000001 2023-01-02T18:19:35.148 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.148 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.148 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:35.149 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388160+0000", 2023-01-02T18:19:35.149 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00050349900000000003 2023-01-02T18:19:35.149 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.149 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.149 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.150 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.388664+0000", 2023-01-02T18:19:35.150 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00040003400000000001 2023-01-02T18:19:35.150 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.150 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.150 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389064+0000", 2023-01-02T18:19:35.151 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2549999999999998e-05 2023-01-02T18:19:35.151 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.151 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.151 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.151 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389096+0000", 2023-01-02T18:19:35.152 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0778999999999999e-05 2023-01-02T18:19:35.152 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.152 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.152 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.152 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.389117+0000", 2023-01-02T18:19:35.153 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0096660940000000001 2023-01-02T18:19:35.153 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.153 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.154 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.154 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.154 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.155 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:42207 3.b 3:d2325361:::rbd_data.12a24628541e.0000000000000000:head [read 44548~512] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected e150)", 2023-01-02T18:19:35.155 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:19:35.156 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 49.310098992999997, 2023-01-02T18:19:35.156 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024391863999999999, 2023-01-02T18:19:35.156 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.157 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:35.157 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.157 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.158 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.158 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 42207 2023-01-02T18:19:35.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.159 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.159 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.160 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:19:35.160 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.161 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.161 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539532+0000", 2023-01-02T18:19:35.161 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:35.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.162 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.162 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.162 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539531+0000", 2023-01-02T18:19:35.162 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.822e-06 2023-01-02T18:19:35.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.163 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.163 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539535+0000", 2023-01-02T18:19:35.163 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.2060000000000004e-06 2023-01-02T18:19:35.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.164 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.164 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.164 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539541+0000", 2023-01-02T18:19:35.164 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0029999999999999e-06 2023-01-02T18:19:35.165 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.165 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.165 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539544+0000", 2023-01-02T18:19:35.165 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5829e-05 2023-01-02T18:19:35.166 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.166 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.166 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.166 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539570+0000", 2023-01-02T18:19:35.167 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.5000999999999999e-05 2023-01-02T18:19:35.167 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.167 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.167 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.167 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.539605+0000", 2023-01-02T18:19:35.168 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024318678999999999 2023-01-02T18:19:35.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.168 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.168 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.168 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:45.563924+0000", 2023-01-02T18:19:35.169 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.024391863999999999 2023-01-02T18:19:35.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.169 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.170 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.170 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.170 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:54299 14.1a 14:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected e154)", 2023-01-02T18:19:35.170 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:19:35.170 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 43.164928558, 2023-01-02T18:19:35.171 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063022640000000001, 2023-01-02T18:19:35.171 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.171 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.171 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.171 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.172 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.172 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 54299 2023-01-02T18:19:35.172 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.172 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.172 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.173 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.173 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:19:35.173 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.173 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.174 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.174 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.174 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684703+0000", 2023-01-02T18:19:35.174 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:35.174 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.175 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.175 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.175 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684700+0000", 2023-01-02T18:19:35.175 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4088e-05 2023-01-02T18:19:35.175 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.176 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.176 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.176 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684714+0000", 2023-01-02T18:19:35.176 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6232e-05 2023-01-02T18:19:35.176 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.177 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.177 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.177 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684730+0000", 2023-01-02T18:19:35.177 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5450000000000003e-06 2023-01-02T18:19:35.177 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.178 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.178 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.178 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684739+0000", 2023-01-02T18:19:35.178 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8902e-05 2023-01-02T18:19:35.178 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.179 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.179 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.179 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684788+0000", 2023-01-02T18:19:35.179 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2610000000000001e-06 2023-01-02T18:19:35.180 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.180 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.180 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.180 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.684793+0000", 2023-01-02T18:19:35.180 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001184554 2023-01-02T18:19:35.181 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.181 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.181 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.181 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.685978+0000", 2023-01-02T18:19:35.181 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013823899999999999 2023-01-02T18:19:35.182 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.182 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.182 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.182 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.686116+0000", 2023-01-02T18:19:35.182 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003439442 2023-01-02T18:19:35.183 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.183 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.183 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 1", 2023-01-02T18:19:35.183 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.689555+0000", 2023-01-02T18:19:35.184 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000894128 2023-01-02T18:19:35.184 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.184 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.184 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.184 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690450+0000", 2023-01-02T18:19:35.185 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00049250100000000001 2023-01-02T18:19:35.185 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.185 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.185 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.186 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690942+0000", 2023-01-02T18:19:35.186 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.7042000000000002e-05 2023-01-02T18:19:35.186 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.186 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.186 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.187 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.690979+0000", 2023-01-02T18:19:35.187 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5789999999999999e-05 2023-01-02T18:19:35.187 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.187 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.187 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.188 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:51.691005+0000", 2023-01-02T18:19:35.188 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0063022640000000001 2023-01-02T18:19:35.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.188 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.188 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.189 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.189 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.189 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:35.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-01-02T18:19:35.191 INFO:tasks.ceph.osd.7.smithi057.stderr:2023-01-02T18:19:35.191+0000 7f10506cb700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 106897) UID: 0 2023-01-02T18:19:35.292 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:35.293+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:35.319 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:35.320 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:35.320 INFO:teuthology.orchestra.run.smithi007.stdout: "num_ops": 0 2023-01-02T18:19:35.320 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:35.330 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-01-02T18:19:35.392 INFO:tasks.ceph.osd.6.smithi057.stderr:2023-01-02T18:19:35.393+0000 7fed5a416700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 106893) UID: 0 2023-01-02T18:19:35.469 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:35.470 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [], 2023-01-02T18:19:35.470 INFO:teuthology.orchestra.run.smithi007.stdout: "complaint_time": 30, 2023-01-02T18:19:35.470 INFO:teuthology.orchestra.run.smithi007.stdout: "num_blocked_ops": 0 2023-01-02T18:19:35.470 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-01-02T18:19:35.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-01-02T18:19:35.524 INFO:tasks.ceph.osd.1.smithi007.stderr:2023-01-02T18:19:35.525+0000 7f5a6eabf700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 107038) UID: 0 2023-01-02T18:19:35.593 INFO:tasks.ceph.osd.3.smithi007.stderr:2023-01-02T18:19:35.594+0000 7f28c98e2700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 107050) UID: 0 2023-01-02T18:19:35.608 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-01-02T18:19:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 20, 2023-01-02T18:19:35.608 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 600, 2023-01-02T18:19:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: "ops": [ 2023-01-02T18:19:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4565.0:246 5.1a e55/54 5:5cea7035:::rbd_info:head v 55'1, mlcod=0'0)", 2023-01-02T18:19:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:19:35.609 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 167.27922051199999, 2023-01-02T18:19:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413, 2023-01-02T18:19:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.610 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:19:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.611 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328528+0000", 2023-01-02T18:19:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.612 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328527+0000", 2023-01-02T18:19:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.826e-06 2023-01-02T18:19:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.613 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328532+0000", 2023-01-02T18:19:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.7840000000000004e-06 2023-01-02T18:19:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.614 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328540+0000", 2023-01-02T18:19:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8839999999999997e-06 2023-01-02T18:19:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328547+0000", 2023-01-02T18:19:35.615 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6513000000000005e-05 2023-01-02T18:19:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328613+0000", 2023-01-02T18:19:35.616 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.0021e-05 2023-01-02T18:19:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.328633+0000", 2023-01-02T18:19:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0073953760000000004 2023-01-02T18:19:35.617 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336029+0000", 2023-01-02T18:19:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.3055000000000001e-05 2023-01-02T18:19:35.618 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:16:48.336062+0000", 2023-01-02T18:19:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00753413 2023-01-02T18:19:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.619 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:2775 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e82)", 2023-01-02T18:19:35.620 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:19:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 140.26972511700001, 2023-01-02T18:19:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001, 2023-01-02T18:19:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:35.621 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2775 2023-01-02T18:19:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.622 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:19:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.623 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338023+0000", 2023-01-02T18:19:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.624 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338021+0000", 2023-01-02T18:19:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6340000000000003e-06 2023-01-02T18:19:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.625 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338028+0000", 2023-01-02T18:19:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0808000000000001e-05 2023-01-02T18:19:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.626 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338039+0000", 2023-01-02T18:19:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.002e-06 2023-01-02T18:19:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.627 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338046+0000", 2023-01-02T18:19:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.7179999999999998e-05 2023-01-02T18:19:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338103+0000", 2023-01-02T18:19:35.628 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0152999999999999e-05 2023-01-02T18:19:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.338113+0000", 2023-01-02T18:19:35.629 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033193300000000001 2023-01-02T18:19:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341432+0000", 2023-01-02T18:19:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4735999999999996e-05 2023-01-02T18:19:35.630 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341527+0000", 2023-01-02T18:19:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010419199999999999 2023-01-02T18:19:35.631 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:15.341631+0000", 2023-01-02T18:19:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0036083560000000001 2023-01-02T18:19:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.632 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2200 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e87)", 2023-01-02T18:19:35.633 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:19:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 135.256667526, 2023-01-02T18:19:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999, 2023-01-02T18:19:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.634 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:19:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2200 2023-01-02T18:19:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.635 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:19:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.636 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351081+0000", 2023-01-02T18:19:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.637 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351079+0000", 2023-01-02T18:19:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0241000000000001e-05 2023-01-02T18:19:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351089+0000", 2023-01-02T18:19:35.638 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6928000000000001e-05 2023-01-02T18:19:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351106+0000", 2023-01-02T18:19:35.639 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0589999999999992e-06 2023-01-02T18:19:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351115+0000", 2023-01-02T18:19:35.640 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3344999999999997e-05 2023-01-02T18:19:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351178+0000", 2023-01-02T18:19:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0113e-05 2023-01-02T18:19:35.641 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.351188+0000", 2023-01-02T18:19:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0031219379999999999 2023-01-02T18:19:35.642 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354310+0000", 2023-01-02T18:19:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100023 2023-01-02T18:19:35.643 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354410+0000", 2023-01-02T18:19:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00013857600000000001 2023-01-02T18:19:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.644 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:20.354549+0000", 2023-01-02T18:19:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0034681709999999999 2023-01-02T18:19:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.645 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2209 3.0 3:067d99e2:::rbd_object_map.11d5ac377738.000000000000000f:head [writefull 0~35] snapc 0=[] ondisk+write+known_if_redirected e88)", 2023-01-02T18:19:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:19:35.646 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 134.24659229599999, 2023-01-02T18:19:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002, 2023-01-02T18:19:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:19:35.647 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2209 2023-01-02T18:19:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.648 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:19:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.649 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361156+0000", 2023-01-02T18:19:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.650 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361154+0000", 2023-01-02T18:19:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0030999999999999e-05 2023-01-02T18:19:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361164+0000", 2023-01-02T18:19:35.651 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7569999999999999e-05 2023-01-02T18:19:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361182+0000", 2023-01-02T18:19:35.652 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.6789999999999999e-06 2023-01-02T18:19:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361188+0000", 2023-01-02T18:19:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.0868999999999997e-05 2023-01-02T18:19:35.653 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361239+0000", 2023-01-02T18:19:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.6910000000000002e-06 2023-01-02T18:19:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.654 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.361245+0000", 2023-01-02T18:19:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0024014040000000002 2023-01-02T18:19:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.655 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363646+0000", 2023-01-02T18:19:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014791699999999999 2023-01-02T18:19:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.656 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363794+0000", 2023-01-02T18:19:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00015939200000000001 2023-01-02T18:19:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.657 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.363954+0000", 2023-01-02T18:19:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.001679645 2023-01-02T18:19:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.658 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.365633+0000", 2023-01-02T18:19:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014164010000000001 2023-01-02T18:19:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.659 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367050+0000", 2023-01-02T18:19:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.9949e-05 2023-01-02T18:19:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.660 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367090+0000", 2023-01-02T18:19:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2910000000000002e-05 2023-01-02T18:19:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.661 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:21.367122+0000", 2023-01-02T18:19:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0059666800000000002 2023-01-02T18:19:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.662 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:2280 3.1a 3:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected e92)", 2023-01-02T18:19:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:19:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 130.28344251199999, 2023-01-02T18:19:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654, 2023-01-02T18:19:35.663 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "started", 2023-01-02T18:19:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:19:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:35.664 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 2280 2023-01-02T18:19:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:19:35.665 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324306+0000", 2023-01-02T18:19:35.666 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324304+0000", 2023-01-02T18:19:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.6640000000000004e-06 2023-01-02T18:19:35.667 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324312+0000", 2023-01-02T18:19:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4076e-05 2023-01-02T18:19:35.668 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324326+0000", 2023-01-02T18:19:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.3710000000000002e-06 2023-01-02T18:19:35.669 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324334+0000", 2023-01-02T18:19:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1201000000000001e-05 2023-01-02T18:19:35.670 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324375+0000", 2023-01-02T18:19:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.1510000000000003e-06 2023-01-02T18:19:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.671 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.324380+0000", 2023-01-02T18:19:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030771520000000001 2023-01-02T18:19:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.672 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327457+0000", 2023-01-02T18:19:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7645000000000005e-05 2023-01-02T18:19:35.673 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327545+0000", 2023-01-02T18:19:35.674 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010935899999999999 2023-01-02T18:19:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.675 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:25.327654+0000", 2023-01-02T18:19:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003348654 2023-01-02T18:19:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.676 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.677 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.677 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.677 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:2819 10.1c e101/98 10:3b239907:::rbd_id.image42:head v 101'3, mlcod=0'0)", 2023-01-02T18:19:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:19:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 121.278145822, 2023-01-02T18:19:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001, 2023-01-02T18:19:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.678 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:19:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.679 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:19:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:35.680 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329602+0000", 2023-01-02T18:19:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.0249e-05 2023-01-02T18:19:35.681 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329612+0000", 2023-01-02T18:19:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0799999999999995e-06 2023-01-02T18:19:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.682 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329621+0000", 2023-01-02T18:19:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9099999999999999e-06 2023-01-02T18:19:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.683 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.329628+0000", 2023-01-02T18:19:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002392838 2023-01-02T18:19:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.684 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332021+0000", 2023-01-02T18:19:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9358e-05 2023-01-02T18:19:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.685 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.332040+0000", 2023-01-02T18:19:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022067599999999999 2023-01-02T18:19:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.686 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334247+0000", 2023-01-02T18:19:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8139000000000002e-05 2023-01-02T18:19:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.687 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:34.334285+0000", 2023-01-02T18:19:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0046825840000000001 2023-01-02T18:19:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.688 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3333 11.14 e107/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 107'2, mlcod=0'0)", 2023-01-02T18:19:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:19:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 111.225697004, 2023-01-02T18:19:35.689 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998, 2023-01-02T18:19:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.690 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:19:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.691 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382051+0000", 2023-01-02T18:19:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.692 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.382049+0000", 2023-01-02T18:19:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0021750200000000002 2023-01-02T18:19:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.693 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384224+0000", 2023-01-02T18:19:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.7612e-05 2023-01-02T18:19:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.694 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384242+0000", 2023-01-02T18:19:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.4879999999999996e-06 2023-01-02T18:19:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.695 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384252+0000", 2023-01-02T18:19:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00014140600000000001 2023-01-02T18:19:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384393+0000", 2023-01-02T18:19:35.696 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1773000000000002e-05 2023-01-02T18:19:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.384425+0000", 2023-01-02T18:19:35.697 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023692769999999999 2023-01-02T18:19:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386794+0000", 2023-01-02T18:19:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0617000000000002e-05 2023-01-02T18:19:35.698 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:44.386825+0000", 2023-01-02T18:19:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047735299999999998 2023-01-02T18:19:35.699 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3334 11.14 e108/102 11:2f92dfc7:::rbd_data.12a2d6b452e6.0000000000000001:head v 108'3, mlcod=107'1)", 2023-01-02T18:19:35.700 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:19:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 110.21821611599999, 2023-01-02T18:19:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318, 2023-01-02T18:19:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.701 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:19:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.702 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389532+0000", 2023-01-02T18:19:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.703 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.389530+0000", 2023-01-02T18:19:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0014828199999999999 2023-01-02T18:19:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.704 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391013+0000", 2023-01-02T18:19:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6222000000000002e-05 2023-01-02T18:19:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.705 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391029+0000", 2023-01-02T18:19:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.686e-06 2023-01-02T18:19:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.706 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391036+0000", 2023-01-02T18:19:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.8513e-05 2023-01-02T18:19:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.707 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391095+0000", 2023-01-02T18:19:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7436999999999998e-05 2023-01-02T18:19:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.708 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.391122+0000", 2023-01-02T18:19:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0019229010000000001 2023-01-02T18:19:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393045+0000", 2023-01-02T18:19:35.709 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9368000000000001e-05 2023-01-02T18:19:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:45.393074+0000", 2023-01-02T18:19:35.710 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003542318 2023-01-02T18:19:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.711 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3347 11.15 e116/102 11:ab1cdcf7:::rbd_data.12a2d6b452e6.0000000000000003:head v 116'4, mlcod=115'2)", 2023-01-02T18:19:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:19:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 101.166190883, 2023-01-02T18:19:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002, 2023-01-02T18:19:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.712 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:19:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.713 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441557+0000", 2023-01-02T18:19:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999986 2023-01-02T18:19:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.714 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.441556+0000", 2023-01-02T18:19:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00058816999999999995 2023-01-02T18:19:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.715 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442144+0000", 2023-01-02T18:19:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8885e-05 2023-01-02T18:19:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.716 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442163+0000", 2023-01-02T18:19:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.7369999999999995e-06 2023-01-02T18:19:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.717 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442171+0000", 2023-01-02T18:19:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0236999999999999e-05 2023-01-02T18:19:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.718 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442242+0000", 2023-01-02T18:19:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.6900000000000001e-05 2023-01-02T18:19:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.719 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.442259+0000", 2023-01-02T18:19:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002261224 2023-01-02T18:19:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.720 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444520+0000", 2023-01-02T18:19:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3904000000000003e-05 2023-01-02T18:19:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.721 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:17:54.444584+0000", 2023-01-02T18:19:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030265320000000002 2023-01-02T18:19:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.722 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3493 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e127)", 2023-01-02T18:19:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:19:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 87.766084429000003, 2023-01-02T18:19:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998, 2023-01-02T18:19:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.723 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3493 2023-01-02T18:19:35.724 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:19:35.725 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.726 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.726 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.726 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841664+0000", 2023-01-02T18:19:35.726 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:35.726 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.727 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.727 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841661+0000", 2023-01-02T18:19:35.727 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8811999999999999e-05 2023-01-02T18:19:35.727 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.727 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.728 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.728 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841680+0000", 2023-01-02T18:19:35.728 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9380000000000001e-05 2023-01-02T18:19:35.728 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.728 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.729 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.729 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841699+0000", 2023-01-02T18:19:35.729 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.2569999999999996e-06 2023-01-02T18:19:35.729 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.729 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.730 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841709+0000", 2023-01-02T18:19:35.730 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00010059 2023-01-02T18:19:35.730 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.730 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.730 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.731 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841809+0000", 2023-01-02T18:19:35.731 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.3533e-05 2023-01-02T18:19:35.731 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.731 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.731 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.841903+0000", 2023-01-02T18:19:35.732 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00036800899999999998 2023-01-02T18:19:35.732 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.732 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.732 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:35.732 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.842271+0000", 2023-01-02T18:19:35.733 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033624560000000002 2023-01-02T18:19:35.733 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.733 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.733 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.733 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845633+0000", 2023-01-02T18:19:35.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00020175099999999999 2023-01-02T18:19:35.734 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.734 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.734 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.734 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845835+0000", 2023-01-02T18:19:35.734 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.1019999999999998e-05 2023-01-02T18:19:35.735 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.735 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.735 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.735 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845866+0000", 2023-01-02T18:19:35.735 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7328999999999999e-05 2023-01-02T18:19:35.736 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.736 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.736 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.736 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:07.845893+0000", 2023-01-02T18:19:35.736 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0042296119999999998 2023-01-02T18:19:35.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.737 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.737 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.737 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.737 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.738 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3494 13.10 13:0e08ca60:::rbd_data.12.12a21d7fc3ba.0000000000000001:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e128)", 2023-01-02T18:19:35.738 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:19:35.738 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 86.761555121000001, 2023-01-02T18:19:35.738 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999, 2023-01-02T18:19:35.738 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.738 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.739 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.739 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3494 2023-01-02T18:19:35.739 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.740 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.740 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.740 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.740 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:19:35.740 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.741 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.741 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.741 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.741 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846193+0000", 2023-01-02T18:19:35.741 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:35.742 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.742 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.742 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.742 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846191+0000", 2023-01-02T18:19:35.742 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4089e-05 2023-01-02T18:19:35.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.743 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.743 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.743 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846205+0000", 2023-01-02T18:19:35.743 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.8082000000000001e-05 2023-01-02T18:19:35.743 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.744 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.744 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.744 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846223+0000", 2023-01-02T18:19:35.744 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.8790000000000003e-06 2023-01-02T18:19:35.744 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.745 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.745 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846231+0000", 2023-01-02T18:19:35.745 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000100853 2023-01-02T18:19:35.745 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.745 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.746 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.746 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846332+0000", 2023-01-02T18:19:35.746 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4294000000000004e-05 2023-01-02T18:19:35.746 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.746 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.747 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846406+0000", 2023-01-02T18:19:35.747 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000381035 2023-01-02T18:19:35.747 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.747 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.747 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:35.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.846787+0000", 2023-01-02T18:19:35.748 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0029262089999999999 2023-01-02T18:19:35.748 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.748 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.748 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.748 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849713+0000", 2023-01-02T18:19:35.749 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00022129699999999999 2023-01-02T18:19:35.749 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.749 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.749 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.749 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849934+0000", 2023-01-02T18:19:35.750 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6384000000000003e-05 2023-01-02T18:19:35.750 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.750 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.750 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.750 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.849971+0000", 2023-01-02T18:19:35.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.9811e-05 2023-01-02T18:19:35.751 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.751 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.751 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.751 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:08.850001+0000", 2023-01-02T18:19:35.751 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038075769999999999 2023-01-02T18:19:35.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.752 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.752 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.752 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.752 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.753 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:3500 13.1c e131/120 13:38bc742a:::rbd_data.12.12a21d7fc3ba.0000000000000002:head v 131'3, mlcod=130'1)", 2023-01-02T18:19:35.753 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:19:35.753 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 82.735587330000001, 2023-01-02T18:19:35.753 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999, 2023-01-02T18:19:35.753 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.754 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.754 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.754 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.754 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.754 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:19:35.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.755 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.755 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.755 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.755 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872161+0000", 2023-01-02T18:19:35.755 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999995 2023-01-02T18:19:35.756 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.756 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.756 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.756 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.872160+0000", 2023-01-02T18:19:35.756 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0022329899999999998 2023-01-02T18:19:35.757 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.757 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.757 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.757 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874393+0000", 2023-01-02T18:19:35.757 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.252e-05 2023-01-02T18:19:35.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.758 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.758 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.758 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874406+0000", 2023-01-02T18:19:35.758 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.0240000000000003e-06 2023-01-02T18:19:35.758 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.759 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.759 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.759 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874415+0000", 2023-01-02T18:19:35.759 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.0895000000000005e-05 2023-01-02T18:19:35.759 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.760 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.760 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874486+0000", 2023-01-02T18:19:35.760 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.4266e-05 2023-01-02T18:19:35.760 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.760 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.761 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.761 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.874520+0000", 2023-01-02T18:19:35.761 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0023338909999999998 2023-01-02T18:19:35.761 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.761 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.762 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876854+0000", 2023-01-02T18:19:35.762 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.3161000000000001e-05 2023-01-02T18:19:35.762 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.762 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.762 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.763 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:12.876907+0000", 2023-01-02T18:19:35.763 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0047461339999999999 2023-01-02T18:19:35.763 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.763 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.763 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.764 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.764 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.764 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:3510 13.10 13:0f559c8b:::rbd_data.12.12a21d7fc3ba.0000000000000004:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+full_try e135)", 2023-01-02T18:19:35.764 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:19:35.764 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 76.696605464000001, 2023-01-02T18:19:35.764 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999, 2023-01-02T18:19:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.765 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.766 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 3510 2023-01-02T18:19:35.766 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.766 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.766 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.766 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.767 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:19:35.767 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.767 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.767 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.767 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.769 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911143+0000", 2023-01-02T18:19:35.769 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999967 2023-01-02T18:19:35.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.770 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.770 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.770 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911139+0000", 2023-01-02T18:19:35.770 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.9587000000000001e-05 2023-01-02T18:19:35.770 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.771 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.771 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911159+0000", 2023-01-02T18:19:35.771 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.2842000000000002e-05 2023-01-02T18:19:35.771 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.771 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.772 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.772 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911192+0000", 2023-01-02T18:19:35.772 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.5116999999999999e-05 2023-01-02T18:19:35.772 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.772 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.773 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.773 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911207+0000", 2023-01-02T18:19:35.773 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000120098 2023-01-02T18:19:35.773 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.773 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.774 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911327+0000", 2023-01-02T18:19:35.774 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.536e-06 2023-01-02T18:19:35.774 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.774 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.774 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.775 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.911332+0000", 2023-01-02T18:19:35.775 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0025961489999999999 2023-01-02T18:19:35.775 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.775 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.775 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.913928+0000", 2023-01-02T18:19:35.776 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00016713700000000001 2023-01-02T18:19:35.776 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.776 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.776 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.776 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914096+0000", 2023-01-02T18:19:35.777 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00044610400000000001 2023-01-02T18:19:35.777 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.777 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.777 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 2", 2023-01-02T18:19:35.777 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.914542+0000", 2023-01-02T18:19:35.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0027693449999999999 2023-01-02T18:19:35.778 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.778 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.778 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.778 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.917311+0000", 2023-01-02T18:19:35.778 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00079338599999999998 2023-01-02T18:19:35.779 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.779 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.779 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.779 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918104+0000", 2023-01-02T18:19:35.779 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.8297000000000003e-05 2023-01-02T18:19:35.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.780 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.780 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.780 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918143+0000", 2023-01-02T18:19:35.780 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.7084e-05 2023-01-02T18:19:35.780 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.781 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.781 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.781 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:18.918170+0000", 2023-01-02T18:19:35.781 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0070271819999999999 2023-01-02T18:19:35.781 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.782 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.782 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.782 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.782 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.782 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:16265 3.6 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head [read 5632~1024] snapc 0=[] ondisk+read+balance_reads+known_if_redirected e141)", 2023-01-02T18:19:35.782 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:19:35.783 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 67.676762881000002, 2023-01-02T18:19:35.783 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055750219999999998, 2023-01-02T18:19:35.783 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.783 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "reached pg", 2023-01-02T18:19:35.783 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.784 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.784 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.784 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 16265 2023-01-02T18:19:35.784 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.784 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.785 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.785 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:19:35.785 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.785 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.785 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.786 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.786 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930985+0000", 2023-01-02T18:19:35.786 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:35.786 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.786 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.787 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.787 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930984+0000", 2023-01-02T18:19:35.787 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.8929999999999999e-06 2023-01-02T18:19:35.787 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.787 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.788 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.788 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.930991+0000", 2023-01-02T18:19:35.788 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4295e-05 2023-01-02T18:19:35.788 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.788 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.789 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.789 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931005+0000", 2023-01-02T18:19:35.789 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.4080000000000001e-06 2023-01-02T18:19:35.789 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.789 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.790 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931013+0000", 2023-01-02T18:19:35.790 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00051094699999999999 2023-01-02T18:19:35.790 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.790 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.790 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.791 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931524+0000", 2023-01-02T18:19:35.791 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.2660000000000001e-06 2023-01-02T18:19:35.791 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.791 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.791 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.931532+0000", 2023-01-02T18:19:35.792 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0049429119999999998 2023-01-02T18:19:35.792 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.792 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.792 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.792 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936475+0000", 2023-01-02T18:19:35.793 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5248999999999996e-05 2023-01-02T18:19:35.793 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.793 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.793 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.793 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:27.936560+0000", 2023-01-02T18:19:35.794 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0055750219999999998 2023-01-02T18:19:35.794 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.794 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.794 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.794 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.795 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.795 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:28804 3.1a e143/124 3:5dc8c609:::rbd_data.12a211eeb54d.0000000000000007:head v 143'6, mlcod=0'0)", 2023-01-02T18:19:35.795 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:19:35.795 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.595205290999999, 2023-01-02T18:19:35.795 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039422229999999999, 2023-01-02T18:19:35.796 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.796 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.796 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.796 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.796 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.796 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:19:35.797 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.797 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.797 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.797 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.797 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:19:35.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967296 2023-01-02T18:19:35.798 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.798 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.798 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.798 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012543+0000", 2023-01-02T18:19:35.798 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.2570000000000001e-06 2023-01-02T18:19:35.799 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.799 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.799 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.799 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012547+0000", 2023-01-02T18:19:35.799 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.3016999999999999e-05 2023-01-02T18:19:35.800 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.800 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.800 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.800 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012560+0000", 2023-01-02T18:19:35.800 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.0260000000000001e-06 2023-01-02T18:19:35.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.801 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.801 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.801 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012564+0000", 2023-01-02T18:19:35.801 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.6282000000000003e-05 2023-01-02T18:19:35.801 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.802 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.802 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.802 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012600+0000", 2023-01-02T18:19:35.802 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.4978e-05 2023-01-02T18:19:35.802 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.803 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.803 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.012615+0000", 2023-01-02T18:19:35.803 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0038441149999999999 2023-01-02T18:19:35.803 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.803 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.804 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016459+0000", 2023-01-02T18:19:35.804 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.5772e-05 2023-01-02T18:19:35.804 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.804 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.804 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.805 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016485+0000", 2023-01-02T18:19:35.805 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0039422229999999999 2023-01-02T18:19:35.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.805 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.805 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.806 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.806 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.806 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_repop(client.4770.0:28808 3.6 e143/43 3:65cbd498:::rbd_data.12a211eeb54d.0000000000000001:head v 143'65, mlcod=142'63)", 2023-01-02T18:19:35.806 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:19:35.806 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 64.594573373000003, 2023-01-02T18:19:35.807 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033349730000000002, 2023-01-02T18:19:35.807 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.807 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.807 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.807 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.807 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.808 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:19:35.808 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.808 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.808 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.808 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.809 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013175+0000", 2023-01-02T18:19:35.809 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:35.809 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.809 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.809 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013174+0000", 2023-01-02T18:19:35.810 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1319999999999999e-06 2023-01-02T18:19:35.810 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.810 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.810 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.810 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013180+0000", 2023-01-02T18:19:35.811 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.7759999999999992e-06 2023-01-02T18:19:35.811 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.811 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.811 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.811 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013190+0000", 2023-01-02T18:19:35.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1320000000000004e-06 2023-01-02T18:19:35.812 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.812 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.812 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.812 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013194+0000", 2023-01-02T18:19:35.812 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 3.0168999999999999e-05 2023-01-02T18:19:35.813 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.813 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.813 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.813 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013224+0000", 2023-01-02T18:19:35.813 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.819e-05 2023-01-02T18:19:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.013242+0000", 2023-01-02T18:19:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.003244963 2023-01-02T18:19:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016487+0000", 2023-01-02T18:19:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2412000000000002e-05 2023-01-02T18:19:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:31.016510+0000", 2023-01-02T18:19:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0033349730000000002 2023-01-02T18:19:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4565.0:10839 3.19 3:9c633b62:::rbd_header.11d5fbafd69b:head [create,call rbd.create in=9b] snapc 0=[] ondisk+write+known_if_redirected e156)", 2023-01-02T18:19:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:18:55.372763+0000", 2023-01-02T18:19:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 40.234985064, 2023-01-02T18:19:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.33363157900000001, 2023-01-02T18:19:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4565", 2023-01-02T18:19:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3841003587", 2023-01-02T18:19:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 10839 2023-01-02T18:19:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.372763+0000", 2023-01-02T18:19:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.372763+0000", 2023-01-02T18:19:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999981 2023-01-02T18:19:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.372761+0000", 2023-01-02T18:19:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2306999999999999e-05 2023-01-02T18:19:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.372774+0000", 2023-01-02T18:19:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.2191999999999999e-05 2023-01-02T18:19:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.372786+0000", 2023-01-02T18:19:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 5.2179999999999998e-06 2023-01-02T18:19:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.372791+0000", 2023-01-02T18:19:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.3297000000000001e-05 2023-01-02T18:19:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.372854+0000", 2023-01-02T18:19:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 7.9459999999999998e-06 2023-01-02T18:19:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for peered", 2023-01-02T18:19:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.372862+0000", 2023-01-02T18:19:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.32920112699999998 2023-01-02T18:19:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.702063+0000", 2023-01-02T18:19:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00012507600000000001 2023-01-02T18:19:35.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.828 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.828 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.828 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.702188+0000", 2023-01-02T18:19:35.828 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00028677800000000001 2023-01-02T18:19:35.828 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 4", 2023-01-02T18:19:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.702475+0000", 2023-01-02T18:19:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000752877 2023-01-02T18:19:35.829 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.703228+0000", 2023-01-02T18:19:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0030643100000000002 2023-01-02T18:19:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.830 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.831 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.831 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.706292+0000", 2023-01-02T18:19:35.831 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.1078999999999998e-05 2023-01-02T18:19:35.831 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.831 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.832 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.706334+0000", 2023-01-02T18:19:35.832 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.1082999999999998e-05 2023-01-02T18:19:35.832 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.832 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.832 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.833 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:18:55.706395+0000", 2023-01-02T18:19:35.833 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.33363157900000001 2023-01-02T18:19:35.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.833 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.833 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.834 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.834 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.834 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:55844 3.8 3:17b2161b:::rbd_header.12a2d74a8e98:head [call rbd.snapshot_remove in=18b] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:35.834 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:19:05.366962+0000", 2023-01-02T18:19:35.834 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.240786268000001, 2023-01-02T18:19:35.834 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010077022999999999, 2023-01-02T18:19:35.835 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.835 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.835 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.836 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 55844 2023-01-02T18:19:35.836 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.836 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.836 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.836 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.366962+0000", 2023-01-02T18:19:35.837 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.837 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.837 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.837 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.837 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.366962+0000", 2023-01-02T18:19:35.838 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.9999976 2023-01-02T18:19:35.838 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.838 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.838 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.838 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.366960+0000", 2023-01-02T18:19:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 1.1544e-05 2023-01-02T18:19:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.839 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.366971+0000", 2023-01-02T18:19:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 2.2520000000000001e-05 2023-01-02T18:19:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "dispatched", 2023-01-02T18:19:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.366994+0000", 2023-01-02T18:19:35.840 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 9.1169999999999993e-06 2023-01-02T18:19:35.841 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.841 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.841 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "queued_for_pg", 2023-01-02T18:19:35.841 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.367003+0000", 2023-01-02T18:19:35.841 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.9933999999999998e-05 2023-01-02T18:19:35.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.842 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.842 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.842 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.367073+0000", 2023-01-02T18:19:35.842 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 8.5939999999999994e-06 2023-01-02T18:19:35.842 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.843 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.843 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op must wait for map", 2023-01-02T18:19:35.843 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.367081+0000", 2023-01-02T18:19:35.843 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.0066929310000000001 2023-01-02T18:19:35.843 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "reached_pg", 2023-01-02T18:19:35.844 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.373774+0000", 2023-01-02T18:19:35.844 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.000152719 2023-01-02T18:19:35.844 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.844 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.844 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "started", 2023-01-02T18:19:35.845 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.373927+0000", 2023-01-02T18:19:35.845 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.00053618399999999999 2023-01-02T18:19:35.845 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.845 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.845 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "waiting for subops from 7", 2023-01-02T18:19:35.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.374463+0000", 2023-01-02T18:19:35.846 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.002417747 2023-01-02T18:19:35.846 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.846 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.846 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "op_commit", 2023-01-02T18:19:35.846 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.376881+0000", 2023-01-02T18:19:35.847 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.8270999999999999e-05 2023-01-02T18:19:35.847 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.847 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.847 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "sub_op_commit_rec", 2023-01-02T18:19:35.847 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.376929+0000", 2023-01-02T18:19:35.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 6.0265e-05 2023-01-02T18:19:35.848 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.848 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.848 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "commit_sent", 2023-01-02T18:19:35.848 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.376989+0000", 2023-01-02T18:19:35.848 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.9410999999999998e-05 2023-01-02T18:19:35.849 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.849 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.849 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "done", 2023-01-02T18:19:35.849 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.377039+0000", 2023-01-02T18:19:35.849 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.010077022999999999 2023-01-02T18:19:35.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.850 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-01-02T18:19:35.850 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-01-02T18:19:35.850 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.850 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.850 INFO:teuthology.orchestra.run.smithi007.stdout: "description": "osd_op(client.4770.0:55847 3.8 3:17b2161b:::rbd_header.12a2d74a8e98:head [watch unwatch cookie 140114583903136] snapc 0=[] ondisk+write+known_if_redirected e165)", 2023-01-02T18:19:35.851 INFO:teuthology.orchestra.run.smithi007.stdout: "initiated_at": "2023-01-02T18:19:05.377994+0000", 2023-01-02T18:19:35.851 INFO:teuthology.orchestra.run.smithi007.stdout: "age": 30.229754586999999, 2023-01-02T18:19:35.851 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0.004604136, 2023-01-02T18:19:35.851 INFO:teuthology.orchestra.run.smithi007.stdout: "type_data": { 2023-01-02T18:19:35.851 INFO:teuthology.orchestra.run.smithi007.stdout: "flag_point": "commit sent; apply or cleanup", 2023-01-02T18:19:35.851 INFO:teuthology.orchestra.run.smithi007.stdout: "client_info": { 2023-01-02T18:19:35.852 INFO:teuthology.orchestra.run.smithi007.stdout: "client": "client.4770", 2023-01-02T18:19:35.852 INFO:teuthology.orchestra.run.smithi007.stdout: "client_addr": "172.21.15.7:0/3028970909", 2023-01-02T18:19:35.852 INFO:teuthology.orchestra.run.smithi007.stdout: "tid": 55847 2023-01-02T18:19:35.852 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.852 INFO:teuthology.orchestra.run.smithi007.stdout: "events": [ 2023-01-02T18:19:35.852 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.853 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "initiated", 2023-01-02T18:19:35.853 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.377994+0000", 2023-01-02T18:19:35.853 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 0 2023-01-02T18:19:35.853 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.853 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.854 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "throttled", 2023-01-02T18:19:35.854 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.377994+0000", 2023-01-02T18:19:35.854 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4294967295.999999 2023-01-02T18:19:35.854 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.854 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "header_read", 2023-01-02T18:19:35.855 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.377993+0000", 2023-01-02T18:19:35.855 INFO:teuthology.orchestra.run.smithi007.stdout: "duration": 4.6290000000000001e-06 2023-01-02T18:19:35.855 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-01-02T18:19:35.855 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-01-02T18:19:35.855 INFO:teuthology.orchestra.run.smithi007.stdout: "event": "all_read", 2023-01-02T18:19:35.856 INFO:teuthology.orchestra.run.smithi007.stdout: "time": "2023-01-02T18:19:05.377997+0000", 2023-01-02T18:19:35.856 INFO:teuthology.orchestra.run.smithi007.stdout: "du